2021-03-25T14:07:01.108 INFO:root:teuthology version: 1.1.0-6b3150e9 2021-03-25T14:07:01.109 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/rishabh-2021-03-25_13:58:08-fs-wip-rishabh-vr-set-shell-to-True-distro-basic-smithi/5997902 --description fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/multifs-auth} --verbose --name rishabh-2021-03-25_13:58:08-fs-wip-rishabh-vr-set-shell-to-True-distro-basic-smithi --owner scheduled_rishabh@teuthology -- /home/teuthworker/archive/rishabh-2021-03-25_13:58:08-fs-wip-rishabh-vr-set-shell-to-True-distro-basic-smithi/5997902/orig.config.yaml 2021-03-25T14:07:01.207 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-03-25T14:07:01.285 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2021-03-25_13:58:08-fs-wip-rishabh-vr-set-shell-to-True-distro-basic-smithi/5997902 branch: wip-rishabh-vr-set-shell-to-True description: fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/multifs-auth} email: null first_in_suite: false job_id: '5997902' kernel: client: sha1: distro kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2021-03-25_13:58:08-fs-wip-rishabh-vr-set-shell-to-True-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.3' overrides: admin_socket: branch: wip-rishabh-vr-set-shell-to-True ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 15m rados osd op timeout: 15m global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 15m rados osd op timeout: 15m mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 fs: xfs log-ignorelist: - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: df88ec382221e0c1a0a6e66961f3fc1519f95986 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: df88ec382221e0c1a0a6e66961f3fc1519f95986 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-vr-set-shell-to-True sha1: df88ec382221e0c1a0a6e66961f3fc1519f95986 owner: scheduled_rishabh@teuthology priority: 50 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 sha1: df88ec382221e0c1a0a6e66961f3fc1519f95986 sleep_before_teardown: 0 suite: fs suite_branch: wip-rishabh-vr-set-shell-to-True suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_df88ec382221e0c1a0a6e66961f3fc1519f95986/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: df88ec382221e0c1a0a6e66961f3fc1519f95986 targets: smithi110.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzFaydq/c422IztJ4TvwTcRzfx2i4qqAqqC27Hs+RHBBAYr/K4S6sVNz/ZwRjVapGr6MZbYAgQof/vGLf4rY7ose+VxAedX9VHPt4a3bVtr5H+FzVOCdf6s8fwli7u42p17QANRGWqNQQ2EvuGkBAGpB4G7h0M/hE4RZ3MVRP9puD8J34/LG3tTOiY3WT3Odg7fT/cEPrtE+Hmh8rihMopKpGqWPDiKzp3/omDKm8TP/WEqH/N6BorPJiJLtmtfvrTB6DqKU5jmQNBrdI0ExaR2JD41iYccNqzZFNiYt4GpU0n+Bz2ob6u38yvndXR2rXpJONFLRDOPCMz0mdTFIV7eWXDSsEoqRZ8dsMP3Fu/uakDR6hCnmhaenSO+QGrse1WkGY+HPjXRB1cd6Pdr/RVbKo1jOVMdl4mT2xKH9xBR3SrVuq7PFloiR9fyTvUjkyLn+reauX7sq4AgXQ4wu9jLmqHG6XZVCYcdHGFTDX2uE2/LYxFlYJ79t/IPqFjzO8= smithi174.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt2YaNg/iFysFF8AlKxk/KeiB6CQlcMuAMNtyKZb5kudCty0eIFWE+v474y5sdXNge8DyqxtrkgrW3n5cAC+/+243UthkI/gka4Q17bhrws/UdcpFxLO1LjHBW1O5/+dTRy6+uOxGIHCCEtm+uZ1Qxxu+VN5Zw7TNId+7mZteTGqHSqunl+cOxiXfHDIbT5x7uu3AICPU3mg/ahqCFafay660G4YSIaDqvgc/gTUyFOTvos+7jFYDV7bZa2U8NQeSeDxWIDPebyGaOXZbx3GSh9kTR3bEVn7JT5Z4ftYonJiSbvWu4RSuK81z2k5IUCecLZ3cYM6fAMlXoeuiITta6yIRti3YKl52mukCkcJG8qsR7mcFWxShmuza/YCWPIlfhJ15G8QZhkISFcAvMTCxAIEQgPHvLMtFHxWLgFdJ3SYnN2TeQ/29a8z5q3dk5Dnl9rQOO76gwhIY57uCkd6uKoxdkuuo2KcA/DW6tZK983qGWOMLI2oz3Feguxq/3As8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_multifs_auth teuthology_branch: master tube: smithi verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.12370 2021-03-25T14:07:01.287 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_df88ec382221e0c1a0a6e66961f3fc1519f95986/qa; will attempt to use it 2021-03-25T14:07:01.295 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_df88ec382221e0c1a0a6e66961f3fc1519f95986/qa/tasks 2021-03-25T14:07:01.295 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-03-25T14:07:01.299 INFO:teuthology.task.internal:Checking packages... 2021-03-25T14:07:01.390 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'basic' and ceph hash 'df88ec382221e0c1a0a6e66961f3fc1519f95986' 2021-03-25T14:07:01.390 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-03-25T14:07:01.390 INFO:teuthology.packaging:ref: None 2021-03-25T14:07:01.391 INFO:teuthology.packaging:tag: None 2021-03-25T14:07:01.391 INFO:teuthology.packaging:branch: wip-rishabh-vr-set-shell-to-True 2021-03-25T14:07:01.391 INFO:teuthology.packaging:sha1: df88ec382221e0c1a0a6e66961f3fc1519f95986 2021-03-25T14:07:01.391 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-rishabh-vr-set-shell-to-True 2021-03-25T14:07:01.561 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-1676.gdf88ec38 2021-03-25T14:07:01.620 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-03-25T14:07:01.676 INFO:teuthology.task.internal:no buildpackages task found 2021-03-25T14:07:01.676 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-03-25T14:07:01.747 INFO:teuthology.task.internal:Saving configuration 2021-03-25T14:07:01.774 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-03-25T14:07:01.868 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-03-25T14:07:01.889 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-03-25 14:01:57.136850', 'description': '/home/teuthworker/archive/rishabh-2021-03-25_13:58:08-fs-wip-rishabh-vr-set-shell-to-True-distro-basic-smithi/5997902', 'locked_by': 'scheduled_rishabh@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPDfC2Y044SuQPkb4cu2bcrg+ZLv9sjThGB2tFHKbV9sFkXhdgPPNyUvaB5CEfwtvaHweSUljtwVy7H/Fk6bxWk=', 'os_version': '8.3', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'rhel', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi110.front.sepia.ceph.com'} 2021-03-25T14:07:01.911 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-03-25 14:01:57.136829', 'description': '/home/teuthworker/archive/rishabh-2021-03-25_13:58:08-fs-wip-rishabh-vr-set-shell-to-True-distro-basic-smithi/5997902', 'locked_by': 'scheduled_rishabh@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCboWvuRnoOFM1LVkDYVV70fKnSPgPm+KwEjHbQJuA5gV9GFvYqfmy47PLFQwPlQnGp7CJ5ctmaAm3Mqd0rQZaw=', 'os_version': '8.3', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'rhel', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi174.front.sepia.ceph.com'} 2021-03-25T14:07:01.912 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-03-25T14:07:01.940 INFO:teuthology.task.internal:roles: ubuntu@smithi110.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2021-03-25T14:07:01.940 INFO:teuthology.task.internal:roles: ubuntu@smithi174.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2021-03-25T14:07:01.940 INFO:teuthology.run_tasks:Running task console_log... 2021-03-25T14:07:02.114 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6092adc400>, signals=[15]) 2021-03-25T14:07:02.137 INFO:teuthology.run_tasks:Running task internal.connect... 2021-03-25T14:07:02.184 INFO:teuthology.task.internal:Opening connections... 2021-03-25T14:07:02.184 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi110.front.sepia.ceph.com 2021-03-25T14:07:02.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-25T14:07:02.265 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi174.front.sepia.ceph.com 2021-03-25T14:07:02.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-25T14:07:02.336 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-03-25T14:07:02.353 DEBUG:teuthology.orchestra.run.smithi110:> uname -m 2021-03-25T14:07:02.389 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2021-03-25T14:07:02.390 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2021-03-25T14:07:02.445 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="Red Hat Enterprise Linux" 2021-03-25T14:07:02.462 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="8.3 (Ootpa)" 2021-03-25T14:07:02.462 INFO:teuthology.orchestra.run.smithi110.stdout:ID="rhel" 2021-03-25T14:07:02.462 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="fedora" 2021-03-25T14:07:02.463 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="8.3" 2021-03-25T14:07:02.463 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el8" 2021-03-25T14:07:02.463 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2021-03-25T14:07:02.463 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2021-03-25T14:07:02.463 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2021-03-25T14:07:02.463 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://www.redhat.com/" 2021-03-25T14:07:02.464 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-03-25T14:07:02.464 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:07:02.464 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-03-25T14:07:02.464 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2021-03-25T14:07:02.464 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-03-25T14:07:02.465 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2021-03-25T14:07:02.468 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2021-03-25T14:07:02.492 DEBUG:teuthology.orchestra.run.smithi174:> uname -m 2021-03-25T14:07:02.512 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64 2021-03-25T14:07:02.513 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2021-03-25T14:07:02.570 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="Red Hat Enterprise Linux" 2021-03-25T14:07:02.730 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="8.3 (Ootpa)" 2021-03-25T14:07:02.730 INFO:teuthology.orchestra.run.smithi174.stdout:ID="rhel" 2021-03-25T14:07:02.730 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="fedora" 2021-03-25T14:07:02.731 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="8.3" 2021-03-25T14:07:02.731 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el8" 2021-03-25T14:07:02.731 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2021-03-25T14:07:02.731 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2021-03-25T14:07:02.731 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2021-03-25T14:07:02.732 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://www.redhat.com/" 2021-03-25T14:07:02.732 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-03-25T14:07:02.732 INFO:teuthology.orchestra.run.smithi174.stdout: 2021-03-25T14:07:02.732 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-03-25T14:07:02.732 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2021-03-25T14:07:02.732 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-03-25T14:07:02.732 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2021-03-25T14:07:02.733 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2021-03-25T14:07:02.750 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-03-25T14:07:02.769 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-03-25T14:07:02.875 INFO:teuthology.task.internal:Checking for old test directory... 2021-03-25T14:07:02.876 DEBUG:teuthology.orchestra.run.smithi110:> test '!' -e /home/ubuntu/cephtest 2021-03-25T14:07:02.878 DEBUG:teuthology.orchestra.run.smithi174:> test '!' -e /home/ubuntu/cephtest 2021-03-25T14:07:02.893 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-03-25T14:07:03.035 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-03-25T14:07:03.035 DEBUG:teuthology.orchestra.run.smithi110:> test -z $(ls -A /var/lib/ceph) 2021-03-25T14:07:03.038 DEBUG:teuthology.orchestra.run.smithi174:> test -z $(ls -A /var/lib/ceph) 2021-03-25T14:07:03.076 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-03-25T14:07:03.138 INFO:teuthology.run_tasks:Running task kernel... 2021-03-25T14:07:03.285 DEBUG:teuthology.task.kernel:normalized config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}} 2021-03-25T14:07:03.296 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2021-03-25T14:07:03.297 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2021-03-25T14:07:03.312 INFO:teuthology.orchestra.run.smithi110.stdout:4.18.0-240.1.1.el8_3.x86_64 2021-03-25T14:07:03.313 INFO:teuthology.task.kernel:Running kernel on smithi110: 4.18.0-240.1.1.el8_3.x86_64 2021-03-25T14:07:03.313 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum install -y kernel 2021-03-25T14:07:04.794 INFO:teuthology.orchestra.run.smithi110.stdout:Updating Subscription Management repositories. 2021-03-25T14:07:04.796 INFO:teuthology.orchestra.run.smithi110.stdout:Unable to read consumer identity 2021-03-25T14:07:04.887 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:07:04.887 INFO:teuthology.orchestra.run.smithi110.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2021-03-25T14:07:04.887 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:07:06.820 INFO:teuthology.orchestra.run.smithi110.stdout:Extra Packages for Enterprise Linux 14 MB/s | 9.1 MB 00:00 2021-03-25T14:07:08.685 INFO:teuthology.orchestra.run.smithi110.stdout:lab-extras 4.1 MB/s | 24 kB 00:00 2021-03-25T14:07:09.242 INFO:teuthology.orchestra.run.smithi110.stdout:Package kernel-4.18.0-240.1.1.el8_3.x86_64 is already installed. 2021-03-25T14:07:09.242 INFO:teuthology.orchestra.run.smithi110.stdout:Package kernel-4.18.0-240.el8.x86_64 is already installed. 2021-03-25T14:07:09.358 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2021-03-25T14:07:09.364 INFO:teuthology.orchestra.run.smithi110.stdout:Nothing to do. 2021-03-25T14:07:09.364 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2021-03-25T14:07:09.461 DEBUG:teuthology.orchestra.run.smithi110:> echo no | sudo yum reinstall kernel || true 2021-03-25T14:07:09.723 INFO:teuthology.orchestra.run.smithi110.stdout:Updating Subscription Management repositories. 2021-03-25T14:07:09.723 INFO:teuthology.orchestra.run.smithi110.stdout:Unable to read consumer identity 2021-03-25T14:07:09.773 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:07:09.773 INFO:teuthology.orchestra.run.smithi110.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2021-03-25T14:07:09.773 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:07:09.940 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:00:01 ago on Thu 25 Mar 2021 02:07:08 PM UTC. 2021-03-25T14:07:10.059 INFO:teuthology.orchestra.run.smithi110.stdout:Installed package kernel-4.18.0-240.1.1.el8_3.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2021-03-25T14:07:10.059 INFO:teuthology.orchestra.run.smithi110.stdout:Installed package kernel-4.18.0-240.el8.x86_64 (from anaconda) not available. 2021-03-25T14:07:10.095 INFO:teuthology.orchestra.run.smithi110.stderr:Error: No packages marked for reinstall. 2021-03-25T14:07:10.132 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum reinstall -y kernel || true 2021-03-25T14:07:10.393 INFO:teuthology.orchestra.run.smithi110.stdout:Updating Subscription Management repositories. 2021-03-25T14:07:10.393 INFO:teuthology.orchestra.run.smithi110.stdout:Unable to read consumer identity 2021-03-25T14:07:10.442 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:07:10.442 INFO:teuthology.orchestra.run.smithi110.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2021-03-25T14:07:10.442 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:07:10.610 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:00:02 ago on Thu 25 Mar 2021 02:07:08 PM UTC. 2021-03-25T14:07:10.733 INFO:teuthology.orchestra.run.smithi110.stdout:Installed package kernel-4.18.0-240.1.1.el8_3.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2021-03-25T14:07:10.733 INFO:teuthology.orchestra.run.smithi110.stdout:Installed package kernel-4.18.0-240.el8.x86_64 (from anaconda) not available. 2021-03-25T14:07:10.759 INFO:teuthology.orchestra.run.smithi110.stderr:Error: No packages marked for reinstall. 2021-03-25T14:07:10.794 DEBUG:teuthology.orchestra.run.smithi110:> rpm -q kernel --last | head -n 1 2021-03-25T14:07:10.881 INFO:teuthology.orchestra.run.smithi110.stdout:kernel-4.18.0-240.1.1.el8_3.x86_64 Tue 10 Nov 2020 09:16:49 PM UTC 2021-03-25T14:07:10.883 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-240.1.1.el8_3.x86_64 2021-03-25T14:07:10.883 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2021-03-25T14:07:10.884 DEBUG:teuthology.orchestra.run.smithi174:> uname -r 2021-03-25T14:07:10.901 INFO:teuthology.orchestra.run.smithi174.stdout:4.18.0-240.1.1.el8_3.x86_64 2021-03-25T14:07:10.902 INFO:teuthology.task.kernel:Running kernel on smithi174: 4.18.0-240.1.1.el8_3.x86_64 2021-03-25T14:07:10.902 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum install -y kernel 2021-03-25T14:07:12.459 INFO:teuthology.orchestra.run.smithi174.stdout:Updating Subscription Management repositories. 2021-03-25T14:07:12.459 INFO:teuthology.orchestra.run.smithi174.stdout:Unable to read consumer identity 2021-03-25T14:07:12.568 INFO:teuthology.orchestra.run.smithi174.stdout: 2021-03-25T14:07:12.569 INFO:teuthology.orchestra.run.smithi174.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2021-03-25T14:07:12.569 INFO:teuthology.orchestra.run.smithi174.stdout: 2021-03-25T14:07:14.611 INFO:teuthology.orchestra.run.smithi174.stdout:Extra Packages for Enterprise Linux 14 MB/s | 9.1 MB 00:00 2021-03-25T14:07:16.447 INFO:teuthology.orchestra.run.smithi174.stdout:lab-extras 4.2 MB/s | 24 kB 00:00 2021-03-25T14:07:16.989 INFO:teuthology.orchestra.run.smithi174.stdout:Package kernel-4.18.0-240.1.1.el8_3.x86_64 is already installed. 2021-03-25T14:07:16.989 INFO:teuthology.orchestra.run.smithi174.stdout:Package kernel-4.18.0-240.el8.x86_64 is already installed. 2021-03-25T14:07:17.100 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2021-03-25T14:07:17.120 INFO:teuthology.orchestra.run.smithi174.stdout:Nothing to do. 2021-03-25T14:07:17.120 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2021-03-25T14:07:17.255 DEBUG:teuthology.orchestra.run.smithi174:> echo no | sudo yum reinstall kernel || true 2021-03-25T14:07:17.559 INFO:teuthology.orchestra.run.smithi174.stdout:Updating Subscription Management repositories. 2021-03-25T14:07:17.559 INFO:teuthology.orchestra.run.smithi174.stdout:Unable to read consumer identity 2021-03-25T14:07:17.608 INFO:teuthology.orchestra.run.smithi174.stdout: 2021-03-25T14:07:17.608 INFO:teuthology.orchestra.run.smithi174.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2021-03-25T14:07:17.608 INFO:teuthology.orchestra.run.smithi174.stdout: 2021-03-25T14:07:17.777 INFO:teuthology.orchestra.run.smithi174.stdout:Last metadata expiration check: 0:00:01 ago on Thu 25 Mar 2021 02:07:16 PM UTC. 2021-03-25T14:07:17.892 INFO:teuthology.orchestra.run.smithi174.stdout:Installed package kernel-4.18.0-240.1.1.el8_3.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2021-03-25T14:07:17.892 INFO:teuthology.orchestra.run.smithi174.stdout:Installed package kernel-4.18.0-240.el8.x86_64 (from anaconda) not available. 2021-03-25T14:07:17.929 INFO:teuthology.orchestra.run.smithi174.stderr:Error: No packages marked for reinstall. 2021-03-25T14:07:17.966 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum reinstall -y kernel || true 2021-03-25T14:07:18.234 INFO:teuthology.orchestra.run.smithi174.stdout:Updating Subscription Management repositories. 2021-03-25T14:07:18.376 INFO:teuthology.orchestra.run.smithi174.stdout:Unable to read consumer identity 2021-03-25T14:07:18.376 INFO:teuthology.orchestra.run.smithi174.stdout: 2021-03-25T14:07:18.376 INFO:teuthology.orchestra.run.smithi174.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2021-03-25T14:07:18.377 INFO:teuthology.orchestra.run.smithi174.stdout: 2021-03-25T14:07:18.447 INFO:teuthology.orchestra.run.smithi174.stdout:Last metadata expiration check: 0:00:02 ago on Thu 25 Mar 2021 02:07:16 PM UTC. 2021-03-25T14:07:18.567 INFO:teuthology.orchestra.run.smithi174.stdout:Installed package kernel-4.18.0-240.1.1.el8_3.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2021-03-25T14:07:18.568 INFO:teuthology.orchestra.run.smithi174.stdout:Installed package kernel-4.18.0-240.el8.x86_64 (from anaconda) not available. 2021-03-25T14:07:18.595 INFO:teuthology.orchestra.run.smithi174.stderr:Error: No packages marked for reinstall. 2021-03-25T14:07:18.630 DEBUG:teuthology.orchestra.run.smithi174:> rpm -q kernel --last | head -n 1 2021-03-25T14:07:18.718 INFO:teuthology.orchestra.run.smithi174.stdout:kernel-4.18.0-240.1.1.el8_3.x86_64 Tue 10 Nov 2020 09:16:49 PM UTC 2021-03-25T14:07:18.719 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-240.1.1.el8_3.x86_64 2021-03-25T14:07:18.719 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2021-03-25T14:07:18.719 INFO:teuthology.run_tasks:Running task internal.base... 2021-03-25T14:07:18.727 INFO:teuthology.task.internal:Creating test directory... 2021-03-25T14:07:18.727 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-03-25T14:07:18.731 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-03-25T14:07:18.746 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-03-25T14:07:18.817 INFO:teuthology.run_tasks:Running task internal.archive... 2021-03-25T14:07:18.884 INFO:teuthology.task.internal:Creating archive directory... 2021-03-25T14:07:18.885 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-03-25T14:07:18.887 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-03-25T14:07:19.065 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-03-25T14:07:19.075 INFO:teuthology.task.internal:Enabling coredump saving... 2021-03-25T14:07:19.076 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-03-25T14:07:19.078 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-03-25T14:07:19.107 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-25T14:07:19.111 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-25T14:07:19.126 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-25T14:07:19.129 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-25T14:07:19.131 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-03-25T14:07:19.143 INFO:teuthology.task.internal:Configuring sudo... 2021-03-25T14:07:19.143 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-03-25T14:07:19.174 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-03-25T14:07:19.199 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-03-25T14:07:19.237 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-03-25T14:07:19.238 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-03-25T14:07:19.240 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-03-25T14:07:19.255 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-03-25T14:07:19.333 DEBUG:teuthology.orchestra.run.smithi110:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2021-03-25T14:07:19.387 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-03-25T14:07:19.468 DEBUG:teuthology.orchestra.run.smithi110:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2021-03-25T14:07:19.510 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2021-03-25T14:07:19.510 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-03-25T14:07:19.573 DEBUG:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-03-25T14:07:19.610 DEBUG:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2021-03-25T14:07:19.663 DEBUG:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-03-25T14:07:19.741 DEBUG:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2021-03-25T14:07:19.784 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2021-03-25T14:07:19.784 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-03-25T14:07:19.847 DEBUG:teuthology.orchestra.run.smithi110:> sudo service rsyslog restart 2021-03-25T14:07:19.849 DEBUG:teuthology.orchestra.run.smithi174:> sudo service rsyslog restart 2021-03-25T14:07:19.914 INFO:teuthology.orchestra.run.smithi110.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2021-03-25T14:07:19.956 INFO:teuthology.orchestra.run.smithi174.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2021-03-25T14:07:20.284 INFO:teuthology.run_tasks:Running task internal.timer... 2021-03-25T14:07:20.293 INFO:teuthology.task.internal:Starting timer... 2021-03-25T14:07:20.293 INFO:teuthology.run_tasks:Running task pcp... 2021-03-25T14:07:20.356 INFO:teuthology.run_tasks:Running task selinux... 2021-03-25T14:07:20.471 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2021-03-25T14:07:20.471 DEBUG:teuthology.orchestra.run.smithi110:> sudo service auditd rotate 2021-03-25T14:07:20.521 INFO:teuthology.orchestra.run.smithi110.stdout:Rotating logs: [ OK ] 2021-03-25T14:07:20.560 DEBUG:teuthology.orchestra.run.smithi174:> sudo service auditd rotate 2021-03-25T14:07:20.607 INFO:teuthology.orchestra.run.smithi174.stdout:Rotating logs: [ OK ] 2021-03-25T14:07:20.609 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-03-25T14:07:20.609 DEBUG:teuthology.orchestra.run.smithi110:> /usr/sbin/getenforce 2021-03-25T14:07:20.629 INFO:teuthology.orchestra.run.smithi110.stdout:Permissive 2021-03-25T14:07:20.630 DEBUG:teuthology.orchestra.run.smithi174:> /usr/sbin/getenforce 2021-03-25T14:07:20.659 INFO:teuthology.orchestra.run.smithi174.stdout:Permissive 2021-03-25T14:07:20.659 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi110.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi174.front.sepia.ceph.com': 'permissive'} 2021-03-25T14:07:20.659 DEBUG:teuthology.orchestra.run.smithi110:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|scontext=system_u:system_r:logrotate_t:s0\)' 2021-03-25T14:07:20.694 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-03-25T14:07:20.695 DEBUG:teuthology.orchestra.run.smithi174:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|scontext=system_u:system_r:logrotate_t:s0\)' 2021-03-25T14:07:20.723 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-03-25T14:07:20.724 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-03-25T14:07:20.724 DEBUG:teuthology.orchestra.run.smithi110:> sudo /usr/sbin/setenforce permissive 2021-03-25T14:07:20.760 DEBUG:teuthology.orchestra.run.smithi174:> sudo /usr/sbin/setenforce permissive 2021-03-25T14:07:20.794 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-03-25T14:07:20.809 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated or references a specific commit; assuming it is current 2021-03-25T14:07:20.809 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-03-25T14:07:20.991 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2021-03-25T14:07:20.996 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi110.front.sepia.ceph.com,smithi174.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-03-25T14:07:22.073 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-03-25T14:07:24.674 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-03-25T14:07:27.574 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-03-25T14:07:27.646 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:07:27 +0000 (0:00:00.110) 0:00:00.110 ******** 2021-03-25T14:07:27.688 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:07:27 +0000 (0:00:00.020) 0:00:00.131 ******** 2021-03-25T14:07:29.237 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi174.front.sepia.ceph.com] 2021-03-25T14:07:29.314 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:07:29 +0000 (0:00:01.647) 0:00:01.778 ******** 2021-03-25T14:07:29.718 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-03-25T14:07:29.744 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:07:29 +0000 (0:00:00.429) 0:00:02.207 ******** 2021-03-25T14:07:30.219 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi110.front.sepia.ceph.com] 2021-03-25T14:07:30.271 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:07:30 +0000 (0:00:00.527) 0:00:02.735 ******** 2021-03-25T14:07:30.394 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-03-25T14:07:30.396 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-03-25T14:07:30.431 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:07:30 +0000 (0:00:00.158) 0:00:02.893 ******** 2021-03-25T14:07:30.469 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-03-25T14:07:30.471 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-03-25T14:07:30.492 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:07:30 +0000 (0:00:00.063) 0:00:02.956 ******** 2021-03-25T14:07:30.512 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-03-25T14:07:30.513 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:07:30.535 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:07:30 +0000 (0:00:00.042) 0:00:02.998 ******** 2021-03-25T14:07:30.786 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-03-25T14:07:30.788 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-03-25T14:07:30.815 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:07:30 +0000 (0:00:00.280) 0:00:03.279 ******** 2021-03-25T14:07:30.889 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-03-25T14:07:30.891 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:07:30.913 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:07:30 +0000 (0:00:00.097) 0:00:03.377 ******** 2021-03-25T14:07:30.920 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2021-03-25T14:07:30.921 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-25T14:07:30.959 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:07:30 +0000 (0:00:00.045) 0:00:03.423 ******** 2021-03-25T14:07:31.095 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-25T14:07:31.122 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:07:31 +0000 (0:00:00.158) 0:00:03.581 ******** 2021-03-25T14:07:32.031 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-03-25T14:07:32.033 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1616681251.1740563-2441-225775679769009/source", "state": "file", "uid": 0} 2021-03-25T14:07:32.054 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:07:32 +0000 (0:00:00.937) 0:00:04.518 ******** 2021-03-25T14:07:32.067 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1616681251.0166292-2401-168146605160147/source", "state": "file", "uid": 0} 2021-03-25T14:07:32.095 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:07:32 +0000 (0:00:00.040) 0:00:04.559 ******** 2021-03-25T14:07:32.815 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-03-25T14:07:32.817 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-03-25T14:07:32.818 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi110.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail 2021-03-25T14:07:32.820 INFO:teuthology.task.ansible.out:.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@ 2021-03-25T14:07:32.821 INFO:teuthology.task.ansible.out:aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-03-25T14:07:32.933 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2021-03-25T14:07:32.936 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-03-25T14:07:33.146 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:07:33 +0000 (0:00:01.051) 0:00:05.610 ******** 2021-03-25T14:07:33.180 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:07:33 +0000 (0:00:00.033) 0:00:05.644 ******** 2021-03-25T14:07:34.845 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi174.front.sepia.ceph.com] 2021-03-25T14:07:34.918 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2021-03-25T14:07:34.920 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:07:34 +0000 (0:00:01.738) 0:00:07.382 ******** 2021-03-25T14:07:35.820 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] 2021-03-25T14:07:35.886 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:07:35 +0000 (0:00:00.967) 0:00:08.350 ******** 2021-03-25T14:07:36.022 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-03-25T14:07:36.024 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.240679", "end": "2021-03-25 14:07:35.988369", "rc": 0, "start": "2021-03-25 14:07:35.747690", "stderr": "", "stderr_lines": [], "stdout": "c31004c4720a55ac12a95d66c32e64f592877604", "stdout_lines": ["c31004c4720a55ac12a95d66c32e64f592877604"]} 2021-03-25T14:07:36.047 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:07:36 +0000 (0:00:00.160) 0:00:08.510 ******** 2021-03-25T14:07:36.305 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-03-25T14:07:36.307 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.020056", "end": "2021-03-25 14:07:36.271762", "failed_when_result": false, "rc": 0, "start": "2021-03-25 14:07:36.251706", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2021-03-25T14:07:36.340 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:07:36 +0000 (0:00:00.293) 0:00:08.804 ******** 2021-03-25T14:07:36.499 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-03-25T14:07:36.500 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:07:36.523 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:07:36 +0000 (0:00:00.183) 0:00:08.987 ******** 2021-03-25T14:07:36.644 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-03-25T14:07:36.646 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:07:36.668 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:07:36 +0000 (0:00:00.145) 0:00:09.132 ******** 2021-03-25T14:07:36.677 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-03-25T14:07:36.678 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.241759", "end": "2021-03-25 14:07:36.620398", "rc": 0, "start": "2021-03-25 14:07:36.378639", "stderr": "", "stderr_lines": [], "stdout": "c31004c4720a55ac12a95d66c32e64f592877604", "stdout_lines": ["c31004c4720a55ac12a95d66c32e64f592877604"]} 2021-03-25T14:07:36.709 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:07:36 +0000 (0:00:00.040) 0:00:09.173 ******** 2021-03-25T14:07:36.782 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-03-25T14:07:36.784 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:07:36.815 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:07:36 +0000 (0:00:00.105) 0:00:09.278 ******** 2021-03-25T14:07:36.932 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [smithi110.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.013102", "end": "2021-03-25 14:07:36.903529", "failed_when_result": false, "rc": 0, "start": "2021-03-25 14:07:36.890427", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} TASK [Filter the managed_users list] ******************************************* skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:07:36.969 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:07:36 +0000 (0:00:00.153) 0:00:09.432 ******** 2021-03-25T14:07:37.012 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:07:37 +0000 (0:00:00.043) 0:00:09.476 ******** 2021-03-25T14:07:37.066 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:07:37.082 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:07:37 +0000 (0:00:00.069) 0:00:09.546 ******** 2021-03-25T14:07:37.100 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-03-25T14:07:37.102 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:07:37.125 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:07:37 +0000 (0:00:00.042) 0:00:09.589 ******** 2021-03-25T14:07:37.194 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-03-25T14:07:37.195 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:07:37.221 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:07:37 +0000 (0:00:00.096) 0:00:09.685 ******** 2021-03-25T14:07:37.326 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-03-25T14:07:37.328 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:07:37.350 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:07:37 +0000 (0:00:00.128) 0:00:09.814 ******** 2021-03-25T14:07:37.402 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-03-25T14:07:37.402 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-25T14:07:37.427 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:07:37 +0000 (0:00:00.077) 0:00:09.891 ******** 2021-03-25T14:07:37.444 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* 2021-03-25T14:07:37.446 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:07:37.492 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:07:37 +0000 (0:00:00.064) 0:00:09.956 ******** 2021-03-25T14:07:37.590 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-03-25T14:07:37.591 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:07:37.614 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:07:37 +0000 (0:00:00.121) 0:00:10.078 ******** 2021-03-25T14:07:37.780 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-03-25T14:07:37.781 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-03-25T14:07:37.880 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-03-25T14:07:37.899 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-25T14:07:37.907 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:07:37 +0000 (0:00:00.293) 0:00:10.371 ******** 2021-03-25T14:07:38.010 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-03-25T14:07:38.012 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-03-25T14:07:38.212 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-03-25T14:07:38.245 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-03-25T14:07:38.414 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-03-25T14:07:38.448 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-03-25T14:07:38.630 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-03-25T14:07:38.649 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-03-25T14:07:38.829 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-03-25T14:07:38.840 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-03-25T14:07:39.026 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-03-25T14:07:39.027 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-03-25T14:07:39.226 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-03-25T14:07:39.228 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-03-25T14:07:39.417 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-03-25T14:07:39.429 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-03-25T14:07:39.621 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-03-25T14:07:39.622 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-03-25T14:07:39.816 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-03-25T14:07:39.818 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-03-25T14:07:40.010 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-03-25T14:07:40.014 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-03-25T14:07:40.230 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-03-25T14:07:40.244 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-03-25T14:07:40.458 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-03-25T14:07:40.460 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-03-25T14:07:40.653 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-03-25T14:07:40.665 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-03-25T14:07:40.667 INFO:teuthology.task.ansible.out: 2021-03-25T14:07:40.848 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-03-25T14:07:40.881 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-03-25T14:07:41.065 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-03-25T14:07:41.100 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-03-25T14:07:41.285 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-03-25T14:07:41.310 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-03-25T14:07:41.491 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-03-25T14:07:41.514 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-03-25T14:07:41.684 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-03-25T14:07:41.716 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-03-25T14:07:41.886 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-03-25T14:07:41.930 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-03-25T14:07:42.079 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-03-25T14:07:42.122 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-03-25T14:07:42.271 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-03-25T14:07:42.314 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-03-25T14:07:42.473 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-03-25T14:07:42.517 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-03-25T14:07:42.667 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-03-25T14:07:42.711 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-03-25T14:07:42.863 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-03-25T14:07:42.898 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-03-25T14:07:43.061 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-03-25T14:07:43.094 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-03-25T14:07:43.265 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-03-25T14:07:43.298 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-03-25T14:07:43.473 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-03-25T14:07:43.495 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-03-25T14:07:43.671 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-03-25T14:07:43.718 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-03-25T14:07:43.889 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-03-25T14:07:43.935 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-03-25T14:07:44.086 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-03-25T14:07:44.133 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-03-25T14:07:44.318 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-03-25T14:07:44.341 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-03-25T14:07:44.534 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-03-25T14:07:44.557 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-03-25T14:07:44.739 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-03-25T14:07:44.762 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-03-25T14:07:44.933 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-03-25T14:07:44.988 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-03-25T14:07:45.133 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-03-25T14:07:45.197 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-03-25T14:07:45.347 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-03-25T14:07:45.403 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-03-25T14:07:45.556 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-03-25T14:07:45.601 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-03-25T14:07:45.770 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-03-25T14:07:45.802 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-03-25T14:07:45.962 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-03-25T14:07:46.005 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-03-25T14:07:46.165 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-03-25T14:07:46.198 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-03-25T14:07:46.358 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-03-25T14:07:46.401 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-03-25T14:07:46.552 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-03-25T14:07:46.597 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-03-25T14:07:46.758 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-03-25T14:07:46.792 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-03-25T14:07:46.964 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-03-25T14:07:47.008 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-03-25T14:07:47.158 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-03-25T14:07:47.213 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-03-25T14:07:47.362 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-03-25T14:07:47.406 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-03-25T14:07:47.557 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-03-25T14:07:47.622 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-03-25T14:07:47.751 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-03-25T14:07:47.827 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-03-25T14:07:47.955 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-03-25T14:07:48.031 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-03-25T14:07:48.159 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-03-25T14:07:48.234 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-03-25T14:07:48.354 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-03-25T14:07:48.433 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-03-25T14:07:48.551 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-03-25T14:07:48.627 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-03-25T14:07:48.628 INFO:teuthology.task.ansible.out: 2021-03-25T14:07:48.755 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-03-25T14:07:48.819 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-03-25T14:07:48.948 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-03-25T14:07:49.023 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-03-25T14:07:49.139 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-03-25T14:07:49.213 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-03-25T14:07:49.329 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-03-25T14:07:49.403 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-03-25T14:07:49.532 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-03-25T14:07:49.607 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-03-25T14:07:49.724 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-03-25T14:07:49.810 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-03-25T14:07:49.918 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-03-25T14:07:50.003 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-03-25T14:07:50.114 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-03-25T14:07:50.232 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-03-25T14:07:50.325 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-03-25T14:07:50.432 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-03-25T14:07:50.518 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-03-25T14:07:50.625 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-03-25T14:07:50.721 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-03-25T14:07:50.828 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-03-25T14:07:50.913 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-03-25T14:07:51.023 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-03-25T14:07:51.107 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-03-25T14:07:51.224 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-03-25T14:07:51.308 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-03-25T14:07:51.415 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-03-25T14:07:51.499 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-03-25T14:07:51.617 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-03-25T14:07:51.701 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-03-25T14:07:51.807 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-03-25T14:07:51.895 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-03-25T14:07:52.001 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-03-25T14:07:52.097 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-03-25T14:07:52.204 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-03-25T14:07:52.290 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-03-25T14:07:52.398 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-03-25T14:07:52.494 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-03-25T14:07:52.589 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-03-25T14:07:52.683 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-03-25T14:07:52.789 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-03-25T14:07:52.885 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-03-25T14:07:52.980 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-03-25T14:07:53.076 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-03-25T14:07:53.183 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-03-25T14:07:53.184 INFO:teuthology.task.ansible.out: 2021-03-25T14:07:53.268 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-03-25T14:07:53.374 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-03-25T14:07:53.459 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-03-25T14:07:53.577 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-03-25T14:07:53.663 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-03-25T14:07:53.768 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-03-25T14:07:53.854 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-03-25T14:07:53.960 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-03-25T14:07:54.055 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-03-25T14:07:54.161 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-03-25T14:07:54.246 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-03-25T14:07:54.353 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-03-25T14:07:54.455 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-03-25T14:07:54.552 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-03-25T14:07:54.647 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-03-25T14:07:54.765 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-03-25T14:07:54.838 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-03-25T14:07:54.947 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-03-25T14:07:55.040 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-03-25T14:07:55.147 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-03-25T14:07:55.234 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-03-25T14:07:55.361 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-03-25T14:07:55.438 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-03-25T14:07:55.554 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-03-25T14:07:55.639 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-03-25T14:07:55.747 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-03-25T14:07:55.825 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-03-25T14:07:55.953 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-03-25T14:07:56.048 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-03-25T14:07:56.155 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-03-25T14:07:56.240 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-03-25T14:07:56.357 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-03-25T14:07:56.444 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-03-25T14:07:56.552 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-03-25T14:07:56.637 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-03-25T14:07:56.764 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-03-25T14:07:56.833 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-03-25T14:07:56.961 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-03-25T14:07:57.035 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-03-25T14:07:57.165 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-03-25T14:07:57.230 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-03-25T14:07:57.359 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-03-25T14:07:57.586 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-03-25T14:07:57.597 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-03-25T14:07:57.781 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-03-25T14:07:57.805 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-03-25T14:07:57.999 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-03-25T14:07:58.012 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-03-25T14:07:58.205 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-03-25T14:07:58.218 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-03-25T14:07:58.413 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-03-25T14:07:58.425 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-03-25T14:07:58.638 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-03-25T14:07:58.639 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-03-25T14:07:58.833 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-03-25T14:07:58.851 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-03-25T14:07:59.032 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-03-25T14:07:59.096 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-03-25T14:07:59.249 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-03-25T14:07:59.313 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-03-25T14:07:59.452 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-03-25T14:07:59.520 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-03-25T14:07:59.651 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-03-25T14:07:59.726 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-03-25T14:07:59.858 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-03-25T14:07:59.922 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-03-25T14:08:00.074 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-03-25T14:08:00.119 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-03-25T14:08:00.314 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-03-25T14:08:00.411 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-03-25T14:08:00.506 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-03-25T14:08:00.602 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-03-25T14:08:00.709 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-03-25T14:08:00.796 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-03-25T14:08:00.902 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-03-25T14:08:00.997 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-03-25T14:08:01.103 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-03-25T14:08:01.200 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-03-25T14:08:01.307 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-03-25T14:08:01.394 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-03-25T14:08:01.506 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-03-25T14:08:01.594 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-03-25T14:08:01.713 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-03-25T14:08:01.788 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-03-25T14:08:01.906 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-03-25T14:08:01.981 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-03-25T14:08:02.099 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-03-25T14:08:02.175 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-03-25T14:08:02.312 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-03-25T14:08:02.366 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-03-25T14:08:02.504 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-03-25T14:08:02.568 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-03-25T14:08:02.698 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-03-25T14:08:02.774 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-03-25T14:08:02.903 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-03-25T14:08:02.983 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-03-25T14:08:03.105 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-03-25T14:08:03.201 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-03-25T14:08:03.307 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-03-25T14:08:03.403 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-03-25T14:08:03.508 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-03-25T14:08:03.603 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-03-25T14:08:03.709 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-03-25T14:08:03.793 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-03-25T14:08:03.900 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-03-25T14:08:04.007 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-03-25T14:08:04.103 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-03-25T14:08:04.189 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-03-25T14:08:04.295 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-03-25T14:08:04.380 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-03-25T14:08:04.487 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-03-25T14:08:04.583 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-03-25T14:08:04.688 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-03-25T14:08:04.783 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-03-25T14:08:04.882 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-03-25T14:08:05.000 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-03-25T14:08:05.076 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-03-25T14:08:05.282 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-03-25T14:08:06.788 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10102, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-03-25T14:08:06.863 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10102, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-03-25T14:08:08.429 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "name": "adking", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-03-25T14:08:08.477 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "name": "adking", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-03-25T14:08:09.851 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "name": "amathuri", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-03-25T14:08:10.104 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "name": "amathuri", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-03-25T14:08:11.330 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2021-03-25T14:08:11.450 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:08:11 +0000 (0:00:33.542) 0:00:43.914 ******** 2021-03-25T14:08:11.543 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-03-25T14:08:11.565 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:08:11 +0000 (0:00:00.115) 0:00:44.029 ******** 2021-03-25T14:08:11.593 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-03-25T14:08:11.594 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2021-03-25T14:08:11.876 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-03-25T14:08:11.878 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-03-25T14:08:11.880 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-03-25T14:08:11.881 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop K 2021-03-25T14:08:11.882 INFO:teuthology.task.ansible.out:D0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9 2021-03-25T14:08:11.884 INFO:teuthology.task.ansible.out:df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 2021-03-25T14:08:11.885 INFO:teuthology.task.ansible.out: 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc9795 2021-03-25T14:08:11.886 INFO:teuthology.task.ansible.out:3cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e 2021-03-25T14:08:11.888 INFO:teuthology.task.ansible.out:7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSC 2021-03-25T14:08:11.888 INFO:teuthology.task.ansible.out:INdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef14 2021-03-25T14:08:11.889 INFO:teuthology.task.ansible.out:80c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d301 2021-03-25T14:08:11.891 INFO:teuthology.task.ansible.out:7b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214 2021-03-25T14:08:11.892 INFO:teuthology.task.ansible.out:bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelope 2021-03-25T14:08:11.893 INFO:teuthology.task.ansible.out:z@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed 2021-03-25T14:08:11.895 INFO:teuthology.task.ansible.out:19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}]}, "changed": false} 2021-03-25T14:08:11.915 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:08:11 +0000 (0:00:00.350) 0:00:44.379 ******** 2021-03-25T14:08:11.938 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:08:11 +0000 (0:00:00.022) 0:00:44.402 ******** 2021-03-25T14:08:12.020 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-03-25T14:08:12.042 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:08:12 +0000 (0:00:00.104) 0:00:44.506 ******** 2021-03-25T14:08:12.158 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-03-25T14:08:12.159 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-03-25T14:08:12.161 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-03-25T14:08:12.162 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop K 2021-03-25T14:08:12.163 INFO:teuthology.task.ansible.out:D0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9 2021-03-25T14:08:12.165 INFO:teuthology.task.ansible.out:df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 2021-03-25T14:08:12.166 INFO:teuthology.task.ansible.out: 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc9795 2021-03-25T14:08:12.167 INFO:teuthology.task.ansible.out:3cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e 2021-03-25T14:08:12.170 INFO:teuthology.task.ansible.out:7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef14 2021-03-25T14:08:12.171 INFO:teuthology.task.ansible.out:80c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d301 2021-03-25T14:08:12.172 INFO:teuthology.task.ansible.out:7b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214 2021-03-25T14:08:12.174 INFO:teuthology.task.ansible.out:bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelope 2021-03-25T14:08:12.175 INFO:teuthology.task.ansible.out:z@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed 2021-03-25T14:08:12.176 INFO:teuthology.task.ansible.out:19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174f 2021-03-25T14:08:12.176 INFO:teuthology.task.ansible.out:e16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}]}, "changed": false} 2021-03-25T14:08:12.208 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:08:12 +0000 (0:00:00.165) 0:00:44.672 ******** 2021-03-25T14:08:12.956 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-03-25T14:08:12.957 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"after": "c31004c4720a55ac12a95d66c32e64f592877604", "attempts": 1, "before": "c31004c4720a55ac12a95d66c32e64f592877604", "changed": false, "remote_url_changed": false} 2021-03-25T14:08:12.983 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:08:12 +0000 (0:00:00.775) 0:00:45.447 ******** 2021-03-25T14:08:12.995 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"after": "c31004c4720a55ac12a95d66c32e64f592877604", "attempts": 1, "before": "c31004c4720a55ac12a95d66c32e64f592877604", "changed": false, "remote_url_changed": false} 2021-03-25T14:08:13.021 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:08:13 +0000 (0:00:00.037) 0:00:45.485 ******** 2021-03-25T14:08:13.369 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-25T14:08:13.371 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-03-25T14:08:13.413 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-03-25T14:08:13.624 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-03-25T14:08:13.646 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-03-25T14:08:13.870 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-03-25T14:08:13.881 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-03-25T14:08:14.132 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-03-25T14:08:14.134 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-03-25T14:08:14.142 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-03-25T14:08:14.144 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-03-25T14:08:14.373 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-03-25T14:08:14.374 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-03-25T14:08:14.618 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-03-25T14:08:14.620 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-03-25T14:08:14.630 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-03-25T14:08:14.631 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-03-25T14:08:14.860 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-03-25T14:08:14.861 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-03-25T14:08:15.094 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-03-25T14:08:15.127 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-03-25T14:08:15.338 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-03-25T14:08:15.349 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:15.360 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-03-25T14:08:15.371 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:15.583 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-03-25T14:08:15.584 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-03-25T14:08:15.605 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-03-25T14:08:15.606 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-03-25T14:08:15.816 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-03-25T14:08:15.818 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-03-25T14:08:15.828 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:15.828 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-03-25T14:08:15.829 INFO:teuthology.task.ansible.out:son", "validate_certs": true} skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:15.840 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:15.841 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:16.072 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-03-25T14:08:16.083 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-03-25T14:08:16.308 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-03-25T14:08:16.309 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-03-25T14:08:16.329 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-03-25T14:08:16.331 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-03-25T14:08:16.530 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-03-25T14:08:16.552 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-03-25T14:08:16.772 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": 2021-03-25T14:08:16.774 INFO:teuthology.task.ansible.out:null, "state": "present", "user": "davidz", "validate_certs": true} 2021-03-25T14:08:16.784 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": 2021-03-25T14:08:16.785 INFO:teuthology.task.ansible.out:null, "state": "present", "user": "davidz", "validate_certs": true} 2021-03-25T14:08:16.995 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-03-25T14:08:17.017 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-03-25T14:08:17.230 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-03-25T14:08:17.251 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-03-25T14:08:17.453 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-03-25T14:08:17.486 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-03-25T14:08:17.688 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-03-25T14:08:17.690 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-03-25T14:08:17.731 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-03-25T14:08:17.732 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-03-25T14:08:17.922 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-03-25T14:08:17.923 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-03-25T14:08:17.965 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-03-25T14:08:17.967 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-03-25T14:08:18.144 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-03-25T14:08:18.208 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-03-25T14:08:18.378 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-03-25T14:08:18.444 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-03-25T14:08:18.634 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46 2021-03-25T14:08:18.635 INFO:teuthology.task.ansible.out:TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-03-25T14:08:18.676 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46 2021-03-25T14:08:18.677 INFO:teuthology.task.ansible.out:TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-03-25T14:08:18.857 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-03-25T14:08:18.900 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-03-25T14:08:19.083 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-03-25T14:08:19.137 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-03-25T14:08:19.317 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-03-25T14:08:19.382 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-03-25T14:08:19.562 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-03-25T14:08:19.626 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-03-25T14:08:19.806 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-03-25T14:08:19.859 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-03-25T14:08:20.028 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-03-25T14:08:20.029 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-03-25T14:08:20.092 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-03-25T14:08:20.094 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-03-25T14:08:20.260 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-03-25T14:08:20.324 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-03-25T14:08:20.493 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-03-25T14:08:20.547 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-03-25T14:08:20.738 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-03-25T14:08:20.791 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-03-25T14:08:20.981 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-03-25T14:08:21.024 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-03-25T14:08:21.212 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2021-03-25T14:08:21.247 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2021-03-25T14:08:21.441 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-03-25T14:08:21.474 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-03-25T14:08:21.663 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-03-25T14:08:21.716 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-03-25T14:08:21.896 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-03-25T14:08:21.951 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-03-25T14:08:22.133 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-03-25T14:08:22.197 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-03-25T14:08:22.366 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-03-25T14:08:22.367 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-03-25T14:08:22.430 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-03-25T14:08:22.432 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-03-25T14:08:22.599 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-03-25T14:08:22.600 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-03-25T14:08:22.664 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-03-25T14:08:22.666 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-03-25T14:08:22.834 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-03-25T14:08:22.888 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-03-25T14:08:23.068 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-03-25T14:08:23.121 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-03-25T14:08:23.312 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-03-25T14:08:23.355 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-03-25T14:08:23.537 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nu 2021-03-25T14:08:23.538 INFO:teuthology.task.ansible.out:ll, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-03-25T14:08:23.590 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nu 2021-03-25T14:08:23.591 INFO:teuthology.task.ansible.out:ll, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-03-25T14:08:23.770 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-03-25T14:08:23.772 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-03-25T14:08:23.773 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-03-25T14:08:23.815 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-03-25T14:08:23.816 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-03-25T14:08:23.817 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-03-25T14:08:24.008 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-03-25T14:08:24.051 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-03-25T14:08:24.252 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-03-25T14:08:24.287 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-03-25T14:08:24.479 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-03-25T14:08:24.511 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-03-25T14:08:24.724 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-03-25T14:08:24.746 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-03-25T14:08:24.958 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-03-25T14:08:24.980 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-03-25T14:08:25.191 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-03-25T14:08:25.193 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-03-25T14:08:25.203 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-03-25T14:08:25.204 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-03-25T14:08:25.421 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-03-25T14:08:25.432 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-03-25T14:08:25.655 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-03-25T14:08:25.666 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-03-25T14:08:25.899 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-03-25T14:08:25.900 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": 2021-03-25T14:08:25.901 INFO:teuthology.task.ansible.out: null, "state": "present", "user": "gabrioux", "validate_certs": true} 2021-03-25T14:08:26.122 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-03-25T14:08:26.134 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-03-25T14:08:26.357 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-03-25T14:08:26.368 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-03-25T14:08:26.592 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-03-25T14:08:26.593 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylM 2021-03-25T14:08:26.595 INFO:teuthology.task.ansible.out:R5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerH 2021-03-25T14:08:26.596 INFO:teuthology.task.ansible.out:COTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-03-25T14:08:26.825 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-03-25T14:08:26.826 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-03-25T14:08:27.082 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-03-25T14:08:27.083 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-03-25T14:08:27.329 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-03-25T14:08:27.330 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-03-25T14:08:27.552 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-03-25T14:08:27.564 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-03-25T14:08:27.787 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-03-25T14:08:27.799 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-03-25T14:08:28.022 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-03-25T14:08:28.023 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-03-25T14:08:28.268 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-03-25T14:08:28.269 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-03-25T14:08:28.497 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", 2021-03-25T14:08:28.498 INFO:teuthology.task.ansible.out: "validate_certs": true} 2021-03-25T14:08:28.732 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-03-25T14:08:28.734 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-03-25T14:08:28.986 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-03-25T14:08:29.001 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-03-25T14:08:29.240 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-03-25T14:08:29.251 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-03-25T14:08:29.474 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-03-25T14:08:29.486 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-03-25T14:08:29.708 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-03-25T14:08:29.710 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-03-25T14:08:29.943 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ 2021-03-25T14:08:29.945 INFO:teuthology.task.ansible.out:7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-03-25T14:08:30.166 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-03-25T14:08:30.177 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-03-25T14:08:30.400 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-03-25T14:08:30.412 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-03-25T14:08:30.632 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-03-25T14:08:30.644 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-03-25T14:08:30.865 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-03-25T14:08:30.887 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-03-25T14:08:31.101 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-03-25T14:08:31.113 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-03-25T14:08:31.327 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-03-25T14:08:31.342 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-03-25T14:08:31.562 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-03-25T14:08:31.564 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-03-25T14:08:31.574 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-03-25T14:08:31.575 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-03-25T14:08:31.784 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-03-25T14:08:31.806 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-03-25T14:08:32.018 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-03-25T14:08:32.057 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-03-25T14:08:32.269 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-03-25T14:08:32.281 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-03-25T14:08:32.528 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-03-25T14:08:32.540 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-03-25T14:08:32.765 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2021-03-25T14:08:32.766 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-03-25T14:08:32.776 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2021-03-25T14:08:32.778 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-03-25T14:08:32.991 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-03-25T14:08:32.993 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-03-25T14:08:33.003 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-03-25T14:08:33.004 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-03-25T14:08:33.235 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-03-25T14:08:33.235 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-03-25T14:08:33.468 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-03-25T14:08:33.470 INFO:teuthology.task.ansible.out: 2021-03-25T14:08:33.480 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-03-25T14:08:33.705 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-03-25T14:08:33.706 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-03-25T14:08:33.949 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-03-25T14:08:34.175 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-03-25T14:08:34.187 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-03-25T14:08:34.424 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-03-25T14:08:34.435 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-03-25T14:08:34.654 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-03-25T14:08:34.666 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-03-25T14:08:34.887 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-03-25T14:08:34.888 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-03-25T14:08:34.920 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-03-25T14:08:34.921 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-03-25T14:08:35.121 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-03-25T14:08:35.143 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-03-25T14:08:35.353 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-03-25T14:08:35.375 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-03-25T14:08:35.597 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-03-25T14:08:35.609 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-03-25T14:08:35.832 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-03-25T14:08:35.832 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-03-25T14:08:36.057 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-03-25T14:08:36.059 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-03-25T14:08:36.303 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-03-25T14:08:36.305 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-03-25T14:08:36.527 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", 2021-03-25T14:08:36.529 INFO:teuthology.task.ansible.out:"manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-03-25T14:08:36.539 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", 2021-03-25T14:08:36.541 INFO:teuthology.task.ansible.out:"manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-03-25T14:08:36.761 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-03-25T14:08:36.772 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-03-25T14:08:36.986 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-03-25T14:08:36.998 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-03-25T14:08:37.220 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-03-25T14:08:37.242 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-03-25T14:08:37.454 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-03-25T14:08:37.465 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-03-25T14:08:37.698 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-03-25T14:08:37.699 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-03-25T14:08:37.930 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-03-25T14:08:37.932 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-03-25T14:08:38.152 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-03-25T14:08:38.163 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-03-25T14:08:38.386 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-03-25T14:08:38.398 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-03-25T14:08:38.620 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-03-25T14:08:38.643 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-03-25T14:08:38.854 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-03-25T14:08:38.876 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-03-25T14:08:39.087 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-03-25T14:08:39.108 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-03-25T14:08:39.319 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-03-25T14:08:39.341 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-03-25T14:08:39.550 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-03-25T14:08:39.572 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-03-25T14:08:39.784 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-03-25T14:08:39.807 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-03-25T14:08:40.017 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-03-25T14:08:40.039 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-03-25T14:08:40.261 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-03-25T14:08:40.272 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-03-25T14:08:40.493 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-03-25T14:08:40.504 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-03-25T14:08:40.725 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-03-25T14:08:40.737 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-03-25T14:08:40.956 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-03-25T14:08:40.975 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFT 2021-03-25T14:08:40.976 INFO:teuthology.task.ansible.out:Vsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-03-25T14:08:41.180 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-03-25T14:08:41.203 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-03-25T14:08:41.414 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-03-25T14:08:41.426 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-03-25T14:08:41.646 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-03-25T14:08:41.657 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-03-25T14:08:41.878 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-03-25T14:08:41.879 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-03-25T14:08:42.110 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-03-25T14:08:42.121 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-03-25T14:08:42.343 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-03-25T14:08:42.344 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-03-25T14:08:42.573 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-03-25T14:08:42.585 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-03-25T14:08:42.804 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-03-25T14:08:42.836 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-03-25T14:08:43.046 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-03-25T14:08:43.067 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-03-25T14:08:43.069 INFO:teuthology.task.ansible.out: 2021-03-25T14:08:43.272 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-03-25T14:08:43.295 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-03-25T14:08:43.496 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-03-25T14:08:43.518 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-03-25T14:08:43.727 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-03-25T14:08:43.749 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-03-25T14:08:43.958 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-03-25T14:08:43.981 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-03-25T14:08:44.213 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-03-25T14:08:44.215 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-03-25T14:08:44.437 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-03-25T14:08:44.448 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-03-25T14:08:44.681 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-03-25T14:08:44.681 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-03-25T14:08:44.911 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", " 2021-03-25T14:08:44.913 INFO:teuthology.task.ansible.out:key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-03-25T14:08:44.923 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", " 2021-03-25T14:08:44.924 INFO:teuthology.task.ansible.out:key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-03-25T14:08:45.144 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-03-25T14:08:45.158 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-03-25T14:08:45.277 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:08:45 +0000 (0:00:32.255) 0:01:17.741 ******** 2021-03-25T14:08:45.298 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:08:45 +0000 (0:00:00.021) 0:01:17.762 ******** 2021-03-25T14:08:45.362 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-25T14:08:45.364 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:45.373 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:45.384 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:45.385 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:45.397 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:45.398 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:45.408 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:45.409 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:45.420 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:45.421 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+9 2021-03-25T14:08:45.423 INFO:teuthology.task.ansible.out:0Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:45.432 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:45.434 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:45.444 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:45.445 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:45.456 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:45.656 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-03-25T14:08:45.667 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:45.678 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:45.679 INFO:teuthology.task.ansible.out: 2021-03-25T14:08:45.699 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-03-25T14:08:45.711 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:45.711 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:45.912 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-03-25T14:08:45.945 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-03-25T14:08:46.146 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-03-25T14:08:46.147 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.158 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.169 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.170 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-03-25T14:08:46.183 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.194 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.195 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.197 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.208 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.209 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cme 2021-03-25T14:08:46.211 INFO:teuthology.task.ansible.out:no@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.220 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.221 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.222 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.232 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.233 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.234 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.245 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.245 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.246 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.257 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.259 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.269 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.270 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.281 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.282 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.283 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.293 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.295 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.296 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.306 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.307 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.308 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.319 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.319 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.320 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.331 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.333 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.335 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.336 INFO:teuthology.task.ansible.out: 2021-03-25T14:08:46.338 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.339 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.352 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.353 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.363 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.364 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.366 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.367 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.377 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.378 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.379 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.391 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.391 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.393 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.403 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.404 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.405 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.416 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.417 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.418 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.419 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.431 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.431 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.443 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.443 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.445 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.447 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.448 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.449 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.461 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.461 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.463 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.473 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.474 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.475 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.486 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.486 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.488 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.498 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.499 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.501 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.502 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.512 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.512 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.514 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.524 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.525 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.526 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.537 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.538 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.539 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.550 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.551 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.552 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.553 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.564 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.566 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.567 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.578 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.578 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.579 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.590 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.590 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.592 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.602 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.603 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.604 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.616 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.617 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.618 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.620 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.631 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.631 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.632 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.634 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.644 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.645 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.646 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.657 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.657 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.659 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.669 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.670 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.671 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.682 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.683 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.684 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.695 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.706 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.707 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.709 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.710 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.721 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.721 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.722 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.724 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.734 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.735 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.736 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.747 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.747 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.749 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.759 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.760 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.761 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.772 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.773 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.774 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.785 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.785 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.787 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.797 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.798 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.800 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.810 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.810 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.811 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.822 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.823 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.824 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.835 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.837 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.837 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.837 INFO:teuthology.task.ansible.out: 2021-03-25T14:08:46.848 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.849 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.860 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.861 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.861 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.872 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.874 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.884 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.885 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.886 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.897 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.897 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.899 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.909 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.910 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.911 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.922 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.923 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.924 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.926 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.936 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.937 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.938 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.948 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.949 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.950 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.961 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.962 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.975 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.975 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.976 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.987 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.988 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.989 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.999 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:46.999 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:47.001 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:47.012 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:47.013 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:47.037 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:47.038 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:47.039 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:47.040 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:47.062 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:08:47 +0000 (0:00:01.763) 0:01:19.526 ******** 2021-03-25T14:08:47.110 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:08:47 +0000 (0:00:00.048) 0:01:19.574 ******** 2021-03-25T14:08:47.128 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* 2021-03-25T14:08:47.130 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:47.152 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:08:47 +0000 (0:00:00.041) 0:01:19.616 ******** 2021-03-25T14:08:47.180 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:08:47.204 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:08:47 +0000 (0:00:00.052) 0:01:19.668 ******** 2021-03-25T14:08:47.435 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-25T14:08:47.436 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-03-25T14:08:47.488 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-03-25T14:08:47.626 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-03-25T14:08:47.679 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-03-25T14:08:47.816 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-03-25T14:08:47.870 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-03-25T14:08:48.006 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-03-25T14:08:48.060 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-03-25T14:08:48.197 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-03-25T14:08:48.240 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-03-25T14:08:48.400 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-03-25T14:08:48.437 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-03-25T14:08:48.596 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-03-25T14:08:48.628 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-03-25T14:08:48.786 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-03-25T14:08:48.818 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-03-25T14:08:48.976 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-03-25T14:08:49.008 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-03-25T14:08:49.175 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-03-25T14:08:49.197 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-03-25T14:08:49.353 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-03-25T14:08:49.385 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-03-25T14:08:49.544 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-03-25T14:08:49.576 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-03-25T14:08:49.733 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-03-25T14:08:49.765 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-03-25T14:08:49.925 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-03-25T14:08:49.959 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-03-25T14:08:50.117 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-03-25T14:08:50.150 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-03-25T14:08:50.321 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-03-25T14:08:50.343 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-03-25T14:08:50.513 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-03-25T14:08:50.545 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-03-25T14:08:50.706 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-03-25T14:08:50.729 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-03-25T14:08:50.900 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-03-25T14:08:50.934 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-03-25T14:08:51.090 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-03-25T14:08:51.133 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-03-25T14:08:51.281 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-03-25T14:08:51.323 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-03-25T14:08:51.471 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2021-03-25T14:08:51.514 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2021-03-25T14:08:51.673 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-03-25T14:08:51.705 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-03-25T14:08:51.854 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-03-25T14:08:51.897 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-03-25T14:08:52.045 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-03-25T14:08:52.078 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-03-25T14:08:52.237 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-03-25T14:08:52.270 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-03-25T14:08:52.429 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-03-25T14:08:52.476 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-03-25T14:08:52.624 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-03-25T14:08:52.656 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-03-25T14:08:52.817 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-03-25T14:08:52.848 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-03-25T14:08:53.009 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-03-25T14:08:53.042 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-03-25T14:08:53.202 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-03-25T14:08:53.236 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-03-25T14:08:53.396 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-03-25T14:08:53.430 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-03-25T14:08:53.588 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-03-25T14:08:53.631 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-03-25T14:08:53.790 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-03-25T14:08:53.812 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-03-25T14:08:53.982 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-03-25T14:08:54.004 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-03-25T14:08:54.185 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-03-25T14:08:54.196 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-03-25T14:08:54.378 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-03-25T14:08:54.390 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-03-25T14:08:55.906 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "dorinda", "name": "dorinda", "remove": false, "state": "absent"} 2021-03-25T14:08:56.117 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "dorinda", "name": "dorinda", "remove": false, "state": "absent"} 2021-03-25T14:08:57.246 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "zyan", "name": "zyan", "remove": false, "state": "absent"} 2021-03-25T14:08:57.458 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-03-25T14:08:57.533 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "zyan", "name": "zyan", "remove": false, "state": "absent"} 2021-03-25T14:08:57.659 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-03-25T14:08:57.744 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-03-25T14:08:57.862 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-03-25T14:08:57.937 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-03-25T14:08:58.055 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-03-25T14:08:58.130 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-03-25T14:08:58.249 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-03-25T14:08:58.326 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-03-25T14:08:58.444 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-03-25T14:08:58.518 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-03-25T14:08:58.629 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-03-25T14:08:58.725 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-03-25T14:08:58.820 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-03-25T14:08:58.906 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-03-25T14:08:59.011 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-03-25T14:08:59.108 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-03-25T14:08:59.207 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-03-25T14:08:59.266 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:08:59 +0000 (0:00:12.062) 0:01:31.730 ******** 2021-03-25T14:08:59.310 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-03-25T14:08:59.502 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-03-25T14:08:59.556 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:08:59 +0000 (0:00:00.290) 0:01:32.020 ******** 2021-03-25T14:08:59.856 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-03-25T14:08:59.858 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => {"changed": true, "checksum": "1d9711ff879c231c67cb70d00ca0088797a377d0", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "80a55def4b505d08aff3687f81f74dc2", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1616681339.3723252-20773-195008398741958/source", "state": "file", "uid": 0} 2021-03-25T14:08:59.884 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:08:59 +0000 (0:00:00.327) 0:01:32.347 ******** 2021-03-25T14:08:59.955 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-03-25T14:08:59.956 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => { "msg": "Host smithi110.front.sepia.ceph.com is running RedHat 8.3 (Ootpa)" } 2021-03-25T14:08:59.981 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:08:59 +0000 (0:00:00.097) 0:01:32.445 ******** 2021-03-25T14:09:00.084 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-03-25T14:09:00.085 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"], "rhsm_repos": ["rhel-8-for-x86_64-baseos-rpms", "rhel-8-for-x86_64-appstream-rpms"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"} 2021-03-25T14:09:00.111 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:00 +0000 (0:00:00.129) 0:01:32.575 ******** 2021-03-25T14:09:00.142 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-03-25T14:09:00.142 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "checksum": "1d9711ff879c231c67cb70d00ca0088797a377d0", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "80a55def4b505d08aff3687f81f74dc2", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1616681339.6700535-20829-81354224734290/source", "state": "file", "uid": 0} 2021-03-25T14:09:00.170 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:00 +0000 (0:00:00.059) 0:01:32.634 ******** 2021-03-25T14:09:00.198 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-03-25T14:09:00.199 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:00.222 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:00 +0000 (0:00:00.051) 0:01:32.686 ******** 2021-03-25T14:09:00.241 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** ok: [smithi174.front.sepia.ceph.com] => { "msg": "Host smithi174.front.sepia.ceph.com is running RedHat 8.3 (Ootpa)" } 2021-03-25T14:09:00.264 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:00 +0000 (0:00:00.041) 0:01:32.728 ******** 2021-03-25T14:09:00.355 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-03-25T14:09:00.357 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"], "rhsm_repos": ["rhel-8-for-x86_64-baseos-rpms", "rhel-8-for-x86_64-appstream-rpms"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"} 2021-03-25T14:09:00.378 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:00 +0000 (0:00:00.114) 0:01:32.842 ******** 2021-03-25T14:09:00.459 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-03-25T14:09:00.460 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:00.488 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:00 +0000 (0:00:00.109) 0:01:32.952 ******** 2021-03-25T14:09:00.798 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-03-25T14:09:00.800 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.328677", "end": "2021-03-25 14:09:00.771977", "rc": 0, "start": "2021-03-25 14:09:00.443300", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-03-25T14:09:00.823 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:00 +0000 (0:00:00.335) 0:01:33.287 ******** 2021-03-25T14:09:00.893 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-03-25T14:09:00.895 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:00.917 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:00 +0000 (0:00:00.094) 0:01:33.381 ******** 2021-03-25T14:09:00.989 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-03-25T14:09:00.990 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:01.012 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:01 +0000 (0:00:00.094) 0:01:33.476 ******** 2021-03-25T14:09:01.060 INFO:teuthology.task.ansible.out: 2021-03-25T14:09:01.062 INFO:teuthology.task.ansible.out:TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.315414", "end": "2021-03-25 14:09:01.030532", "rc": 0, "start": "2021-03-25 14:09:00.715118", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-03-25T14:09:01.088 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:01 +0000 (0:00:00.075) 0:01:33.552 ******** 2021-03-25T14:09:01.095 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-03-25T14:09:01.097 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:01.122 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:01 +0000 (0:00:00.033) 0:01:33.586 ******** 2021-03-25T14:09:01.162 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-03-25T14:09:01.163 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:01.186 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:01 +0000 (0:00:00.064) 0:01:33.650 ******** 2021-03-25T14:09:01.218 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-03-25T14:09:01.220 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:01.244 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:01 +0000 (0:00:00.058) 0:01:33.708 ******** 2021-03-25T14:09:01.285 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-03-25T14:09:01.287 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:01.316 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:01 +0000 (0:00:00.071) 0:01:33.779 ******** 2021-03-25T14:09:01.336 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-03-25T14:09:01.338 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:01.364 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:01 +0000 (0:00:00.047) 0:01:33.827 ******** 2021-03-25T14:09:01.413 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-03-25T14:09:01.414 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:01.441 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:01 +0000 (0:00:00.077) 0:01:33.905 ******** 2021-03-25T14:09:01.459 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-03-25T14:09:01.461 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"ansible_facts": {"entitlements_path": "/etc/ansible/secrets/entitlements.yml"}, "changed": false} 2021-03-25T14:09:01.485 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:01 +0000 (0:00:00.044) 0:01:33.949 ******** 2021-03-25T14:09:01.528 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-03-25T14:09:01.529 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:01.556 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:01 +0000 (0:00:00.070) 0:01:34.020 ******** 2021-03-25T14:09:01.584 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-03-25T14:09:01.585 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi110.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-25T14:09:01.608 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:01 +0000 (0:00:00.051) 0:01:34.072 ******** 2021-03-25T14:09:01.636 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-03-25T14:09:01.637 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:01.661 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:01 +0000 (0:00:00.053) 0:01:34.125 ******** 2021-03-25T14:09:01.691 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-03-25T14:09:01.692 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"ansible_facts": {"have_entitlements": true}, "changed": false} 2021-03-25T14:09:01.721 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:01 +0000 (0:00:00.059) 0:01:34.185 ******** 2021-03-25T14:09:01.749 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-03-25T14:09:01.750 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"entitlements_path": "/etc/ansible/secrets/entitlements.yml"}, "changed": false} 2021-03-25T14:09:01.780 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:01 +0000 (0:00:00.058) 0:01:34.243 ******** 2021-03-25T14:09:01.872 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-03-25T14:09:01.874 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi174.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-25T14:09:01.896 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:01 +0000 (0:00:00.116) 0:01:34.360 ******** 2021-03-25T14:09:01.988 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"have_entitlements": true}, "changed": false} 2021-03-25T14:09:02.011 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:02 +0000 (0:00:00.114) 0:01:34.475 ******** 2021-03-25T14:09:02.984 INFO:teuthology.task.ansible.out: 2021-03-25T14:09:02.985 INFO:teuthology.task.ansible.out:TASK [common : Install CA Cert from Satellite Server] ************************** ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed /root/.ansible/tmp/ansible-moduletmp-1616681342.8423886-nu_809qp/katello-ca-consumer-latest.noarch66eyady3.rpm"]} ok: [smithi110.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed /root/.ansible/tmp/ansible-moduletmp-1616681342.8465421-kbubmh41/katello-ca-consumer-latest.noarchaxpu6qu4.rpm"]} 2021-03-25T14:09:02.987 INFO:teuthology.task.ansible.out: 2021-03-25T14:09:03.007 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:03 +0000 (0:00:00.995) 0:01:35.471 ******** 2021-03-25T14:09:03.029 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:03 +0000 (0:00:00.021) 0:01:35.492 ******** 2021-03-25T14:09:03.607 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-03-25T14:09:03.609 INFO:teuthology.task.ansible.out:fatal: [smithi110.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ...ignoring 2021-03-25T14:09:03.646 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:03 +0000 (0:00:00.617) 0:01:36.110 ******** 2021-03-25T14:09:03.657 INFO:teuthology.task.ansible.out:fatal: [smithi174.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ...ignoring 2021-03-25T14:09:03.691 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:03 +0000 (0:00:00.045) 0:01:36.155 ******** 2021-03-25T14:09:03.719 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-03-25T14:09:03.721 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": false}, "changed": false} 2021-03-25T14:09:03.744 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:03 +0000 (0:00:00.052) 0:01:36.208 ******** 2021-03-25T14:09:03.773 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": false}, "changed": false} 2021-03-25T14:09:03.796 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:03 +0000 (0:00:00.051) 0:01:36.260 ******** 2021-03-25T14:09:17.939 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-03-25T14:09:17.940 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"attempts": 1, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-03-25T14:09:17.965 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:17 +0000 (0:00:14.169) 0:01:50.429 ******** 2021-03-25T14:09:18.060 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-03-25T14:09:18.061 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": true}, "changed": false} 2021-03-25T14:09:18.086 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:18 +0000 (0:00:00.120) 0:01:50.550 ******** 2021-03-25T14:09:18.700 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager release --list | grep -E '[0-9]'", "delta": "0:00:00.370307", "end": "2021-03-25 14:09:18.677820", "failed_when_result": false, "rc": 0, "start": "2021-03-25 14:09:18.307513", "stderr": "", "stderr_lines": [], "stdout": "7.4\n7.5\n7.6\n7.7\n7.8\n7.9\n7Server\n8\n8.0\n8.1\n8.2\n8.3", "stdout_lines": ["7.4", "7.5", "7.6", "7.7", "7.8", "7.9", "7Server", "8", "8.0", "8.1", "8.2", "8.3"]} 2021-03-25T14:09:18.723 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:18 +0000 (0:00:00.636) 0:01:51.187 ******** 2021-03-25T14:09:18.803 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-03-25T14:09:18.804 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:18.835 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:18 +0000 (0:00:00.112) 0:01:51.299 ******** 2021-03-25T14:09:18.919 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-03-25T14:09:18.920 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:18.942 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:18 +0000 (0:00:00.106) 0:01:51.406 ******** 2021-03-25T14:09:19.022 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-03-25T14:09:19.024 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-25T14:09:19.045 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:19 +0000 (0:00:00.103) 0:01:51.509 ******** 2021-03-25T14:09:19.125 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:19.151 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:19 +0000 (0:00:00.106) 0:01:51.615 ******** 2021-03-25T14:09:19.714 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-03-25T14:09:19.716 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => {"attempts": 1, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-03-25T14:09:19.738 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:19 +0000 (0:00:00.586) 0:01:52.202 ******** 2021-03-25T14:09:19.821 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-03-25T14:09:19.822 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": true}, "changed": false} 2021-03-25T14:09:19.843 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:19 +0000 (0:00:00.105) 0:01:52.307 ******** 2021-03-25T14:09:20.459 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-03-25T14:09:20.460 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager release --list | grep -E '[0-9]'", "delta": "0:00:00.366988", "end": "2021-03-25 14:09:20.424025", "failed_when_result": false, "rc": 0, "start": "2021-03-25 14:09:20.057037", "stderr": "", "stderr_lines": [], "stdout": "7.4\n7.5\n7.6\n7.7\n7.8\n7.9\n7Server\n8\n8.0\n8.1\n8.2\n8.3", "stdout_lines": ["7.4", "7.5", "7.6", "7.7", "7.8", "7.9", "7Server", "8", "8.0", "8.1", "8.2", "8.3"]} 2021-03-25T14:09:20.482 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:20 +0000 (0:00:00.639) 0:01:52.946 ******** 2021-03-25T14:09:20.585 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-03-25T14:09:20.586 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:20.613 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:20 +0000 (0:00:00.130) 0:01:53.077 ******** 2021-03-25T14:09:20.686 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-03-25T14:09:20.687 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:20.712 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:20 +0000 (0:00:00.099) 0:01:53.176 ******** 2021-03-25T14:09:20.783 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-03-25T14:09:20.785 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-25T14:09:20.807 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:20 +0000 (0:00:00.094) 0:01:53.270 ******** 2021-03-25T14:09:20.888 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-03-25T14:09:20.889 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:20.910 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:20 +0000 (0:00:00.103) 0:01:53.374 ******** 2021-03-25T14:09:21.767 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-03-25T14:09:21.769 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager repos --list | grep -B4 'Enabled:.*1' | grep 'Repo ID:' | sed -e 's/Repo ID:\\s*\\(.*\\)/\\1/' | sort", "delta": "0:00:02.378593", "end": "2021-03-25 14:09:21.745179", "rc": 0, "start": "2021-03-25 14:09:19.366586", "stderr": "", "stderr_lines": [], "stdout": "rhel-8-for-x86_64-appstream-rpms\nrhel-8-for-x86_64-baseos-rpms", "stdout_lines": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]} 2021-03-25T14:09:21.794 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:21 +0000 (0:00:00.883) 0:01:54.258 ******** 2021-03-25T14:09:21.881 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-03-25T14:09:21.882 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"repo_list": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]}, "changed": false} 2021-03-25T14:09:21.904 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:21 +0000 (0:00:00.109) 0:01:54.368 ******** 2021-03-25T14:09:21.985 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-03-25T14:09:21.986 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:22.007 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:22 +0000 (0:00:00.103) 0:01:54.471 ******** 2021-03-25T14:09:22.091 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-03-25T14:09:22.092 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": false}, "changed": false} 2021-03-25T14:09:22.114 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:22 +0000 (0:00:00.106) 0:01:54.578 ******** 2021-03-25T14:09:22.206 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-03-25T14:09:22.208 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2021-03-25T14:09:22.229 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:22 +0000 (0:00:00.114) 0:01:54.693 ******** 2021-03-25T14:09:23.534 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-03-25T14:09:23.536 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager repos --list | grep -B4 'Enabled:.*1' | grep 'Repo ID:' | sed -e 's/Repo ID:\\s*\\(.*\\)/\\1/' | sort", "delta": "0:00:02.383055", "end": "2021-03-25 14:09:23.516985", "rc": 0, "start": "2021-03-25 14:09:21.133930", "stderr": "", "stderr_lines": [], "stdout": "rhel-8-for-x86_64-appstream-rpms\nrhel-8-for-x86_64-baseos-rpms", "stdout_lines": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]} 2021-03-25T14:09:23.559 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:23 +0000 (0:00:01.329) 0:01:56.023 ******** 2021-03-25T14:09:23.640 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-03-25T14:09:23.642 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"ansible_facts": {"repo_list": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]}, "changed": false} 2021-03-25T14:09:23.663 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:23 +0000 (0:00:00.104) 0:01:56.127 ******** 2021-03-25T14:09:23.745 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-03-25T14:09:23.747 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:23.768 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:23 +0000 (0:00:00.104) 0:01:56.232 ******** 2021-03-25T14:09:23.848 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-03-25T14:09:23.849 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": false}, "changed": false} 2021-03-25T14:09:23.870 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:23 +0000 (0:00:00.101) 0:01:56.334 ******** 2021-03-25T14:09:23.951 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-03-25T14:09:23.952 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2021-03-25T14:09:23.977 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:23 +0000 (0:00:00.106) 0:01:56.441 ******** 2021-03-25T14:09:24.388 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-03-25T14:09:24.390 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-03-25T14:09:24.412 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:24 +0000 (0:00:00.434) 0:01:56.875 ******** 2021-03-25T14:09:26.044 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-03-25T14:09:26.101 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:26 +0000 (0:00:01.656) 0:01:58.532 ******** 2021-03-25T14:09:27.609 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-03-25T14:09:27.610 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": ["subscription-manager", "repos", "--enable=rhel-8-for-x86_64-baseos-rpms", "--enable=rhel-8-for-x86_64-appstream-rpms"], "delta": "0:00:02.949715", "end": "2021-03-25 14:09:27.580804", "rc": 0, "start": "2021-03-25 14:09:24.631089", "stderr": "", "stderr_lines": [], "stdout": "Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.\nRepository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system.", "stdout_lines": ["Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.", "Repository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system."]} 2021-03-25T14:09:27.654 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:27 +0000 (0:00:01.586) 0:02:00.118 ******** 2021-03-25T14:09:28.347 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-03-25T14:09:28.349 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "path": "/etc/yum.repos.d/cd.repo", "state": "absent"} 2021-03-25T14:09:28.372 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:28 +0000 (0:00:00.718) 0:02:00.836 ******** 2021-03-25T14:09:28.649 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-03-25T14:09:28.748 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} Thursday 25 March 2021 14:09:28 +0000 (0:00:00.299) 0:02:01.135 ******** 2021-03-25T14:09:29.209 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-03-25T14:09:29.211 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => {"changed": true, "cmd": ["subscription-manager", "repos", "--enable=rhel-8-for-x86_64-baseos-rpms", "--enable=rhel-8-for-x86_64-appstream-rpms"], "delta": "0:00:02.903841", "end": "2021-03-25 14:09:29.191102", "rc": 0, "start": "2021-03-25 14:09:26.287261", "stderr": "", "stderr_lines": [], "stdout": "Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.\nRepository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system.", "stdout_lines": ["Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.", "Repository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system."]} 2021-03-25T14:09:29.241 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:29 +0000 (0:00:00.569) 0:02:01.705 ******** 2021-03-25T14:09:29.333 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-03-25T14:09:29.431 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2021-03-25T14:09:29.496 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-03-25T14:09:29.498 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"changed": false, "path": "/etc/yum.repos.d/cd.repo", "state": "absent"} 2021-03-25T14:09:29.532 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:29 +0000 (0:00:00.291) 0:02:01.996 ******** 2021-03-25T14:09:29.837 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-03-25T14:09:29.837 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2021-03-25T14:09:29.881 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:29 +0000 (0:00:00.348) 0:02:02.345 ******** 2021-03-25T14:09:29.888 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-03-25T14:09:29.889 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-25T14:09:29.920 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:29 +0000 (0:00:00.038) 0:02:02.384 ******** 2021-03-25T14:09:30.427 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-03-25T14:09:30.427 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2021-03-25T14:09:30.461 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-03-25T14:09:30.462 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2021-03-25T14:09:30.882 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-03-25T14:09:30.883 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2021-03-25T14:09:30.910 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:30 +0000 (0:00:00.989) 0:02:03.373 ******** 2021-03-25T14:09:30.919 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-03-25T14:09:30.920 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2021-03-25T14:09:30.955 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:30 +0000 (0:00:00.045) 0:02:03.419 ******** 2021-03-25T14:09:30.997 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:31.023 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:31 +0000 (0:00:00.067) 0:02:03.486 ******** 2021-03-25T14:09:31.128 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:31.153 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:31 +0000 (0:00:00.130) 0:02:03.617 ******** 2021-03-25T14:09:31.244 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-03-25T14:09:31.245 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:31.273 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:31 +0000 (0:00:00.119) 0:02:03.737 ******** 2021-03-25T14:09:31.359 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:31.393 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:31 +0000 (0:00:00.118) 0:02:03.856 ******** 2021-03-25T14:09:31.473 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-03-25T14:09:31.475 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} 2021-03-25T14:09:31.485 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} 2021-03-25T14:09:31.486 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} 2021-03-25T14:09:31.496 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-03-25T14:09:31.520 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:31 +0000 (0:00:00.127) 0:02:03.984 ******** 2021-03-25T14:09:31.582 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-03-25T14:09:31.583 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2021-03-25T14:09:31.616 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-03-25T14:09:31.618 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:31.644 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:31 +0000 (0:00:00.123) 0:02:04.108 ******** 2021-03-25T14:09:31.645 INFO:teuthology.task.ansible.out: 2021-03-25T14:09:31.726 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-03-25T14:09:31.811 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Thursday 25 March 2021 14:09:31 +0000 (0:00:00.106) 0:02:04.214 ******** 2021-03-25T14:09:31.835 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-03-25T14:09:31.835 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:31.858 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:31 +0000 (0:00:00.107) 0:02:04.322 ******** 2021-03-25T14:09:31.938 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-03-25T14:09:31.954 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:31.961 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:31 +0000 (0:00:00.103) 0:02:04.425 ******** 2021-03-25T14:09:32.034 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-03-25T14:09:32.087 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} Thursday 25 March 2021 14:09:32 +0000 (0:00:00.099) 0:02:04.525 ******** TASK [common : Refresh repos] ************************************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:32.098 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:32 +0000 (0:00:00.037) 0:02:04.562 ******** 2021-03-25T14:09:32.151 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-03-25T14:09:32.152 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:32.180 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:32 +0000 (0:00:00.081) 0:02:04.644 ******** 2021-03-25T14:09:32.251 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-03-25T14:09:32.252 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:32.273 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:32 +0000 (0:00:00.093) 0:02:04.737 ******** 2021-03-25T14:09:32.352 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-03-25T14:09:32.353 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:32.376 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:32 +0000 (0:00:00.102) 0:02:04.840 ******** 2021-03-25T14:09:32.457 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-03-25T14:09:32.458 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:32.479 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:32 +0000 (0:00:00.103) 0:02:04.943 ******** 2021-03-25T14:09:32.518 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-03-25T14:09:32.519 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.220928", "end": "2021-03-25 14:09:32.500337", "rc": 0, "start": "2021-03-25 14:09:32.279409", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-25T14:09:32.546 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:32 +0000 (0:00:00.066) 0:02:05.010 ******** 2021-03-25T14:09:32.568 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-03-25T14:09:32.569 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} skipping: [smithi110.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} 2021-03-25T14:09:32.580 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} 2021-03-25T14:09:32.581 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-03-25T14:09:32.604 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:32 +0000 (0:00:00.057) 0:02:05.068 ******** 2021-03-25T14:09:32.684 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-03-25T14:09:32.685 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:32.708 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:32 +0000 (0:00:00.104) 0:02:05.172 ******** 2021-03-25T14:09:32.777 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-03-25T14:09:32.779 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:32.799 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:32 +0000 (0:00:00.090) 0:02:05.263 ******** 2021-03-25T14:09:32.890 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-03-25T14:09:32.891 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:32.914 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:32 +0000 (0:00:00.115) 0:02:05.378 ******** 2021-03-25T14:09:32.984 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-03-25T14:09:32.986 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:33.009 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:33 +0000 (0:00:00.094) 0:02:05.473 ******** 2021-03-25T14:09:33.091 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:33.114 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:33 +0000 (0:00:00.105) 0:02:05.578 ******** 2021-03-25T14:09:33.522 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-03-25T14:09:33.523 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.213161", "end": "2021-03-25 14:09:33.500356", "rc": 0, "start": "2021-03-25 14:09:33.287195", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-25T14:09:33.547 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:33 +0000 (0:00:00.432) 0:02:06.011 ******** 2021-03-25T14:09:35.536 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-03-25T14:09:35.537 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-03-25T14:09:35.559 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:35 +0000 (0:00:02.012) 0:02:08.023 ******** 2021-03-25T14:09:35.629 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-03-25T14:09:35.630 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:35.652 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:35 +0000 (0:00:00.092) 0:02:08.116 ******** 2021-03-25T14:09:35.720 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-03-25T14:09:35.722 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:35.745 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:35 +0000 (0:00:00.093) 0:02:08.209 ******** 2021-03-25T14:09:35.815 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-03-25T14:09:35.816 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:35.844 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:35 +0000 (0:00:00.098) 0:02:08.308 ******** 2021-03-25T14:09:35.924 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-03-25T14:09:35.925 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:35.947 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:35 +0000 (0:00:00.103) 0:02:08.411 ******** 2021-03-25T14:09:36.438 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-03-25T14:09:36.440 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2021-03-25T14:09:36.468 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:36 +0000 (0:00:00.520) 0:02:08.932 ******** 2021-03-25T14:09:36.487 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-03-25T14:09:36.552 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} Thursday 25 March 2021 14:09:36 +0000 (0:00:00.045) 0:02:08.978 ******** 2021-03-25T14:09:36.594 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-03-25T14:09:36.596 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:36.617 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:36 +0000 (0:00:00.103) 0:02:09.081 ******** 2021-03-25T14:09:36.688 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-03-25T14:09:36.689 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:36.711 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:36 +0000 (0:00:00.093) 0:02:09.175 ******** 2021-03-25T14:09:36.782 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-03-25T14:09:36.783 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:36.815 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:36 +0000 (0:00:00.103) 0:02:09.279 ******** 2021-03-25T14:09:36.889 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-03-25T14:09:36.890 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:36.911 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:36 +0000 (0:00:00.096) 0:02:09.375 ******** 2021-03-25T14:09:37.401 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-03-25T14:09:37.403 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2021-03-25T14:09:37.425 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:37 +0000 (0:00:00.513) 0:02:09.889 ******** 2021-03-25T14:09:39.030 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-03-25T14:09:39.031 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-03-25T14:09:39.053 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:39 +0000 (0:00:01.628) 0:02:11.517 ******** 2021-03-25T14:09:39.589 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi174.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2021-03-25T14:09:39.995 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-03-25T14:09:39.997 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-03-25T14:09:40.021 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:40 +0000 (0:00:00.967) 0:02:12.485 ******** 2021-03-25T14:09:40.051 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-03-25T14:09:40.052 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2021-03-25T14:09:40.487 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2021-03-25T14:09:40.519 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:40 +0000 (0:00:00.497) 0:02:12.983 ******** 2021-03-25T14:09:40.547 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2021-03-25T14:09:40.715 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-03-25T14:09:40.716 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-03-25T14:09:40.738 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:40 +0000 (0:00:00.219) 0:02:13.202 ******** 2021-03-25T14:09:40.985 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-03-25T14:09:40.987 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2021-03-25T14:09:41.322 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-03-25T14:09:41.324 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": true, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "md5sum": "14041bf2666d8f8d277567958c7e9f69", "mode": "0755", "owner": "root", "secontext": "system_u:object_r:bin_t:s0", "size": 13355, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1616681380.8353543-29133-66223997390962/source", "state": "file", "uid": 0} 2021-03-25T14:09:41.419 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-03-25T14:09:41.421 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2021-03-25T14:09:41.447 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:41 +0000 (0:00:00.708) 0:02:13.911 ******** 2021-03-25T14:09:41.645 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-03-25T14:09:41.646 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-03-25T14:09:41.680 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:41 +0000 (0:00:00.232) 0:02:14.143 ******** 2021-03-25T14:09:41.733 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-03-25T14:09:41.811 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2021-03-25T14:09:42.158 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2021-03-25T14:09:42.185 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:42 +0000 (0:00:00.505) 0:02:14.649 ******** 2021-03-25T14:09:42.264 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-03-25T14:09:42.295 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Thursday 25 March 2021 14:09:42 +0000 (0:00:00.104) 0:02:14.753 ******** 2021-03-25T14:09:42.297 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** changed: [smithi110.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": true, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "md5sum": "14041bf2666d8f8d277567958c7e9f69", "mode": "0755", "owner": "root", "secontext": "system_u:object_r:bin_t:s0", "size": 13355, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1616681381.809354-29361-265944965562574/source", "state": "file", "uid": 0} 2021-03-25T14:09:42.383 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-03-25T14:09:42.384 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2021-03-25T14:09:42.408 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:42 +0000 (0:00:00.119) 0:02:14.872 ******** 2021-03-25T14:09:42.648 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-03-25T14:09:42.650 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-03-25T14:09:42.672 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:42 +0000 (0:00:00.263) 0:02:15.136 ******** 2021-03-25T14:09:42.722 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-03-25T14:09:42.724 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2021-03-25T14:09:42.770 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-03-25T14:09:42.771 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-25T14:09:42.781 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-25T14:09:42.793 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-25T14:09:42.794 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-25T14:09:42.816 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:42 +0000 (0:00:00.143) 0:02:15.280 ******** 2021-03-25T14:09:43.155 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-03-25T14:09:43.156 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2021-03-25T14:09:43.187 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:43 +0000 (0:00:00.370) 0:02:15.650 ******** 2021-03-25T14:09:43.288 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-03-25T14:09:43.290 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:43.311 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:43 +0000 (0:00:00.124) 0:02:15.775 ******** 2021-03-25T14:09:43.413 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-03-25T14:09:43.415 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2021-03-25T14:09:43.442 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:43 +0000 (0:00:00.131) 0:02:15.906 ******** 2021-03-25T14:09:44.700 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-03-25T14:09:44.702 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-03-25T14:09:44.722 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:44 +0000 (0:00:01.279) 0:02:17.186 ******** 2021-03-25T14:09:44.803 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-03-25T14:09:44.805 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-25T14:09:44.815 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-25T14:09:44.816 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-25T14:09:44.827 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-25T14:09:44.851 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:44 +0000 (0:00:00.128) 0:02:17.315 ******** 2021-03-25T14:09:48.790 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-03-25T14:09:48.791 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: nagios-common-4.4.6-4.el8.x86_64", "Removed: nagios-common-4.4.5-1.el8.x86_64"]} 2021-03-25T14:09:48.814 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:48 +0000 (0:00:03.962) 0:02:21.278 ******** 2021-03-25T14:09:48.895 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-03-25T14:09:48.896 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:48.919 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:48 +0000 (0:00:00.105) 0:02:21.383 ******** 2021-03-25T14:09:49.423 INFO:teuthology.task.ansible.out: 2021-03-25T14:09:49.424 INFO:teuthology.task.ansible.out:TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-03-25T14:09:49.425 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2021-03-25T14:09:49.452 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:49 +0000 (0:00:00.532) 0:02:21.916 ******** 2021-03-25T14:09:49.963 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2021-03-25T14:09:49.987 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:49 +0000 (0:00:00.535) 0:02:22.451 ******** 2021-03-25T14:09:50.090 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-03-25T14:09:50.092 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2021-03-25T14:09:50.113 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:50 +0000 (0:00:00.125) 0:02:22.577 ******** 2021-03-25T14:09:50.369 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-03-25T14:09:50.371 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-25T14:09:50.395 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:50 +0000 (0:00:00.282) 0:02:22.859 ******** 2021-03-25T14:09:50.718 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-03-25T14:09:50.720 INFO:teuthology.task.ansible.out:fatal: [smithi174.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2021-03-25T14:09:50.749 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:50 +0000 (0:00:00.353) 0:02:23.213 ******** 2021-03-25T14:09:50.787 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-03-25T14:09:50.788 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: nagios-common-4.4.6-4.el8.x86_64", "Removed: nagios-common-4.4.5-1.el8.x86_64"]} 2021-03-25T14:09:50.825 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:50 +0000 (0:00:00.076) 0:02:23.289 ******** 2021-03-25T14:09:50.837 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:50.864 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:50 +0000 (0:00:00.038) 0:02:23.328 ******** 2021-03-25T14:09:50.905 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:50.943 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:50 +0000 (0:00:00.079) 0:02:23.407 ******** 2021-03-25T14:09:51.399 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-03-25T14:09:51.427 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} Thursday 25 March 2021 14:09:51 +0000 (0:00:00.481) 0:02:23.889 ******** 2021-03-25T14:09:51.485 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-03-25T14:09:51.486 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2021-03-25T14:09:51.510 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:51 +0000 (0:00:00.084) 0:02:23.974 ******** 2021-03-25T14:09:52.013 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-03-25T14:09:52.015 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2021-03-25T14:09:52.043 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:52 +0000 (0:00:00.532) 0:02:24.506 ******** 2021-03-25T14:09:52.129 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ skipping: [smithi110.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2021-03-25T14:09:52.178 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} Thursday 25 March 2021 14:09:52 +0000 (0:00:00.119) 0:02:24.626 ******** 2021-03-25T14:09:52.236 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-03-25T14:09:52.238 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2021-03-25 14:06:20 UTC", "ActiveEnterTimestampMonotonic": "15954189", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "var-run.mount basic.target local-fs.target systemd-tmpfiles-setup.service network.target nss-lookup.target sysinit.target -.mount systemd-journald.socket system.slice time-sync.target tmp.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2021-03-25 14:06:20 UTC", "AssertTimestampMonotonic": "15953003", "Before": "plymouth-quit.service getty@tty1.service xdm.service shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2021-03-25 14:06:20 UTC", "ConditionTimestampMonotonic": "15953002", "ConfigurationDirectoryMode": " 2021-03-25T14:09:52.240 INFO:teuthology.task.ansible.out:0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "977", "ExecMainStartTimestamp": "Thu 2021-03-25 14:06:20 UTC", "ExecMainStartTimestampMonotonic": "15954136", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Thu 2021-03-25 14:06:20 UTC] ; stop_time=[n/a] ; pid=977 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "FreezerState": "running", "GID": "984", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2021-03-25 14:06:20 UTC", "InactiveExitTimestampMonotonic": "15954189", "InvocationID": "1d599c9f497344388aab22ec12be5766", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infin 2021-03-25T14:09:52.241 INFO:teuthology.task.ansible.out:ity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127237", "LimitNPROCSoft": "127237", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127237", "LimitSIGPENDINGSoft": "127237", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "977", "MemoryAccounting": "yes", "MemoryCurrent": "1429504", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualSta 2021-03-25T14:09:52.242 INFO:teuthology.task.ansible.out:rt": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2021-03-25 14:06:20 UTC", "StateChangeTimestampMonotonic": "15954189", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203580", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "988", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2021-03-25 14:06:20 UTC", "WatchdogTimestampMonotonic": "15954188", "WatchdogUSec": "0"}} 2021-03-25T14:09:52.265 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:52 +0000 (0:00:00.102) 0:02:24.729 ******** 2021-03-25T14:09:52.411 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-03-25T14:09:52.428 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-25T14:09:52.438 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:52 +0000 (0:00:00.173) 0:02:24.902 ******** 2021-03-25T14:09:52.642 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-03-25T14:09:52.643 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001716", "end": "2021-03-25 14:09:52.619078", "rc": 0, "start": "2021-03-25 14:09:52.617362", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2021-03-25T14:09:52.668 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:52 +0000 (0:00:00.230) 0:02:25.132 ******** 2021-03-25T14:09:52.891 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-03-25T14:09:52.892 INFO:teuthology.task.ansible.out:fatal: [smithi110.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2021-03-25T14:09:52.915 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:52 +0000 (0:00:00.246) 0:02:25.379 ******** 2021-03-25T14:09:53.146 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-03-25T14:09:53.147 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:09:53.175 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:53 +0000 (0:00:00.259) 0:02:25.639 ******** 2021-03-25T14:09:53.683 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-03-25T14:09:53.684 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2021-03-25T14:09:53.710 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:53 +0000 (0:00:00.534) 0:02:26.174 ******** 2021-03-25T14:09:54.045 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-03-25T14:09:54.047 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2021-03-25 14:06:19 UTC", "ActiveEnterTimestampMonotonic": "15563330", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "var-run.mount network.target local-fs.target -.mount system.slice systemd-tmpfiles-setup.service nss-lookup.target tmp.mount sysinit.target time-sync.target basic.target systemd-journald.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2021-03-25 14:06:19 UTC", "AssertTimestampMonotonic": "15546764", "Before": "xdm.service plymouth-quit.service getty@tty1.service multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2021-03-25 14:06:19 UTC", "ConditionTimestampMonotonic": "15546764", "ConfigurationDirectoryMode": " 2021-03-25T14:09:54.048 INFO:teuthology.task.ansible.out:0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "978", "ExecMainStartTimestamp": "Thu 2021-03-25 14:06:19 UTC", "ExecMainStartTimestampMonotonic": "15562766", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Thu 2021-03-25 14:06:19 UTC] ; stop_time=[n/a] ; pid=978 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "FreezerState": "running", "GID": "984", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2021-03-25 14:06:19 UTC", "InactiveExitTimestampMonotonic": "15563330", "InvocationID": "1c05e2a3bb074cf7ab3fb59ba3f07b25", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infin 2021-03-25T14:09:54.049 INFO:teuthology.task.ansible.out:ity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127237", "LimitNPROCSoft": "127237", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127237", "LimitSIGPENDINGSoft": "127237", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "978", "MemoryAccounting": "yes", "MemoryCurrent": "1511424", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualSta 2021-03-25T14:09:54.050 INFO:teuthology.task.ansible.out:rt": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/run/nrpe /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2021-03-25 14:06:19 UTC", "StateChangeTimestampMonotonic": "15563330", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203579", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "988", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2021-03-25 14:06:19 UTC", "WatchdogTimestampMonotonic": "15563308", "WatchdogUSec": "0"}} 2021-03-25T14:09:54.070 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:54 +0000 (0:00:00.360) 0:02:26.534 ******** 2021-03-25T14:09:54.301 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-03-25T14:09:54.302 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001725", "end": "2021-03-25 14:09:54.275885", "rc": 0, "start": "2021-03-25 14:09:54.274160", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2021-03-25T14:09:54.324 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:54 +0000 (0:00:00.253) 0:02:26.787 ******** 2021-03-25T14:09:55.425 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-03-25T14:09:55.426 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-03-25T14:09:55.449 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:55 +0000 (0:00:01.124) 0:02:27.912 ******** 2021-03-25T14:09:56.928 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-03-25T14:09:56.953 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:09:56 +0000 (0:00:01.504) 0:02:29.417 ******** 2021-03-25T14:10:36.827 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-03-25T14:10:36.833 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: selinux-policy-3.14.3-54.el8_3.2.noarch", "Installed: selinux-policy-targeted-3.14.3-54.el8_3.2.noarch", "Removed: selinux-policy-3.14.3-54.el8.noarch", "Removed: selinux-policy-targeted-3.14.3-54.el8.noarch"]} 2021-03-25T14:10:36.853 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:10:36 +0000 (0:00:39.900) 0:03:09.317 ******** 2021-03-25T14:10:37.527 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-03-25T14:10:37.528 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2021-03-25T14:10:37.549 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:10:37 +0000 (0:00:00.695) 0:03:10.013 ******** 2021-03-25T14:10:37.670 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-03-25T14:10:37.672 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: selinux-policy-3.14.3-54.el8_3.2.noarch", "Installed: selinux-policy-targeted-3.14.3-54.el8_3.2.noarch", "Removed: selinux-policy-3.14.3-54.el8.noarch", "Removed: selinux-policy-targeted-3.14.3-54.el8.noarch"]} 2021-03-25T14:10:37.694 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:10:37 +0000 (0:00:00.144) 0:03:10.157 ******** 2021-03-25T14:10:38.181 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-03-25T14:10:38.183 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2021-03-25T14:10:38.203 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:10:38 +0000 (0:00:00.509) 0:03:10.667 ******** 2021-03-25T14:10:53.988 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-03-25T14:10:53.990 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.196211", "end": "2021-03-25 14:10:53.963321", "failed_when_result": false, "rc": 0, "start": "2021-03-25 14:10:37.767110", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2021-03-25T14:10:54.014 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:10:54 +0000 (0:00:15.810) 0:03:26.478 ******** 2021-03-25T14:10:54.527 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.091752", "end": "2021-03-25 14:10:54.501114", "failed_when_result": false, "rc": 0, "start": "2021-03-25 14:10:38.409362", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2021-03-25T14:10:54.530 INFO:teuthology.task.ansible.out: 2021-03-25T14:10:54.554 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:10:54 +0000 (0:00:00.540) 0:03:27.018 ******** 2021-03-25T14:10:54.563 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-03-25T14:10:54.564 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2021-03-25T14:10:54.596 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:10:54 +0000 (0:00:00.041) 0:03:27.060 ******** 2021-03-25T14:10:54.871 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-03-25T14:10:54.873 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.022150", "end": "2021-03-25 14:10:54.848135", "rc": 0, "start": "2021-03-25 14:10:54.825985", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-25T14:10:54.894 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:10:54 +0000 (0:00:00.298) 0:03:27.358 ******** 2021-03-25T14:10:55.111 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-03-25T14:10:55.112 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2021-03-25T14:10:55.134 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:10:55 +0000 (0:00:00.239) 0:03:27.598 ******** 2021-03-25T14:10:55.184 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-03-25T14:10:55.185 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.025737", "end": "2021-03-25 14:10:55.156342", "rc": 0, "start": "2021-03-25 14:10:55.130605", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-25T14:10:55.210 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:10:55 +0000 (0:00:00.076) 0:03:27.674 ******** 2021-03-25T14:10:55.403 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-03-25T14:10:55.405 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.010858", "end": "2021-03-25 14:10:55.381973", "rc": 0, "start": "2021-03-25 14:10:55.371115", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-25T14:10:55.427 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:10:55 +0000 (0:00:00.216) 0:03:27.891 ******** 2021-03-25T14:10:55.667 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** changed: [smithi110.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.005201", "end": "2021-03-25 14:10:55.648323", "rc": 0, "start": "2021-03-25 14:10:55.643122", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-25T14:10:55.669 INFO:teuthology.task.ansible.out: 2021-03-25T14:10:55.702 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:10:55 +0000 (0:00:00.274) 0:03:28.166 ******** 2021-03-25T14:11:11.677 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-03-25T14:11:11.678 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.222940", "end": "2021-03-25 14:11:11.653489", "rc": 0, "start": "2021-03-25 14:10:55.430549", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-25T14:11:11.709 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:11 +0000 (0:00:16.007) 0:03:44.173 ******** 2021-03-25T14:11:11.949 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2021-03-25T14:11:11.972 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:11 +0000 (0:00:00.263) 0:03:44.436 ******** 2021-03-25T14:11:12.022 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-03-25T14:11:12.023 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.089239", "end": "2021-03-25 14:11:11.996485", "rc": 0, "start": "2021-03-25 14:10:55.907246", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-25T14:11:12.046 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:12 +0000 (0:00:00.073) 0:03:44.510 ******** 2021-03-25T14:11:12.081 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-03-25T14:11:12.084 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2021-03-25T14:11:12.120 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:12 +0000 (0:00:00.073) 0:03:44.584 ******** 2021-03-25T14:11:12.222 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-03-25T14:11:12.224 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-03-25T14:11:12.248 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:12 +0000 (0:00:00.128) 0:03:44.712 ******** 2021-03-25T14:11:12.322 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-03-25T14:11:12.322 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2021-03-25T14:11:12.350 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:12 +0000 (0:00:00.101) 0:03:44.813 ******** 2021-03-25T14:11:12.361 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-03-25T14:11:12.361 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "epel_packages": ["dbench"], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "git-all", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "podman", "redhat-lsb", "firewalld", "wget", "podman-docker", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "make", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "autoconf", "gdb", "iozone", "lvm2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"} 2021-03-25T14:11:12.395 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:12 +0000 (0:00:00.044) 0:03:44.858 ******** 2021-03-25T14:11:12.434 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-03-25T14:11:12.436 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2021-03-25T14:11:12.458 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:12 +0000 (0:00:00.064) 0:03:44.922 ******** 2021-03-25T14:11:12.498 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-03-25T14:11:12.500 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-03-25T14:11:12.527 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:12 +0000 (0:00:00.068) 0:03:44.991 ******** 2021-03-25T14:11:12.555 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-03-25T14:11:12.557 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-03-25T14:11:12.580 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:12 +0000 (0:00:00.052) 0:03:45.043 ******** 2021-03-25T14:11:12.671 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-03-25T14:11:12.673 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "epel_packages": ["dbench"], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "git-all", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "podman", "redhat-lsb", "firewalld", "wget", "podman-docker", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "make", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "autoconf", "gdb", "iozone", "lvm2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"} 2021-03-25T14:11:12.704 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:12 +0000 (0:00:00.124) 0:03:45.168 ******** 2021-03-25T14:11:12.726 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-03-25T14:11:12.751 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:12 +0000 (0:00:00.046) 0:03:45.215 ******** 2021-03-25T14:11:12.811 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-03-25T14:11:12.813 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-03-25T14:11:12.836 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:12 +0000 (0:00:00.084) 0:03:45.300 ******** 2021-03-25T14:11:12.990 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-03-25T14:11:12.992 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "name": "ubuntu", "state": "present", "system": false} 2021-03-25T14:11:13.014 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:13 +0000 (0:00:00.178) 0:03:45.478 ******** 2021-03-25T14:11:13.022 INFO:teuthology.task.ansible.out: 2021-03-25T14:11:13.024 INFO:teuthology.task.ansible.out:TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi110.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-03-25T14:11:13.050 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:13 +0000 (0:00:00.035) 0:03:45.514 ******** 2021-03-25T14:11:13.099 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-03-25T14:11:13.101 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:11:13.123 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:13 +0000 (0:00:00.072) 0:03:45.587 ******** 2021-03-25T14:11:13.205 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:11:13.229 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:13 +0000 (0:00:00.106) 0:03:45.693 ******** 2021-03-25T14:11:13.290 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-03-25T14:11:13.291 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "name": "ubuntu", "state": "present", "system": false} 2021-03-25T14:11:13.319 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:13 +0000 (0:00:00.087) 0:03:45.781 ******** 2021-03-25T14:11:13.398 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:11:13.421 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:13 +0000 (0:00:00.103) 0:03:45.885 ******** 2021-03-25T14:11:13.490 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-03-25T14:11:13.491 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:11:13.513 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:13 +0000 (0:00:00.092) 0:03:45.977 ******** 2021-03-25T14:11:13.522 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-03-25T14:11:13.522 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2021-03-25T14:11:13.549 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:13 +0000 (0:00:00.035) 0:03:46.013 ******** 2021-03-25T14:11:13.778 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2021-03-25T14:11:13.802 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:13 +0000 (0:00:00.252) 0:03:46.265 ******** 2021-03-25T14:11:14.125 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-03-25T14:11:14.126 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2021-03-25T14:11:14.148 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:14 +0000 (0:00:00.346) 0:03:46.612 ******** 2021-03-25T14:11:14.229 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-03-25T14:11:14.230 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi174"}, "changed": false} 2021-03-25T14:11:14.253 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:14 +0000 (0:00:00.105) 0:03:46.717 ******** 2021-03-25T14:11:14.387 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-03-25T14:11:14.388 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2021-03-25T14:11:14.410 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:14 +0000 (0:00:00.157) 0:03:46.874 ******** 2021-03-25T14:11:14.494 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-03-25T14:11:14.495 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi110"}, "changed": false} 2021-03-25T14:11:14.517 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:14 +0000 (0:00:00.106) 0:03:46.981 ******** 2021-03-25T14:11:15.271 INFO:teuthology.task.ansible.out: 2021-03-25T14:11:15.272 INFO:teuthology.task.ansible.out:TASK [testnode : Set the system's hostname] ************************************ ok: [smithi110.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi110", "ansible_hostname": "smithi110", "ansible_nodename": "smithi110"}, "changed": false, "name": "smithi110"} 2021-03-25T14:11:15.299 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:15 +0000 (0:00:00.782) 0:03:47.763 ******** 2021-03-25T14:11:15.307 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi174", "ansible_hostname": "smithi174", "ansible_nodename": "smithi174"}, "changed": false, "name": "smithi174"} 2021-03-25T14:11:15.331 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:15 +0000 (0:00:00.032) 0:03:47.795 ******** 2021-03-25T14:11:15.845 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-03-25T14:11:15.847 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} ok: [smithi110.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2021-03-25T14:11:15.869 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:15 +0000 (0:00:00.537) 0:03:48.333 ******** 2021-03-25T14:11:15.893 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:15 +0000 (0:00:00.024) 0:03:48.357 ******** 2021-03-25T14:11:16.353 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-03-25T14:11:16.354 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2021-03-25T14:11:16.395 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:16 +0000 (0:00:00.502) 0:03:48.859 ******** 2021-03-25T14:11:16.405 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2021-03-25T14:11:16.430 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:16 +0000 (0:00:00.034) 0:03:48.894 ******** 2021-03-25T14:11:17.027 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-03-25T14:11:17.028 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-03-25T14:11:17.050 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:17 +0000 (0:00:00.620) 0:03:49.514 ******** 2021-03-25T14:11:17.068 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-03-25T14:11:17.095 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:17 +0000 (0:00:00.045) 0:03:49.559 ******** 2021-03-25T14:11:17.554 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-03-25T14:11:17.556 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2021-03-25T14:11:17.582 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:17 +0000 (0:00:00.486) 0:03:50.045 ******** 2021-03-25T14:11:17.615 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2021-03-25T14:11:17.640 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:17 +0000 (0:00:00.058) 0:03:50.104 ******** 2021-03-25T14:11:17.842 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-03-25T14:11:17.843 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2021-03-25T14:11:17.870 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:17 +0000 (0:00:00.229) 0:03:50.334 ******** 2021-03-25T14:11:17.920 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2021-03-25T14:11:17.945 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:17 +0000 (0:00:00.074) 0:03:50.408 ******** 2021-03-25T14:11:18.142 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-03-25T14:11:18.143 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2021-03-25T14:11:18.167 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:18 +0000 (0:00:00.222) 0:03:50.631 ******** 2021-03-25T14:11:18.218 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2021-03-25T14:11:18.254 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:18 +0000 (0:00:00.086) 0:03:50.718 ******** 2021-03-25T14:11:18.433 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-03-25T14:11:18.434 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1236, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-03-25T14:11:18.456 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:18 +0000 (0:00:00.202) 0:03:50.920 ******** 2021-03-25T14:11:18.570 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1236, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-03-25T14:11:18.593 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:18 +0000 (0:00:00.136) 0:03:51.057 ******** 2021-03-25T14:11:19.002 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-03-25T14:11:19.003 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2021-03-25T14:11:19.027 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:19 +0000 (0:00:00.434) 0:03:51.491 ******** 2021-03-25T14:11:19.161 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2021-03-25T14:11:19.186 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:19 +0000 (0:00:00.157) 0:03:51.649 ******** 2021-03-25T14:11:19.552 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** ok: [smithi110.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2021-03-25T14:11:19.574 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:19 +0000 (0:00:00.389) 0:03:52.038 ******** 2021-03-25T14:11:19.851 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2021-03-25T14:11:19.854 INFO:teuthology.task.ansible.out: 2021-03-25T14:11:19.883 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:19 +0000 (0:00:00.308) 0:03:52.347 ******** 2021-03-25T14:11:21.964 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-03-25T14:11:21.964 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2021-03-25T14:11:21.965 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.029843", "end": "2021-03-25 14:11:21.930035", "rc": 0, "start": "2021-03-25 14:11:19.900192", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-25T14:11:21.998 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:21 +0000 (0:00:02.115) 0:03:54.462 ******** 2021-03-25T14:11:22.084 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-03-25T14:11:22.094 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:11:22.107 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:22 +0000 (0:00:00.108) 0:03:54.571 ******** 2021-03-25T14:11:22.166 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-03-25T14:11:22.167 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.017245", "end": "2021-03-25 14:11:22.136270", "rc": 0, "start": "2021-03-25 14:11:20.119025", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-25T14:11:22.193 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:22 +0000 (0:00:00.085) 0:03:54.657 ******** 2021-03-25T14:11:22.296 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-03-25T14:11:22.298 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:11:22.321 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:22 +0000 (0:00:00.128) 0:03:54.785 ******** 2021-03-25T14:11:22.734 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* ok: [smithi110.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2021-03-25T14:11:22.757 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:22 +0000 (0:00:00.436) 0:03:55.221 ******** 2021-03-25T14:11:22.860 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-03-25T14:11:22.884 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:22 +0000 (0:00:00.126) 0:03:55.348 ******** 2021-03-25T14:11:22.902 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-03-25T14:11:22.903 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2021-03-25T14:11:22.931 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:22 +0000 (0:00:00.047) 0:03:55.395 ******** 2021-03-25T14:11:22.981 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-03-25T14:11:23.007 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:23 +0000 (0:00:00.075) 0:03:55.471 ******** 2021-03-25T14:11:23.015 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-03-25T14:11:23.041 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:23 +0000 (0:00:00.034) 0:03:55.505 ******** 2021-03-25T14:11:23.120 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-03-25T14:11:23.121 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:11:23.143 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:23 +0000 (0:00:00.102) 0:03:55.607 ******** 2021-03-25T14:11:23.151 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-03-25T14:11:23.176 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:23 +0000 (0:00:00.032) 0:03:55.640 ******** 2021-03-25T14:11:23.229 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi110.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-03-25T14:11:23.232 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-03-25T14:11:23.254 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:23 +0000 (0:00:00.077) 0:03:55.718 ******** 2021-03-25T14:11:23.272 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-03-25T14:11:23.274 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:11:23.298 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:23 +0000 (0:00:00.043) 0:03:55.762 ******** 2021-03-25T14:11:23.358 INFO:teuthology.task.ansible.out: 2021-03-25T14:11:23.362 INFO:teuthology.task.ansible.out:TASK [testnode : Clean yum cache] ********************************************** 2021-03-25T14:11:23.364 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:11:23.388 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:23 +0000 (0:00:00.090) 0:03:55.852 ******** 2021-03-25T14:11:23.396 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-03-25T14:11:23.397 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-03-25T14:11:23.399 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-03-25T14:11:23.425 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:23 +0000 (0:00:00.037) 0:03:55.889 ******** 2021-03-25T14:11:23.477 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-25T14:11:23.478 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:11:23.501 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:23 +0000 (0:00:00.075) 0:03:55.964 ******** 2021-03-25T14:11:23.518 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-03-25T14:11:23.520 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:11:23.555 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:23 +0000 (0:00:00.054) 0:03:56.019 ******** 2021-03-25T14:11:23.606 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-03-25T14:11:23.607 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:11:23.629 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:23 +0000 (0:00:00.073) 0:03:56.093 ******** 2021-03-25T14:11:23.647 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-25T14:11:23.649 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:11:23.679 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:23 +0000 (0:00:00.049) 0:03:56.143 ******** 2021-03-25T14:11:23.683 INFO:teuthology.task.ansible.out: 2021-03-25T14:11:23.751 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:11:23.776 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:23 +0000 (0:00:00.096) 0:03:56.240 ******** 2021-03-25T14:11:23.809 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:11:23.842 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:23 +0000 (0:00:00.065) 0:03:56.305 ******** 2021-03-25T14:11:23.928 INFO:teuthology.task.ansible.out: 2021-03-25T14:11:23.929 INFO:teuthology.task.ansible.out:TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:11:23.969 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:23 +0000 (0:00:00.127) 0:03:56.433 ******** 2021-03-25T14:11:24.061 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-03-25T14:11:24.061 INFO:teuthology.task.ansible.out:fatal: [smithi110.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.007224", "end": "2021-03-25 14:11:24.040318", "msg": "non-zero return code", "rc": 1, "start": "2021-03-25 14:11:24.033094", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2021-03-25T14:11:24.085 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:24 +0000 (0:00:00.115) 0:03:56.549 ******** 2021-03-25T14:11:24.167 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-03-25T14:11:24.167 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:11:24.194 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:24 +0000 (0:00:00.109) 0:03:56.658 ******** 2021-03-25T14:11:24.250 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-03-25T14:11:24.251 INFO:teuthology.task.ansible.out:fatal: [smithi174.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.007262", "end": "2021-03-25 14:11:24.224484", "msg": "non-zero return code", "rc": 1, "start": "2021-03-25 14:11:24.217222", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2021-03-25T14:11:24.282 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:24 +0000 (0:00:00.087) 0:03:56.746 ******** 2021-03-25T14:11:24.284 INFO:teuthology.task.ansible.out: 2021-03-25T14:11:24.385 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:11:24.412 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:24 +0000 (0:00:00.129) 0:03:56.876 ******** 2021-03-25T14:11:30.064 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-03-25T14:11:30.066 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64"]} 2021-03-25T14:11:30.088 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:30 +0000 (0:00:05.675) 0:04:02.552 ******** 2021-03-25T14:11:30.587 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64"]} 2021-03-25T14:11:30.611 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:30 +0000 (0:00:00.522) 0:04:03.075 ******** 2021-03-25T14:11:35.910 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-03-25T14:11:35.911 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-10.el8.x86_64", "Removed: boost-random-1.66.0-10.el8.x86_64"]} 2021-03-25T14:11:35.935 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:35 +0000 (0:00:05.323) 0:04:08.399 ******** 2021-03-25T14:11:36.443 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-10.el8.x86_64", "Removed: boost-random-1.66.0-10.el8.x86_64"]} 2021-03-25T14:11:36.468 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:11:36 +0000 (0:00:00.533) 0:04:08.932 ******** 2021-03-25T14:12:09.835 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-03-25T14:12:09.836 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: perl-B-Lint-1.20-11.el8.noarch", "Installed: redhat-lsb-languages-4.1-47.el8.x86_64", "Installed: poppler-utils-0.66.0-27.el8.x86_64", "Installed: libXt-1.1.5-12.el8.x86_64", "Installed: libXmu-1.1.3-1.el8.x86_64", "Installed: cups-1:2.2.6-38.el8.x86_64", "Installed: perl-Text-Unidecode-1.30-5.el8.noarch", "Installed: perl-XML-NamespaceSupport-1.12-4.el8.noarch", "Installed: adobe-mappings-pdf-20180407-1.el8.noarch", "Installed: perl-HTTP-Negotiate-6.01-19.module+el8.3.0+6498+9eecfe51.noarch", "Installed: urw-base35-fonts-20170801-10.el8.noarch", "Installed: perl-XML-SAX-Base-1.09-4.el8.noarch", "Installed: urw-base35-z003-fonts-20170801-10.el8.noarch", "Installed: adobe-mappings-cmap-20171205-3.el8.noarch", "Installed: perl-libwww-perl-6.34-1.module+el8.3.0+6498+9eecfe51.noarch", "Installed: boost-random-1.66.0-10.el8.x86_64", "Installed: cups-filesystem-1:2.2.6-38.el8.noarch", "Installed: qemu-kvm-common-15:4.2.0-34.module+el8.3.0+9903+ca3e42fb.4.x86_64", "Installed: libidn-1.34-5.el8.x86_64", "Installed: qemu-kvm-core-15:4.2.0-34.module+el8.3.0+9903+ca3e42fb.4.x86_64", "Installed: lcms2-2.9-2.el8.x86_64", "Installed: adobe-mappings-cmap-deprecated-20171205-3.el8.noarch", "Installed: perl-Module-Runtime-0.016-2.el8.noarch", "Installed: urw-base35-d050000l-fonts-20170801-10.el8.noarch", "Installed: perl-Class-ISA-0.36-1022.el8.noarch", "Installed: perl-Pod-Plainer-1.04-7.el8.noarch", "Installed: redhat-lsb-desktop-4.1-47.el8.x86_64", "Installed: poppler-data-0.4.9-1.el8.noarch", "Installed: mcpp-2.7.2-20.el8.x86_64", "Installed: urw-base35-c059-fonts-20170801-10.el8.noarch", "Installed: perl-HTTP-Cookies-6.04-2.module+el8.3.0+6498+9eecfe51.noarch", "Installed: urw-base35-bookman-fonts-20170801-10.el8.noarch", "Installed: urw-base35-fonts-common-20170801-10.el8.noarch", "Installed: perl-XML-LibXML-1:2.0132-2.el8.x86_64", "Installed: libijs-0.35-5.el8.x86_64", " 2021-03-25T14:12:09.837 INFO:teuthology.task.ansible.out:Installed: perl-NTLM-1.09-17.module+el8.3.0+6498+9eecfe51.noarch", "Installed: libpaper-1.1.24-22.el8.x86_64", "Installed: libICE-1.0.9-15.el8.x86_64", "Installed: ghostscript-9.25-7.el8.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: perl-Module-Pluggable-2:5.2-7.el8.noarch", "Installed: xorg-x11-server-utils-7.7-27.el8.x86_64", "Installed: qpdf-libs-7.1.1-10.el8.x86_64", "Installed: openjpeg2-2.3.1-6.el8.x86_64", "Installed: poppler-0.66.0-27.el8.x86_64", "Installed: cups-filters-1.20.0-20.el8.x86_64", "Installed: cups-filters-libs-1.20.0-20.el8.x86_64", "Installed: perl-File-CheckTree-4.42-303.el8.noarch", "Installed: perl-Data-Dump-1.23-7.module+el8.3.0+6498+9eecfe51.noarch", "Installed: avahi-0.7-19.el8.x86_64", "Installed: urw-base35-standard-symbols-ps-fonts-20170801-10.el8.noarch", "Installed: perl-Net-HTTP-6.17-2.module+el8.3.0+6498+9eecfe51.noarch", "Installed: google-droid-sans-fonts-20120715-13.el8.noarch", "Installed: urw-base35-nimbus-sans-fonts-20170801-10.el8.noarch", "Installed: avahi-glib-0.7-19.el8.x86_64", "Installed: perl-Try-Tiny-0.30-7.module+el8.3.0+6498+9eecfe51.noarch", "Installed: redhat-lsb-printing-4.1-47.el8.x86_64", "Installed: perl-WWW-RobotRules-6.02-18.module+el8.3.0+6498+9eecfe51.noarch", "Installed: urw-base35-gothic-fonts-20170801-10.el8.noarch", "Installed: perl-Pod-LaTeX-0.61-302.el8.noarch", "Installed: perl-Text-Soundex-3.05-8.el8.x86_64", "Installed: redhat-lsb-submod-multimedia-4.1-47.el8.x86_64", "Installed: libpng12-1.2.57-5.el8.x86_64", "Installed: jbig2dec-libs-0.14-4.el8_2.x86_64", "Installed: cups-ipptool-1:2.2.6-38.el8.x86_64", "Installed: redhat-lsb-cxx-4.1-47.el8.x86_64", "Installed: libSM-1.2.3-1.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: libmcpp-2.7.2-20.el8.x86_64", "Installed: perl-XML-SAX-1.00-1.el8.noarch", "Installed: libgs-9.25-7.el8.x86_64", "Installed: perl-File-Listing-6.04-17.module+el8.3.0+6498+9eecfe51.noarch", "Installed: liberation-mono-fonts-1:2.00.3-7.e 2021-03-25T14:12:09.838 INFO:teuthology.task.ansible.out:l8.noarch", "Installed: urw-base35-nimbus-mono-ps-fonts-20170801-10.el8.noarch", "Installed: mesa-libGLU-9.0.0-15.el8.x86_64", "Installed: liberation-fonts-common-1:2.00.3-7.el8.noarch", "Installed: qemu-kvm-block-rbd-15:4.2.0-34.module+el8.3.0+9903+ca3e42fb.4.x86_64", "Installed: qemu-img-15:4.2.0-34.module+el8.3.0+9903+ca3e42fb.4.x86_64", "Installed: redhat-lsb-4.1-47.el8.x86_64", "Installed: urw-base35-p052-fonts-20170801-10.el8.noarch", "Installed: libXxf86misc-1.0.4-1.el8.x86_64", "Installed: urw-base35-nimbus-roman-fonts-20170801-10.el8.noarch", "Installed: boost-program-options-1.66.0-10.el8.x86_64", "Removed: qemu-img-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64", "Removed: qemu-kvm-common-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64", "Removed: qemu-kvm-core-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64"]} 2021-03-25T14:12:09.863 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:09 +0000 (0:00:33.395) 0:04:42.327 ******** 2021-03-25T14:12:12.532 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-03-25T14:12:12.533 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-03-25T14:12:12.554 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:12 +0000 (0:00:02.690) 0:04:45.018 ******** 2021-03-25T14:12:12.807 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-03-25T14:12:12.808 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: urw-base35-nimbus-mono-ps-fonts-20170801-10.el8.noarch", "Installed: mesa-libGLU-9.0.0-15.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:4.2.0-34.module+el8.3.0+9903+ca3e42fb.4.x86_64", "Installed: qemu-img-15:4.2.0-34.module+el8.3.0+9903+ca3e42fb.4.x86_64", "Installed: redhat-lsb-4.1-47.el8.x86_64", "Installed: urw-base35-p052-fonts-20170801-10.el8.noarch", "Installed: libXxf86misc-1.0.4-1.el8.x86_64", "Installed: urw-base35-nimbus-roman-fonts-20170801-10.el8.noarch", "Installed: libijs-0.35-5.el8.x86_64", "Installed: qemu-kvm-common-15:4.2.0-34.module+el8.3.0+9903+ca3e42fb.4.x86_64", "Installed: qemu-kvm-core-15:4.2.0-34.module+el8.3.0+9903+ca3e42fb.4.x86_64", "Installed: boost-program-options-1.66.0-10.el8.x86_64", "Installed: perl-B-Lint-1.20-11.el8.noarch", "Installed: perl-XML-SAX-1.00-1.el8.noarch", "Installed: redhat-lsb-languages-4.1-47.el8.x86_64", "Installed: libXt-1.1.5-12.el8.x86_64", "Installed: libXmu-1.1.3-1.el8.x86_64", "Installed: cups-1:2.2.6-38.el8.x86_64", "Installed: perl-Text-Unidecode-1.30-5.el8.noarch", "Installed: perl-XML-NamespaceSupport-1.12-4.el8.noarch", "Installed: adobe-mappings-pdf-20180407-1.el8.noarch", "Installed: poppler-utils-0.66.0-27.el8.x86_64", "Installed: perl-HTTP-Negotiate-6.01-19.module+el8.3.0+6498+9eecfe51.noarch", "Installed: urw-base35-fonts-20170801-10.el8.noarch", "Installed: perl-XML-SAX-Base-1.09-4.el8.noarch", "Installed: urw-base35-z003-fonts-20170801-10.el8.noarch", "Installed: adobe-mappings-cmap-20171205-3.el8.noarch", "Installed: perl-libwww-perl-6.34-1.module+el8.3.0+6498+9eecfe51.noarch", "Installed: boost-random-1.66.0-10.el8.x86_64", "Installed: cups-filesystem-1:2.2.6-38.el8.noarch", "Installed: libidn-1.34-5.el8.x86_64", "Installed: avahi-0.7-19.el8.x86_64", "Installed: lcms2-2.9-2.el8.x86_64", "Installed: adobe-mappings-cmap-deprecated-20171205-3.el8.noarch", "Installed: perl-Module-Runtime-0.0 2021-03-25T14:12:12.809 INFO:teuthology.task.ansible.out:16-2.el8.noarch", "Installed: urw-base35-d050000l-fonts-20170801-10.el8.noarch", "Installed: perl-Class-ISA-0.36-1022.el8.noarch", "Installed: perl-Pod-Plainer-1.04-7.el8.noarch", "Installed: redhat-lsb-desktop-4.1-47.el8.x86_64", "Installed: poppler-data-0.4.9-1.el8.noarch", "Installed: mcpp-2.7.2-20.el8.x86_64", "Installed: urw-base35-c059-fonts-20170801-10.el8.noarch", "Installed: perl-HTTP-Cookies-6.04-2.module+el8.3.0+6498+9eecfe51.noarch", "Installed: urw-base35-bookman-fonts-20170801-10.el8.noarch", "Installed: urw-base35-fonts-common-20170801-10.el8.noarch", "Installed: perl-XML-LibXML-1:2.0132-2.el8.x86_64", "Installed: avahi-glib-0.7-19.el8.x86_64", "Installed: perl-NTLM-1.09-17.module+el8.3.0+6498+9eecfe51.noarch", "Installed: libpaper-1.1.24-22.el8.x86_64", "Installed: libICE-1.0.9-15.el8.x86_64", "Installed: ghostscript-9.25-7.el8.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: perl-Module-Pluggable-2:5.2-7.el8.noarch", "Installed: xorg-x11-server-utils-7.7-27.el8.x86_64", "Installed: qpdf-libs-7.1.1-10.el8.x86_64", "Installed: openjpeg2-2.3.1-6.el8.x86_64", "Installed: poppler-0.66.0-27.el8.x86_64", "Installed: cups-filters-1.20.0-20.el8.x86_64", "Installed: liberation-mono-fonts-1:2.00.3-7.el8.noarch", "Installed: perl-File-CheckTree-4.42-303.el8.noarch", "Installed: perl-Data-Dump-1.23-7.module+el8.3.0+6498+9eecfe51.noarch", "Installed: cups-filters-libs-1.20.0-20.el8.x86_64", "Installed: urw-base35-standard-symbols-ps-fonts-20170801-10.el8.noarch", "Installed: perl-Net-HTTP-6.17-2.module+el8.3.0+6498+9eecfe51.noarch", "Installed: google-droid-sans-fonts-20120715-13.el8.noarch", "Installed: urw-base35-nimbus-sans-fonts-20170801-10.el8.noarch", "Installed: liberation-fonts-common-1:2.00.3-7.el8.noarch", "Installed: perl-Try-Tiny-0.30-7.module+el8.3.0+6498+9eecfe51.noarch", "Installed: redhat-lsb-printing-4.1-47.el8.x86_64", "Installed: perl-WWW-RobotRules-6.02-18.module+el8.3.0+6498+9eecfe51.noarch", "Installed: urw-base35-gothic-fo 2021-03-25T14:12:12.811 INFO:teuthology.task.ansible.out:nts-20170801-10.el8.noarch", "Installed: perl-Pod-LaTeX-0.61-302.el8.noarch", "Installed: perl-Text-Soundex-3.05-8.el8.x86_64", "Installed: redhat-lsb-submod-multimedia-4.1-47.el8.x86_64", "Installed: libpng12-1.2.57-5.el8.x86_64", "Installed: jbig2dec-libs-0.14-4.el8_2.x86_64", "Installed: cups-ipptool-1:2.2.6-38.el8.x86_64", "Installed: redhat-lsb-cxx-4.1-47.el8.x86_64", "Installed: libSM-1.2.3-1.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: libmcpp-2.7.2-20.el8.x86_64", "Installed: perl-File-Listing-6.04-17.module+el8.3.0+6498+9eecfe51.noarch", "Installed: libgs-9.25-7.el8.x86_64", "Removed: qemu-img-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64", "Removed: qemu-kvm-common-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64", "Removed: qemu-kvm-core-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64"]} 2021-03-25T14:12:12.843 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:12 +0000 (0:00:00.288) 0:04:45.307 ******** 2021-03-25T14:12:15.221 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-03-25T14:12:15.222 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-03-25T14:12:15.244 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:15 +0000 (0:00:02.400) 0:04:47.708 ******** 2021-03-25T14:12:15.336 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-25T14:12:15.337 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:15.358 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:15 +0000 (0:00:00.114) 0:04:47.822 ******** 2021-03-25T14:12:15.471 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-03-25T14:12:15.473 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-03-25T14:12:15.498 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:15 +0000 (0:00:00.139) 0:04:47.962 ******** 2021-03-25T14:12:15.713 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-03-25T14:12:15.714 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "polkit.service sysinit.target basic.target dbus.socket dbus.service system.slice", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target ebtables.service ipset.service nftables.service ip6tables.service iptables.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "D 2021-03-25T14:12:15.716 INFO:teuthology.task.ansible.out:evicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "Limi 2021-03-25T14:12:15.717 INFO:teuthology.task.ansible.out:tNOFILESoft": "1024", "LimitNPROC": "127237", "LimitNPROCSoft": "127237", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127237", "LimitSIGPENDINGSoft": "127237", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice dbus.socket sysinit.target", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "S 2021-03-25T14:12:15.719 INFO:teuthology.task.ansible.out:tartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "203579", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-25T14:12:15.747 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:15 +0000 (0:00:00.248) 0:04:48.210 ******** 2021-03-25T14:12:16.095 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-03-25T14:12:16.097 INFO:teuthology.task.ansible.out:fatal: [smithi110.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2021-03-25T14:12:16.119 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:16 +0000 (0:00:00.372) 0:04:48.583 ******** 2021-03-25T14:12:16.844 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-03-25T14:12:16.846 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2021-03-25T14:12:16.873 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:16 +0000 (0:00:00.754) 0:04:49.337 ******** 2021-03-25T14:12:16.957 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-03-25T14:12:16.958 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:16.987 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:16 +0000 (0:00:00.114) 0:04:49.451 ******** 2021-03-25T14:12:17.079 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-03-25T14:12:17.080 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:17.105 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:17 +0000 (0:00:00.117) 0:04:49.569 ******** 2021-03-25T14:12:17.188 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-03-25T14:12:17.202 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:17.227 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:17 +0000 (0:00:00.122) 0:04:49.691 ******** 2021-03-25T14:12:17.311 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:17.337 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:17 +0000 (0:00:00.109) 0:04:49.800 ******** 2021-03-25T14:12:17.420 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-03-25T14:12:17.422 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:17.450 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:17 +0000 (0:00:00.114) 0:04:49.914 ******** 2021-03-25T14:12:17.521 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-03-25T14:12:17.523 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:17.547 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:17 +0000 (0:00:00.096) 0:04:50.010 ******** 2021-03-25T14:12:17.637 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-03-25T14:12:17.640 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:17 +0000 (0:00:00.093) 0:04:50.104 ******** 2021-03-25T14:12:17.712 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-03-25T14:12:17.714 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:17.734 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:17 +0000 (0:00:00.094) 0:04:50.198 ******** 2021-03-25T14:12:17.804 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-03-25T14:12:17.806 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:17.826 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:17 +0000 (0:00:00.091) 0:04:50.290 ******** 2021-03-25T14:12:17.947 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* skipping: [smithi110.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-03-25T14:12:17.949 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-03-25T14:12:17.970 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:17 +0000 (0:00:00.143) 0:04:50.434 ******** 2021-03-25T14:12:18.052 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-03-25T14:12:18.053 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:18.078 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:18 +0000 (0:00:00.107) 0:04:50.542 ******** 2021-03-25T14:12:18.169 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-03-25T14:12:18.175 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:18 +0000 (0:00:00.097) 0:04:50.639 ******** 2021-03-25T14:12:18.193 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-03-25T14:12:18.194 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-03-25T14:12:18.217 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:18 +0000 (0:00:00.042) 0:04:50.681 ******** 2021-03-25T14:12:18.257 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-03-25T14:12:18.258 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:18.282 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:18 +0000 (0:00:00.064) 0:04:50.746 ******** 2021-03-25T14:12:18.304 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-25T14:12:18.305 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:18.339 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:18 +0000 (0:00:00.057) 0:04:50.803 ******** 2021-03-25T14:12:18.364 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-03-25T14:12:18.365 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:18.389 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:18 +0000 (0:00:00.049) 0:04:50.853 ******** 2021-03-25T14:12:18.494 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-03-25T14:12:18.503 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:18.519 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:18 +0000 (0:00:00.129) 0:04:50.983 ******** 2021-03-25T14:12:18.591 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-25T14:12:18.603 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:18.614 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:18 +0000 (0:00:00.094) 0:04:51.077 ******** 2021-03-25T14:12:18.684 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-03-25T14:12:18.685 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:18.706 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:18 +0000 (0:00:00.092) 0:04:51.170 ******** 2021-03-25T14:12:18.714 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-03-25T14:12:18.715 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "polkit.service basic.target dbus.socket sysinit.target system.slice dbus.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target iptables.service ebtables.service ip6tables.service ipset.service nftables.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "D 2021-03-25T14:12:18.717 INFO:teuthology.task.ansible.out:evicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "Limi 2021-03-25T14:12:18.718 INFO:teuthology.task.ansible.out:tNOFILESoft": "1024", "LimitNPROC": "127237", "LimitNPROCSoft": "127237", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127237", "LimitSIGPENDINGSoft": "127237", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice dbus.socket sysinit.target", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "S 2021-03-25T14:12:18.719 INFO:teuthology.task.ansible.out:tartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "203580", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-25T14:12:18.742 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:18 +0000 (0:00:00.036) 0:04:51.206 ******** 2021-03-25T14:12:18.744 INFO:teuthology.task.ansible.out: 2021-03-25T14:12:18.782 INFO:teuthology.task.ansible.out: 2021-03-25T14:12:18.783 INFO:teuthology.task.ansible.out:TASK [testnode : Install packages] ********************************************* skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:18.806 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:18 +0000 (0:00:00.063) 0:04:51.270 ******** 2021-03-25T14:12:18.876 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-03-25T14:12:18.878 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:18.900 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:18 +0000 (0:00:00.093) 0:04:51.363 ******** 2021-03-25T14:12:18.995 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-03-25T14:12:18.997 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:19.018 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:19 +0000 (0:00:00.118) 0:04:51.482 ******** 2021-03-25T14:12:19.090 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-03-25T14:12:19.092 INFO:teuthology.task.ansible.out:fatal: [smithi174.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:19.123 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:19 +0000 (0:00:00.104) 0:04:51.586 ******** 2021-03-25T14:12:19.160 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:19 +0000 (0:00:00.037) 0:04:51.624 ******** 2021-03-25T14:12:19.199 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-03-25T14:12:19.200 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:19.223 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:19 +0000 (0:00:00.063) 0:04:51.687 ******** 2021-03-25T14:12:19.294 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-03-25T14:12:19.295 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:19.317 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:19 +0000 (0:00:00.093) 0:04:51.781 ******** 2021-03-25T14:12:19.387 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-03-25T14:12:19.388 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:19.413 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:19 +0000 (0:00:00.095) 0:04:51.877 ******** 2021-03-25T14:12:19.483 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-03-25T14:12:19.485 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:19.506 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:19 +0000 (0:00:00.092) 0:04:51.970 ******** 2021-03-25T14:12:19.513 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-03-25T14:12:19.514 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2021-03-25T14:12:19.537 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:19 +0000 (0:00:00.030) 0:04:52.001 ******** 2021-03-25T14:12:19.575 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-03-25T14:12:19.576 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:19.599 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:19 +0000 (0:00:00.061) 0:04:52.063 ******** 2021-03-25T14:12:19.628 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-03-25T14:12:19.629 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:19.651 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:19 +0000 (0:00:00.052) 0:04:52.115 ******** 2021-03-25T14:12:19.678 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-03-25T14:12:19.679 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:19.701 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:19 +0000 (0:00:00.050) 0:04:52.165 ******** 2021-03-25T14:12:19.729 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-03-25T14:12:19.730 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:19.752 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:19 +0000 (0:00:00.050) 0:04:52.216 ******** 2021-03-25T14:12:19.769 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-03-25T14:12:19.770 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:19.797 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:19 +0000 (0:00:00.045) 0:04:52.261 ******** 2021-03-25T14:12:19.849 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-03-25T14:12:19.850 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:19.872 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:19 +0000 (0:00:00.075) 0:04:52.336 ******** 2021-03-25T14:12:19.893 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-03-25T14:12:19.895 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:19.919 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:19 +0000 (0:00:00.046) 0:04:52.383 ******** 2021-03-25T14:12:19.947 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-03-25T14:12:19.948 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:19.972 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:19 +0000 (0:00:00.052) 0:04:52.435 ******** 2021-03-25T14:12:20.000 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-03-25T14:12:20.001 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:20.026 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:20 +0000 (0:00:00.054) 0:04:52.490 ******** 2021-03-25T14:12:20.044 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-03-25T14:12:20.045 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:20.069 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:20 +0000 (0:00:00.042) 0:04:52.533 ******** 2021-03-25T14:12:20.097 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-03-25T14:12:20.098 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:20.121 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:20 +0000 (0:00:00.051) 0:04:52.585 ******** 2021-03-25T14:12:20.138 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-03-25T14:12:20.140 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:20.163 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:20 +0000 (0:00:00.041) 0:04:52.626 ******** 2021-03-25T14:12:20.191 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-03-25T14:12:20.192 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:20.215 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:20 +0000 (0:00:00.052) 0:04:52.679 ******** 2021-03-25T14:12:20.233 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-03-25T14:12:20.258 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:20 +0000 (0:00:00.042) 0:04:52.722 ******** 2021-03-25T14:12:20.287 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-03-25T14:12:20.289 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:20.314 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:20 +0000 (0:00:00.055) 0:04:52.778 ******** 2021-03-25T14:12:20.334 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-03-25T14:12:20.335 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:20.360 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:20 +0000 (0:00:00.045) 0:04:52.824 ******** 2021-03-25T14:12:20.388 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-03-25T14:12:20.390 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:20.413 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:20 +0000 (0:00:00.053) 0:04:52.877 ******** 2021-03-25T14:12:20.453 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-03-25T14:12:20.454 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:20.479 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:20 +0000 (0:00:00.065) 0:04:52.943 ******** 2021-03-25T14:12:20.498 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-03-25T14:12:20.499 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:20.523 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:20 +0000 (0:00:00.043) 0:04:52.987 ******** 2021-03-25T14:12:20.561 INFO:teuthology.task.ansible.out: 2021-03-25T14:12:20.563 INFO:teuthology.task.ansible.out:TASK [testnode : Install apt keys] ********************************************* skipping: [smithi174.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-03-25T14:12:20.587 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:20 +0000 (0:00:00.063) 0:04:53.051 ******** 2021-03-25T14:12:20.604 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:20.628 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:20 +0000 (0:00:00.041) 0:04:53.092 ******** 2021-03-25T14:12:20.656 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-03-25T14:12:20.657 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:20.682 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:20 +0000 (0:00:00.053) 0:04:53.146 ******** 2021-03-25T14:12:20.722 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-03-25T14:12:20.723 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:20.746 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:20 +0000 (0:00:00.063) 0:04:53.210 ******** 2021-03-25T14:12:20.764 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-03-25T14:12:20.790 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:20 +0000 (0:00:00.044) 0:04:53.254 ******** 2021-03-25T14:12:20.829 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-03-25T14:12:20.830 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:20.854 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:20 +0000 (0:00:00.064) 0:04:53.318 ******** 2021-03-25T14:12:20.873 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:20.905 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:20 +0000 (0:00:00.050) 0:04:53.369 ******** 2021-03-25T14:12:20.933 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-25T14:12:20.935 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:20.964 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:20 +0000 (0:00:00.058) 0:04:53.428 ******** 2021-03-25T14:12:20.985 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-03-25T14:12:20.987 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:21.011 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:21 +0000 (0:00:00.046) 0:04:53.475 ******** 2021-03-25T14:12:21.029 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-03-25T14:12:21.031 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:21.055 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:21 +0000 (0:00:00.044) 0:04:53.519 ******** 2021-03-25T14:12:21.084 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-03-25T14:12:21.085 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:21.109 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:21 +0000 (0:00:00.053) 0:04:53.572 ******** 2021-03-25T14:12:21.127 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:21.154 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:21 +0000 (0:00:00.045) 0:04:53.618 ******** 2021-03-25T14:12:21.183 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-25T14:12:21.184 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:21.214 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:21 +0000 (0:00:00.059) 0:04:53.678 ******** 2021-03-25T14:12:21.232 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-25T14:12:21.234 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:21.257 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:21 +0000 (0:00:00.042) 0:04:53.721 ******** 2021-03-25T14:12:21.285 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-03-25T14:12:21.286 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:21.308 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:21 +0000 (0:00:00.051) 0:04:53.772 ******** 2021-03-25T14:12:21.325 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-25T14:12:21.327 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:21.358 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:21 +0000 (0:00:00.049) 0:04:53.822 ******** 2021-03-25T14:12:21.378 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-03-25T14:12:21.379 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:21.403 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:21 +0000 (0:00:00.045) 0:04:53.867 ******** 2021-03-25T14:12:21.431 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-03-25T14:12:21.432 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:21.455 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:21 +0000 (0:00:00.051) 0:04:53.919 ******** 2021-03-25T14:12:21.473 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-03-25T14:12:21.475 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:21.497 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:21 +0000 (0:00:00.042) 0:04:53.961 ******** 2021-03-25T14:12:21.526 INFO:teuthology.task.ansible.out: 2021-03-25T14:12:21.527 INFO:teuthology.task.ansible.out:TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:21.556 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:21 +0000 (0:00:00.056) 0:04:54.018 ******** 2021-03-25T14:12:21.597 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:21.620 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:21 +0000 (0:00:00.066) 0:04:54.084 ******** 2021-03-25T14:12:21.622 INFO:teuthology.task.ansible.out: 2021-03-25T14:12:21.640 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-03-25T14:12:21.640 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:21.675 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:21 +0000 (0:00:00.054) 0:04:54.139 ******** 2021-03-25T14:12:21.694 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-03-25T14:12:21.695 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:21.718 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:21 +0000 (0:00:00.042) 0:04:54.182 ******** 2021-03-25T14:12:21.745 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-25T14:12:21.747 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:21.769 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:21 +0000 (0:00:00.051) 0:04:54.233 ******** 2021-03-25T14:12:21.787 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-03-25T14:12:21.788 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:21.811 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:21 +0000 (0:00:00.041) 0:04:54.275 ******** 2021-03-25T14:12:21.850 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-25T14:12:21.852 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:21.875 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:21 +0000 (0:00:00.063) 0:04:54.339 ******** 2021-03-25T14:12:21.897 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:21.923 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:21 +0000 (0:00:00.047) 0:04:54.387 ******** 2021-03-25T14:12:21.951 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-25T14:12:21.952 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:21.977 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:21 +0000 (0:00:00.054) 0:04:54.441 ******** 2021-03-25T14:12:21.998 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-03-25T14:12:21.999 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:22.022 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:22 +0000 (0:00:00.044) 0:04:54.486 ******** 2021-03-25T14:12:22.049 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-25T14:12:22.051 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:22.078 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:22 +0000 (0:00:00.056) 0:04:54.542 ******** 2021-03-25T14:12:22.096 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-03-25T14:12:22.098 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:22.124 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:22 +0000 (0:00:00.045) 0:04:54.588 ******** 2021-03-25T14:12:22.152 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-25T14:12:22.154 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:22.177 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:22 +0000 (0:00:00.053) 0:04:54.641 ******** 2021-03-25T14:12:22.195 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-03-25T14:12:22.197 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:22.219 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:22 +0000 (0:00:00.042) 0:04:54.683 ******** 2021-03-25T14:12:22.248 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-25T14:12:22.249 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:22.275 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:22 +0000 (0:00:00.055) 0:04:54.739 ******** 2021-03-25T14:12:22.296 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-03-25T14:12:22.297 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:22.322 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:22 +0000 (0:00:00.046) 0:04:54.786 ******** 2021-03-25T14:12:22.350 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-03-25T14:12:22.351 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:22.374 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:22 +0000 (0:00:00.052) 0:04:54.838 ******** 2021-03-25T14:12:22.394 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:22.421 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:22 +0000 (0:00:00.045) 0:04:54.884 ******** 2021-03-25T14:12:22.455 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:22.478 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:22 +0000 (0:00:00.058) 0:04:54.942 ******** 2021-03-25T14:12:22.507 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-03-25T14:12:22.509 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:22.531 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:22 +0000 (0:00:00.052) 0:04:54.995 ******** 2021-03-25T14:12:22.559 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-03-25T14:12:22.560 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:22.583 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:22 +0000 (0:00:00.051) 0:04:55.046 ******** 2021-03-25T14:12:22.612 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-03-25T14:12:22.613 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:22.637 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:22 +0000 (0:00:00.054) 0:04:55.101 ******** 2021-03-25T14:12:22.656 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-03-25T14:12:22.658 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:22.683 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:22 +0000 (0:00:00.045) 0:04:55.147 ******** 2021-03-25T14:12:22.714 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-03-25T14:12:22.716 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:22.739 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:22 +0000 (0:00:00.055) 0:04:55.203 ******** 2021-03-25T14:12:22.767 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-03-25T14:12:22.769 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:22.792 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:22 +0000 (0:00:00.053) 0:04:55.256 ******** 2021-03-25T14:12:22.823 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-03-25T14:12:22.824 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:22.857 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:22 +0000 (0:00:00.064) 0:04:55.321 ******** 2021-03-25T14:12:22.889 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-03-25T14:12:22.890 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:22.916 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:22 +0000 (0:00:00.058) 0:04:55.380 ******** 2021-03-25T14:12:22.945 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-03-25T14:12:22.947 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:22.969 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:22 +0000 (0:00:00.053) 0:04:55.433 ******** 2021-03-25T14:12:22.997 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-03-25T14:12:22.999 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:23.024 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:23 +0000 (0:00:00.054) 0:04:55.487 ******** 2021-03-25T14:12:23.065 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-03-25T14:12:23.067 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:23.090 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:23 +0000 (0:00:00.065) 0:04:55.553 ******** 2021-03-25T14:12:23.092 INFO:teuthology.task.ansible.out: 2021-03-25T14:12:23.108 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-03-25T14:12:23.109 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:23.132 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:23 +0000 (0:00:00.042) 0:04:55.596 ******** 2021-03-25T14:12:23.171 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-03-25T14:12:23.172 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:23.196 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:23 +0000 (0:00:00.063) 0:04:55.660 ******** 2021-03-25T14:12:23.216 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:23.240 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:23 +0000 (0:00:00.043) 0:04:55.704 ******** 2021-03-25T14:12:23.268 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-25T14:12:23.270 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:23.298 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:23 +0000 (0:00:00.058) 0:04:55.762 ******** 2021-03-25T14:12:23.327 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-03-25T14:12:23.328 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:23.354 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:23 +0000 (0:00:00.055) 0:04:55.818 ******** 2021-03-25T14:12:23.385 INFO:teuthology.task.ansible.out: 2021-03-25T14:12:23.385 INFO:teuthology.task.ansible.out:TASK [testnode : Remove packages] ********************************************** 2021-03-25T14:12:23.387 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:23.411 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:23 +0000 (0:00:00.057) 0:04:55.875 ******** 2021-03-25T14:12:23.430 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-03-25T14:12:23.431 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:23.455 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:23 +0000 (0:00:00.043) 0:04:55.919 ******** 2021-03-25T14:12:23.486 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-03-25T14:12:23.488 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:23.513 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:23 +0000 (0:00:00.057) 0:04:55.977 ******** 2021-03-25T14:12:23.541 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-03-25T14:12:23.543 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:23.565 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:23 +0000 (0:00:00.051) 0:04:56.029 ******** 2021-03-25T14:12:23.583 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-25T14:12:23.585 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:23.611 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:23 +0000 (0:00:00.045) 0:04:56.074 ******** 2021-03-25T14:12:23.641 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-03-25T14:12:23.643 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:23.665 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:23 +0000 (0:00:00.054) 0:04:56.129 ******** 2021-03-25T14:12:23.682 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-03-25T14:12:23.682 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:23.706 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:23 +0000 (0:00:00.041) 0:04:56.170 ******** 2021-03-25T14:12:23.745 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-25T14:12:23.747 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-03-25T14:12:23.769 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:23 +0000 (0:00:00.062) 0:04:56.233 ******** 2021-03-25T14:12:23.787 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-25T14:12:23.788 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:23.812 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:23 +0000 (0:00:00.042) 0:04:56.276 ******** 2021-03-25T14:12:23.861 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-03-25T14:12:23.862 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-03-25T14:12:23.883 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-03-25T14:12:23.884 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi110.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:23.884 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi110.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-03-25T14:12:23.907 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:23 +0000 (0:00:00.095) 0:04:56.371 ******** 2021-03-25T14:12:23.923 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} skipping: [smithi110.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-03-25T14:12:23.956 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:23 +0000 (0:00:00.049) 0:04:56.420 ******** 2021-03-25T14:12:23.995 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-25T14:12:23.997 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:24.021 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:24 +0000 (0:00:00.064) 0:04:56.485 ******** 2021-03-25T14:12:24.115 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:24.138 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:24 +0000 (0:00:00.117) 0:04:56.602 ******** 2021-03-25T14:12:24.220 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-03-25T14:12:24.221 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.005195", "end": "2021-03-25 14:12:24.193608", "rc": 0, "start": "2021-03-25 14:12:24.188413", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/bin/teuthology-lock"]} 2021-03-25T14:12:24.246 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:24 +0000 (0:00:00.107) 0:04:56.710 ******** 2021-03-25T14:12:24.255 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-03-25T14:12:24.255 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:24.282 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:24 +0000 (0:00:00.035) 0:04:56.745 ******** 2021-03-25T14:12:24.331 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-03-25T14:12:24.333 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:24.360 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:24 +0000 (0:00:00.077) 0:04:56.823 ******** 2021-03-25T14:12:24.379 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-03-25T14:12:24.382 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:24.406 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:24 +0000 (0:00:00.046) 0:04:56.870 ******** 2021-03-25T14:12:24.440 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-03-25T14:12:24.441 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:24.469 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:24 +0000 (0:00:00.063) 0:04:56.933 ******** 2021-03-25T14:12:24.498 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:24.529 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:24 +0000 (0:00:00.059) 0:04:56.992 ******** 2021-03-25T14:12:24.558 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-03-25T14:12:24.560 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:24.584 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:24 +0000 (0:00:00.055) 0:04:57.047 ******** 2021-03-25T14:12:24.612 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-25T14:12:24.613 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:24.637 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:24 +0000 (0:00:00.053) 0:04:57.101 ******** 2021-03-25T14:12:24.659 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-03-25T14:12:24.661 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:24.685 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:24 +0000 (0:00:00.047) 0:04:57.149 ******** 2021-03-25T14:12:24.718 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:24.743 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:24 +0000 (0:00:00.058) 0:04:57.207 ******** 2021-03-25T14:12:24.815 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-25T14:12:24.816 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:24.839 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:24 +0000 (0:00:00.095) 0:04:57.303 ******** 2021-03-25T14:12:24.908 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-25T14:12:24.910 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:24.930 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:24 +0000 (0:00:00.091) 0:04:57.394 ******** 2021-03-25T14:12:25.000 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-25T14:12:25.001 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:25.024 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:25 +0000 (0:00:00.094) 0:04:57.488 ******** 2021-03-25T14:12:25.094 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-03-25T14:12:25.096 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:25.117 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:25 +0000 (0:00:00.092) 0:04:57.581 ******** 2021-03-25T14:12:25.186 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-03-25T14:12:25.187 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:25.208 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:25 +0000 (0:00:00.091) 0:04:57.672 ******** 2021-03-25T14:12:25.288 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-03-25T14:12:25.289 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:25.314 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:25 +0000 (0:00:00.104) 0:04:57.776 ******** 2021-03-25T14:12:25.384 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-03-25T14:12:25.386 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:25.407 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:25 +0000 (0:00:00.094) 0:04:57.871 ******** 2021-03-25T14:12:25.478 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-03-25T14:12:25.480 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:25.501 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:25 +0000 (0:00:00.093) 0:04:57.965 ******** 2021-03-25T14:12:25.572 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-03-25T14:12:25.595 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:25.597 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:25 +0000 (0:00:00.095) 0:04:58.060 ******** 2021-03-25T14:12:25.669 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-03-25T14:12:25.679 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:25.696 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:25 +0000 (0:00:00.099) 0:04:58.159 ******** 2021-03-25T14:12:25.765 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-03-25T14:12:25.766 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:25.787 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:25 +0000 (0:00:00.092) 0:04:58.251 ******** 2021-03-25T14:12:25.858 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-03-25T14:12:25.859 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:25.880 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:25 +0000 (0:00:00.092) 0:04:58.344 ******** 2021-03-25T14:12:25.960 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-03-25T14:12:25.962 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:25.985 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:25 +0000 (0:00:00.104) 0:04:58.448 ******** 2021-03-25T14:12:26.054 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-03-25T14:12:26.121 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Thursday 25 March 2021 14:12:26 +0000 (0:00:00.098) 0:04:58.547 ******** 2021-03-25T14:12:26.179 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-03-25T14:12:26.204 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Thursday 25 March 2021 14:12:26 +0000 (0:00:00.118) 0:04:58.666 ******** 2021-03-25T14:12:26.294 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-03-25T14:12:26.295 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:26.316 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:26 +0000 (0:00:00.114) 0:04:58.780 ******** 2021-03-25T14:12:26.397 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-25T14:12:26.399 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-03-25T14:12:26.420 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:26 +0000 (0:00:00.103) 0:04:58.884 ******** 2021-03-25T14:12:26.511 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-03-25T14:12:26.512 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-03-25T14:12:26.522 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-03-25T14:12:26.533 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-03-25T14:12:26.544 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-03-25T14:12:26.555 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-03-25T14:12:26.566 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-03-25T14:12:26.641 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} Thursday 25 March 2021 14:12:26 +0000 (0:00:00.181) 0:04:59.066 ******** 2021-03-25T14:12:26.871 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-03-25T14:12:26.873 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004193", "end": "2021-03-25 14:12:26.841343", "rc": 0, "start": "2021-03-25 14:12:26.837150", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/bin/teuthology-lock"]} 2021-03-25T14:12:26.896 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:26 +0000 (0:00:00.294) 0:04:59.360 ******** 2021-03-25T14:12:26.976 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-03-25T14:12:26.977 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:27.001 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:26 +0000 (0:00:00.104) 0:04:59.465 ******** 2021-03-25T14:12:27.081 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-03-25T14:12:27.083 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:27.104 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:27 +0000 (0:00:00.102) 0:04:59.568 ******** 2021-03-25T14:12:27.184 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-03-25T14:12:27.185 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:27.210 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:27 +0000 (0:00:00.105) 0:04:59.674 ******** 2021-03-25T14:12:27.279 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-03-25T14:12:27.281 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make sure rpm dependencies are installed] ********************* ok: [smithi110.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-03-25T14:12:27.303 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:27 +0000 (0:00:00.093) 0:04:59.767 ******** 2021-03-25T14:12:27.324 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:27 +0000 (0:00:00.020) 0:04:59.787 ******** 2021-03-25T14:12:27.385 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-03-25T14:12:27.389 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930419154944, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227153114, 'block_used': 12941994, 'inode_total': 61054976, 'inode_available': 60986959, 'inode_used': 68017, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227153114, "block_size": 4096, "block_total": 240095108, "block_used": 12941994, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986959, "inode_total": 61054976, "inode_used": 68017, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930419154944, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}} 2021-03-25T14:12:27.411 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:27 +0000 (0:00:00.087) 0:04:59.875 ******** 2021-03-25T14:12:27.642 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-03-25T14:12:27.643 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.004996", "end": "2021-03-25 14:12:27.621727", "rc": 0, "start": "2021-03-25 14:12:27.616731", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-25T14:12:27.665 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:27 +0000 (0:00:00.254) 0:05:00.129 ******** 2021-03-25T14:12:27.759 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-03-25T14:12:27.761 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930419154944, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227153114, 'block_used': 12941994, 'inode_total': 61054976, 'inode_available': 60986959, 'inode_used': 68017, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227153114, "block_size": 4096, "block_total": 240095108, "block_used": 12941994, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986959, "inode_total": 61054976, "inode_used": 68017, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930419154944, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:27.784 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:27 +0000 (0:00:00.118) 0:05:00.248 ******** 2021-03-25T14:12:27.856 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-03-25T14:12:27.879 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:27 +0000 (0:00:00.095) 0:05:00.343 ******** 2021-03-25T14:12:29.975 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-03-25T14:12:29.976 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-03-25T14:12:29.999 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:29 +0000 (0:00:02.120) 0:05:02.463 ******** 2021-03-25T14:12:30.091 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-03-25T14:12:30.092 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930419159040, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227153115, 'block_used': 12941993, 'inode_total': 61054976, 'inode_available': 60986959, 'inode_used': 68017, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227153115, "block_size": 4096, "block_total": 240095108, "block_used": 12941993, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986959, "inode_total": 61054976, "inode_used": 68017, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930419159040, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}} 2021-03-25T14:12:30.118 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:30 +0000 (0:00:00.118) 0:05:02.582 ******** 2021-03-25T14:12:30.127 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-03-25T14:12:30.128 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-CytXFhirqCmeAaLE2XqyZOUul22ayI1V7cpVoegewUxkBwY4eGzpQ6szi6XdguEJ'], 'uuids': ['acece024-57c0-4e37-8662-68332eeb413d'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.954344", "end": "2021-03-25 14:12:30.078728", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-CytXFhirqCmeAaLE2XqyZOUul22ayI1V7cpVoegewUxkBwY4eGzpQ6szi6XdguEJ"], "labels": [], "masters": [], "uuids": ["acece024-57c0-4e37-8662-68332eeb413d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-25 14:12:28.124384", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-25T14:12:30.350 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-03-25T14:12:30.352 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005040", "end": "2021-03-25 14:12:30.330142", "rc": 0, "start": "2021-03-25 14:12:30.325102", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-25T14:12:30.373 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:30 +0000 (0:00:00.255) 0:05:02.837 ******** 2021-03-25T14:12:30.454 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** skipping: [smithi174.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930419159040, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227153115, 'block_used': 12941993, 'inode_total': 61054976, 'inode_available': 60986959, 'inode_used': 68017, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227153115, "block_size": 4096, "block_total": 240095108, "block_used": 12941993, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986959, "inode_total": 61054976, "inode_used": 68017, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930419159040, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:30.476 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:30 +0000 (0:00:00.102) 0:05:02.940 ******** 2021-03-25T14:12:30.546 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-03-25T14:12:30.569 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:30 +0000 (0:00:00.093) 0:05:03.033 ******** 2021-03-25T14:12:31.398 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-03-25T14:12:31.399 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-QRJQRk-wwe9-UUcD-OQmB-sxxK-eu6Z-IAoeXP', 'nvme-INTEL_SSDPED1D480GA_PHMB7476002T480DGN', 'nvme-nvme.8086-50484d42373437363030325434383044474e-494e54454c2053534450454431443438304741-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPED1D480GA', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '937703088', 'sectorsize': '512', 'size': '447.13 GB', 'host': 'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.105550", "end": "2021-03-25 14:12:31.368681", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-QRJQRk-wwe9-UUcD-OQmB-sxxK-eu6Z-IAoeXP", "nvme-INTEL_SSDPED1D480GA_PHMB7476002T480DGN", "nvme-nvme.8086-50484d42373437363030325434383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-25 14:12:30.263131", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now pa 2021-03-25T14:12:31.400 INFO:teuthology.task.ansible.out:rtition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-25T14:12:32.615 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-zDm5rsLgrKA7boxQjDZNaqqKFAMMJxYVJZeYwBHNE04sBb6H1e1XeCx6xFrPeBqj'], 'uuids': ['2a4fb96a-92b0-40d2-a48f-e8a1fa7a26fa'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.795963", "end": "2021-03-25 14:12:32.587016", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-zDm5rsLgrKA7boxQjDZNaqqKFAMMJxYVJZeYwBHNE04sBb6H1e1XeCx6xFrPeBqj"], "labels": [], "masters": [], "uuids": ["2a4fb96a-92b0-40d2-a48f-e8a1fa7a26fa"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-25 14:12:30.791053", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-25T14:12:32.638 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-CytXFhirqCmeAaLE2XqyZOUul22ayI1Vdb2FE35O2d4FtQdf8D9wVBnsP3kadxSM'], 'uuids': ['6c7f2ad1-7416-4c48-8e7a-931c940bdbb0'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.055287", "end": "2021-03-25 14:12:32.608532", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-CytXFhirqCmeAaLE2XqyZOUul22ayI1Vdb2FE35O2d4FtQdf8D9wVBnsP3kadxSM"], "labels": [], "masters": [], "uuids": ["6c7f2ad1-7416-4c48-8e7a-931c940bdbb0"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-25 14:12:31.553245", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-25T14:12:33.860 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-NPFNFl-pszK-yCIy-ssLc-MjmK-3RhD-FLZqos', 'nvme-INTEL_SSDPEDMD400G4_PHFT62050074400BGN', 'nvme-nvme.8086-50484654363230353030373434303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.056353", "end": "2021-03-25 14:12:33.827956", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-NPFNFl-pszK-yCIy-ssLc-MjmK-3RhD-FLZqos", "nvme-INTEL_SSDPEDMD400G4_PHFT62050074400BGN", "nvme-nvme.8086-50484654363230353030373434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-25 14:12:32.771603", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2021-03-25T14:12:33.862 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-25T14:12:33.893 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-CytXFhirqCmeAaLE2XqyZOUul22ayI1VFSCYbEcVfdEZLnILEApiqaWIL5uyQyuF'], 'uuids': ['26cabb02-3244-461f-beb9-0e9bf8a664ed'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.061128", "end": "2021-03-25 14:12:33.858645", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-CytXFhirqCmeAaLE2XqyZOUul22ayI1VFSCYbEcVfdEZLnILEApiqaWIL5uyQyuF"], "labels": [], "masters": [], "uuids": ["26cabb02-3244-461f-beb9-0e9bf8a664ed"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-25 14:12:32.797517", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-25T14:12:35.117 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-zDm5rsLgrKA7boxQjDZNaqqKFAMMJxYVmOg8q7S7KG10C2FXgrDma3MvxWtdvKxP'], 'uuids': ['68be944f-f7be-4a32-8ba6-9c25b10b7475'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.062261", "end": "2021-03-25 14:12:35.086232", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-zDm5rsLgrKA7boxQjDZNaqqKFAMMJxYVmOg8q7S7KG10C2FXgrDma3MvxWtdvKxP"], "labels": [], "masters": [], "uuids": ["68be944f-f7be-4a32-8ba6-9c25b10b7475"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-25 14:12:34.023971", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-25T14:12:35.150 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-CytXFhirqCmeAaLE2XqyZOUul22ayI1VpFpPgR1Y628Fv5tjeQSg2aQKAihMlzyR'], 'uuids': ['bc09dcf9-cad5-4bc5-a192-03a52a9d549e'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.072664", "end": "2021-03-25 14:12:35.116668", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-CytXFhirqCmeAaLE2XqyZOUul22ayI1VpFpPgR1Y628Fv5tjeQSg2aQKAihMlzyR"], "labels": [], "masters": [], "uuids": ["bc09dcf9-cad5-4bc5-a192-03a52a9d549e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-25 14:12:34.044004", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-25T14:12:35.152 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QFRD', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5QFRD', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5QFRD', 'scsi-35000c50091dfc3c1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5QFRD', 'wwn-0x5000c50091dfc3c1'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5QFRD', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50091dfc3c1', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QFRD-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5QFRD-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5QFRD-part1', 'scsi-35000c50091dfc3c1-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5QFRD-part1', 'wwn-0x5000c50091dfc3c1-part1'], 'uuids': ['782d0384-b480-44b3-9c95-fe95daf886ae'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QFRD", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5QFRD", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5QFRD", "scsi-35000c50091dfc3c1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5QFRD", "wwn-0x5000c50091dfc3c1"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QFRD-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5QFRD-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2021-03-25T14:12:35.154 INFO:teuthology.task.ansible.out:Z1W5QFRD-part1", "scsi-35000c50091dfc3c1-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5QFRD-part1", "wwn-0x5000c50091dfc3c1-part1"], "labels": [], "masters": [], "uuids": ["782d0384-b480-44b3-9c95-fe95daf886ae"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QFRD", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091dfc3c1"}}, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:36.398 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-zDm5rsLgrKA7boxQjDZNaqqKFAMMJxYVDy9eXrwgV4HpDejyjWjLvkf1aDAXSoYI'], 'uuids': ['7d66f161-8c42-4e4d-afe4-f2c10c2706c2'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.093472", "end": "2021-03-25 14:12:36.365727", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-zDm5rsLgrKA7boxQjDZNaqqKFAMMJxYVDy9eXrwgV4HpDejyjWjLvkf1aDAXSoYI"], "labels": [], "masters": [], "uuids": ["7d66f161-8c42-4e4d-afe4-f2c10c2706c2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-25 14:12:35.272255", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-25T14:12:36.409 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-CytXFhirqCmeAaLE2XqyZOUul22ayI1V1S27cds4Vd8Jx8GygpwGhymyPJMMiha2'], 'uuids': ['18aff782-e523-4449-b237-e38160a3aea4'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.062284", "end": "2021-03-25 14:12:36.375452", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-CytXFhirqCmeAaLE2XqyZOUul22ayI1V1S27cds4Vd8Jx8GygpwGhymyPJMMiha2"], "labels": [], "masters": [], "uuids": ["18aff782-e523-4449-b237-e38160a3aea4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-25 14:12:35.313168", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-25T14:12:36.438 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:36 +0000 (0:00:05.868) 0:05:08.902 ******** 2021-03-25T14:12:36.795 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-03-25T14:12:36.797 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-CytXFhirqCmeAaLE2XqyZOUul22ayI1V7cpVoegewUxkBwY4eGzpQ6szi6XdguEJ'], 'uuids': ['acece024-57c0-4e37-8662-68332eeb413d'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.096150", "end": "2021-03-25 14:12:36.766656", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-CytXFhirqCmeAaLE2XqyZOUul22ayI1V7cpVoegewUxkBwY4eGzpQ6szi6XdguEJ"], "labels": [], "masters": [], "uuids": ["acece024-57c0-4e37-8662-68332eeb413d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-25 14:12:36.670506", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0935241 s, 1.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0935241 s, 1.2 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-25T14:12:37.008 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-QRJQRk-wwe9-UUcD-OQmB-sxxK-eu6Z-IAoeXP', 'nvme-INTEL_SSDPED1D480GA_PHMB7476002T480DGN', 'nvme-nvme.8086-50484d42373437363030325434383044474e-494e54454c2053534450454431443438304741-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPED1D480GA', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '937703088', 'sectorsize': '512', 'size': '447.13 GB', 'host': 'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.037632", "end": "2021-03-25 14:12:36.977834", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-QRJQRk-wwe9-UUcD-OQmB-sxxK-eu6Z-IAoeXP", "nvme-INTEL_SSDPED1D480GA_PHMB7476002T480DGN", "nvme-nvme.8086-50484d42373437363030325434383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-25 14:12:36.940202", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0349272 s, 3.3 GB/s", "stderr_lines": [" 2021-03-25T14:12:37.008 INFO:teuthology.task.ansible.out:110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0349272 s, 3.3 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-25T14:12:37.273 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-CytXFhirqCmeAaLE2XqyZOUul22ayI1Vdb2FE35O2d4FtQdf8D9wVBnsP3kadxSM'], 'uuids': ['6c7f2ad1-7416-4c48-8e7a-931c940bdbb0'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.096549", "end": "2021-03-25 14:12:37.242562", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-CytXFhirqCmeAaLE2XqyZOUul22ayI1Vdb2FE35O2d4FtQdf8D9wVBnsP3kadxSM"], "labels": [], "masters": [], "uuids": ["6c7f2ad1-7416-4c48-8e7a-931c940bdbb0"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-25 14:12:37.146013", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0939657 s, 1.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0939657 s, 1.2 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-25T14:12:37.538 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-CytXFhirqCmeAaLE2XqyZOUul22ayI1VFSCYbEcVfdEZLnILEApiqaWIL5uyQyuF'], 'uuids': ['26cabb02-3244-461f-beb9-0e9bf8a664ed'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.095712", "end": "2021-03-25 14:12:37.511495", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-CytXFhirqCmeAaLE2XqyZOUul22ayI1VFSCYbEcVfdEZLnILEApiqaWIL5uyQyuF"], "labels": [], "masters": [], "uuids": ["26cabb02-3244-461f-beb9-0e9bf8a664ed"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-25 14:12:37.415783", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0931648 s, 1.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0931648 s, 1.2 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-25T14:12:37.634 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-03-25T14:12:37.636 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-zDm5rsLgrKA7boxQjDZNaqqKFAMMJxYV9EftpLAYpl03y0IqqT1NSBt9VFzpRhcg'], 'uuids': ['8736f9e4-8d0b-48d4-9c25-e4a6bfeca399'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.056867", "end": "2021-03-25 14:12:37.604129", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-zDm5rsLgrKA7boxQjDZNaqqKFAMMJxYV9EftpLAYpl03y0IqqT1NSBt9VFzpRhcg"], "labels": [], "masters": [], "uuids": ["8736f9e4-8d0b-48d4-9c25-e4a6bfeca399"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-25 14:12:36.547262", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-25T14:12:37.647 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XN3Z', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XN3Z', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XN3Z', 'scsi-35000c50092940234', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XN3Z', 'wwn-0x5000c50092940234'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XN3Z', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50092940234', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XN3Z-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XN3Z-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XN3Z-part1', 'scsi-35000c50092940234-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XN3Z-part1', 'wwn-0x5000c50092940234-part1'], 'uuids': ['782d0384-b480-44b3-9c95-fe95daf886ae'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XN3Z", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XN3Z", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XN3Z", "scsi-35000c50092940234", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XN3Z", "wwn-0x5000c50092940234"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XN3Z-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XN3Z-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2021-03-25T14:12:37.648 INFO:teuthology.task.ansible.out:Z1W5XN3Z-part1", "scsi-35000c50092940234-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XN3Z-part1", "wwn-0x5000c50092940234-part1"], "labels": [], "masters": [], "uuids": ["782d0384-b480-44b3-9c95-fe95daf886ae"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XN3Z", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092940234"}}, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:37.806 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-03-25T14:12:37.807 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-CytXFhirqCmeAaLE2XqyZOUul22ayI1VpFpPgR1Y628Fv5tjeQSg2aQKAihMlzyR'], 'uuids': ['bc09dcf9-cad5-4bc5-a192-03a52a9d549e'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.096011", "end": "2021-03-25 14:12:37.777176", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-CytXFhirqCmeAaLE2XqyZOUul22ayI1VpFpPgR1Y628Fv5tjeQSg2aQKAihMlzyR"], "labels": [], "masters": [], "uuids": ["bc09dcf9-cad5-4bc5-a192-03a52a9d549e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-25 14:12:37.681165", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0934147 s, 1.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0934147 s, 1.2 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-25T14:12:37.808 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QFRD', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5QFRD', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5QFRD', 'scsi-35000c50091dfc3c1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5QFRD', 'wwn-0x5000c50091dfc3c1'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5QFRD', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50091dfc3c1', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QFRD-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5QFRD-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5QFRD-part1', 'scsi-35000c50091dfc3c1-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5QFRD-part1', 'wwn-0x5000c50091dfc3c1-part1'], 'uuids': ['782d0384-b480-44b3-9c95-fe95daf886ae'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QFRD", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5QFRD", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5QFRD", "scsi-35000c50091dfc3c1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5QFRD", "wwn-0x5000c50091dfc3c1"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QFRD-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5QFRD-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2021-03-25T14:12:37.809 INFO:teuthology.task.ansible.out:Z1W5QFRD-part1", "scsi-35000c50091dfc3c1-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5QFRD-part1", "wwn-0x5000c50091dfc3c1-part1"], "labels": [], "masters": [], "uuids": ["782d0384-b480-44b3-9c95-fe95daf886ae"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QFRD", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091dfc3c1"}}, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:38.078 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-CytXFhirqCmeAaLE2XqyZOUul22ayI1V1S27cds4Vd8Jx8GygpwGhymyPJMMiha2'], 'uuids': ['18aff782-e523-4449-b237-e38160a3aea4'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.095674", "end": "2021-03-25 14:12:38.049214", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-CytXFhirqCmeAaLE2XqyZOUul22ayI1V1S27cds4Vd8Jx8GygpwGhymyPJMMiha2"], "labels": [], "masters": [], "uuids": ["18aff782-e523-4449-b237-e38160a3aea4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-25 14:12:37.953540", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0930541 s, 1.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0930541 s, 1.2 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-25T14:12:38.107 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:38 +0000 (0:00:01.669) 0:05:10.571 ******** 2021-03-25T14:12:38.400 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-03-25T14:12:38.425 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.056943", "end": "2021-03-25 14:12:38.323841", "rc": 0, "start": "2021-03-25 14:12:38.266898", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-25T14:12:38.428 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:38 +0000 (0:00:00.320) 0:05:10.892 ******** 2021-03-25T14:12:38.649 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-03-25T14:12:38.651 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.039598", "end": "2021-03-25 14:12:38.629738", "rc": 0, "start": "2021-03-25 14:12:38.590140", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-25T14:12:38.672 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:38 +0000 (0:00:00.244) 0:05:11.136 ******** 2021-03-25T14:12:38.745 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-03-25T14:12:38.813 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:38 +0000 (0:00:00.139) 0:05:11.276 ******** 2021-03-25T14:12:38.840 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-03-25T14:12:38.842 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:38.867 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:38 +0000 (0:00:00.054) 0:05:11.331 ******** 2021-03-25T14:12:38.899 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-03-25T14:12:38.926 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Thursday 25 March 2021 14:12:38 +0000 (0:00:00.055) 0:05:11.387 ******** 2021-03-25T14:12:38.930 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-03-25T14:12:38.931 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-zDm5rsLgrKA7boxQjDZNaqqKFAMMJxYVgHWkvPwMdekCvGlBNVZYSFlr2uCUp6O5'], 'uuids': ['68d08ae6-2353-49de-8683-1d7519b27056'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.087165", "end": "2021-03-25 14:12:38.883882", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-zDm5rsLgrKA7boxQjDZNaqqKFAMMJxYVgHWkvPwMdekCvGlBNVZYSFlr2uCUp6O5"], "labels": [], "masters": [], "uuids": ["68d08ae6-2353-49de-8683-1d7519b27056"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-25 14:12:37.796717", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-25T14:12:38.962 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:38 +0000 (0:00:00.039) 0:05:11.426 ******** 2021-03-25T14:12:38.970 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-03-25T14:12:38.971 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:38.997 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:38 +0000 (0:00:00.035) 0:05:11.461 ******** 2021-03-25T14:12:39.035 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-03-25T14:12:39.101 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Thursday 25 March 2021 14:12:39 +0000 (0:00:00.060) 0:05:11.522 ******** 2021-03-25T14:12:39.248 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-03-25T14:12:39.249 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-25T14:12:39.281 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:39 +0000 (0:00:00.223) 0:05:11.745 ******** 2021-03-25T14:12:39.331 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ skipping: [smithi110.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930419154944, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227153114, 'block_used': 12941994, 'inode_total': 61054976, 'inode_available': 60986959, 'inode_used': 68017, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227153114, "block_size": 4096, "block_total": 240095108, "block_used": 12941994, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986959, "inode_total": 61054976, "inode_used": 68017, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930419154944, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:39.332 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-03-25T14:12:39.334 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-zDm5rsLgrKA7boxQjDZNaqqKFAMMJxYVJZeYwBHNE04sBb6H1e1XeCx6xFrPeBqj'], 'uuids': ['2a4fb96a-92b0-40d2-a48f-e8a1fa7a26fa'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.141692", "end": "2021-03-25 14:12:39.306415", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-zDm5rsLgrKA7boxQjDZNaqqKFAMMJxYVJZeYwBHNE04sBb6H1e1XeCx6xFrPeBqj"], "labels": [], "masters": [], "uuids": ["2a4fb96a-92b0-40d2-a48f-e8a1fa7a26fa"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-25 14:12:39.164723", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.138971 s, 830 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.138971 s, 830 MB/s"], "stdout": "", "stdout_lines": []} 2021-03-25T14:12:39.356 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:39 +0000 (0:00:00.074) 0:05:11.820 ******** 2021-03-25T14:12:39.396 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-03-25T14:12:39.397 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:39.418 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:39 +0000 (0:00:00.062) 0:05:11.882 ******** 2021-03-25T14:12:39.467 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:39.483 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:39 +0000 (0:00:00.064) 0:05:11.947 ******** 2021-03-25T14:12:39.511 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-25T14:12:39.513 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:39.535 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:39 +0000 (0:00:00.052) 0:05:11.999 ******** 2021-03-25T14:12:39.545 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-03-25T14:12:39.592 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-NPFNFl-pszK-yCIy-ssLc-MjmK-3RhD-FLZqos', 'nvme-INTEL_SSDPEDMD400G4_PHFT62050074400BGN', 'nvme-nvme.8086-50484654363230353030373434303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.037730", "end": "2021-03-25 14:12:39.515584", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-NPFNFl-pszK-yCIy-ssLc-MjmK-3RhD-FLZqos", "nvme-INTEL_SSDPEDMD400G4_PHFT62050074400BGN", "nvme-nvme.8086-50484654363230353030373434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-25 14:12:39.477854", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0350934 s, 3.3 GB/s", "std 2021-03-25T14:12:39.594 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0350934 s, 3.3 GB/s"], "stdout": "", "stdout_lines": []} TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Thursday 25 March 2021 14:12:39 +0000 (0:00:00.056) 0:05:12.056 ******** 2021-03-25T14:12:39.619 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-03-25T14:12:39.621 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:39.642 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:39 +0000 (0:00:00.049) 0:05:12.106 ******** 2021-03-25T14:12:39.669 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:39.691 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:39 +0000 (0:00:00.049) 0:05:12.155 ******** 2021-03-25T14:12:39.856 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-03-25T14:12:39.857 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-zDm5rsLgrKA7boxQjDZNaqqKFAMMJxYVmOg8q7S7KG10C2FXgrDma3MvxWtdvKxP'], 'uuids': ['68be944f-f7be-4a32-8ba6-9c25b10b7475'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.139914", "end": "2021-03-25 14:12:39.833440", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-zDm5rsLgrKA7boxQjDZNaqqKFAMMJxYVmOg8q7S7KG10C2FXgrDma3MvxWtdvKxP"], "labels": [], "masters": [], "uuids": ["68be944f-f7be-4a32-8ba6-9c25b10b7475"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-25 14:12:39.693526", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.13734 s, 840 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.13734 s, 840 MB/s"], "stdout": "", "stdout_lines": []} 2021-03-25T14:12:40.188 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-zDm5rsLgrKA7boxQjDZNaqqKFAMMJxYVDy9eXrwgV4HpDejyjWjLvkf1aDAXSoYI'], 'uuids': ['7d66f161-8c42-4e4d-afe4-f2c10c2706c2'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.150729", "end": "2021-03-25 14:12:40.156748", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-zDm5rsLgrKA7boxQjDZNaqqKFAMMJxYVDy9eXrwgV4HpDejyjWjLvkf1aDAXSoYI"], "labels": [], "masters": [], "uuids": ["7d66f161-8c42-4e4d-afe4-f2c10c2706c2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-25 14:12:40.006019", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.148083 s, 779 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.148083 s, 779 MB/s"], "stdout": "", "stdout_lines": []} 2021-03-25T14:12:40.410 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-03-25T14:12:40.412 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-03-25T14:12:40.434 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:40 +0000 (0:00:00.742) 0:05:12.898 ******** 2021-03-25T14:12:40.494 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-03-25T14:12:40.494 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-zDm5rsLgrKA7boxQjDZNaqqKFAMMJxYV9EftpLAYpl03y0IqqT1NSBt9VFzpRhcg'], 'uuids': ['8736f9e4-8d0b-48d4-9c25-e4a6bfeca399'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.142357", "end": "2021-03-25 14:12:40.468764", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-zDm5rsLgrKA7boxQjDZNaqqKFAMMJxYV9EftpLAYpl03y0IqqT1NSBt9VFzpRhcg"], "labels": [], "masters": [], "uuids": ["8736f9e4-8d0b-48d4-9c25-e4a6bfeca399"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-25 14:12:40.326407", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.139766 s, 825 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.139766 s, 825 MB/s"], "stdout": "", "stdout_lines": []} 2021-03-25T14:12:40.507 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XN3Z', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XN3Z', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XN3Z', 'scsi-35000c50092940234', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XN3Z', 'wwn-0x5000c50092940234'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XN3Z', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50092940234', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XN3Z-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XN3Z-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XN3Z-part1', 'scsi-35000c50092940234-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XN3Z-part1', 'wwn-0x5000c50092940234-part1'], 'uuids': ['782d0384-b480-44b3-9c95-fe95daf886ae'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XN3Z", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XN3Z", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XN3Z", "scsi-35000c50092940234", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XN3Z", "wwn-0x5000c50092940234"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XN3Z-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XN3Z-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2021-03-25T14:12:40.508 INFO:teuthology.task.ansible.out:Z1W5XN3Z-part1", "scsi-35000c50092940234-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XN3Z-part1", "wwn-0x5000c50092940234-part1"], "labels": [], "masters": [], "uuids": ["782d0384-b480-44b3-9c95-fe95daf886ae"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XN3Z", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092940234"}}, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:40.815 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-zDm5rsLgrKA7boxQjDZNaqqKFAMMJxYVgHWkvPwMdekCvGlBNVZYSFlr2uCUp6O5'], 'uuids': ['68d08ae6-2353-49de-8683-1d7519b27056'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.139851", "end": "2021-03-25 14:12:40.791289", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-zDm5rsLgrKA7boxQjDZNaqqKFAMMJxYVgHWkvPwMdekCvGlBNVZYSFlr2uCUp6O5"], "labels": [], "masters": [], "uuids": ["68d08ae6-2353-49de-8683-1d7519b27056"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-25 14:12:40.651438", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137246 s, 840 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137246 s, 840 MB/s"], "stdout": "", "stdout_lines": []} 2021-03-25T14:12:40.846 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:40 +0000 (0:00:00.411) 0:05:13.310 ******** 2021-03-25T14:12:41.067 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-03-25T14:12:41.068 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-25T14:12:41.099 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-03-25T14:12:41.101 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.061952", "end": "2021-03-25 14:12:41.067580", "rc": 0, "start": "2021-03-25 14:12:41.005628", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-25T14:12:41.121 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:41 +0000 (0:00:00.275) 0:05:13.585 ******** 2021-03-25T14:12:41.353 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-03-25T14:12:41.354 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.041891", "end": "2021-03-25 14:12:41.325456", "rc": 0, "start": "2021-03-25 14:12:41.283565", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-25T14:12:41.377 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:41 +0000 (0:00:00.255) 0:05:13.841 ******** 2021-03-25T14:12:41.394 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-03-25T14:12:41.395 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-25T14:12:41.405 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-03-25T14:12:41.430 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:41 +0000 (0:00:00.053) 0:05:13.894 ******** 2021-03-25T14:12:41.457 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-03-25T14:12:41.459 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:41.484 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:41 +0000 (0:00:00.054) 0:05:13.948 ******** 2021-03-25T14:12:41.512 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-03-25T14:12:41.514 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:41.536 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:41 +0000 (0:00:00.051) 0:05:14.000 ******** 2021-03-25T14:12:41.563 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-03-25T14:12:41.565 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:41.589 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:41 +0000 (0:00:00.052) 0:05:14.053 ******** 2021-03-25T14:12:41.616 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-03-25T14:12:41.617 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:41.639 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:41 +0000 (0:00:00.049) 0:05:14.103 ******** 2021-03-25T14:12:41.698 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-03-25T14:12:41.700 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-25T14:12:41.826 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-03-25T14:12:41.827 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-25T14:12:41.849 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:41 +0000 (0:00:00.210) 0:05:14.313 ******** 2021-03-25T14:12:41.898 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-03-25T14:12:41.900 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930419159040, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227153115, 'block_used': 12941993, 'inode_total': 61054976, 'inode_available': 60986959, 'inode_used': 68017, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227153115, "block_size": 4096, "block_total": 240095108, "block_used": 12941993, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986959, "inode_total": 61054976, "inode_used": 68017, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930419159040, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:41.923 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:41 +0000 (0:00:00.074) 0:05:14.387 ******** 2021-03-25T14:12:41.951 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-03-25T14:12:41.953 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:41.975 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:41 +0000 (0:00:00.052) 0:05:14.439 ******** 2021-03-25T14:12:42.003 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-03-25T14:12:42.004 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} TASK [testnode : set_fact] ***************************************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:42.026 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:42 +0000 (0:00:00.050) 0:05:14.490 ******** 2021-03-25T14:12:42.056 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:42.079 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:42 +0000 (0:00:00.052) 0:05:14.543 ******** 2021-03-25T14:12:42.117 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-03-25T14:12:42.118 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:42.139 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:42 +0000 (0:00:00.059) 0:05:14.603 ******** 2021-03-25T14:12:42.166 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:42.190 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:42 +0000 (0:00:00.050) 0:05:14.654 ******** 2021-03-25T14:12:42.217 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-03-25T14:12:42.219 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:42.242 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:42 +0000 (0:00:00.052) 0:05:14.706 ******** 2021-03-25T14:12:42.323 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-03-25T14:12:42.325 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-25T14:12:42.354 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:42 +0000 (0:00:00.111) 0:05:14.818 ******** 2021-03-25T14:12:42.552 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-03-25T14:12:42.553 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-03-25T14:12:42.575 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:42 +0000 (0:00:00.220) 0:05:15.039 ******** 2021-03-25T14:12:42.699 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-03-25T14:12:42.700 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-03-25T14:12:42.724 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:42 +0000 (0:00:00.148) 0:05:15.188 ******** 2021-03-25T14:12:42.784 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-03-25T14:12:42.785 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-25T14:12:42.954 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-25T14:12:43.115 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi174.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-25T14:12:43.126 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-03-25T14:12:43.128 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-25T14:12:43.296 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-25T14:12:43.298 INFO:teuthology.task.ansible.out: 2021-03-25T14:12:43.308 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:43.335 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:43 +0000 (0:00:00.610) 0:05:15.798 ******** 2021-03-25T14:12:43.364 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-03-25T14:12:43.365 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:43.388 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:43 +0000 (0:00:00.053) 0:05:15.852 ******** 2021-03-25T14:12:43.426 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-03-25T14:12:43.428 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi174.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-25T14:12:43.450 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:43 +0000 (0:00:00.061) 0:05:15.914 ******** 2021-03-25T14:12:43.660 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-03-25T14:12:43.661 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-03-25T14:12:43.686 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:43 +0000 (0:00:00.236) 0:05:16.150 ******** 2021-03-25T14:12:43.713 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-03-25T14:12:43.715 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:43.746 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:43 +0000 (0:00:00.059) 0:05:16.210 ******** 2021-03-25T14:12:43.777 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-03-25T14:12:43.779 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-25T14:12:44.116 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-25T14:12:44.294 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-03-25T14:12:44.296 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => {"changed": true} 2021-03-25T14:12:44.319 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:44 +0000 (0:00:00.572) 0:05:16.783 ******** 2021-03-25T14:12:44.434 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi174.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-25T14:12:44.459 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:44 +0000 (0:00:00.140) 0:05:16.923 ******** 2021-03-25T14:12:44.659 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-03-25T14:12:44.660 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-03-25T14:12:44.681 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:44 +0000 (0:00:00.221) 0:05:17.145 ******** 2021-03-25T14:12:44.898 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi110.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-03-25T14:12:44.932 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:44 +0000 (0:00:00.251) 0:05:17.396 ******** 2021-03-25T14:12:44.943 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-03-25T14:12:44.943 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-25T14:12:44.966 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-03-25T14:12:44.968 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:44.990 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:44 +0000 (0:00:00.057) 0:05:17.454 ******** 2021-03-25T14:12:45.017 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-03-25T14:12:45.019 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:45.040 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:45 +0000 (0:00:00.050) 0:05:17.504 ******** 2021-03-25T14:12:45.080 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:45.080 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-03-25T14:12:45.080 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-25T14:12:45.103 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:45 +0000 (0:00:00.062) 0:05:17.567 ******** 2021-03-25T14:12:45.132 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-03-25T14:12:45.133 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:45.154 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:45 +0000 (0:00:00.051) 0:05:17.618 ******** 2021-03-25T14:12:45.183 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-03-25T14:12:45.184 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:45.206 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:45 +0000 (0:00:00.051) 0:05:17.670 ******** 2021-03-25T14:12:45.234 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-03-25T14:12:45.235 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:45.256 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:45 +0000 (0:00:00.050) 0:05:17.720 ******** 2021-03-25T14:12:45.264 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-03-25T14:12:45.264 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-25T14:12:45.287 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-03-25T14:12:45.288 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:45.308 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:45 +0000 (0:00:00.052) 0:05:17.772 ******** 2021-03-25T14:12:45.336 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-03-25T14:12:45.337 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:45.358 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:45 +0000 (0:00:00.049) 0:05:17.822 ******** 2021-03-25T14:12:45.387 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-03-25T14:12:45.388 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:45.411 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:45 +0000 (0:00:00.052) 0:05:17.875 ******** 2021-03-25T14:12:45.429 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-03-25T14:12:45.429 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-25T14:12:45.430 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:45.458 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:45 +0000 (0:00:00.047) 0:05:17.922 ******** 2021-03-25T14:12:45.466 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-03-25T14:12:45.467 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:45.493 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:45 +0000 (0:00:00.034) 0:05:17.957 ******** 2021-03-25T14:12:45.502 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-03-25T14:12:45.502 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:45.526 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:45 +0000 (0:00:00.033) 0:05:17.990 ******** 2021-03-25T14:12:45.533 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-03-25T14:12:45.534 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:45.557 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:45 +0000 (0:00:00.031) 0:05:18.021 ******** 2021-03-25T14:12:45.564 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-03-25T14:12:45.565 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:45.587 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:45 +0000 (0:00:00.030) 0:05:18.051 ******** 2021-03-25T14:12:45.594 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-03-25T14:12:45.596 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:45.620 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:45 +0000 (0:00:00.031) 0:05:18.083 ******** 2021-03-25T14:12:45.647 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-03-25T14:12:45.648 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:45.677 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:45 +0000 (0:00:00.057) 0:05:18.141 ******** 2021-03-25T14:12:45.704 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-03-25T14:12:45.706 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:45.728 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:45 +0000 (0:00:00.050) 0:05:18.192 ******** 2021-03-25T14:12:45.756 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-03-25T14:12:45.757 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:45.779 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:45 +0000 (0:00:00.050) 0:05:18.242 ******** 2021-03-25T14:12:45.786 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-03-25T14:12:45.786 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-03-25T14:12:45.818 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:45 +0000 (0:00:00.039) 0:05:18.282 ******** 2021-03-25T14:12:45.858 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-03-25T14:12:45.859 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:45.883 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:45 +0000 (0:00:00.065) 0:05:18.347 ******** 2021-03-25T14:12:46.162 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-03-25T14:12:46.164 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true} 2021-03-25T14:12:46.184 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:46 +0000 (0:00:00.300) 0:05:18.648 ******** 2021-03-25T14:12:46.243 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-03-25T14:12:46.243 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2021-03-25T14:12:46.274 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:46 +0000 (0:00:00.090) 0:05:18.738 ******** 2021-03-25T14:12:46.485 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-03-25T14:12:46.487 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-03-25T14:12:46.510 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:46 +0000 (0:00:00.235) 0:05:18.974 ******** 2021-03-25T14:12:46.538 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:46.561 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:46 +0000 (0:00:00.051) 0:05:19.025 ******** 2021-03-25T14:12:46.562 INFO:teuthology.task.ansible.out: 2021-03-25T14:12:46.580 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-03-25T14:12:46.582 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2021-03-25 14:06:19 UTC", "ActiveEnterTimestampMonotonic": "15619024", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "tmp.mount sysinit.target systemd-tmpfiles-setup.service systemd-journald.socket ntpd.service ntpdate.service basic.target sntp.service system.slice -.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2021-03-25 14:06:18 UTC", "AssertTimestampMonotonic": "14329316", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2021-03-25 14:06:18 UTC", "ConditionTimestampMonotonic": "14329282", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service ntpd.service shutdown.target", "ControlGro 2021-03-25T14:12:46.583 INFO:teuthology.task.ansible.out:up": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "899", "ExecMainStartTimestamp": "Thu 2021-03-25 14:06:19 UTC", "ExecMainStartTimestampMonotonic": "15478864", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2021-03-25 14:06:18 UTC", "InactiveExitTimestampMonotonic": "14374934", "InvocationID": "b54931f11b964462b51848ed828f867c", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity" 2021-03-25T14:12:46.584 INFO:teuthology.task.ansible.out:, "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127237", "LimitNPROCSoft": "127237", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127237", "LimitSIGPENDINGSoft": "127237", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "899", "MemoryAccounting": "yes", "MemoryCurrent": "3276800", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no 2021-03-25T14:12:46.585 INFO:teuthology.task.ansible.out:", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2021-03-25 14:06:19 UTC", "StateChangeTimestampMonotonic": "15619024", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203579", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2021-03-25 14:06:19 UTC", "WatchdogTimestampMonotonic": "15479102", "WatchdogUSec": "0"}} 2021-03-25T14:12:46.605 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:46 +0000 (0:00:00.044) 0:05:19.069 ******** 2021-03-25T14:12:46.612 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-03-25T14:12:46.614 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:46.635 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:46 +0000 (0:00:00.030) 0:05:19.099 ******** 2021-03-25T14:12:46.642 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-25T14:12:46.643 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-03-25T14:12:46.666 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:46 +0000 (0:00:00.030) 0:05:19.130 ******** 2021-03-25T14:12:46.672 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-03-25T14:12:46.674 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:46.696 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:46 +0000 (0:00:00.030) 0:05:19.160 ******** 2021-03-25T14:12:46.703 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-25T14:12:46.703 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-03-25T14:12:46.728 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:46 +0000 (0:00:00.031) 0:05:19.192 ******** 2021-03-25T14:12:46.735 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-03-25T14:12:46.736 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:46.763 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:46 +0000 (0:00:00.035) 0:05:19.227 ******** 2021-03-25T14:12:46.771 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-03-25T14:12:46.772 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:46.806 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:46 +0000 (0:00:00.043) 0:05:19.270 ******** 2021-03-25T14:12:46.817 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-03-25T14:12:46.817 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:46.848 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:46 +0000 (0:00:00.041) 0:05:19.312 ******** 2021-03-25T14:12:46.857 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-03-25T14:12:46.859 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:46.885 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:46 +0000 (0:00:00.036) 0:05:19.348 ******** 2021-03-25T14:12:46.895 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-03-25T14:12:46.896 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:46.921 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:46 +0000 (0:00:00.036) 0:05:19.385 ******** 2021-03-25T14:12:46.927 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-03-25T14:12:46.929 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:46.975 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:46 +0000 (0:00:00.034) 0:05:19.420 ******** TASK [testnode : Upload CPAN config for the teuthology user.] ****************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:46.989 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:46 +0000 (0:00:00.032) 0:05:19.453 ******** 2021-03-25T14:12:47.018 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-03-25T14:12:47.020 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:47.045 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:47 +0000 (0:00:00.055) 0:05:19.509 ******** 2021-03-25T14:12:47.072 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-03-25T14:12:47.074 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:47.096 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:47 +0000 (0:00:00.051) 0:05:19.560 ******** 2021-03-25T14:12:47.124 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:47.147 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:47 +0000 (0:00:00.050) 0:05:19.611 ******** 2021-03-25T14:12:47.153 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-03-25T14:12:47.154 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2021-03-25T14:12:47.155 INFO:teuthology.task.ansible.out: 2021-03-25T14:12:47.178 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:47 +0000 (0:00:00.031) 0:05:19.642 ******** 2021-03-25T14:12:47.186 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-03-25T14:12:47.187 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:47.212 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:47 +0000 (0:00:00.033) 0:05:19.676 ******** 2021-03-25T14:12:47.285 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Thursday 25 March 2021 14:12:47 +0000 (0:00:00.050) 0:05:19.727 ******** 2021-03-25T14:12:47.291 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-03-25T14:12:47.292 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:47.314 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:47 +0000 (0:00:00.050) 0:05:19.778 ******** 2021-03-25T14:12:47.341 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-03-25T14:12:47.368 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Thursday 25 March 2021 14:12:47 +0000 (0:00:00.049) 0:05:19.827 ******** 2021-03-25T14:12:47.390 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-03-25T14:12:47.392 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:47.413 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:47 +0000 (0:00:00.049) 0:05:19.877 ******** 2021-03-25T14:12:47.641 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-03-25T14:12:47.643 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2021-03-25T14:12:47.665 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:47 +0000 (0:00:00.251) 0:05:20.129 ******** 2021-03-25T14:12:47.883 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-03-25T14:12:47.902 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2021-03-25T14:12:47.905 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:47 +0000 (0:00:00.240) 0:05:20.369 ******** 2021-03-25T14:12:48.212 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-03-25T14:12:48.213 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2021-03-25 14:06:20 UTC", "ActiveEnterTimestampMonotonic": "15866254", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "ntpdate.service -.mount systemd-journald.socket sntp.service systemd-tmpfiles-setup.service system.slice tmp.mount ntpd.service basic.target sysinit.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2021-03-25 14:06:19 UTC", "AssertTimestampMonotonic": "14676046", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2021-03-25 14:06:19 UTC", "ConditionTimestampMonotonic": "14675988", "ConfigurationDirectoryMode": "0755", "Conflicts": "ntpd.service shutdown.target systemd-timesyncd.service", "ControlGro 2021-03-25T14:12:48.214 INFO:teuthology.task.ansible.out:up": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "870", "ExecMainStartTimestamp": "Thu 2021-03-25 14:06:20 UTC", "ExecMainStartTimestampMonotonic": "15826527", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2021-03-25 14:06:19 UTC", "InactiveExitTimestampMonotonic": "14688402", "InvocationID": "f0941278e3cc41c7a5c702cdeab45d04", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity" 2021-03-25T14:12:48.215 INFO:teuthology.task.ansible.out:, "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127237", "LimitNPROCSoft": "127237", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127237", "LimitSIGPENDINGSoft": "127237", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "870", "MemoryAccounting": "yes", "MemoryCurrent": "3276800", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp", "Restart": "no 2021-03-25T14:12:48.217 INFO:teuthology.task.ansible.out:", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2021-03-25 14:06:20 UTC", "StateChangeTimestampMonotonic": "15866254", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203580", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2021-03-25 14:06:20 UTC", "WatchdogTimestampMonotonic": "15826553", "WatchdogUSec": "0"}} 2021-03-25T14:12:48.236 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:48 +0000 (0:00:00.331) 0:05:20.700 ******** 2021-03-25T14:12:48.264 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-25T14:12:48.294 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} Thursday 25 March 2021 14:12:48 +0000 (0:00:00.049) 0:05:20.749 ******** 2021-03-25T14:12:48.334 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-25T14:12:48.335 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-03-25T14:12:48.360 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:48 +0000 (0:00:00.074) 0:05:20.824 ******** 2021-03-25T14:12:48.388 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-03-25T14:12:48.389 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:48.413 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:48 +0000 (0:00:00.053) 0:05:20.877 ******** 2021-03-25T14:12:48.440 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-03-25T14:12:48.442 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:48.470 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:48 +0000 (0:00:00.056) 0:05:20.934 ******** 2021-03-25T14:12:48.500 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-03-25T14:12:48.501 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:48.524 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:48 +0000 (0:00:00.053) 0:05:20.988 ******** 2021-03-25T14:12:48.722 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-03-25T14:12:48.724 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2021-03-25T14:12:48.745 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:48 +0000 (0:00:00.220) 0:05:21.209 ******** 2021-03-25T14:12:48.993 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-03-25T14:12:48.995 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-03-25T14:12:49.021 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:49 +0000 (0:00:00.276) 0:05:21.485 ******** 2021-03-25T14:12:49.052 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-03-25T14:12:49.111 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Thursday 25 March 2021 14:12:49 +0000 (0:00:00.052) 0:05:21.538 ******** 2021-03-25T14:12:49.113 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ ok: [smithi110.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-03-25T14:12:49.134 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:49 +0000 (0:00:00.059) 0:05:21.598 ******** 2021-03-25T14:12:49.224 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-03-25T14:12:49.225 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2021-03-25T14:12:49.247 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:49 +0000 (0:00:00.113) 0:05:21.711 ******** 2021-03-25T14:12:49.306 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-03-25T14:12:49.369 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} Thursday 25 March 2021 14:12:49 +0000 (0:00:00.081) 0:05:21.793 ******** TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:49.384 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:49 +0000 (0:00:00.055) 0:05:21.849 ******** 2021-03-25T14:12:49.412 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-03-25T14:12:49.413 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-03-25T14:12:49.434 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:49 +0000 (0:00:00.048) 0:05:21.898 ******** 2021-03-25T14:12:49.471 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-03-25T14:12:49.473 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:49.493 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:49 +0000 (0:00:00.059) 0:05:21.957 ******** 2021-03-25T14:12:49.678 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-03-25T14:12:49.679 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-03-25T14:12:49.702 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:49 +0000 (0:00:00.208) 0:05:22.166 ******** 2021-03-25T14:12:49.902 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-03-25T14:12:49.903 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-03-25T14:12:49.924 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:49 +0000 (0:00:00.222) 0:05:22.388 ******** 2021-03-25T14:12:49.953 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-03-25T14:12:49.955 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:49.976 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:49 +0000 (0:00:00.051) 0:05:22.440 ******** 2021-03-25T14:12:50.045 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi110.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi110.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi110.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} skipping: [smithi110.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi110.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-03-25T14:12:50.051 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:50 +0000 (0:00:00.074) 0:05:22.515 ******** 2021-03-25T14:12:50.089 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-03-25T14:12:50.090 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:50.091 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi110.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:50.103 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:50.104 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:50.138 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:50 +0000 (0:00:00.086) 0:05:22.602 ******** 2021-03-25T14:12:50.166 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-25T14:12:50.168 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:50.193 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:50 +0000 (0:00:00.055) 0:05:22.657 ******** 2021-03-25T14:12:50.225 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-03-25T14:12:50.226 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:50.250 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:50 +0000 (0:00:00.056) 0:05:22.714 ******** 2021-03-25T14:12:50.289 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-03-25T14:12:50.290 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:50.316 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:50 +0000 (0:00:00.065) 0:05:22.780 ******** 2021-03-25T14:12:50.324 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-03-25T14:12:50.325 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-03-25T14:12:50.348 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:50 +0000 (0:00:00.032) 0:05:22.812 ******** 2021-03-25T14:12:50.355 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-03-25T14:12:50.357 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:50.382 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:50 +0000 (0:00:00.033) 0:05:22.846 ******** 2021-03-25T14:12:50.389 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-03-25T14:12:50.390 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:50.412 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:50 +0000 (0:00:00.030) 0:05:22.876 ******** 2021-03-25T14:12:50.419 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-03-25T14:12:50.419 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:50.445 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:50 +0000 (0:00:00.033) 0:05:22.909 ******** 2021-03-25T14:12:50.452 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-03-25T14:12:50.453 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-03-25T14:12:50.475 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:50 +0000 (0:00:00.029) 0:05:22.939 ******** 2021-03-25T14:12:50.481 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-03-25T14:12:50.483 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:50.515 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:50 +0000 (0:00:00.039) 0:05:22.979 ******** 2021-03-25T14:12:50.554 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-03-25T14:12:50.555 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:50.580 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:50 +0000 (0:00:00.065) 0:05:23.044 ******** 2021-03-25T14:12:50.608 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-03-25T14:12:50.609 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:50.630 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:50 +0000 (0:00:00.049) 0:05:23.094 ******** 2021-03-25T14:12:50.658 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-03-25T14:12:50.660 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-03-25T14:12:50.683 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:50 +0000 (0:00:00.052) 0:05:23.147 ******** 2021-03-25T14:12:50.711 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-03-25T14:12:50.712 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:50.734 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:50 +0000 (0:00:00.051) 0:05:23.198 ******** 2021-03-25T14:12:50.762 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-03-25T14:12:50.763 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-03-25T14:12:50.786 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:50 +0000 (0:00:00.051) 0:05:23.250 ******** 2021-03-25T14:12:50.814 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-03-25T14:12:50.815 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:50.837 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:50 +0000 (0:00:00.051) 0:05:23.301 ******** 2021-03-25T14:12:50.845 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-03-25T14:12:50.845 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005132", "end": "2021-03-25 14:12:50.808286", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-03-25 14:12:50.803154", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-25T14:12:51.004 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.002982", "end": "2021-03-25 14:12:50.978671", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-03-25 14:12:50.975689", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-25T14:12:51.026 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-03-25T14:12:51.028 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-03-25T14:12:51.050 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:51 +0000 (0:00:00.213) 0:05:23.514 ******** 2021-03-25T14:12:51.184 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-03-25T14:12:51.185 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002836", "end": "2021-03-25 14:12:51.149761", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-03-25 14:12:51.146925", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2021-03-25T14:12:51.238 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-03-25T14:12:51.239 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-03-25T14:12:51.267 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:51 +0000 (0:00:00.216) 0:05:23.731 ******** 2021-03-25T14:12:51.296 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-03-25T14:12:51.297 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:51.329 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:51 +0000 (0:00:00.061) 0:05:23.792 ******** 2021-03-25T14:12:51.349 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-03-25T14:12:51.350 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.003542", "end": "2021-03-25 14:12:51.319746", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-03-25 14:12:51.316204", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-25T14:12:51.377 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:51 +0000 (0:00:00.048) 0:05:23.841 ******** 2021-03-25T14:12:51.385 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-03-25T14:12:51.387 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-03-25T14:12:51.387 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2021-03-25T14:12:51.389 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-03-25T14:12:51.411 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:51 +0000 (0:00:00.033) 0:05:23.875 ******** 2021-03-25T14:12:51.418 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-03-25T14:12:51.442 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:51 +0000 (0:00:00.030) 0:05:23.905 ******** 2021-03-25T14:12:51.449 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-03-25T14:12:51.451 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:51.452 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:51.453 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:51.464 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:51.465 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:51.490 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:51 +0000 (0:00:00.048) 0:05:23.954 ******** 2021-03-25T14:12:51.517 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-25T14:12:51.518 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:51.542 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:51 +0000 (0:00:00.052) 0:05:24.006 ******** 2021-03-25T14:12:51.580 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:51.607 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:51 +0000 (0:00:00.064) 0:05:24.071 ******** 2021-03-25T14:12:51.624 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-03-25T14:12:51.624 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2021-03-25T14:12:51.648 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:51.681 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:51 +0000 (0:00:00.074) 0:05:24.145 ******** 2021-03-25T14:12:51.709 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-03-25T14:12:51.710 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:51.736 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:51 +0000 (0:00:00.054) 0:05:24.199 ******** 2021-03-25T14:12:51.763 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-03-25T14:12:51.765 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:51.788 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:51 +0000 (0:00:00.052) 0:05:24.252 ******** 2021-03-25T14:12:51.827 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-03-25T14:12:51.828 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:51.858 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:51 +0000 (0:00:00.070) 0:05:24.322 ******** 2021-03-25T14:12:51.886 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-03-25T14:12:51.887 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:51.915 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:51 +0000 (0:00:00.056) 0:05:24.379 ******** 2021-03-25T14:12:51.942 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-03-25T14:12:51.943 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:51.963 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:51 +0000 (0:00:00.048) 0:05:24.427 ******** 2021-03-25T14:12:52.169 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-03-25T14:12:52.170 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005066", "end": "2021-03-25 14:12:52.137138", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-03-25 14:12:52.132072", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-25T14:12:52.347 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003005", "end": "2021-03-25 14:12:52.314232", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-03-25 14:12:52.311227", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-25T14:12:52.504 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002749", "end": "2021-03-25 14:12:52.481455", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-03-25 14:12:52.478706", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2021-03-25T14:12:53.679 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:01.004282", "end": "2021-03-25 14:12:53.648196", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-03-25 14:12:52.643914", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-25T14:12:53.703 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:53 +0000 (0:00:01.739) 0:05:26.167 ******** 2021-03-25T14:12:53.730 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-03-25T14:12:53.752 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:53 +0000 (0:00:00.049) 0:05:26.216 ******** 2021-03-25T14:12:53.955 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-03-25T14:12:53.956 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2021-03-25T14:12:54.033 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-03-25T14:12:54.061 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:54 +0000 (0:00:00.308) 0:05:26.524 ******** 2021-03-25T14:12:54.090 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:54 +0000 (0:00:00.029) 0:05:26.554 ******** 2021-03-25T14:12:54.724 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi174.front.sepia.ceph.com] 2021-03-25T14:12:54.772 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:54 +0000 (0:00:00.681) 0:05:27.236 ******** 2021-03-25T14:12:54.799 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-25T14:12:54.800 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:54.821 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:54 +0000 (0:00:00.049) 0:05:27.285 ******** 2021-03-25T14:12:54.849 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-25T14:12:54.850 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "yum"}, "changed": false} 2021-03-25T14:12:54.874 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:54 +0000 (0:00:00.052) 0:05:27.337 ******** 2021-03-25T14:12:54.914 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-03-25T14:12:54.915 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml) => {"ansible_facts": {"container_packages": ["podman", "podman-docker"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"} 2021-03-25T14:12:54.939 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:54 +0000 (0:00:00.065) 0:05:27.403 ******** 2021-03-25T14:12:55.804 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi110.front.sepia.ceph.com] 2021-03-25T14:12:55.851 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:55 +0000 (0:00:00.911) 0:05:28.315 ******** 2021-03-25T14:12:55.879 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-25T14:12:55.881 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:12:55.901 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:55 +0000 (0:00:00.049) 0:05:28.365 ******** 2021-03-25T14:12:55.928 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-25T14:12:55.930 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "yum"}, "changed": false} 2021-03-25T14:12:55.951 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:55 +0000 (0:00:00.049) 0:05:28.415 ******** 2021-03-25T14:12:55.988 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-03-25T14:12:55.989 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml) => {"ansible_facts": {"container_packages": ["podman", "podman-docker"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"} 2021-03-25T14:12:56.010 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:12:56 +0000 (0:00:00.059) 0:05:28.474 ******** 2021-03-25T14:13:05.139 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-03-25T14:13:05.141 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: runc-1.0.0-70.rc92.module+el8.3.1+9857+68fb1526.x86_64", "Installed: podman-2.2.1-7.module+el8.3.1+9857+68fb1526.x86_64", "Installed: podman-catatonit-2.2.1-7.module+el8.3.1+9857+68fb1526.x86_64", "Installed: podman-docker-2.2.1-7.module+el8.3.1+9857+68fb1526.noarch", "Removed: podman-catatonit-2.0.5-5.module+el8.3.0+8221+97165c3f.x86_64", "Removed: podman-docker-2.0.5-5.module+el8.3.0+8221+97165c3f.noarch", "Removed: runc-1.0.0-68.rc92.module+el8.3.0+8221+97165c3f.x86_64", "Removed: podman-2.0.5-5.module+el8.3.0+8221+97165c3f.x86_64"]} 2021-03-25T14:13:05.163 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:13:05 +0000 (0:00:09.153) 0:05:37.627 ******** 2021-03-25T14:13:05.201 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-25T14:13:05.202 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/containers/registries.conf"}, "changed": false} 2021-03-25T14:13:05.223 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:13:05 +0000 (0:00:00.059) 0:05:37.687 ******** 2021-03-25T14:13:05.250 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:13:05.273 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:13:05 +0000 (0:00:00.050) 0:05:37.737 ******** 2021-03-25T14:13:05.501 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-03-25T14:13:05.503 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-03-25T14:13:05.691 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-03-25T14:13:05.717 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:13:05 +0000 (0:00:00.443) 0:05:38.181 ******** 2021-03-25T14:13:05.767 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** changed: [smithi110.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: podman-2.2.1-7.module+el8.3.1+9857+68fb1526.x86_64", "Installed: podman-catatonit-2.2.1-7.module+el8.3.1+9857+68fb1526.x86_64", "Installed: podman-docker-2.2.1-7.module+el8.3.1+9857+68fb1526.noarch", "Installed: runc-1.0.0-70.rc92.module+el8.3.1+9857+68fb1526.x86_64", "Removed: podman-catatonit-2.0.5-5.module+el8.3.0+8221+97165c3f.x86_64", "Removed: podman-docker-2.0.5-5.module+el8.3.0+8221+97165c3f.noarch", "Removed: runc-1.0.0-68.rc92.module+el8.3.0+8221+97165c3f.x86_64", "Removed: podman-2.0.5-5.module+el8.3.0+8221+97165c3f.x86_64"]} 2021-03-25T14:13:05.793 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:13:05 +0000 (0:00:00.076) 0:05:38.257 ******** 2021-03-25T14:13:05.820 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-25T14:13:05.821 INFO:teuthology.task.ansible.out:ok: [smithi110.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/containers/registries.conf"}, "changed": false} 2021-03-25T14:13:05.842 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:13:05 +0000 (0:00:00.049) 0:05:38.306 ******** 2021-03-25T14:13:05.870 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-25T14:13:05.871 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:13:05.894 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:13:05 +0000 (0:00:00.052) 0:05:38.358 ******** 2021-03-25T14:13:06.115 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-03-25T14:13:06.116 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-03-25T14:13:06.251 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-03-25T14:13:06.253 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:cert_t:s0", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1616681585.7863433-4619-204271634961723/source", "state": "file", "uid": 0} 2021-03-25T14:13:06.295 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-03-25T14:13:06.296 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-03-25T14:13:06.322 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:13:06 +0000 (0:00:00.427) 0:05:38.786 ******** 2021-03-25T14:13:06.709 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-03-25T14:13:06.710 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1616681586.272204-4619-50051101717220/source", "state": "file", "uid": 0} 2021-03-25T14:13:06.748 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:13:06 +0000 (0:00:00.426) 0:05:39.212 ******** 2021-03-25T14:13:06.836 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:cert_t:s0", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1616681586.3957899-4780-97217470596224/source", "state": "file", "uid": 0} 2021-03-25T14:13:06.838 INFO:teuthology.task.ansible.out: 2021-03-25T14:13:07.308 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1616681586.8688061-4780-35586677759588/source", "state": "file", "uid": 0} 2021-03-25T14:13:07.333 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:13:07 +0000 (0:00:00.585) 0:05:39.797 ******** 2021-03-25T14:13:10.009 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-03-25T14:13:10.010 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": ["/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-3xuo8vhu-build\nCollecting toml (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl\nCollecting docopt (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz\nInstalling collected packages: toml, docopt, registries-conf-ctl\n Running setup.py install for docopt: started\n Running setup.py install for docopt: finished with status 'done'\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-3xuo8vhu-build", "Collecting toml (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl", "Collecting docopt (from registries-conf-ctl==1.0)", " Downloading https://files. 2021-03-25T14:13:10.011 INFO:teuthology.task.ansible.out:pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz", "Installing collected packages: toml, docopt, registries-conf-ctl", " Running setup.py install for docopt: started", " Running setup.py install for docopt: finished with status 'done'", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-03-25T14:13:10.039 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:13:10 +0000 (0:00:02.706) 0:05:42.503 ******** 2021-03-25T14:13:10.067 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-03-25T14:13:10.069 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:13:10.092 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:13:10 +0000 (0:00:00.052) 0:05:42.556 ******** 2021-03-25T14:13:10.132 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/containers/registries.conf if necessary] **** 2021-03-25T14:13:10.133 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:13:10.160 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:13:10 +0000 (0:00:00.068) 0:05:42.624 ******** 2021-03-25T14:13:10.515 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-03-25T14:13:10.516 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.159097", "end": "2021-03-25 14:13:10.491813", "rc": 0, "start": "2021-03-25 14:13:10.332716", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-25T14:13:10.539 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:13:10 +0000 (0:00:00.378) 0:05:43.003 ******** 2021-03-25T14:13:10.546 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-03-25T14:13:10.547 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => {"changed": true, "cmd": ["/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-tdw0l_mt-build\nCollecting toml (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl\nCollecting docopt (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz\nInstalling collected packages: toml, docopt, registries-conf-ctl\n Running setup.py install for docopt: started\n Running setup.py install for docopt: finished with status 'done'\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-tdw0l_mt-build", "Collecting toml (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl", "Collecting docopt (from registries-conf-ctl==1.0)", " Downloading https://files. 2021-03-25T14:13:10.549 INFO:teuthology.task.ansible.out:pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz", "Installing collected packages: toml, docopt, registries-conf-ctl", " Running setup.py install for docopt: started", " Running setup.py install for docopt: finished with status 'done'", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-03-25T14:13:10.572 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:13:10 +0000 (0:00:00.033) 0:05:43.036 ******** 2021-03-25T14:13:10.580 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-03-25T14:13:10.581 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:13:10.613 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-03-25T14:13:10.615 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:13:10.638 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:13:10 +0000 (0:00:00.065) 0:05:43.102 ******** 2021-03-25T14:13:10.680 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/containers/registries.conf if necessary] **** 2021-03-25T14:13:10.681 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:13:10.702 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:13:10 +0000 (0:00:00.063) 0:05:43.166 ******** 2021-03-25T14:13:11.042 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-03-25T14:13:11.043 INFO:teuthology.task.ansible.out:changed: [smithi110.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.147705", "end": "2021-03-25 14:13:11.016987", "rc": 0, "start": "2021-03-25 14:13:10.869282", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-25T14:13:11.064 INFO:teuthology.task.ansible.out:Thursday 25 March 2021 14:13:11 +0000 (0:00:00.361) 0:05:43.527 ******** 2021-03-25T14:13:11.091 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-03-25T14:13:11.092 INFO:teuthology.task.ansible.out:skipping: [smithi110.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-25T14:13:11.160 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-03-25T14:13:11.161 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-03-25T14:13:11.163 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched PLAY RECAP ********************************************************************* smithi110.front.sepia.ceph.com : ok=136 changed=46 unreachable=0 failed=0 skipped=175 rescued=0 ignored=4 smithi174.front.sepia.ceph.com : ok=136 changed=46 unreachable=0 failed=0 skipped=175 rescued=0 ignored=4 Thursday 25 March 2021 14:13:11 +0000 (0:00:00.099) 0:05:43.627 ******** =============================================================================== 2021-03-25T14:13:11.164 INFO:teuthology.task.ansible.out:common : nrpe - Ensure SELinux policy is up to date -------------------- 39.90s Create all admin users with sudo access. ------------------------------- 33.54s testnode : Install packages -------------------------------------------- 33.40s users : Update authorized_keys using the keys repo --------------------- 32.26s 2021-03-25T14:13:11.164 INFO:teuthology.task.ansible.out:common : nrpe - Load SELinux policy package ---------------------------- 16.01s common : nrpe - Remove SELinux policy package -------------------------- 15.81s common : Register with subscription-manager. --------------------------- 14.17s Remove revoked users --------------------------------------------------- 12.06s container-host : Install container packages ----------------------------- 9.15s testnode : Zap all non-root disks --------------------------------------- 5.87s testnode : Ensure ceph packages are not present. ------------------------ 5.68s testnode : Ensure ceph dependency packages are not present. ------------- 5.32s 2021-03-25T14:13:11.164 INFO:teuthology.task.ansible.out:common : Install nrpe package and dependencies (RHEL/CentOS) ------------ 3.96s container-host : Install registries-conf-ctl ---------------------------- 2.71s testnode : Install epel packages ---------------------------------------- 2.40s testnode : Rebuild rpmdb ------------------------------------------------ 2.12s common : Install Kerberos Packages (RedHat) ----------------------------- 2.01s users : Update authorized_keys for each user with literal keys ---------- 1.76s testnode : List any leftover Ceph artifacts from previous jobs ---------- 1.74s 2021-03-25T14:13:11.164 INFO:teuthology.task.ansible.out:Gathering Facts --------------------------------------------------------- 1.74s 2021-03-25T14:13:11.523 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi110.front.sepia.ceph.com'), Remote(name='ubuntu@smithi174.front.sepia.ceph.com')] 2021-03-25T14:13:11.524 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-25T14:13:11.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-25T14:13:11.596 DEBUG:teuthology.orchestra.run.smithi110:> true 2021-03-25T14:13:11.691 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-25T14:13:11.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-25T14:13:11.761 DEBUG:teuthology.orchestra.run.smithi174:> true 2021-03-25T14:13:11.856 INFO:teuthology.run_tasks:Running task clock... 2021-03-25T14:13:11.869 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-03-25T14:13:11.869 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-03-25T14:13:11.870 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-03-25T14:13:11.902 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2021-03-25T14:13:11.917 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2021-03-25T14:13:11.952 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: ntpd: command not found 2021-03-25T14:13:11.962 INFO:teuthology.orchestra.run.smithi110.stdout:506 Cannot talk to daemon 2021-03-25T14:13:11.976 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to start ntp.service: Unit ntp.service not found. 2021-03-25T14:13:11.989 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2021-03-25T14:13:12.053 INFO:teuthology.orchestra.run.smithi110.stderr:bash: ntpq: command not found 2021-03-25T14:13:12.055 INFO:teuthology.orchestra.run.smithi110.stdout:210 Number of sources = 4 2021-03-25T14:13:12.055 INFO:teuthology.orchestra.run.smithi110.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2021-03-25T14:13:12.055 INFO:teuthology.orchestra.run.smithi110.stdout:=============================================================================== 2021-03-25T14:13:12.055 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-03-25T14:13:12.055 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-03-25T14:13:12.055 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-03-25T14:13:12.055 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-03-25T14:13:12.056 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-03-25T14:13:12.057 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-03-25T14:13:12.093 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2021-03-25T14:13:12.109 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2021-03-25T14:13:12.150 INFO:teuthology.orchestra.run.smithi174.stderr:sudo: ntpd: command not found 2021-03-25T14:13:12.161 INFO:teuthology.orchestra.run.smithi174.stdout:506 Cannot talk to daemon 2021-03-25T14:13:12.177 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to start ntp.service: Unit ntp.service not found. 2021-03-25T14:13:12.191 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2021-03-25T14:13:12.252 INFO:teuthology.orchestra.run.smithi174.stderr:bash: ntpq: command not found 2021-03-25T14:13:12.255 INFO:teuthology.orchestra.run.smithi174.stdout:210 Number of sources = 4 2021-03-25T14:13:12.255 INFO:teuthology.orchestra.run.smithi174.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2021-03-25T14:13:12.256 INFO:teuthology.orchestra.run.smithi174.stdout:=============================================================================== 2021-03-25T14:13:12.256 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-03-25T14:13:12.256 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-03-25T14:13:12.256 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-03-25T14:13:12.256 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-03-25T14:13:12.256 INFO:teuthology.run_tasks:Running task install... 2021-03-25T14:13:12.264 DEBUG:teuthology.task.install:project ceph 2021-03-25T14:13:12.265 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': 'df88ec382221e0c1a0a6e66961f3fc1519f95986'}} 2021-03-25T14:13:12.265 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': 'df88ec382221e0c1a0a6e66961f3fc1519f95986'} 2021-03-25T14:13:12.265 INFO:teuthology.task.install:Using flavor: basic 2021-03-25T14:13:12.279 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2021-03-25T14:13:12.279 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2021-03-25T14:13:12.280 DEBUG:teuthology.orchestra.run.smithi110:> sudo lsb_release -is 2021-03-25T14:13:12.318 INFO:teuthology.orchestra.run.smithi110.stdout:RedHatEnterprise 2021-03-25T14:13:12.319 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2021-03-25T14:13:12.319 DEBUG:teuthology.orchestra.run.smithi174:> sudo lsb_release -is 2021-03-25T14:13:12.320 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'df88ec382221e0c1a0a6e66961f3fc1519f95986', 'tag': None, 'wait_for_package': False} 2021-03-25T14:13:12.320 DEBUG:teuthology.orchestra.run.smithi110:> sudo lsb_release -is 2021-03-25T14:13:12.358 INFO:teuthology.orchestra.run.smithi174.stdout:RedHatEnterprise 2021-03-25T14:13:12.359 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2021-03-25T14:13:12.359 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'df88ec382221e0c1a0a6e66961f3fc1519f95986', 'tag': None, 'wait_for_package': False} 2021-03-25T14:13:12.359 DEBUG:teuthology.orchestra.run.smithi174:> sudo lsb_release -is 2021-03-25T14:13:12.396 INFO:teuthology.orchestra.run.smithi110.stdout:RedHatEnterprise 2021-03-25T14:13:12.397 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2021-03-25T14:13:12.398 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=df88ec382221e0c1a0a6e66961f3fc1519f95986 2021-03-25T14:13:12.438 INFO:teuthology.orchestra.run.smithi174.stdout:RedHatEnterprise 2021-03-25T14:13:12.439 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2021-03-25T14:13:12.439 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=df88ec382221e0c1a0a6e66961f3fc1519f95986 2021-03-25T14:13:12.544 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-rishabh-vr-set-shell-to-True/df88ec382221e0c1a0a6e66961f3fc1519f95986/centos/8/flavors/default/ 2021-03-25T14:13:12.544 INFO:teuthology.task.install.rpm:Package version is 17.0.0-1676.gdf88ec38 2021-03-25T14:13:12.576 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-rishabh-vr-set-shell-to-True/df88ec382221e0c1a0a6e66961f3fc1519f95986/centos/8/flavors/default/ 2021-03-25T14:13:12.576 INFO:teuthology.task.install.rpm:Package version is 17.0.0-1676.gdf88ec38 2021-03-25T14:13:12.652 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-vr-set-shell-to-True/df88ec382221e0c1a0a6e66961f3fc1519f95986/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-vr-set-shell-to-True/df88ec382221e0c1a0a6e66961f3fc1519f95986/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-vr-set-shell-to-True/df88ec382221e0c1a0a6e66961f3fc1519f95986/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2021-03-25T14:13:12.652 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2021-03-25T14:13:12.653 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/yum.repos.d/ceph.repo 2021-03-25T14:13:12.677 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2021-03-25T14:13:12.677 DEBUG:teuthology.orchestra.run.smithi110:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/df88ec382221e0c1a0a6e66961f3fc1519f95986/;g' /etc/yum.repos.d/ceph.repo ; fi 2021-03-25T14:13:12.680 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-vr-set-shell-to-True/df88ec382221e0c1a0a6e66961f3fc1519f95986/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-vr-set-shell-to-True/df88ec382221e0c1a0a6e66961f3fc1519f95986/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-vr-set-shell-to-True/df88ec382221e0c1a0a6e66961f3fc1519f95986/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2021-03-25T14:13:12.681 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2021-03-25T14:13:12.681 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/yum.repos.d/ceph.repo 2021-03-25T14:13:12.704 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2021-03-25T14:13:12.704 DEBUG:teuthology.orchestra.run.smithi174:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/df88ec382221e0c1a0a6e66961f3fc1519f95986/;g' /etc/yum.repos.d/ceph.repo ; fi 2021-03-25T14:13:12.742 DEBUG:teuthology.orchestra.run.smithi110:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2021-03-25T14:13:12.769 DEBUG:teuthology.orchestra.run.smithi174:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2021-03-25T14:13:12.816 DEBUG:teuthology.orchestra.run.smithi110:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2021-03-25T14:13:12.843 DEBUG:teuthology.orchestra.run.smithi174:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2021-03-25T14:13:12.878 INFO:teuthology.orchestra.run.smithi110.stdout:check_obsoletes = 1 2021-03-25T14:13:12.880 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum clean all 2021-03-25T14:13:12.907 INFO:teuthology.orchestra.run.smithi174.stdout:check_obsoletes = 1 2021-03-25T14:13:12.908 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum clean all 2021-03-25T14:13:13.183 INFO:teuthology.orchestra.run.smithi110.stdout:Updating Subscription Management repositories. 2021-03-25T14:13:13.213 INFO:teuthology.orchestra.run.smithi174.stdout:Updating Subscription Management repositories. 2021-03-25T14:13:13.450 INFO:teuthology.orchestra.run.smithi110.stdout:123 files removed 2021-03-25T14:13:13.487 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2021-03-25T14:13:13.488 INFO:teuthology.orchestra.run.smithi174.stdout:123 files removed 2021-03-25T14:13:13.523 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2021-03-25T14:13:13.751 INFO:teuthology.orchestra.run.smithi110.stdout:Updating Subscription Management repositories. 2021-03-25T14:13:13.785 INFO:teuthology.orchestra.run.smithi174.stdout:Updating Subscription Management repositories. 2021-03-25T14:13:14.344 INFO:teuthology.orchestra.run.smithi110.stdout:ceph packages for x86_64 336 kB/s | 75 kB 00:00 2021-03-25T14:13:14.369 INFO:teuthology.orchestra.run.smithi174.stdout:ceph packages for x86_64 341 kB/s | 75 kB 00:00 2021-03-25T14:13:14.559 INFO:teuthology.orchestra.run.smithi110.stdout:ceph noarch packages 83 kB/s | 15 kB 00:00 2021-03-25T14:13:14.579 INFO:teuthology.orchestra.run.smithi174.stdout:ceph noarch packages 85 kB/s | 15 kB 00:00 2021-03-25T14:13:14.764 INFO:teuthology.orchestra.run.smithi110.stdout:ceph source packages 7.8 kB/s | 1.4 kB 00:00 2021-03-25T14:13:14.785 INFO:teuthology.orchestra.run.smithi174.stdout:ceph source packages 7.8 kB/s | 1.4 kB 00:00 2021-03-25T14:13:15.518 INFO:teuthology.orchestra.run.smithi110.stdout:Extra Packages for Enterprise Linux 12 MB/s | 9.1 MB 00:00 2021-03-25T14:13:15.657 INFO:teuthology.orchestra.run.smithi174.stdout:Extra Packages for Enterprise Linux 11 MB/s | 9.1 MB 00:00 2021-03-25T14:13:17.378 INFO:teuthology.orchestra.run.smithi110.stdout:lab-extras 4.2 MB/s | 24 kB 00:00 2021-03-25T14:13:17.467 INFO:teuthology.orchestra.run.smithi174.stdout:lab-extras 4.5 MB/s | 24 kB 00:00 2021-03-25T14:13:17.653 INFO:teuthology.orchestra.run.smithi110.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 116 MB/s | 26 MB 00:00 2021-03-25T14:13:17.750 INFO:teuthology.orchestra.run.smithi174.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 122 MB/s | 28 MB 00:00 2021-03-25T14:13:21.719 INFO:teuthology.orchestra.run.smithi110.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 126 MB/s | 28 MB 00:00 2021-03-25T14:13:21.898 INFO:teuthology.orchestra.run.smithi174.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 115 MB/s | 26 MB 00:00 2021-03-25T14:13:27.996 INFO:teuthology.orchestra.run.smithi110.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2021-03-25T14:13:27.997 INFO:teuthology.orchestra.run.smithi110.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2021-03-25T14:13:28.005 INFO:teuthology.orchestra.run.smithi110.stdout:Package NetworkManager-1:1.26.0-8.el8.x86_64 is already installed. 2021-03-25T14:13:28.006 INFO:teuthology.orchestra.run.smithi110.stdout:Package iproute-5.3.0-5.el8.x86_64 is already installed. 2021-03-25T14:13:28.006 INFO:teuthology.orchestra.run.smithi110.stdout:Package util-linux-2.32.1-24.el8.x86_64 is already installed. 2021-03-25T14:13:28.007 INFO:teuthology.orchestra.run.smithi110.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2021-03-25T14:13:28.008 INFO:teuthology.orchestra.run.smithi110.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2021-03-25T14:13:28.010 INFO:teuthology.orchestra.run.smithi110.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2021-03-25T14:13:28.011 INFO:teuthology.orchestra.run.smithi110.stdout:Package xfsprogs-5.0.0-4.el8.x86_64 is already installed. 2021-03-25T14:13:28.056 INFO:teuthology.orchestra.run.smithi174.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2021-03-25T14:13:28.057 INFO:teuthology.orchestra.run.smithi174.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2021-03-25T14:13:28.065 INFO:teuthology.orchestra.run.smithi174.stdout:Package NetworkManager-1:1.26.0-8.el8.x86_64 is already installed. 2021-03-25T14:13:28.065 INFO:teuthology.orchestra.run.smithi174.stdout:Package iproute-5.3.0-5.el8.x86_64 is already installed. 2021-03-25T14:13:28.066 INFO:teuthology.orchestra.run.smithi174.stdout:Package util-linux-2.32.1-24.el8.x86_64 is already installed. 2021-03-25T14:13:28.067 INFO:teuthology.orchestra.run.smithi174.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2021-03-25T14:13:28.068 INFO:teuthology.orchestra.run.smithi174.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2021-03-25T14:13:28.070 INFO:teuthology.orchestra.run.smithi174.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2021-03-25T14:13:28.070 INFO:teuthology.orchestra.run.smithi174.stdout:Package xfsprogs-5.0.0-4.el8.x86_64 is already installed. 2021-03-25T14:13:28.365 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2021-03-25T14:13:28.394 INFO:teuthology.orchestra.run.smithi110.stdout:====================================================================================================================== 2021-03-25T14:13:28.394 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2021-03-25T14:13:28.394 INFO:teuthology.orchestra.run.smithi110.stdout:====================================================================================================================== 2021-03-25T14:13:28.394 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2021-03-25T14:13:28.394 INFO:teuthology.orchestra.run.smithi110.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2021-03-25T14:13:28.394 INFO:teuthology.orchestra.run.smithi110.stdout: ceph x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 6.4 k 2021-03-25T14:13:28.394 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 5.1 M 2021-03-25T14:13:28.395 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-fuse x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 826 k 2021-03-25T14:13:28.395 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-immutable-object-cache x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 155 k 2021-03-25T14:13:28.395 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 1.4 M 2021-03-25T14:13:28.395 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-cephadm noarch 2:17.0.0-1676.gdf88ec38.el8 ceph-noarch 74 k 2021-03-25T14:13:28.395 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-dashboard noarch 2:17.0.0-1676.gdf88ec38.el8 ceph-noarch 2.3 M 2021-03-25T14:13:28.395 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-diskprediction-local noarch 2:17.0.0-1676.gdf88ec38.el8 ceph-noarch 7.4 M 2021-03-25T14:13:28.395 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-rook noarch 2:17.0.0-1676.gdf88ec38.el8 ceph-noarch 26 k 2021-03-25T14:13:28.395 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-radosgw x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 9.0 M 2021-03-25T14:13:28.395 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-test x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 40 M 2021-03-25T14:13:28.395 INFO:teuthology.orchestra.run.smithi110.stdout: cephadm noarch 2:17.0.0-1676.gdf88ec38.el8 ceph-noarch 65 k 2021-03-25T14:13:28.395 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-mirror x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 211 k 2021-03-25T14:13:28.395 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-top noarch 2:17.0.0-1676.gdf88ec38.el8 ceph-noarch 12 k 2021-03-25T14:13:28.395 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-libelf-devel x86_64 0.180-1.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2021-03-25T14:13:28.396 INFO:teuthology.orchestra.run.smithi110.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2021-03-25T14:13:28.396 INFO:teuthology.orchestra.run.smithi110.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2021-03-25T14:13:28.396 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs-devel x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 23 k 2021-03-25T14:13:28.396 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs2 x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 748 k 2021-03-25T14:13:28.396 INFO:teuthology.orchestra.run.smithi110.stdout: librados-devel x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 125 k 2021-03-25T14:13:28.396 INFO:teuthology.orchestra.run.smithi110.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2021-03-25T14:13:28.396 INFO:teuthology.orchestra.run.smithi110.stdout: libuuid-devel x86_64 2.32.1-24.el8 rhel-8-for-x86_64-baseos-rpms 96 k 2021-03-25T14:13:28.396 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-devel x86_64 1:1.1.1g-12.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2021-03-25T14:13:28.396 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cephfs x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 176 k 2021-03-25T14:13:28.396 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rados x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 364 k 2021-03-25T14:13:28.396 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rbd x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 345 k 2021-03-25T14:13:28.396 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rgw x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 110 k 2021-03-25T14:13:28.397 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-fuse x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 86 k 2021-03-25T14:13:28.397 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-mirror x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 3.4 M 2021-03-25T14:13:28.397 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-nbd x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 165 k 2021-03-25T14:13:28.397 INFO:teuthology.orchestra.run.smithi110.stdout: xfsprogs-devel x86_64 5.0.0-4.el8 rhel-8-for-x86_64-baseos-rpms 69 k 2021-03-25T14:13:28.397 INFO:teuthology.orchestra.run.smithi110.stdout:Upgrading: 2021-03-25T14:13:28.397 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager x86_64 1:1.26.0-13.el8_3 rhel-8-for-x86_64-baseos-rpms 2.4 M 2021-03-25T14:13:28.398 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-libnm x86_64 1:1.26.0-13.el8_3 rhel-8-for-x86_64-baseos-rpms 1.8 M 2021-03-25T14:13:28.398 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-team x86_64 1:1.26.0-13.el8_3 rhel-8-for-x86_64-baseos-rpms 142 k 2021-03-25T14:13:28.398 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-tui x86_64 1:1.26.0-13.el8_3 rhel-8-for-x86_64-baseos-rpms 320 k 2021-03-25T14:13:28.398 INFO:teuthology.orchestra.run.smithi110.stdout: librados2 x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 3.3 M 2021-03-25T14:13:28.398 INFO:teuthology.orchestra.run.smithi110.stdout: librbd1 x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 3.4 M 2021-03-25T14:13:28.398 INFO:teuthology.orchestra.run.smithi110.stdout: openssl x86_64 1:1.1.1g-12.el8_3 rhel-8-for-x86_64-baseos-rpms 707 k 2021-03-25T14:13:28.398 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-libs x86_64 1:1.1.1g-12.el8_3 rhel-8-for-x86_64-baseos-rpms 1.5 M 2021-03-25T14:13:28.398 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2021-03-25T14:13:28.398 INFO:teuthology.orchestra.run.smithi110.stdout: automake noarch 1.16.1-6.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2021-03-25T14:13:28.398 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-common x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 19 M 2021-03-25T14:13:28.398 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-grafana-dashboards noarch 2:17.0.0-1676.gdf88ec38.el8 ceph-noarch 23 k 2021-03-25T14:13:28.399 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mds x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 2.2 M 2021-03-25T14:13:28.399 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-modules-core noarch 2:17.0.0-1676.gdf88ec38.el8 ceph-noarch 198 k 2021-03-25T14:13:28.399 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mon x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 3.5 M 2021-03-25T14:13:28.399 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-osd x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 16 M 2021-03-25T14:13:28.399 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-prometheus-alerts noarch 2:17.0.0-1676.gdf88ec38.el8 ceph-noarch 8.9 k 2021-03-25T14:13:28.399 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-selinux x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 23 k 2021-03-25T14:13:28.399 INFO:teuthology.orchestra.run.smithi110.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2021-03-25T14:13:28.399 INFO:teuthology.orchestra.run.smithi110.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2021-03-25T14:13:28.399 INFO:teuthology.orchestra.run.smithi110.stdout: fuse-common x86_64 3.2.1-12.el8 rhel-8-for-x86_64-baseos-rpms 21 k 2021-03-25T14:13:28.399 INFO:teuthology.orchestra.run.smithi110.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2021-03-25T14:13:28.399 INFO:teuthology.orchestra.run.smithi110.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2021-03-25T14:13:28.399 INFO:teuthology.orchestra.run.smithi110.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2021-03-25T14:13:28.400 INFO:teuthology.orchestra.run.smithi110.stdout: krb5-devel x86_64 1.18.2-5.el8 rhel-8-for-x86_64-baseos-rpms 558 k 2021-03-25T14:13:28.400 INFO:teuthology.orchestra.run.smithi110.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2021-03-25T14:13:28.400 INFO:teuthology.orchestra.run.smithi110.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2021-03-25T14:13:28.400 INFO:teuthology.orchestra.run.smithi110.stdout: libgfortran x86_64 8.3.1-5.1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2021-03-25T14:13:28.400 INFO:teuthology.orchestra.run.smithi110.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2021-03-25T14:13:28.400 INFO:teuthology.orchestra.run.smithi110.stdout: libquadmath x86_64 8.3.1-5.1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2021-03-25T14:13:28.400 INFO:teuthology.orchestra.run.smithi110.stdout: librabbitmq x86_64 0.9.0-2.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2021-03-25T14:13:28.400 INFO:teuthology.orchestra.run.smithi110.stdout: libradosstriper1 x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 456 k 2021-03-25T14:13:28.400 INFO:teuthology.orchestra.run.smithi110.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2021-03-25T14:13:28.400 INFO:teuthology.orchestra.run.smithi110.stdout: librgw2 x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 3.6 M 2021-03-25T14:13:28.400 INFO:teuthology.orchestra.run.smithi110.stdout: libselinux-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 199 k 2021-03-25T14:13:28.400 INFO:teuthology.orchestra.run.smithi110.stdout: libsepol-devel x86_64 2.9-1.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2021-03-25T14:13:28.401 INFO:teuthology.orchestra.run.smithi110.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2021-03-25T14:13:28.401 INFO:teuthology.orchestra.run.smithi110.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2021-03-25T14:13:28.401 INFO:teuthology.orchestra.run.smithi110.stdout: libxslt x86_64 1.1.32-5.el8 rhel-8-for-x86_64-baseos-rpms 250 k 2021-03-25T14:13:28.401 INFO:teuthology.orchestra.run.smithi110.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2021-03-25T14:13:28.401 INFO:teuthology.orchestra.run.smithi110.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2021-03-25T14:13:28.401 INFO:teuthology.orchestra.run.smithi110.stdout: openblas x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.3 M 2021-03-25T14:13:28.401 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-threads x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.4 M 2021-03-25T14:13:28.401 INFO:teuthology.orchestra.run.smithi110.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2021-03-25T14:13:28.401 INFO:teuthology.orchestra.run.smithi110.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2021-03-25T14:13:28.401 INFO:teuthology.orchestra.run.smithi110.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2021-03-25T14:13:28.401 INFO:teuthology.orchestra.run.smithi110.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2021-03-25T14:13:28.402 INFO:teuthology.orchestra.run.smithi110.stdout: python3-asn1crypto noarch 0.24.0-3.el8 rhel-8-for-x86_64-baseos-rpms 181 k 2021-03-25T14:13:28.402 INFO:teuthology.orchestra.run.smithi110.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2021-03-25T14:13:28.402 INFO:teuthology.orchestra.run.smithi110.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2021-03-25T14:13:28.402 INFO:teuthology.orchestra.run.smithi110.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2021-03-25T14:13:28.402 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2021-03-25T14:13:28.402 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-argparse x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 42 k 2021-03-25T14:13:28.402 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-common x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 73 k 2021-03-25T14:13:28.402 INFO:teuthology.orchestra.run.smithi110.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2021-03-25T14:13:28.402 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2021-03-25T14:13:28.402 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2021-03-25T14:13:28.402 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2021-03-25T14:13:28.402 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cryptography x86_64 2.3-3.el8 rhel-8-for-x86_64-baseos-rpms 511 k 2021-03-25T14:13:28.403 INFO:teuthology.orchestra.run.smithi110.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2021-03-25T14:13:28.403 INFO:teuthology.orchestra.run.smithi110.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2021-03-25T14:13:28.403 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2021-03-25T14:13:28.403 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2021-03-25T14:13:28.403 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2021-03-25T14:13:28.403 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2021-03-25T14:13:28.403 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2021-03-25T14:13:28.403 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2021-03-25T14:13:28.403 INFO:teuthology.orchestra.run.smithi110.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2021-03-25T14:13:28.403 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2021-03-25T14:13:28.403 INFO:teuthology.orchestra.run.smithi110.stdout: python3-lxml x86_64 4.2.3-1.el8 rhel-8-for-x86_64-appstream-rpms 1.5 M 2021-03-25T14:13:28.403 INFO:teuthology.orchestra.run.smithi110.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2021-03-25T14:13:28.404 INFO:teuthology.orchestra.run.smithi110.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2021-03-25T14:13:28.404 INFO:teuthology.orchestra.run.smithi110.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2021-03-25T14:13:28.404 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2021-03-25T14:13:28.404 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2021-03-25T14:13:28.404 INFO:teuthology.orchestra.run.smithi110.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2021-03-25T14:13:28.404 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2021-03-25T14:13:28.404 INFO:teuthology.orchestra.run.smithi110.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2021-03-25T14:13:28.405 INFO:teuthology.orchestra.run.smithi110.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2021-03-25T14:13:28.405 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyOpenSSL noarch 18.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2021-03-25T14:13:28.405 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2021-03-25T14:13:28.405 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2021-03-25T14:13:28.405 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2021-03-25T14:13:28.405 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2021-03-25T14:13:28.405 INFO:teuthology.orchestra.run.smithi110.stdout: python3-remoto noarch 1.1.4-4.el8 epel 48 k 2021-03-25T14:13:28.405 INFO:teuthology.orchestra.run.smithi110.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2021-03-25T14:13:28.405 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2021-03-25T14:13:28.405 INFO:teuthology.orchestra.run.smithi110.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2021-03-25T14:13:28.405 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rsa noarch 3.4.2-16.el8 epel 73 k 2021-03-25T14:13:28.406 INFO:teuthology.orchestra.run.smithi110.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2021-03-25T14:13:28.406 INFO:teuthology.orchestra.run.smithi110.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2021-03-25T14:13:28.406 INFO:teuthology.orchestra.run.smithi110.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2021-03-25T14:13:28.406 INFO:teuthology.orchestra.run.smithi110.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2021-03-25T14:13:28.406 INFO:teuthology.orchestra.run.smithi110.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2021-03-25T14:13:28.406 INFO:teuthology.orchestra.run.smithi110.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2021-03-25T14:13:28.406 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webencodings noarch 0.5.1-6.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2021-03-25T14:13:28.406 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2021-03-25T14:13:28.406 INFO:teuthology.orchestra.run.smithi110.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2021-03-25T14:13:28.406 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2021-03-25T14:13:28.406 INFO:teuthology.orchestra.run.smithi110.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2021-03-25T14:13:28.406 INFO:teuthology.orchestra.run.smithi110.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2021-03-25T14:13:28.407 INFO:teuthology.orchestra.run.smithi110.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2021-03-25T14:13:28.407 INFO:teuthology.orchestra.run.smithi110.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2021-03-25T14:13:28.407 INFO:teuthology.orchestra.run.smithi110.stdout: zlib-devel x86_64 1.2.11-16.el8_2 rhel-8-for-x86_64-baseos-rpms 57 k 2021-03-25T14:13:28.407 INFO:teuthology.orchestra.run.smithi110.stdout:Installing weak dependencies: 2021-03-25T14:13:28.407 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2021-03-25T14:13:28.407 INFO:teuthology.orchestra.run.smithi110.stdout: python3-html5lib noarch 1:0.999999999-6.el8 rhel-8-for-x86_64-appstream-rpms 214 k 2021-03-25T14:13:28.407 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:13:28.407 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2021-03-25T14:13:28.407 INFO:teuthology.orchestra.run.smithi110.stdout:====================================================================================================================== 2021-03-25T14:13:28.407 INFO:teuthology.orchestra.run.smithi110.stdout:Install 129 Packages 2021-03-25T14:13:28.407 INFO:teuthology.orchestra.run.smithi110.stdout:Upgrade 8 Packages 2021-03-25T14:13:28.408 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:13:28.408 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 181 M 2021-03-25T14:13:28.408 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2021-03-25T14:13:28.418 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2021-03-25T14:13:28.439 INFO:teuthology.orchestra.run.smithi174.stdout:====================================================================================================================== 2021-03-25T14:13:28.439 INFO:teuthology.orchestra.run.smithi174.stdout: Package Arch Version Repository Size 2021-03-25T14:13:28.439 INFO:teuthology.orchestra.run.smithi174.stdout:====================================================================================================================== 2021-03-25T14:13:28.439 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2021-03-25T14:13:28.439 INFO:teuthology.orchestra.run.smithi174.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2021-03-25T14:13:28.439 INFO:teuthology.orchestra.run.smithi174.stdout: ceph x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 6.4 k 2021-03-25T14:13:28.439 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-base x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 5.1 M 2021-03-25T14:13:28.439 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-fuse x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 826 k 2021-03-25T14:13:28.440 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-immutable-object-cache x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 155 k 2021-03-25T14:13:28.440 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 1.4 M 2021-03-25T14:13:28.440 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-cephadm noarch 2:17.0.0-1676.gdf88ec38.el8 ceph-noarch 74 k 2021-03-25T14:13:28.440 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-dashboard noarch 2:17.0.0-1676.gdf88ec38.el8 ceph-noarch 2.3 M 2021-03-25T14:13:28.440 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-diskprediction-local noarch 2:17.0.0-1676.gdf88ec38.el8 ceph-noarch 7.4 M 2021-03-25T14:13:28.440 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-rook noarch 2:17.0.0-1676.gdf88ec38.el8 ceph-noarch 26 k 2021-03-25T14:13:28.440 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-radosgw x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 9.0 M 2021-03-25T14:13:28.440 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-test x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 40 M 2021-03-25T14:13:28.440 INFO:teuthology.orchestra.run.smithi174.stdout: cephadm noarch 2:17.0.0-1676.gdf88ec38.el8 ceph-noarch 65 k 2021-03-25T14:13:28.440 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-mirror x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 211 k 2021-03-25T14:13:28.440 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-top noarch 2:17.0.0-1676.gdf88ec38.el8 ceph-noarch 12 k 2021-03-25T14:13:28.440 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libelf-devel x86_64 0.180-1.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2021-03-25T14:13:28.440 INFO:teuthology.orchestra.run.smithi174.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2021-03-25T14:13:28.441 INFO:teuthology.orchestra.run.smithi174.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2021-03-25T14:13:28.441 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs-devel x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 23 k 2021-03-25T14:13:28.441 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs2 x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 748 k 2021-03-25T14:13:28.441 INFO:teuthology.orchestra.run.smithi174.stdout: librados-devel x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 125 k 2021-03-25T14:13:28.441 INFO:teuthology.orchestra.run.smithi174.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2021-03-25T14:13:28.441 INFO:teuthology.orchestra.run.smithi174.stdout: libuuid-devel x86_64 2.32.1-24.el8 rhel-8-for-x86_64-baseos-rpms 96 k 2021-03-25T14:13:28.441 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-devel x86_64 1:1.1.1g-12.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2021-03-25T14:13:28.441 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cephfs x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 176 k 2021-03-25T14:13:28.441 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rados x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 364 k 2021-03-25T14:13:28.441 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rbd x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 345 k 2021-03-25T14:13:28.441 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rgw x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 110 k 2021-03-25T14:13:28.441 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-fuse x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 86 k 2021-03-25T14:13:28.442 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-mirror x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 3.4 M 2021-03-25T14:13:28.442 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-nbd x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 165 k 2021-03-25T14:13:28.442 INFO:teuthology.orchestra.run.smithi174.stdout: xfsprogs-devel x86_64 5.0.0-4.el8 rhel-8-for-x86_64-baseos-rpms 69 k 2021-03-25T14:13:28.442 INFO:teuthology.orchestra.run.smithi174.stdout:Upgrading: 2021-03-25T14:13:28.442 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager x86_64 1:1.26.0-13.el8_3 rhel-8-for-x86_64-baseos-rpms 2.4 M 2021-03-25T14:13:28.442 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-libnm x86_64 1:1.26.0-13.el8_3 rhel-8-for-x86_64-baseos-rpms 1.8 M 2021-03-25T14:13:28.442 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-team x86_64 1:1.26.0-13.el8_3 rhel-8-for-x86_64-baseos-rpms 142 k 2021-03-25T14:13:28.442 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-tui x86_64 1:1.26.0-13.el8_3 rhel-8-for-x86_64-baseos-rpms 320 k 2021-03-25T14:13:28.442 INFO:teuthology.orchestra.run.smithi174.stdout: librados2 x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 3.3 M 2021-03-25T14:13:28.442 INFO:teuthology.orchestra.run.smithi174.stdout: librbd1 x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 3.4 M 2021-03-25T14:13:28.442 INFO:teuthology.orchestra.run.smithi174.stdout: openssl x86_64 1:1.1.1g-12.el8_3 rhel-8-for-x86_64-baseos-rpms 707 k 2021-03-25T14:13:28.442 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-libs x86_64 1:1.1.1g-12.el8_3 rhel-8-for-x86_64-baseos-rpms 1.5 M 2021-03-25T14:13:28.443 INFO:teuthology.orchestra.run.smithi174.stdout:Installing dependencies: 2021-03-25T14:13:28.443 INFO:teuthology.orchestra.run.smithi174.stdout: automake noarch 1.16.1-6.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2021-03-25T14:13:28.443 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-common x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 19 M 2021-03-25T14:13:28.443 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-grafana-dashboards noarch 2:17.0.0-1676.gdf88ec38.el8 ceph-noarch 23 k 2021-03-25T14:13:28.443 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mds x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 2.2 M 2021-03-25T14:13:28.443 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-modules-core noarch 2:17.0.0-1676.gdf88ec38.el8 ceph-noarch 198 k 2021-03-25T14:13:28.443 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mon x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 3.5 M 2021-03-25T14:13:28.443 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-osd x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 16 M 2021-03-25T14:13:28.443 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-prometheus-alerts noarch 2:17.0.0-1676.gdf88ec38.el8 ceph-noarch 8.9 k 2021-03-25T14:13:28.443 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-selinux x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 23 k 2021-03-25T14:13:28.443 INFO:teuthology.orchestra.run.smithi174.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2021-03-25T14:13:28.443 INFO:teuthology.orchestra.run.smithi174.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2021-03-25T14:13:28.444 INFO:teuthology.orchestra.run.smithi174.stdout: fuse-common x86_64 3.2.1-12.el8 rhel-8-for-x86_64-baseos-rpms 21 k 2021-03-25T14:13:28.444 INFO:teuthology.orchestra.run.smithi174.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2021-03-25T14:13:28.444 INFO:teuthology.orchestra.run.smithi174.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2021-03-25T14:13:28.444 INFO:teuthology.orchestra.run.smithi174.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2021-03-25T14:13:28.444 INFO:teuthology.orchestra.run.smithi174.stdout: krb5-devel x86_64 1.18.2-5.el8 rhel-8-for-x86_64-baseos-rpms 558 k 2021-03-25T14:13:28.444 INFO:teuthology.orchestra.run.smithi174.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2021-03-25T14:13:28.444 INFO:teuthology.orchestra.run.smithi174.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2021-03-25T14:13:28.444 INFO:teuthology.orchestra.run.smithi174.stdout: libgfortran x86_64 8.3.1-5.1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2021-03-25T14:13:28.444 INFO:teuthology.orchestra.run.smithi174.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2021-03-25T14:13:28.444 INFO:teuthology.orchestra.run.smithi174.stdout: libquadmath x86_64 8.3.1-5.1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2021-03-25T14:13:28.444 INFO:teuthology.orchestra.run.smithi174.stdout: librabbitmq x86_64 0.9.0-2.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2021-03-25T14:13:28.444 INFO:teuthology.orchestra.run.smithi174.stdout: libradosstriper1 x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 456 k 2021-03-25T14:13:28.444 INFO:teuthology.orchestra.run.smithi174.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2021-03-25T14:13:28.445 INFO:teuthology.orchestra.run.smithi174.stdout: librgw2 x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 3.6 M 2021-03-25T14:13:28.445 INFO:teuthology.orchestra.run.smithi174.stdout: libselinux-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 199 k 2021-03-25T14:13:28.445 INFO:teuthology.orchestra.run.smithi174.stdout: libsepol-devel x86_64 2.9-1.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2021-03-25T14:13:28.445 INFO:teuthology.orchestra.run.smithi174.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2021-03-25T14:13:28.445 INFO:teuthology.orchestra.run.smithi174.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2021-03-25T14:13:28.445 INFO:teuthology.orchestra.run.smithi174.stdout: libxslt x86_64 1.1.32-5.el8 rhel-8-for-x86_64-baseos-rpms 250 k 2021-03-25T14:13:28.445 INFO:teuthology.orchestra.run.smithi174.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2021-03-25T14:13:28.445 INFO:teuthology.orchestra.run.smithi174.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2021-03-25T14:13:28.445 INFO:teuthology.orchestra.run.smithi174.stdout: openblas x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.3 M 2021-03-25T14:13:28.445 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-threads x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.4 M 2021-03-25T14:13:28.445 INFO:teuthology.orchestra.run.smithi174.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2021-03-25T14:13:28.445 INFO:teuthology.orchestra.run.smithi174.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2021-03-25T14:13:28.446 INFO:teuthology.orchestra.run.smithi174.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2021-03-25T14:13:28.446 INFO:teuthology.orchestra.run.smithi174.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2021-03-25T14:13:28.446 INFO:teuthology.orchestra.run.smithi174.stdout: python3-asn1crypto noarch 0.24.0-3.el8 rhel-8-for-x86_64-baseos-rpms 181 k 2021-03-25T14:13:28.446 INFO:teuthology.orchestra.run.smithi174.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2021-03-25T14:13:28.446 INFO:teuthology.orchestra.run.smithi174.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2021-03-25T14:13:28.446 INFO:teuthology.orchestra.run.smithi174.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2021-03-25T14:13:28.446 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2021-03-25T14:13:28.446 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-argparse x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 42 k 2021-03-25T14:13:28.446 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-common x86_64 2:17.0.0-1676.gdf88ec38.el8 ceph 73 k 2021-03-25T14:13:28.446 INFO:teuthology.orchestra.run.smithi174.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2021-03-25T14:13:28.446 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2021-03-25T14:13:28.446 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2021-03-25T14:13:28.447 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2021-03-25T14:13:28.447 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cryptography x86_64 2.3-3.el8 rhel-8-for-x86_64-baseos-rpms 511 k 2021-03-25T14:13:28.447 INFO:teuthology.orchestra.run.smithi174.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2021-03-25T14:13:28.447 INFO:teuthology.orchestra.run.smithi174.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2021-03-25T14:13:28.447 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2021-03-25T14:13:28.447 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2021-03-25T14:13:28.447 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2021-03-25T14:13:28.447 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2021-03-25T14:13:28.447 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2021-03-25T14:13:28.447 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2021-03-25T14:13:28.447 INFO:teuthology.orchestra.run.smithi174.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2021-03-25T14:13:28.447 INFO:teuthology.orchestra.run.smithi174.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2021-03-25T14:13:28.448 INFO:teuthology.orchestra.run.smithi174.stdout: python3-lxml x86_64 4.2.3-1.el8 rhel-8-for-x86_64-appstream-rpms 1.5 M 2021-03-25T14:13:28.448 INFO:teuthology.orchestra.run.smithi174.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2021-03-25T14:13:28.448 INFO:teuthology.orchestra.run.smithi174.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2021-03-25T14:13:28.448 INFO:teuthology.orchestra.run.smithi174.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2021-03-25T14:13:28.448 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2021-03-25T14:13:28.448 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2021-03-25T14:13:28.448 INFO:teuthology.orchestra.run.smithi174.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2021-03-25T14:13:28.448 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2021-03-25T14:13:28.448 INFO:teuthology.orchestra.run.smithi174.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2021-03-25T14:13:28.448 INFO:teuthology.orchestra.run.smithi174.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2021-03-25T14:13:28.448 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyOpenSSL noarch 18.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2021-03-25T14:13:28.448 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2021-03-25T14:13:28.448 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2021-03-25T14:13:28.449 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2021-03-25T14:13:28.449 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2021-03-25T14:13:28.449 INFO:teuthology.orchestra.run.smithi174.stdout: python3-remoto noarch 1.1.4-4.el8 epel 48 k 2021-03-25T14:13:28.449 INFO:teuthology.orchestra.run.smithi174.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2021-03-25T14:13:28.449 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2021-03-25T14:13:28.449 INFO:teuthology.orchestra.run.smithi174.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2021-03-25T14:13:28.449 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rsa noarch 3.4.2-16.el8 epel 73 k 2021-03-25T14:13:28.449 INFO:teuthology.orchestra.run.smithi174.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2021-03-25T14:13:28.449 INFO:teuthology.orchestra.run.smithi174.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2021-03-25T14:13:28.449 INFO:teuthology.orchestra.run.smithi174.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2021-03-25T14:13:28.449 INFO:teuthology.orchestra.run.smithi174.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2021-03-25T14:13:28.449 INFO:teuthology.orchestra.run.smithi174.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2021-03-25T14:13:28.450 INFO:teuthology.orchestra.run.smithi174.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2021-03-25T14:13:28.450 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webencodings noarch 0.5.1-6.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2021-03-25T14:13:28.450 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2021-03-25T14:13:28.450 INFO:teuthology.orchestra.run.smithi174.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2021-03-25T14:13:28.450 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2021-03-25T14:13:28.450 INFO:teuthology.orchestra.run.smithi174.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2021-03-25T14:13:28.450 INFO:teuthology.orchestra.run.smithi174.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2021-03-25T14:13:28.450 INFO:teuthology.orchestra.run.smithi174.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2021-03-25T14:13:28.450 INFO:teuthology.orchestra.run.smithi174.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2021-03-25T14:13:28.450 INFO:teuthology.orchestra.run.smithi174.stdout: zlib-devel x86_64 1.2.11-16.el8_2 rhel-8-for-x86_64-baseos-rpms 57 k 2021-03-25T14:13:28.450 INFO:teuthology.orchestra.run.smithi174.stdout:Installing weak dependencies: 2021-03-25T14:13:28.450 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2021-03-25T14:13:28.451 INFO:teuthology.orchestra.run.smithi174.stdout: python3-html5lib noarch 1:0.999999999-6.el8 rhel-8-for-x86_64-appstream-rpms 214 k 2021-03-25T14:13:28.451 INFO:teuthology.orchestra.run.smithi174.stdout: 2021-03-25T14:13:28.451 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2021-03-25T14:13:28.451 INFO:teuthology.orchestra.run.smithi174.stdout:====================================================================================================================== 2021-03-25T14:13:28.451 INFO:teuthology.orchestra.run.smithi174.stdout:Install 129 Packages 2021-03-25T14:13:28.451 INFO:teuthology.orchestra.run.smithi174.stdout:Upgrade 8 Packages 2021-03-25T14:13:28.451 INFO:teuthology.orchestra.run.smithi174.stdout: 2021-03-25T14:13:28.452 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 181 M 2021-03-25T14:13:28.452 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading Packages: 2021-03-25T14:13:28.689 INFO:teuthology.orchestra.run.smithi110.stdout:(1/137): ceph-17.0.0-1676.gdf88ec38.el8.x86_64. 23 kB/s | 6.4 kB 00:00 2021-03-25T14:13:28.732 INFO:teuthology.orchestra.run.smithi174.stdout:(1/137): ceph-17.0.0-1676.gdf88ec38.el8.x86_64. 23 kB/s | 6.4 kB 00:00 2021-03-25T14:13:29.107 INFO:teuthology.orchestra.run.smithi110.stdout:(2/137): ceph-fuse-17.0.0-1676.gdf88ec38.el8.x8 1.9 MB/s | 826 kB 00:00 2021-03-25T14:13:29.248 INFO:teuthology.orchestra.run.smithi174.stdout:(2/137): ceph-fuse-17.0.0-1676.gdf88ec38.el8.x8 1.6 MB/s | 826 kB 00:00 2021-03-25T14:13:29.318 INFO:teuthology.orchestra.run.smithi174.stdout:(3/137): ceph-immutable-object-cache-17.0.0-167 2.2 MB/s | 155 kB 00:00 2021-03-25T14:13:29.597 INFO:teuthology.orchestra.run.smithi174.stdout:(4/137): ceph-base-17.0.0-1676.gdf88ec38.el8.x8 4.5 MB/s | 5.1 MB 00:01 2021-03-25T14:13:29.673 INFO:teuthology.orchestra.run.smithi174.stdout:(5/137): ceph-mds-17.0.0-1676.gdf88ec38.el8.x86 6.2 MB/s | 2.2 MB 00:00 2021-03-25T14:13:29.803 INFO:teuthology.orchestra.run.smithi174.stdout:(6/137): ceph-mgr-17.0.0-1676.gdf88ec38.el8.x86 7.0 MB/s | 1.4 MB 00:00 2021-03-25T14:13:29.819 INFO:teuthology.orchestra.run.smithi110.stdout:(3/137): ceph-immutable-object-cache-17.0.0-167 218 kB/s | 155 kB 00:00 2021-03-25T14:13:30.121 INFO:teuthology.orchestra.run.smithi110.stdout:(4/137): ceph-base-17.0.0-1676.gdf88ec38.el8.x8 3.0 MB/s | 5.1 MB 00:01 2021-03-25T14:13:30.139 INFO:teuthology.orchestra.run.smithi174.stdout:(7/137): ceph-mon-17.0.0-1676.gdf88ec38.el8.x86 7.5 MB/s | 3.5 MB 00:00 2021-03-25T14:13:30.424 INFO:teuthology.orchestra.run.smithi110.stdout:(5/137): ceph-mds-17.0.0-1676.gdf88ec38.el8.x86 3.6 MB/s | 2.2 MB 00:00 2021-03-25T14:13:30.572 INFO:teuthology.orchestra.run.smithi110.stdout:(6/137): ceph-mgr-17.0.0-1676.gdf88ec38.el8.x86 3.2 MB/s | 1.4 MB 00:00 2021-03-25T14:13:31.453 INFO:teuthology.orchestra.run.smithi110.stdout:(7/137): ceph-mon-17.0.0-1676.gdf88ec38.el8.x86 3.4 MB/s | 3.5 MB 00:01 2021-03-25T14:13:31.498 INFO:teuthology.orchestra.run.smithi174.stdout:(8/137): ceph-osd-17.0.0-1676.gdf88ec38.el8.x86 9.2 MB/s | 16 MB 00:01 2021-03-25T14:13:31.571 INFO:teuthology.orchestra.run.smithi174.stdout:(9/137): ceph-selinux-17.0.0-1676.gdf88ec38.el8 321 kB/s | 23 kB 00:00 2021-03-25T14:13:31.720 INFO:teuthology.orchestra.run.smithi174.stdout:(10/137): ceph-radosgw-17.0.0-1676.gdf88ec38.el 5.7 MB/s | 9.0 MB 00:01 2021-03-25T14:13:31.809 INFO:teuthology.orchestra.run.smithi174.stdout:(11/137): cephfs-mirror-17.0.0-1676.gdf88ec38.e 2.3 MB/s | 211 kB 00:00 2021-03-25T14:13:31.873 INFO:teuthology.orchestra.run.smithi174.stdout:(12/137): libcephfs-devel-17.0.0-1676.gdf88ec38 360 kB/s | 23 kB 00:00 2021-03-25T14:13:32.032 INFO:teuthology.orchestra.run.smithi174.stdout:(13/137): libcephfs2-17.0.0-1676.gdf88ec38.el8. 4.6 MB/s | 748 kB 00:00 2021-03-25T14:13:32.103 INFO:teuthology.orchestra.run.smithi174.stdout:(14/137): librados-devel-17.0.0-1676.gdf88ec38. 1.7 MB/s | 125 kB 00:00 2021-03-25T14:13:32.246 INFO:teuthology.orchestra.run.smithi174.stdout:(15/137): libradosstriper1-17.0.0-1676.gdf88ec3 3.1 MB/s | 456 kB 00:00 2021-03-25T14:13:33.022 INFO:teuthology.orchestra.run.smithi174.stdout:(16/137): librgw2-17.0.0-1676.gdf88ec38.el8.x86 4.7 MB/s | 3.6 MB 00:00 2021-03-25T14:13:33.089 INFO:teuthology.orchestra.run.smithi174.stdout:(17/137): python3-ceph-argparse-17.0.0-1676.gdf 637 kB/s | 42 kB 00:00 2021-03-25T14:13:33.155 INFO:teuthology.orchestra.run.smithi174.stdout:(18/137): python3-ceph-common-17.0.0-1676.gdf88 1.1 MB/s | 73 kB 00:00 2021-03-25T14:13:33.228 INFO:teuthology.orchestra.run.smithi174.stdout:(19/137): python3-cephfs-17.0.0-1676.gdf88ec38. 2.4 MB/s | 176 kB 00:00 2021-03-25T14:13:33.302 INFO:teuthology.orchestra.run.smithi174.stdout:(20/137): python3-rados-17.0.0-1676.gdf88ec38.e 4.8 MB/s | 364 kB 00:00 2021-03-25T14:13:33.441 INFO:teuthology.orchestra.run.smithi110.stdout:(8/137): ceph-osd-17.0.0-1676.gdf88ec38.el8.x86 5.4 MB/s | 16 MB 00:02 2021-03-25T14:13:33.456 INFO:teuthology.orchestra.run.smithi174.stdout:(21/137): ceph-common-17.0.0-1676.gdf88ec38.el8 3.9 MB/s | 19 MB 00:05 2021-03-25T14:13:33.459 INFO:teuthology.orchestra.run.smithi174.stdout:(22/137): python3-rbd-17.0.0-1676.gdf88ec38.el8 2.2 MB/s | 345 kB 00:00 2021-03-25T14:13:33.507 INFO:teuthology.orchestra.run.smithi110.stdout:(9/137): ceph-selinux-17.0.0-1676.gdf88ec38.el8 358 kB/s | 23 kB 00:00 2021-03-25T14:13:33.535 INFO:teuthology.orchestra.run.smithi174.stdout:(23/137): python3-rgw-17.0.0-1676.gdf88ec38.el8 1.4 MB/s | 110 kB 00:00 2021-03-25T14:13:33.538 INFO:teuthology.orchestra.run.smithi174.stdout:(24/137): rbd-fuse-17.0.0-1676.gdf88ec38.el8.x8 1.1 MB/s | 86 kB 00:00 2021-03-25T14:13:33.636 INFO:teuthology.orchestra.run.smithi174.stdout:(25/137): rbd-nbd-17.0.0-1676.gdf88ec38.el8.x86 1.6 MB/s | 165 kB 00:00 2021-03-25T14:13:33.706 INFO:teuthology.orchestra.run.smithi174.stdout:(26/137): ceph-grafana-dashboards-17.0.0-1676.g 331 kB/s | 23 kB 00:00 2021-03-25T14:13:33.777 INFO:teuthology.orchestra.run.smithi174.stdout:(27/137): ceph-mgr-cephadm-17.0.0-1676.gdf88ec3 1.0 MB/s | 74 kB 00:00 2021-03-25T14:13:34.246 INFO:teuthology.orchestra.run.smithi174.stdout:(28/137): ceph-mgr-dashboard-17.0.0-1676.gdf88e 4.8 MB/s | 2.3 MB 00:00 2021-03-25T14:13:34.473 INFO:teuthology.orchestra.run.smithi110.stdout:(10/137): ceph-radosgw-17.0.0-1676.gdf88ec38.el 3.0 MB/s | 9.0 MB 00:03 2021-03-25T14:13:34.505 INFO:teuthology.orchestra.run.smithi174.stdout:(29/137): rbd-mirror-17.0.0-1676.gdf88ec38.el8. 3.5 MB/s | 3.4 MB 00:00 2021-03-25T14:13:34.540 INFO:teuthology.orchestra.run.smithi110.stdout:(11/137): cephfs-mirror-17.0.0-1676.gdf88ec38.e 3.1 MB/s | 211 kB 00:00 2021-03-25T14:13:34.572 INFO:teuthology.orchestra.run.smithi174.stdout:(30/137): ceph-mgr-modules-core-17.0.0-1676.gdf 2.9 MB/s | 198 kB 00:00 2021-03-25T14:13:34.599 INFO:teuthology.orchestra.run.smithi110.stdout:(12/137): libcephfs-devel-17.0.0-1676.gdf88ec38 391 kB/s | 23 kB 00:00 2021-03-25T14:13:34.624 INFO:teuthology.orchestra.run.smithi174.stdout:(31/137): ceph-mgr-rook-17.0.0-1676.gdf88ec38.e 500 kB/s | 26 kB 00:00 2021-03-25T14:13:34.682 INFO:teuthology.orchestra.run.smithi174.stdout:(32/137): ceph-prometheus-alerts-17.0.0-1676.gd 153 kB/s | 8.9 kB 00:00 2021-03-25T14:13:34.774 INFO:teuthology.orchestra.run.smithi174.stdout:(33/137): cephadm-17.0.0-1676.gdf88ec38.el8.noa 707 kB/s | 65 kB 00:00 2021-03-25T14:13:34.838 INFO:teuthology.orchestra.run.smithi174.stdout:(34/137): cephfs-top-17.0.0-1676.gdf88ec38.el8. 194 kB/s | 12 kB 00:00 2021-03-25T14:13:34.856 INFO:teuthology.orchestra.run.smithi110.stdout:(13/137): libcephfs2-17.0.0-1676.gdf88ec38.el8. 2.9 MB/s | 748 kB 00:00 2021-03-25T14:13:34.927 INFO:teuthology.orchestra.run.smithi110.stdout:(14/137): librados-devel-17.0.0-1676.gdf88ec38. 1.7 MB/s | 125 kB 00:00 2021-03-25T14:13:34.972 INFO:teuthology.orchestra.run.smithi174.stdout:(35/137): fmt-6.2.1-1.el8.x86_64.rpm 868 kB/s | 116 kB 00:00 2021-03-25T14:13:35.036 INFO:teuthology.orchestra.run.smithi174.stdout:(36/137): gperftools-libs-2.7-9.el8.x86_64.rpm 4.7 MB/s | 306 kB 00:00 2021-03-25T14:13:35.064 INFO:teuthology.orchestra.run.smithi174.stdout:(37/137): leveldb-1.22-1.el8.x86_64.rpm 6.2 MB/s | 181 kB 00:00 2021-03-25T14:13:35.091 INFO:teuthology.orchestra.run.smithi174.stdout:(38/137): liboath-2.6.2-3.el8.x86_64.rpm 2.1 MB/s | 59 kB 00:00 2021-03-25T14:13:35.119 INFO:teuthology.orchestra.run.smithi174.stdout:(39/137): libunwind-1.3.1-3.el8.x86_64.rpm 2.7 MB/s | 75 kB 00:00 2021-03-25T14:13:35.134 INFO:teuthology.orchestra.run.smithi110.stdout:(15/137): libradosstriper1-17.0.0-1676.gdf88ec3 2.2 MB/s | 456 kB 00:00 2021-03-25T14:13:35.427 INFO:teuthology.orchestra.run.smithi174.stdout:(40/137): ceph-test-17.0.0-1676.gdf88ec38.el8.x 10 MB/s | 40 MB 00:03 2021-03-25T14:13:35.428 INFO:teuthology.orchestra.run.smithi174.stdout:(41/137): python3-apipkg-1.5-6.el8.noarch.rpm 69 kB/s | 21 kB 00:00 2021-03-25T14:13:35.455 INFO:teuthology.orchestra.run.smithi174.stdout:(42/137): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.6 MB/s | 44 kB 00:00 2021-03-25T14:13:35.482 INFO:teuthology.orchestra.run.smithi174.stdout:(43/137): python3-cachetools-3.1.1-4.el8.noarch 1.2 MB/s | 33 kB 00:00 2021-03-25T14:13:35.509 INFO:teuthology.orchestra.run.smithi174.stdout:(44/137): python3-certifi-2018.10.15-7.el8.noar 607 kB/s | 16 kB 00:00 2021-03-25T14:13:35.562 INFO:teuthology.orchestra.run.smithi174.stdout:(45/137): python3-beautifulsoup4-4.6.3-2.el8.1. 1.4 MB/s | 185 kB 00:00 2021-03-25T14:13:35.563 INFO:teuthology.orchestra.run.smithi174.stdout:(46/137): python3-cheroot-8.5.2-1.el8.noarch.rp 3.1 MB/s | 173 kB 00:00 2021-03-25T14:13:35.591 INFO:teuthology.orchestra.run.smithi174.stdout:(47/137): python3-cssselect-0.9.2-10.el8.noarch 1.4 MB/s | 40 kB 00:00 2021-03-25T14:13:35.617 INFO:teuthology.orchestra.run.smithi174.stdout:(48/137): python3-cherrypy-18.4.0-1.el8.noarch. 6.8 MB/s | 384 kB 00:00 2021-03-25T14:13:35.646 INFO:teuthology.orchestra.run.smithi174.stdout:(49/137): python3-google-auth-1.1.1-10.el8.noar 2.8 MB/s | 81 kB 00:00 2021-03-25T14:13:35.647 INFO:teuthology.orchestra.run.smithi174.stdout:(50/137): python3-execnet-1.7.1-1.el8.noarch.rp 6.2 MB/s | 355 kB 00:00 2021-03-25T14:13:35.673 INFO:teuthology.orchestra.run.smithi174.stdout:(51/137): python3-jaraco-6.2-6.el8.noarch.rpm 414 kB/s | 11 kB 00:00 2021-03-25T14:13:35.674 INFO:teuthology.orchestra.run.smithi174.stdout:(52/137): python3-jaraco-functools-2.0-4.el8.no 654 kB/s | 18 kB 00:00 2021-03-25T14:13:35.703 INFO:teuthology.orchestra.run.smithi174.stdout:(53/137): python3-logutils-0.3.5-11.el8.noarch. 1.7 MB/s | 49 kB 00:00 2021-03-25T14:13:35.730 INFO:teuthology.orchestra.run.smithi174.stdout:(54/137): python3-more-itertools-7.2.0-3.el8.no 2.1 MB/s | 59 kB 00:00 2021-03-25T14:13:35.785 INFO:teuthology.orchestra.run.smithi174.stdout:(55/137): python3-pecan-1.3.2-9.el8.noarch.rpm 5.1 MB/s | 283 kB 00:00 2021-03-25T14:13:35.810 INFO:teuthology.orchestra.run.smithi174.stdout:(56/137): python3-kubernetes-11.0.0-6.el8.noarc 8.5 MB/s | 1.2 MB 00:00 2021-03-25T14:13:35.812 INFO:teuthology.orchestra.run.smithi174.stdout:(57/137): python3-portend-2.6-1.el8.noarch.rpm 573 kB/s | 16 kB 00:00 2021-03-25T14:13:35.837 INFO:teuthology.orchestra.run.smithi174.stdout:(58/137): python3-remoto-1.1.4-4.el8.noarch.rpm 1.7 MB/s | 48 kB 00:00 2021-03-25T14:13:35.839 INFO:teuthology.orchestra.run.smithi174.stdout:(59/137): python3-repoze-lru-0.7-6.el8.noarch.r 1.2 MB/s | 34 kB 00:00 2021-03-25T14:13:35.867 INFO:teuthology.orchestra.run.smithi174.stdout:(60/137): python3-routes-2.4.1-12.el8.noarch.rp 6.6 MB/s | 196 kB 00:00 2021-03-25T14:13:35.867 INFO:teuthology.orchestra.run.smithi174.stdout:(61/137): python3-rsa-3.4.2-16.el8.noarch.rpm 2.5 MB/s | 73 kB 00:00 2021-03-25T14:13:35.894 INFO:teuthology.orchestra.run.smithi174.stdout:(62/137): python3-simplegeneric-0.8.1-17.el8.no 697 kB/s | 19 kB 00:00 2021-03-25T14:13:35.894 INFO:teuthology.orchestra.run.smithi174.stdout:(63/137): python3-singledispatch-3.4.0.3-18.el8 886 kB/s | 24 kB 00:00 2021-03-25T14:13:35.935 INFO:teuthology.orchestra.run.smithi174.stdout:(64/137): ceph-mgr-diskprediction-local-17.0.0- 4.4 MB/s | 7.4 MB 00:01 2021-03-25T14:13:35.936 INFO:teuthology.orchestra.run.smithi174.stdout:(65/137): python3-tempora-1.14.1-5.el8.noarch.r 698 kB/s | 29 kB 00:00 2021-03-25T14:13:35.936 INFO:teuthology.orchestra.run.smithi174.stdout:(66/137): python3-trustme-0.6.0-4.el8.noarch.rp 669 kB/s | 27 kB 00:00 2021-03-25T14:13:35.966 INFO:teuthology.orchestra.run.smithi174.stdout:(67/137): python3-websocket-client-0.56.0-5.el8 2.0 MB/s | 61 kB 00:00 2021-03-25T14:13:35.990 INFO:teuthology.orchestra.run.smithi174.stdout:(68/137): python3-webob-1.8.5-1.el8.1.noarch.rp 4.6 MB/s | 251 kB 00:00 2021-03-25T14:13:35.993 INFO:teuthology.orchestra.run.smithi174.stdout:(69/137): python3-webtest-2.0.33-1.el8.noarch.r 3.0 MB/s | 85 kB 00:00 2021-03-25T14:13:36.017 INFO:teuthology.orchestra.run.smithi174.stdout:(70/137): python3-zc-lockfile-2.0-2.el8.noarch. 851 kB/s | 23 kB 00:00 2021-03-25T14:13:36.021 INFO:teuthology.orchestra.run.smithi174.stdout:(71/137): xmlstarlet-1.6.1-11.el8.x86_64.rpm 2.5 MB/s | 69 kB 00:00 2021-03-25T14:13:36.058 INFO:teuthology.orchestra.run.smithi174.stdout:(72/137): python3-cffi-1.11.5-5.el8.x86_64.rpm 5.7 MB/s | 238 kB 00:00 2021-03-25T14:13:36.065 INFO:teuthology.orchestra.run.smithi174.stdout:(73/137): libverto-devel-0.3.0-5.el8.x86_64.rpm 411 kB/s | 18 kB 00:00 2021-03-25T14:13:36.083 INFO:teuthology.orchestra.run.smithi174.stdout:(74/137): python3-asn1crypto-0.24.0-3.el8.noarc 7.0 MB/s | 181 kB 00:00 2021-03-25T14:13:36.091 INFO:teuthology.orchestra.run.smithi174.stdout:(75/137): python3-requests-oauthlib-1.0.0-1.el8 1.6 MB/s | 43 kB 00:00 2021-03-25T14:13:36.102 INFO:teuthology.orchestra.run.smithi174.stdout:(76/137): python3-waitress-1.2.1-2.el8.1.noarch 1.4 MB/s | 241 kB 00:00 2021-03-25T14:13:36.103 INFO:teuthology.orchestra.run.smithi174.stdout:(77/137): fuse-2.9.7-12.el8.x86_64.rpm 4.0 MB/s | 83 kB 00:00 2021-03-25T14:13:36.115 INFO:teuthology.orchestra.run.smithi174.stdout:(78/137): python3-pycparser-2.14-14.el8.noarch. 4.4 MB/s | 109 kB 00:00 2021-03-25T14:13:36.143 INFO:teuthology.orchestra.run.smithi174.stdout:(79/137): python3-jwt-1.6.1-2.el8.noarch.rpm 1.4 MB/s | 43 kB 00:00 2021-03-25T14:13:36.150 INFO:teuthology.orchestra.run.smithi174.stdout:(80/137): python3-oauthlib-2.1.0-1.el8.noarch.r 4.4 MB/s | 155 kB 00:00 2021-03-25T14:13:36.151 INFO:teuthology.orchestra.run.smithi174.stdout:(81/137): keyutils-libs-devel-1.5.10-6.el8.x86_ 986 kB/s | 48 kB 00:00 2021-03-25T14:13:36.175 INFO:teuthology.orchestra.run.smithi174.stdout:(82/137): fuse-common-3.2.1-12.el8.x86_64.rpm 678 kB/s | 21 kB 00:00 2021-03-25T14:13:36.176 INFO:teuthology.orchestra.run.smithi174.stdout:(83/137): libsepol-devel-2.9-1.el8.x86_64.rpm 3.2 MB/s | 86 kB 00:00 2021-03-25T14:13:36.181 INFO:teuthology.orchestra.run.smithi174.stdout:(84/137): libaio-devel-0.3.112-1.el8.x86_64.rpm 618 kB/s | 19 kB 00:00 2021-03-25T14:13:36.206 INFO:teuthology.orchestra.run.smithi174.stdout:(85/137): libselinux-devel-2.9-3.el8.x86_64.rpm 6.3 MB/s | 199 kB 00:00 2021-03-25T14:13:36.206 INFO:teuthology.orchestra.run.smithi174.stdout:(86/137): zlib-devel-1.2.11-16.el8_2.x86_64.rpm 2.2 MB/s | 57 kB 00:00 2021-03-25T14:13:36.228 INFO:teuthology.orchestra.run.smithi174.stdout:(87/137): python3-cryptography-2.3-3.el8.x86_64 9.8 MB/s | 511 kB 00:00 2021-03-25T14:13:36.228 INFO:teuthology.orchestra.run.smithi174.stdout:(88/137): libuuid-devel-2.32.1-24.el8.x86_64.rp 4.2 MB/s | 96 kB 00:00 2021-03-25T14:13:36.240 INFO:teuthology.orchestra.run.smithi174.stdout:(89/137): libxslt-1.1.32-5.el8.x86_64.rpm 7.4 MB/s | 250 kB 00:00 2021-03-25T14:13:36.254 INFO:teuthology.orchestra.run.smithi174.stdout:(90/137): libcom_err-devel-1.45.6-1.el8.x86_64. 1.4 MB/s | 38 kB 00:00 2021-03-25T14:13:36.257 INFO:teuthology.orchestra.run.smithi174.stdout:(91/137): libquadmath-8.3.1-5.1.el8.x86_64.rpm 5.9 MB/s | 169 kB 00:00 2021-03-25T14:13:36.283 INFO:teuthology.orchestra.run.smithi174.stdout:(92/137): pcre2-devel-10.32-2.el8.x86_64.rpm 15 MB/s | 605 kB 00:00 2021-03-25T14:13:36.289 INFO:teuthology.orchestra.run.smithi174.stdout:(93/137): elfutils-libelf-devel-0.180-1.el8.x86 2.3 MB/s | 58 kB 00:00 2021-03-25T14:13:36.291 INFO:teuthology.orchestra.run.smithi174.stdout:(94/137): libgfortran-8.3.1-5.1.el8.x86_64.rpm 17 MB/s | 639 kB 00:00 2021-03-25T14:13:36.306 INFO:teuthology.orchestra.run.smithi174.stdout:(95/137): pcre2-utf32-10.32-2.el8.x86_64.rpm 9.1 MB/s | 220 kB 00:00 2021-03-25T14:13:36.321 INFO:teuthology.orchestra.run.smithi174.stdout:(96/137): pcre2-utf16-10.32-2.el8.x86_64.rpm 7.0 MB/s | 229 kB 00:00 2021-03-25T14:13:36.331 INFO:teuthology.orchestra.run.smithi110.stdout:(16/137): librgw2-17.0.0-1676.gdf88ec38.el8.x86 3.0 MB/s | 3.6 MB 00:01 2021-03-25T14:13:36.333 INFO:teuthology.orchestra.run.smithi174.stdout:(97/137): krb5-devel-1.18.2-5.el8.x86_64.rpm 13 MB/s | 558 kB 00:00 2021-03-25T14:13:36.334 INFO:teuthology.orchestra.run.smithi174.stdout:(98/137): xfsprogs-devel-5.0.0-4.el8.x86_64.rpm 2.9 MB/s | 69 kB 00:00 2021-03-25T14:13:36.353 INFO:teuthology.orchestra.run.smithi174.stdout:(99/137): librabbitmq-0.9.0-2.el8.x86_64.rpm 1.5 MB/s | 47 kB 00:00 2021-03-25T14:13:36.374 INFO:teuthology.orchestra.run.smithi174.stdout:(100/137): automake-1.16.1-6.el8.noarch.rpm 18 MB/s | 713 kB 00:00 2021-03-25T14:13:36.380 INFO:teuthology.orchestra.run.smithi174.stdout:(101/137): python3-webencodings-0.5.1-6.el8.noa 988 kB/s | 27 kB 00:00 2021-03-25T14:13:36.398 INFO:teuthology.orchestra.run.smithi174.stdout:(102/137): openssl-devel-1.1.1g-12.el8_3.x86_64 36 MB/s | 2.3 MB 00:00 2021-03-25T14:13:36.402 INFO:teuthology.orchestra.run.smithi110.stdout:(17/137): python3-ceph-argparse-17.0.0-1676.gdf 596 kB/s | 42 kB 00:00 2021-03-25T14:13:36.411 INFO:teuthology.orchestra.run.smithi174.stdout:(103/137): jq-1.5-12.el8.x86_64.rpm 5.2 MB/s | 161 kB 00:00 2021-03-25T14:13:36.425 INFO:teuthology.orchestra.run.smithi174.stdout:(104/137): python3-lxml-4.2.3-1.el8.x86_64.rpm 29 MB/s | 1.5 MB 00:00 2021-03-25T14:13:36.426 INFO:teuthology.orchestra.run.smithi174.stdout:(105/137): python3-pyOpenSSL-18.0.0-1.el8.noarc 3.6 MB/s | 103 kB 00:00 2021-03-25T14:13:36.442 INFO:teuthology.orchestra.run.smithi174.stdout:(106/137): python3-werkzeug-0.12.2-4.el8.noarch 14 MB/s | 457 kB 00:00 2021-03-25T14:13:36.454 INFO:teuthology.orchestra.run.smithi174.stdout:(107/137): python3-mako-1.0.6-13.el8.noarch.rpm 5.5 MB/s | 157 kB 00:00 2021-03-25T14:13:36.458 INFO:teuthology.orchestra.run.smithi174.stdout:(108/137): python3-jsonpatch-1.21-2.el8.noarch. 820 kB/s | 27 kB 00:00 2021-03-25T14:13:36.473 INFO:teuthology.orchestra.run.smithi110.stdout:(18/137): python3-ceph-common-17.0.0-1676.gdf88 1.0 MB/s | 73 kB 00:00 2021-03-25T14:13:36.483 INFO:teuthology.orchestra.run.smithi174.stdout:(109/137): python3-jsonpointer-1.10-11.el8.noar 630 kB/s | 20 kB 00:00 2021-03-25T14:13:36.492 INFO:teuthology.orchestra.run.smithi174.stdout:(110/137): python3-pyasn1-0.3.7-6.el8.noarch.rp 3.9 MB/s | 126 kB 00:00 2021-03-25T14:13:36.492 INFO:teuthology.orchestra.run.smithi174.stdout:(111/137): python3-html5lib-0.999999999-6.el8.n 6.3 MB/s | 214 kB 00:00 2021-03-25T14:13:36.510 INFO:teuthology.orchestra.run.smithi174.stdout:(112/137): python3-pytz-2017.2-9.el8.noarch.rpm 1.9 MB/s | 54 kB 00:00 2021-03-25T14:13:36.516 INFO:teuthology.orchestra.run.smithi174.stdout:(113/137): python3-pyasn1-modules-0.3.7-6.el8.n 4.1 MB/s | 110 kB 00:00 2021-03-25T14:13:36.521 INFO:teuthology.orchestra.run.smithi174.stdout:(114/137): python3-prettytable-0.7.2-14.el8.noa 1.4 MB/s | 44 kB 00:00 2021-03-25T14:13:36.539 INFO:teuthology.orchestra.run.smithi174.stdout:(115/137): python3-markupsafe-0.23-19.el8.x86_6 1.3 MB/s | 39 kB 00:00 2021-03-25T14:13:36.545 INFO:teuthology.orchestra.run.smithi110.stdout:(19/137): python3-cephfs-17.0.0-1676.gdf88ec38. 2.4 MB/s | 176 kB 00:00 2021-03-25T14:13:36.551 INFO:teuthology.orchestra.run.smithi174.stdout:(116/137): flex-2.6.1-9.el8.x86_64.rpm 9.0 MB/s | 320 kB 00:00 2021-03-25T14:13:36.557 INFO:teuthology.orchestra.run.smithi174.stdout:(117/137): librdkafka-0.11.4-1.el8.x86_64.rpm 9.6 MB/s | 353 kB 00:00 2021-03-25T14:13:36.574 INFO:teuthology.orchestra.run.smithi174.stdout:(118/137): bison-3.0.4-10.el8.x86_64.rpm 19 MB/s | 688 kB 00:00 2021-03-25T14:13:36.588 INFO:teuthology.orchestra.run.smithi174.stdout:(119/137): libtool-2.4.6-25.el8.x86_64.rpm 19 MB/s | 709 kB 00:00 2021-03-25T14:13:36.600 INFO:teuthology.orchestra.run.smithi174.stdout:(120/137): python3-jinja2-2.10.1-2.el8_0.noarch 14 MB/s | 538 kB 00:00 2021-03-25T14:13:36.613 INFO:teuthology.orchestra.run.smithi174.stdout:(121/137): python3-numpy-f2py-1.14.3-9.el8.x86_ 9.0 MB/s | 225 kB 00:00 2021-03-25T14:13:36.640 INFO:teuthology.orchestra.run.smithi174.stdout:(122/137): lttng-ust-2.8.1-11.el8.x86_64.rpm 11 MB/s | 259 kB 00:00 2021-03-25T14:13:36.683 INFO:teuthology.orchestra.run.smithi174.stdout:(123/137): python3-babel-2.5.1-5.el8.noarch.rpm 58 MB/s | 4.8 MB 00:00 2021-03-25T14:13:36.688 INFO:teuthology.orchestra.run.smithi110.stdout:(20/137): python3-rados-17.0.0-1676.gdf88ec38.e 2.5 MB/s | 364 kB 00:00 2021-03-25T14:13:36.714 INFO:teuthology.orchestra.run.smithi174.stdout:(124/137): python3-numpy-1.14.3-9.el8.x86_64.rp 51 MB/s | 3.7 MB 00:00 2021-03-25T14:13:36.761 INFO:teuthology.orchestra.run.smithi174.stdout:(125/137): openblas-threads-0.3.3-5.el8.x86_64. 56 MB/s | 4.4 MB 00:00 2021-03-25T14:13:36.831 INFO:teuthology.orchestra.run.smithi110.stdout:(21/137): python3-rbd-17.0.0-1676.gdf88ec38.el8 2.4 MB/s | 345 kB 00:00 2021-03-25T14:13:36.889 INFO:teuthology.orchestra.run.smithi174.stdout:(126/137): python3-scipy-1.0.0-20.module+el8.1. 47 MB/s | 15 MB 00:00 2021-03-25T14:13:36.899 INFO:teuthology.orchestra.run.smithi174.stdout:(127/137): openblas-0.3.3-5.el8.x86_64.rpm 23 MB/s | 4.3 MB 00:00 2021-03-25T14:13:36.901 INFO:teuthology.orchestra.run.smithi174.stdout:(128/137): socat-1.7.3.3-2.el8.x86_64.rpm 2.1 MB/s | 302 kB 00:00 2021-03-25T14:13:36.902 INFO:teuthology.orchestra.run.smithi110.stdout:(22/137): python3-rgw-17.0.0-1676.gdf88ec38.el8 1.5 MB/s | 110 kB 00:00 2021-03-25T14:13:36.921 INFO:teuthology.orchestra.run.smithi174.stdout:(129/137): oniguruma-6.8.2-2.el8.x86_64.rpm 8.5 MB/s | 187 kB 00:00 2021-03-25T14:13:36.951 INFO:teuthology.orchestra.run.smithi174.stdout:(130/137): openssl-libs-1.1.1g-12.el8_3.x86_64. 50 MB/s | 1.5 MB 00:00 2021-03-25T14:13:36.974 INFO:teuthology.orchestra.run.smithi174.stdout:(131/137): openssl-1.1.1g-12.el8_3.x86_64.rpm 30 MB/s | 707 kB 00:00 2021-03-25T14:13:36.979 INFO:teuthology.orchestra.run.smithi110.stdout:(23/137): rbd-fuse-17.0.0-1676.gdf88ec38.el8.x8 1.1 MB/s | 86 kB 00:00 2021-03-25T14:13:37.004 INFO:teuthology.orchestra.run.smithi174.stdout:(132/137): NetworkManager-libnm-1.26.0-13.el8_3 59 MB/s | 1.8 MB 00:00 2021-03-25T14:13:37.028 INFO:teuthology.orchestra.run.smithi174.stdout:(133/137): NetworkManager-team-1.26.0-13.el8_3. 5.8 MB/s | 142 kB 00:00 2021-03-25T14:13:37.064 INFO:teuthology.orchestra.run.smithi174.stdout:(134/137): NetworkManager-1.26.0-13.el8_3.x86_6 69 MB/s | 2.4 MB 00:00 2021-03-25T14:13:37.085 INFO:teuthology.orchestra.run.smithi174.stdout:(135/137): NetworkManager-tui-1.26.0-13.el8_3.x 14 MB/s | 320 kB 00:00 2021-03-25T14:13:37.635 INFO:teuthology.orchestra.run.smithi174.stdout:(136/137): librbd1-17.0.0-1676.gdf88ec38.el8.x8 4.7 MB/s | 3.4 MB 00:00 2021-03-25T14:13:37.747 INFO:teuthology.orchestra.run.smithi174.stdout:(137/137): librados2-17.0.0-1676.gdf88ec38.el8. 3.8 MB/s | 3.3 MB 00:00 2021-03-25T14:13:37.751 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2021-03-25T14:13:37.751 INFO:teuthology.orchestra.run.smithi174.stdout:Total 20 MB/s | 181 MB 00:09 2021-03-25T14:13:37.813 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2021-03-25T14:13:37.976 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction check succeeded. 2021-03-25T14:13:37.977 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2021-03-25T14:13:38.038 INFO:teuthology.orchestra.run.smithi110.stdout:(24/137): rbd-mirror-17.0.0-1676.gdf88ec38.el8. 3.2 MB/s | 3.4 MB 00:01 2021-03-25T14:13:38.115 INFO:teuthology.orchestra.run.smithi110.stdout:(25/137): rbd-nbd-17.0.0-1676.gdf88ec38.el8.x86 2.1 MB/s | 165 kB 00:00 2021-03-25T14:13:38.185 INFO:teuthology.orchestra.run.smithi110.stdout:(26/137): ceph-grafana-dashboards-17.0.0-1676.g 327 kB/s | 23 kB 00:00 2021-03-25T14:13:38.258 INFO:teuthology.orchestra.run.smithi110.stdout:(27/137): ceph-mgr-cephadm-17.0.0-1676.gdf88ec3 1.0 MB/s | 74 kB 00:00 2021-03-25T14:13:39.002 INFO:teuthology.orchestra.run.smithi110.stdout:(28/137): ceph-mgr-dashboard-17.0.0-1676.gdf88e 3.0 MB/s | 2.3 MB 00:00 2021-03-25T14:13:39.247 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded. 2021-03-25T14:13:39.251 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2021-03-25T14:13:39.697 INFO:teuthology.orchestra.run.smithi110.stdout:(29/137): ceph-common-17.0.0-1676.gdf88ec38.el8 1.7 MB/s | 19 MB 00:11 2021-03-25T14:13:39.777 INFO:teuthology.orchestra.run.smithi110.stdout:(30/137): ceph-mgr-modules-core-17.0.0-1676.gdf 2.5 MB/s | 198 kB 00:00 2021-03-25T14:13:39.854 INFO:teuthology.orchestra.run.smithi110.stdout:(31/137): ceph-mgr-rook-17.0.0-1676.gdf88ec38.e 335 kB/s | 26 kB 00:00 2021-03-25T14:13:39.932 INFO:teuthology.orchestra.run.smithi110.stdout:(32/137): ceph-prometheus-alerts-17.0.0-1676.gd 114 kB/s | 8.9 kB 00:00 2021-03-25T14:13:40.010 INFO:teuthology.orchestra.run.smithi110.stdout:(33/137): cephadm-17.0.0-1676.gdf88ec38.el8.noa 830 kB/s | 65 kB 00:00 2021-03-25T14:13:40.089 INFO:teuthology.orchestra.run.smithi110.stdout:(34/137): cephfs-top-17.0.0-1676.gdf88ec38.el8. 159 kB/s | 12 kB 00:00 2021-03-25T14:13:40.241 INFO:teuthology.orchestra.run.smithi110.stdout:(35/137): fmt-6.2.1-1.el8.x86_64.rpm 767 kB/s | 116 kB 00:00 2021-03-25T14:13:40.296 INFO:teuthology.orchestra.run.smithi110.stdout:(36/137): gperftools-libs-2.7-9.el8.x86_64.rpm 5.4 MB/s | 306 kB 00:00 2021-03-25T14:13:40.326 INFO:teuthology.orchestra.run.smithi110.stdout:(37/137): leveldb-1.22-1.el8.x86_64.rpm 6.2 MB/s | 181 kB 00:00 2021-03-25T14:13:40.353 INFO:teuthology.orchestra.run.smithi110.stdout:(38/137): liboath-2.6.2-3.el8.x86_64.rpm 2.1 MB/s | 59 kB 00:00 2021-03-25T14:13:40.380 INFO:teuthology.orchestra.run.smithi110.stdout:(39/137): libunwind-1.3.1-3.el8.x86_64.rpm 2.7 MB/s | 75 kB 00:00 2021-03-25T14:13:40.408 INFO:teuthology.orchestra.run.smithi110.stdout:(40/137): python3-apipkg-1.5-6.el8.noarch.rpm 782 kB/s | 21 kB 00:00 2021-03-25T14:13:40.435 INFO:teuthology.orchestra.run.smithi110.stdout:(41/137): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.6 MB/s | 44 kB 00:00 2021-03-25T14:13:40.464 INFO:teuthology.orchestra.run.smithi110.stdout:(42/137): python3-beautifulsoup4-4.6.3-2.el8.1. 6.3 MB/s | 185 kB 00:00 2021-03-25T14:13:40.492 INFO:teuthology.orchestra.run.smithi110.stdout:(43/137): python3-cachetools-3.1.1-4.el8.noarch 1.2 MB/s | 33 kB 00:00 2021-03-25T14:13:40.520 INFO:teuthology.orchestra.run.smithi110.stdout:(44/137): python3-certifi-2018.10.15-7.el8.noar 601 kB/s | 16 kB 00:00 2021-03-25T14:13:40.548 INFO:teuthology.orchestra.run.smithi110.stdout:(45/137): python3-cheroot-8.5.2-1.el8.noarch.rp 5.9 MB/s | 173 kB 00:00 2021-03-25T14:13:40.604 INFO:teuthology.orchestra.run.smithi110.stdout:(46/137): python3-cherrypy-18.4.0-1.el8.noarch. 6.7 MB/s | 384 kB 00:00 2021-03-25T14:13:40.632 INFO:teuthology.orchestra.run.smithi110.stdout:(47/137): python3-cssselect-0.9.2-10.el8.noarch 1.4 MB/s | 40 kB 00:00 2021-03-25T14:13:40.690 INFO:teuthology.orchestra.run.smithi110.stdout:(48/137): python3-execnet-1.7.1-1.el8.noarch.rp 5.9 MB/s | 355 kB 00:00 2021-03-25T14:13:40.718 INFO:teuthology.orchestra.run.smithi110.stdout:(49/137): python3-google-auth-1.1.1-10.el8.noar 2.9 MB/s | 81 kB 00:00 2021-03-25T14:13:40.745 INFO:teuthology.orchestra.run.smithi110.stdout:(50/137): python3-jaraco-6.2-6.el8.noarch.rpm 415 kB/s | 11 kB 00:00 2021-03-25T14:13:40.772 INFO:teuthology.orchestra.run.smithi110.stdout:(51/137): python3-jaraco-functools-2.0-4.el8.no 651 kB/s | 18 kB 00:00 2021-03-25T14:13:40.934 INFO:teuthology.orchestra.run.smithi110.stdout:(52/137): python3-kubernetes-11.0.0-6.el8.noarc 7.2 MB/s | 1.2 MB 00:00 2021-03-25T14:13:41.237 INFO:teuthology.orchestra.run.smithi110.stdout:(53/137): ceph-test-17.0.0-1676.gdf88ec38.el8.x 5.2 MB/s | 40 MB 00:07 2021-03-25T14:13:41.237 INFO:teuthology.orchestra.run.smithi110.stdout:(54/137): python3-logutils-0.3.5-11.el8.noarch. 161 kB/s | 49 kB 00:00 2021-03-25T14:13:41.279 INFO:teuthology.orchestra.run.smithi110.stdout:(55/137): ceph-mgr-diskprediction-local-17.0.0- 3.2 MB/s | 7.4 MB 00:02 2021-03-25T14:13:41.308 INFO:teuthology.orchestra.run.smithi110.stdout:(56/137): python3-pecan-1.3.2-9.el8.noarch.rpm 4.0 MB/s | 283 kB 00:00 2021-03-25T14:13:41.325 INFO:teuthology.orchestra.run.smithi110.stdout:(57/137): python3-more-itertools-7.2.0-3.el8.no 662 kB/s | 59 kB 00:00 2021-03-25T14:13:41.335 INFO:teuthology.orchestra.run.smithi110.stdout:(58/137): python3-remoto-1.1.4-4.el8.noarch.rpm 1.7 MB/s | 48 kB 00:00 2021-03-25T14:13:41.346 INFO:teuthology.orchestra.run.smithi110.stdout:(59/137): python3-portend-2.6-1.el8.noarch.rpm 234 kB/s | 16 kB 00:00 2021-03-25T14:13:41.348 INFO:teuthology.orchestra.run.smithi110.stdout:(60/137): python3-repoze-lru-0.7-6.el8.noarch.r 1.5 MB/s | 34 kB 00:00 2021-03-25T14:13:41.364 INFO:teuthology.orchestra.run.smithi110.stdout:(61/137): python3-routes-2.4.1-12.el8.noarch.rp 6.6 MB/s | 196 kB 00:00 2021-03-25T14:13:41.371 INFO:teuthology.orchestra.run.smithi110.stdout:(62/137): python3-simplegeneric-0.8.1-17.el8.no 842 kB/s | 19 kB 00:00 2021-03-25T14:13:41.391 INFO:teuthology.orchestra.run.smithi110.stdout:(63/137): python3-rsa-3.4.2-16.el8.noarch.rpm 1.6 MB/s | 73 kB 00:00 2021-03-25T14:13:41.391 INFO:teuthology.orchestra.run.smithi110.stdout:(64/137): python3-singledispatch-3.4.0.3-18.el8 871 kB/s | 24 kB 00:00 2021-03-25T14:13:41.393 INFO:teuthology.orchestra.run.smithi110.stdout:(65/137): python3-tempora-1.14.1-5.el8.noarch.r 1.3 MB/s | 29 kB 00:00 2021-03-25T14:13:41.418 INFO:teuthology.orchestra.run.smithi110.stdout:(66/137): python3-trustme-0.6.0-4.el8.noarch.rp 1.0 MB/s | 27 kB 00:00 2021-03-25T14:13:41.437 INFO:teuthology.orchestra.run.smithi110.stdout:(67/137): python3-waitress-1.2.1-2.el8.1.noarch 5.2 MB/s | 241 kB 00:00 2021-03-25T14:13:41.446 INFO:teuthology.orchestra.run.smithi110.stdout:(68/137): python3-websocket-client-0.56.0-5.el8 2.2 MB/s | 61 kB 00:00 2021-03-25T14:13:41.460 INFO:teuthology.orchestra.run.smithi110.stdout:(69/137): python3-webob-1.8.5-1.el8.1.noarch.rp 3.7 MB/s | 251 kB 00:00 2021-03-25T14:13:41.461 INFO:teuthology.orchestra.run.smithi110.stdout:(70/137): python3-webtest-2.0.33-1.el8.noarch.r 3.5 MB/s | 85 kB 00:00 2021-03-25T14:13:41.473 INFO:teuthology.orchestra.run.smithi110.stdout:(71/137): python3-zc-lockfile-2.0-2.el8.noarch. 853 kB/s | 23 kB 00:00 2021-03-25T14:13:41.485 INFO:teuthology.orchestra.run.smithi110.stdout:(72/137): xmlstarlet-1.6.1-11.el8.x86_64.rpm 2.7 MB/s | 69 kB 00:00 2021-03-25T14:13:41.514 INFO:teuthology.orchestra.run.smithi110.stdout:(73/137): automake-1.16.1-6.el8.noarch.rpm 13 MB/s | 713 kB 00:00 2021-03-25T14:13:41.519 INFO:teuthology.orchestra.run.smithi110.stdout:(74/137): python3-webencodings-0.5.1-6.el8.noar 594 kB/s | 27 kB 00:00 2021-03-25T14:13:41.544 INFO:teuthology.orchestra.run.smithi110.stdout:(75/137): jq-1.5-12.el8.x86_64.rpm 6.1 MB/s | 161 kB 00:00 2021-03-25T14:13:41.548 INFO:teuthology.orchestra.run.smithi110.stdout:(76/137): python3-lxml-4.2.3-1.el8.x86_64.rpm 24 MB/s | 1.5 MB 00:00 2021-03-25T14:13:41.550 INFO:teuthology.orchestra.run.smithi110.stdout:(77/137): python3-pyOpenSSL-18.0.0-1.el8.noarch 3.3 MB/s | 103 kB 00:00 2021-03-25T14:13:41.580 INFO:teuthology.orchestra.run.smithi110.stdout:(78/137): python3-mako-1.0.6-13.el8.noarch.rpm 4.9 MB/s | 157 kB 00:00 2021-03-25T14:13:41.583 INFO:teuthology.orchestra.run.smithi110.stdout:(79/137): python3-werkzeug-0.12.2-4.el8.noarch. 12 MB/s | 457 kB 00:00 2021-03-25T14:13:41.587 INFO:teuthology.orchestra.run.smithi110.stdout:(80/137): python3-jsonpatch-1.21-2.el8.noarch.r 706 kB/s | 27 kB 00:00 2021-03-25T14:13:41.613 INFO:teuthology.orchestra.run.smithi110.stdout:(81/137): python3-jsonpointer-1.10-11.el8.noarc 621 kB/s | 20 kB 00:00 2021-03-25T14:13:41.620 INFO:teuthology.orchestra.run.smithi110.stdout:(82/137): python3-pyasn1-0.3.7-6.el8.noarch.rpm 3.8 MB/s | 126 kB 00:00 2021-03-25T14:13:41.622 INFO:teuthology.orchestra.run.smithi110.stdout:(83/137): python3-html5lib-0.999999999-6.el8.no 6.0 MB/s | 214 kB 00:00 2021-03-25T14:13:41.641 INFO:teuthology.orchestra.run.smithi110.stdout:(84/137): python3-pytz-2017.2-9.el8.noarch.rpm 1.9 MB/s | 54 kB 00:00 2021-03-25T14:13:41.647 INFO:teuthology.orchestra.run.smithi110.stdout:(85/137): python3-pyasn1-modules-0.3.7-6.el8.no 4.1 MB/s | 110 kB 00:00 2021-03-25T14:13:41.652 INFO:teuthology.orchestra.run.smithi110.stdout:(86/137): python3-prettytable-0.7.2-14.el8.noar 1.4 MB/s | 44 kB 00:00 2021-03-25T14:13:41.677 INFO:teuthology.orchestra.run.smithi110.stdout:(87/137): python3-markupsafe-0.23-19.el8.x86_64 1.0 MB/s | 39 kB 00:00 2021-03-25T14:13:41.686 INFO:teuthology.orchestra.run.smithi110.stdout:(88/137): flex-2.6.1-9.el8.x86_64.rpm 8.0 MB/s | 320 kB 00:00 2021-03-25T14:13:41.692 INFO:teuthology.orchestra.run.smithi110.stdout:(89/137): librdkafka-0.11.4-1.el8.x86_64.rpm 8.8 MB/s | 353 kB 00:00 2021-03-25T14:13:41.706 INFO:teuthology.orchestra.run.smithi110.stdout:(90/137): bison-3.0.4-10.el8.x86_64.rpm 23 MB/s | 688 kB 00:00 2021-03-25T14:13:41.726 INFO:teuthology.orchestra.run.smithi110.stdout:(91/137): libtool-2.4.6-25.el8.x86_64.rpm 20 MB/s | 709 kB 00:00 2021-03-25T14:13:41.733 INFO:teuthology.orchestra.run.smithi110.stdout:(92/137): python3-jinja2-2.10.1-2.el8_0.noarch. 13 MB/s | 538 kB 00:00 2021-03-25T14:13:41.751 INFO:teuthology.orchestra.run.smithi110.stdout:(93/137): python3-numpy-f2py-1.14.3-9.el8.x86_6 11 MB/s | 225 kB 00:00 2021-03-25T14:13:41.778 INFO:teuthology.orchestra.run.smithi110.stdout:(94/137): lttng-ust-2.8.1-11.el8.x86_64.rpm 11 MB/s | 259 kB 00:00 2021-03-25T14:13:41.816 INFO:teuthology.orchestra.run.smithi110.stdout:(95/137): python3-babel-2.5.1-5.el8.noarch.rpm 61 MB/s | 4.8 MB 00:00 2021-03-25T14:13:41.851 INFO:teuthology.orchestra.run.smithi110.stdout:(96/137): python3-numpy-1.14.3-9.el8.x86_64.rpm 51 MB/s | 3.7 MB 00:00 2021-03-25T14:13:41.891 INFO:teuthology.orchestra.run.smithi110.stdout:(97/137): openblas-threads-0.3.3-5.el8.x86_64.r 58 MB/s | 4.4 MB 00:00 2021-03-25T14:13:42.012 INFO:teuthology.orchestra.run.smithi110.stdout:(98/137): python3-scipy-1.0.0-20.module+el8.1.0 48 MB/s | 15 MB 00:00 2021-03-25T14:13:42.015 INFO:teuthology.orchestra.run.smithi110.stdout:(99/137): socat-1.7.3.3-2.el8.x86_64.rpm 2.4 MB/s | 302 kB 00:00 2021-03-25T14:13:42.048 INFO:teuthology.orchestra.run.smithi110.stdout:(100/137): openblas-0.3.3-5.el8.x86_64.rpm 22 MB/s | 4.3 MB 00:00 2021-03-25T14:13:42.049 INFO:teuthology.orchestra.run.smithi110.stdout:(101/137): oniguruma-6.8.2-2.el8.x86_64.rpm 4.9 MB/s | 187 kB 00:00 2021-03-25T14:13:42.050 INFO:teuthology.orchestra.run.smithi110.stdout:(102/137): python3-cffi-1.11.5-5.el8.x86_64.rpm 7.4 MB/s | 238 kB 00:00 2021-03-25T14:13:42.083 INFO:teuthology.orchestra.run.smithi110.stdout:(103/137): libverto-devel-0.3.0-5.el8.x86_64.rp 517 kB/s | 18 kB 00:00 2021-03-25T14:13:42.084 INFO:teuthology.orchestra.run.smithi110.stdout:(104/137): python3-asn1crypto-0.24.0-3.el8.noar 5.1 MB/s | 181 kB 00:00 2021-03-25T14:13:42.089 INFO:teuthology.orchestra.run.smithi110.stdout:(105/137): python3-requests-oauthlib-1.0.0-1.el 1.2 MB/s | 43 kB 00:00 2021-03-25T14:13:42.114 INFO:teuthology.orchestra.run.smithi110.stdout:(106/137): fuse-2.9.7-12.el8.x86_64.rpm 2.6 MB/s | 83 kB 00:00 2021-03-25T14:13:42.115 INFO:teuthology.orchestra.run.smithi110.stdout:(107/137): python3-pycparser-2.14-14.el8.noarch 3.5 MB/s | 109 kB 00:00 2021-03-25T14:13:42.125 INFO:teuthology.orchestra.run.smithi110.stdout:(108/137): keyutils-libs-devel-1.5.10-6.el8.x86 1.3 MB/s | 48 kB 00:00 2021-03-25T14:13:42.141 INFO:teuthology.orchestra.run.smithi110.stdout:(109/137): python3-jwt-1.6.1-2.el8.noarch.rpm 1.5 MB/s | 43 kB 00:00 2021-03-25T14:13:42.143 INFO:teuthology.orchestra.run.smithi110.stdout:(110/137): python3-oauthlib-2.1.0-1.el8.noarch. 5.3 MB/s | 155 kB 00:00 2021-03-25T14:13:42.163 INFO:teuthology.orchestra.run.smithi110.stdout:(111/137): fuse-common-3.2.1-12.el8.x86_64.rpm 568 kB/s | 21 kB 00:00 2021-03-25T14:13:42.173 INFO:teuthology.orchestra.run.smithi110.stdout:(112/137): libsepol-devel-2.9-1.el8.x86_64.rpm 2.6 MB/s | 86 kB 00:00 2021-03-25T14:13:42.174 INFO:teuthology.orchestra.run.smithi110.stdout:(113/137): libaio-devel-0.3.112-1.el8.x86_64.rp 830 kB/s | 19 kB 00:00 2021-03-25T14:13:42.196 INFO:teuthology.orchestra.run.smithi110.stdout:(114/137): libselinux-devel-2.9-3.el8.x86_64.rp 6.0 MB/s | 199 kB 00:00 2021-03-25T14:13:42.203 INFO:teuthology.orchestra.run.smithi110.stdout:(115/137): python3-cryptography-2.3-3.el8.x86_6 17 MB/s | 511 kB 00:00 2021-03-25T14:13:42.208 INFO:teuthology.orchestra.run.smithi110.stdout:(116/137): zlib-devel-1.2.11-16.el8_2.x86_64.rp 1.7 MB/s | 57 kB 00:00 2021-03-25T14:13:42.226 INFO:teuthology.orchestra.run.smithi110.stdout:(117/137): libuuid-devel-2.32.1-24.el8.x86_64.r 3.6 MB/s | 96 kB 00:00 2021-03-25T14:13:42.236 INFO:teuthology.orchestra.run.smithi110.stdout:(118/137): libcom_err-devel-1.45.6-1.el8.x86_64 1.3 MB/s | 38 kB 00:00 2021-03-25T14:13:42.242 INFO:teuthology.orchestra.run.smithi110.stdout:(119/137): libxslt-1.1.32-5.el8.x86_64.rpm 7.0 MB/s | 250 kB 00:00 2021-03-25T14:13:42.262 INFO:teuthology.orchestra.run.smithi110.stdout:(120/137): libquadmath-8.3.1-5.1.el8.x86_64.rpm 5.3 MB/s | 169 kB 00:00 2021-03-25T14:13:42.275 INFO:teuthology.orchestra.run.smithi110.stdout:(121/137): pcre2-devel-10.32-2.el8.x86_64.rpm 17 MB/s | 605 kB 00:00 2021-03-25T14:13:42.287 INFO:teuthology.orchestra.run.smithi110.stdout:(122/137): libgfortran-8.3.1-5.1.el8.x86_64.rpm 15 MB/s | 639 kB 00:00 2021-03-25T14:13:42.293 INFO:teuthology.orchestra.run.smithi110.stdout:(123/137): elfutils-libelf-devel-0.180-1.el8.x8 1.8 MB/s | 58 kB 00:00 2021-03-25T14:13:42.305 INFO:teuthology.orchestra.run.smithi110.stdout:(124/137): pcre2-utf32-10.32-2.el8.x86_64.rpm 7.2 MB/s | 220 kB 00:00 2021-03-25T14:13:42.320 INFO:teuthology.orchestra.run.smithi110.stdout:(125/137): pcre2-utf16-10.32-2.el8.x86_64.rpm 8.1 MB/s | 229 kB 00:00 2021-03-25T14:13:42.333 INFO:teuthology.orchestra.run.smithi110.stdout:(126/137): krb5-devel-1.18.2-5.el8.x86_64.rpm 14 MB/s | 558 kB 00:00 2021-03-25T14:13:42.333 INFO:teuthology.orchestra.run.smithi110.stdout:(127/137): xfsprogs-devel-5.0.0-4.el8.x86_64.rp 2.8 MB/s | 69 kB 00:00 2021-03-25T14:13:42.344 INFO:teuthology.orchestra.run.smithi110.stdout:(128/137): librabbitmq-0.9.0-2.el8.x86_64.rpm 1.9 MB/s | 47 kB 00:00 2021-03-25T14:13:42.368 INFO:teuthology.orchestra.run.smithi110.stdout:(129/137): openssl-devel-1.1.1g-12.el8_3.x86_64 66 MB/s | 2.3 MB 00:00 2021-03-25T14:13:42.395 INFO:teuthology.orchestra.run.smithi110.stdout:(130/137): openssl-libs-1.1.1g-12.el8_3.x86_64. 53 MB/s | 1.5 MB 00:00 2021-03-25T14:13:42.419 INFO:teuthology.orchestra.run.smithi110.stdout:(131/137): openssl-1.1.1g-12.el8_3.x86_64.rpm 29 MB/s | 707 kB 00:00 2021-03-25T14:13:42.448 INFO:teuthology.orchestra.run.smithi110.stdout:(132/137): NetworkManager-libnm-1.26.0-13.el8_3 61 MB/s | 1.8 MB 00:00 2021-03-25T14:13:42.469 INFO:teuthology.orchestra.run.smithi110.stdout:(133/137): NetworkManager-team-1.26.0-13.el8_3. 6.6 MB/s | 142 kB 00:00 2021-03-25T14:13:42.503 INFO:teuthology.orchestra.run.smithi110.stdout:(134/137): NetworkManager-1.26.0-13.el8_3.x86_6 73 MB/s | 2.4 MB 00:00 2021-03-25T14:13:42.525 INFO:teuthology.orchestra.run.smithi110.stdout:(135/137): NetworkManager-tui-1.26.0-13.el8_3.x 14 MB/s | 320 kB 00:00 2021-03-25T14:13:43.224 INFO:teuthology.orchestra.run.smithi110.stdout:(136/137): librbd1-17.0.0-1676.gdf88ec38.el8.x8 3.9 MB/s | 3.4 MB 00:00 2021-03-25T14:13:43.416 INFO:teuthology.orchestra.run.smithi110.stdout:(137/137): librados2-17.0.0-1676.gdf88ec38.el8. 3.0 MB/s | 3.3 MB 00:01 2021-03-25T14:13:43.420 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2021-03-25T14:13:43.420 INFO:teuthology.orchestra.run.smithi110.stdout:Total 12 MB/s | 181 MB 00:15 2021-03-25T14:13:43.484 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2021-03-25T14:13:43.646 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2021-03-25T14:13:43.647 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2021-03-25T14:13:44.880 INFO:teuthology.orchestra.run.smithi174.stdout: Preparing : 1/1 2021-03-25T14:13:44.919 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2021-03-25T14:13:44.923 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2021-03-25T14:13:45.066 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: openssl-libs-1:1.1.1g-12.el8_3.x86_64 1/1 2021-03-25T14:13:45.281 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : openssl-libs-1:1.1.1g-12.el8_3.x86_64 1/145 2021-03-25T14:13:45.525 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: openssl-libs-1:1.1.1g-12.el8_3.x86_64 1/145 2021-03-25T14:13:45.749 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : fmt-6.2.1-1.el8.x86_64 2/145 2021-03-25T14:13:45.910 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/145 2021-03-25T14:13:46.122 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : leveldb-1.22-1.el8.x86_64 4/145 2021-03-25T14:13:46.361 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librabbitmq-0.9.0-2.el8.x86_64 5/145 2021-03-25T14:13:46.542 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 6/145 2021-03-25T14:13:46.657 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 6/145 2021-03-25T14:13:46.834 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/145 2021-03-25T14:13:47.248 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/145 2021-03-25T14:13:47.484 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : librados2-2:17.0.0-1676.gdf88ec38.el8.x86_64 8/145 2021-03-25T14:13:47.876 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librados2-2:17.0.0-1676.gdf88ec38.el8.x86_64 8/145 2021-03-25T14:13:48.117 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : librbd1-2:17.0.0-1676.gdf88ec38.el8.x86_64 9/145 2021-03-25T14:13:48.243 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librbd1-2:17.0.0-1676.gdf88ec38.el8.x86_64 9/145 2021-03-25T14:13:48.458 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephfs2-2:17.0.0-1676.gdf88ec38.el8.x86_64 10/145 2021-03-25T14:13:48.589 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libcephfs2-2:17.0.0-1676.gdf88ec38.el8.x86_64 10/145 2021-03-25T14:13:49.134 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rados-2:17.0.0-1676.gdf88ec38.el8.x86_64 11/145 2021-03-25T14:13:49.317 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librgw2-2:17.0.0-1676.gdf88ec38.el8.x86_64 12/145 2021-03-25T14:13:49.432 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librgw2-2:17.0.0-1676.gdf88ec38.el8.x86_64 12/145 2021-03-25T14:13:49.687 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 13/145 2021-03-25T14:13:49.919 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/145 2021-03-25T14:13:49.957 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2021-03-25T14:13:50.083 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libradosstriper1-2:17.0.0-1676.gdf88ec38.el8.x86 15/145 2021-03-25T14:13:50.118 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: openssl-libs-1:1.1.1g-12.el8_3.x86_64 1/1 2021-03-25T14:13:50.380 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : openssl-libs-1:1.1.1g-12.el8_3.x86_64 1/145 2021-03-25T14:13:50.405 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libradosstriper1-2:17.0.0-1676.gdf88ec38.el8.x86 15/145 2021-03-25T14:13:50.445 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: openssl-libs-1:1.1.1g-12.el8_3.x86_64 1/145 2021-03-25T14:13:50.648 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : fmt-6.2.1-1.el8.x86_64 2/145 2021-03-25T14:13:50.799 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/145 2021-03-25T14:13:51.000 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : leveldb-1.22-1.el8.x86_64 4/145 2021-03-25T14:13:51.121 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : NetworkManager-libnm-1:1.26.0-13.el8_3.x86_64 16/145 2021-03-25T14:13:51.158 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 5/145 2021-03-25T14:13:51.191 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-libnm-1:1.26.0-13.el8_3.x86_64 16/145 2021-03-25T14:13:51.222 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 5/145 2021-03-25T14:13:51.418 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librabbitmq-0.9.0-2.el8.x86_64 6/145 2021-03-25T14:13:51.463 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-1:1.26.0-13.el8_3.x86_64 17/145 2021-03-25T14:13:51.574 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/145 2021-03-25T14:13:51.742 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : NetworkManager-1:1.26.0-13.el8_3.x86_64 17/145 2021-03-25T14:13:51.979 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/145 2021-03-25T14:13:52.074 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-1:1.26.0-13.el8_3.x86_64 17/145 2021-03-25T14:13:52.191 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : librados2-2:17.0.0-1676.gdf88ec38.el8.x86_64 8/145 2021-03-25T14:13:52.323 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 18/145 2021-03-25T14:13:52.579 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 19/145 2021-03-25T14:13:52.600 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librados2-2:17.0.0-1676.gdf88ec38.el8.x86_64 8/145 2021-03-25T14:13:52.772 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 20/145 2021-03-25T14:13:52.983 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libquadmath-8.3.1-5.1.el8.x86_64 21/145 2021-03-25T14:13:53.096 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libquadmath-8.3.1-5.1.el8.x86_64 21/145 2021-03-25T14:13:53.157 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : librbd1-2:17.0.0-1676.gdf88ec38.el8.x86_64 9/145 2021-03-25T14:13:53.274 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librbd1-2:17.0.0-1676.gdf88ec38.el8.x86_64 9/145 2021-03-25T14:13:53.308 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libgfortran-8.3.1-5.1.el8.x86_64 22/145 2021-03-25T14:13:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephfs2-2:17.0.0-1676.gdf88ec38.el8.x86_64 10/145 2021-03-25T14:13:53.563 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libcephfs2-2:17.0.0-1676.gdf88ec38.el8.x86_64 10/145 2021-03-25T14:13:53.818 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libgfortran-8.3.1-5.1.el8.x86_64 22/145 2021-03-25T14:13:53.991 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openblas-threads-0.3.3-5.el8.x86_64 23/145 2021-03-25T14:13:54.074 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rados-2:17.0.0-1676.gdf88ec38.el8.x86_64 11/145 2021-03-25T14:13:54.241 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librgw2-2:17.0.0-1676.gdf88ec38.el8.x86_64 12/145 2021-03-25T14:13:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librgw2-2:17.0.0-1676.gdf88ec38.el8.x86_64 12/145 2021-03-25T14:13:54.494 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: openblas-threads-0.3.3-5.el8.x86_64 23/145 2021-03-25T14:13:54.536 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 13/145 2021-03-25T14:13:54.699 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openblas-0.3.3-5.el8.x86_64 24/145 2021-03-25T14:13:54.775 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/145 2021-03-25T14:13:54.907 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libradosstriper1-2:17.0.0-1676.gdf88ec38.el8.x86 15/145 2021-03-25T14:13:55.229 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libradosstriper1-2:17.0.0-1676.gdf88ec38.el8.x86 15/145 2021-03-25T14:13:55.414 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: openblas-0.3.3-5.el8.x86_64 24/145 2021-03-25T14:13:55.525 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : NetworkManager-libnm-1:1.26.0-13.el8_3.x86_64 16/145 2021-03-25T14:13:55.579 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-libnm-1:1.26.0-13.el8_3.x86_64 16/145 2021-03-25T14:13:55.734 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 25/145 2021-03-25T14:13:55.843 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-1:1.26.0-13.el8_3.x86_64 17/145 2021-03-25T14:13:55.938 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libxslt-1.1.32-5.el8.x86_64 26/145 2021-03-25T14:13:56.116 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : NetworkManager-1:1.26.0-13.el8_3.x86_64 17/145 2021-03-25T14:13:56.453 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-1:1.26.0-13.el8_3.x86_64 17/145 2021-03-25T14:13:56.693 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : zlib-devel-1.2.11-16.el8_2.x86_64 27/145 2021-03-25T14:13:56.723 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libquadmath-8.3.1-5.1.el8.x86_64 18/145 2021-03-25T14:13:56.840 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libquadmath-8.3.1-5.1.el8.x86_64 18/145 2021-03-25T14:13:56.946 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 28/145 2021-03-25T14:13:57.007 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libgfortran-8.3.1-5.1.el8.x86_64 19/145 2021-03-25T14:13:57.189 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-ceph-common-2:17.0.0-1676.gdf88ec38.el8. 29/145 2021-03-25T14:13:57.360 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-ceph-argparse-2:17.0.0-1676.gdf88ec38.el 30/145 2021-03-25T14:13:57.512 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libgfortran-8.3.1-5.1.el8.x86_64 19/145 2021-03-25T14:13:57.561 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cephfs-2:17.0.0-1676.gdf88ec38.el8.x86_6 31/145 2021-03-25T14:13:57.656 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openblas-threads-0.3.3-5.el8.x86_64 20/145 2021-03-25T14:13:57.835 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 32/145 2021-03-25T14:13:58.048 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 33/145 2021-03-25T14:13:58.164 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: openblas-threads-0.3.3-5.el8.x86_64 20/145 2021-03-25T14:13:58.323 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openblas-0.3.3-5.el8.x86_64 21/145 2021-03-25T14:13:59.055 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: openblas-0.3.3-5.el8.x86_64 21/145 2021-03-25T14:13:59.381 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 22/145 2021-03-25T14:13:59.596 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libxslt-1.1.32-5.el8.x86_64 23/145 2021-03-25T14:13:59.762 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : zlib-devel-1.2.11-16.el8_2.x86_64 24/145 2021-03-25T14:13:59.940 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 25/145 2021-03-25T14:14:00.034 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 33/145 2021-03-25T14:14:00.226 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 26/145 2021-03-25T14:14:00.474 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/145 2021-03-25T14:14:00.691 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 28/145 2021-03-25T14:14:00.862 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ceph-common-2:17.0.0-1676.gdf88ec38.el8. 29/145 2021-03-25T14:14:01.016 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ceph-argparse-2:17.0.0-1676.gdf88ec38.el 30/145 2021-03-25T14:14:01.099 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 34/145 2021-03-25T14:14:01.445 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 35/145 2021-03-25T14:14:01.712 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 36/145 2021-03-25T14:14:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cephfs-2:17.0.0-1676.gdf88ec38.el8.x86_6 31/145 2021-03-25T14:14:02.011 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 37/145 2021-03-25T14:14:02.212 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 32/145 2021-03-25T14:14:02.261 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rsa-3.4.2-16.el8.noarch 38/145 2021-03-25T14:14:02.436 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 33/145 2021-03-25T14:14:02.492 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 39/145 2021-03-25T14:14:02.689 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 34/145 2021-03-25T14:14:02.728 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rgw-2:17.0.0-1676.gdf88ec38.el8.x86_64 40/145 2021-03-25T14:14:02.910 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rbd-2:17.0.0-1676.gdf88ec38.el8.x86_64 41/145 2021-03-25T14:14:02.942 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 35/145 2021-03-25T14:14:03.121 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librados-devel-2:17.0.0-1676.gdf88ec38.el8.x86_6 42/145 2021-03-25T14:14:03.148 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 36/145 2021-03-25T14:14:03.342 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 43/145 2021-03-25T14:14:03.523 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 44/145 2021-03-25T14:14:03.608 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 44/145 2021-03-25T14:14:03.840 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : jq-1.5-12.el8.x86_64 45/145 2021-03-25T14:14:04.005 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 46/145 2021-03-25T14:14:04.184 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 47/145 2021-03-25T14:14:04.377 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 48/145 2021-03-25T14:14:04.591 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 49/145 2021-03-25T14:14:04.944 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 50/145 2021-03-25T14:14:05.167 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 36/145 2021-03-25T14:14:05.201 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : automake-1.16.1-6.el8.noarch 51/145 2021-03-25T14:14:05.433 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 52/145 2021-03-25T14:14:05.523 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 37/145 2021-03-25T14:14:05.720 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rsa-3.4.2-16.el8.noarch 38/145 2021-03-25T14:14:05.747 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 53/145 2021-03-25T14:14:05.892 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 39/145 2021-03-25T14:14:05.977 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 54/145 2021-03-25T14:14:06.081 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rgw-2:17.0.0-1676.gdf88ec38.el8.x86_64 40/145 2021-03-25T14:14:06.155 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 55/145 2021-03-25T14:14:06.243 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rbd-2:17.0.0-1676.gdf88ec38.el8.x86_64 41/145 2021-03-25T14:14:06.356 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libuuid-devel-2.32.1-24.el8.x86_64 56/145 2021-03-25T14:14:06.452 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librados-devel-2:17.0.0-1676.gdf88ec38.el8.x86_6 42/145 2021-03-25T14:14:06.642 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 43/145 2021-03-25T14:14:06.691 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 57/145 2021-03-25T14:14:06.859 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 44/145 2021-03-25T14:14:07.016 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libselinux-devel-2.9-3.el8.x86_64 58/145 2021-03-25T14:14:07.017 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 59/145 2021-03-25T14:14:07.017 INFO:teuthology.orchestra.run.smithi174.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2021-03-25T14:14:07.017 INFO:teuthology.orchestra.run.smithi174.stdout: 2021-03-25T14:14:07.137 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 45/145 2021-03-25T14:14:07.343 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 46/145 2021-03-25T14:14:07.395 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : fuse-2.9.7-12.el8.x86_64 60/145 2021-03-25T14:14:07.487 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 47/145 2021-03-25T14:14:07.615 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 61/145 2021-03-25T14:14:07.636 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libuuid-devel-2.32.1-24.el8.x86_64 48/145 2021-03-25T14:14:07.872 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 62/145 2021-03-25T14:14:07.895 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 49/145 2021-03-25T14:14:08.083 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 63/145 2021-03-25T14:14:08.107 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libselinux-devel-2.9-3.el8.x86_64 50/145 2021-03-25T14:14:08.107 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 51/145 2021-03-25T14:14:08.107 INFO:teuthology.orchestra.run.smithi110.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2021-03-25T14:14:08.107 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:14:08.335 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 64/145 2021-03-25T14:14:08.444 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : fuse-2.9.7-12.el8.x86_64 52/145 2021-03-25T14:14:08.638 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 53/145 2021-03-25T14:14:08.680 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-asn1crypto-0.24.0-3.el8.noarch 65/145 2021-03-25T14:14:08.984 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cryptography-2.3-3.el8.x86_64 66/145 2021-03-25T14:14:09.201 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 67/145 2021-03-25T14:14:09.215 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 54/145 2021-03-25T14:14:09.457 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 55/145 2021-03-25T14:14:09.482 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyOpenSSL-18.0.0-1.el8.noarch 68/145 2021-03-25T14:14:09.652 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 56/145 2021-03-25T14:14:09.762 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 69/145 2021-03-25T14:14:09.964 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 70/145 2021-03-25T14:14:09.989 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-asn1crypto-0.24.0-3.el8.noarch 57/145 2021-03-25T14:14:10.133 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 71/145 2021-03-25T14:14:10.276 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cryptography-2.3-3.el8.x86_64 58/145 2021-03-25T14:14:10.379 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 72/145 2021-03-25T14:14:10.475 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyOpenSSL-18.0.0-1.el8.noarch 59/145 2021-03-25T14:14:10.641 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : krb5-devel-1.18.2-5.el8.x86_64 73/145 2021-03-25T14:14:10.723 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 60/145 2021-03-25T14:14:10.838 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 74/145 2021-03-25T14:14:11.020 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 61/145 2021-03-25T14:14:11.131 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 75/145 2021-03-25T14:14:11.198 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 62/145 2021-03-25T14:14:11.332 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/145 2021-03-25T14:14:11.338 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 76/145 2021-03-25T14:14:11.510 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 77/145 2021-03-25T14:14:11.514 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 64/145 2021-03-25T14:14:11.651 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 78/145 2021-03-25T14:14:11.758 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : krb5-devel-1.18.2-5.el8.x86_64 65/145 2021-03-25T14:14:11.843 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 79/145 2021-03-25T14:14:11.930 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 66/145 2021-03-25T14:14:12.016 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 66/145 2021-03-25T14:14:12.205 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : jq-1.5-12.el8.x86_64 67/145 2021-03-25T14:14:12.400 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 68/145 2021-03-25T14:14:12.558 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 80/145 2021-03-25T14:14:12.587 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 69/145 2021-03-25T14:14:12.792 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 70/145 2021-03-25T14:14:12.792 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 81/145 2021-03-25T14:14:12.954 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 82/145 2021-03-25T14:14:13.023 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 71/145 2021-03-25T14:14:13.175 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 83/145 2021-03-25T14:14:13.272 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 72/145 2021-03-25T14:14:13.376 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 84/145 2021-03-25T14:14:13.454 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : automake-1.16.1-6.el8.noarch 73/145 2021-03-25T14:14:13.578 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 85/145 2021-03-25T14:14:13.650 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 74/145 2021-03-25T14:14:13.862 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-portend-2.6-1.el8.noarch 86/145 2021-03-25T14:14:13.880 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 75/145 2021-03-25T14:14:14.053 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 76/145 2021-03-25T14:14:14.083 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 87/145 2021-03-25T14:14:14.217 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 77/145 2021-03-25T14:14:14.415 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 78/145 2021-03-25T14:14:14.423 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 88/145 2021-03-25T14:14:14.606 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 79/145 2021-03-25T14:14:14.698 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 89/145 2021-03-25T14:14:14.782 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 80/145 2021-03-25T14:14:14.966 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 81/145 2021-03-25T14:14:14.972 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 90/145 2021-03-25T14:14:15.110 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 82/145 2021-03-25T14:14:15.293 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 91/145 2021-03-25T14:14:15.343 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 83/145 2021-03-25T14:14:15.570 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 92/145 2021-03-25T14:14:15.591 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 84/145 2021-03-25T14:14:15.736 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 93/145 2021-03-25T14:14:15.785 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 85/145 2021-03-25T14:14:15.970 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 94/145 2021-03-25T14:14:16.038 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-portend-2.6-1.el8.noarch 86/145 2021-03-25T14:14:16.232 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 87/145 2021-03-25T14:14:16.574 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 88/145 2021-03-25T14:14:16.849 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 89/145 2021-03-25T14:14:17.118 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 95/145 2021-03-25T14:14:17.123 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 90/145 2021-03-25T14:14:17.369 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 96/145 2021-03-25T14:14:17.450 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 91/145 2021-03-25T14:14:17.634 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 97/145 2021-03-25T14:14:17.704 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 92/145 2021-03-25T14:14:17.870 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 93/145 2021-03-25T14:14:18.081 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 94/145 2021-03-25T14:14:18.124 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 98/145 2021-03-25T14:14:18.354 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 99/145 2021-03-25T14:14:18.565 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 100/145 2021-03-25T14:14:18.755 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 101/145 2021-03-25T14:14:19.211 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 95/145 2021-03-25T14:14:19.419 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 96/145 2021-03-25T14:14:19.660 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 97/145 2021-03-25T14:14:19.884 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 98/145 2021-03-25T14:14:20.097 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 99/145 2021-03-25T14:14:20.271 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 100/145 2021-03-25T14:14:20.429 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 101/145 2021-03-25T14:14:22.690 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-common-2:17.0.0-1676.gdf88ec38.el8.x86_64 102/145 2021-03-25T14:14:22.912 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-common-2:17.0.0-1676.gdf88ec38.el8.x86_64 102/145 2021-03-25T14:14:23.747 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-common-2:17.0.0-1676.gdf88ec38.el8.x86_64 102/145 2021-03-25T14:14:24.067 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-base-2:17.0.0-1676.gdf88ec38.el8.x86_64 103/145 2021-03-25T14:14:24.180 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-base-2:17.0.0-1676.gdf88ec38.el8.x86_64 103/145 2021-03-25T14:14:24.194 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-common-2:17.0.0-1676.gdf88ec38.el8.x86_64 102/145 2021-03-25T14:14:24.370 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-selinux-2:17.0.0-1676.gdf88ec38.el8.x86_64 104/145 2021-03-25T14:14:24.403 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-common-2:17.0.0-1676.gdf88ec38.el8.x86_64 102/145 2021-03-25T14:14:25.108 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-common-2:17.0.0-1676.gdf88ec38.el8.x86_64 102/145 2021-03-25T14:14:25.409 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-base-2:17.0.0-1676.gdf88ec38.el8.x86_64 103/145 2021-03-25T14:14:25.517 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-base-2:17.0.0-1676.gdf88ec38.el8.x86_64 103/145 2021-03-25T14:14:25.645 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-selinux-2:17.0.0-1676.gdf88ec38.el8.x86_64 104/145 2021-03-25T14:14:41.273 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-selinux-2:17.0.0-1676.gdf88ec38.el8.x86_64 104/145 2021-03-25T14:14:41.273 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /sys 2021-03-25T14:14:41.273 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /proc 2021-03-25T14:14:41.273 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /dev 2021-03-25T14:14:41.273 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /run 2021-03-25T14:14:41.274 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /mnt 2021-03-25T14:14:41.274 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /var/tmp 2021-03-25T14:14:41.274 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /home 2021-03-25T14:14:41.274 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /tmp 2021-03-25T14:14:41.274 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /dev 2021-03-25T14:14:41.274 INFO:teuthology.orchestra.run.smithi174.stdout: 2021-03-25T14:14:41.667 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mds-2:17.0.0-1676.gdf88ec38.el8.x86_64 105/145 2021-03-25T14:14:42.029 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mds-2:17.0.0-1676.gdf88ec38.el8.x86_64 105/145 2021-03-25T14:14:42.206 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mon-2:17.0.0-1676.gdf88ec38.el8.x86_64 106/145 2021-03-25T14:14:42.428 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-selinux-2:17.0.0-1676.gdf88ec38.el8.x86_64 104/145 2021-03-25T14:14:42.428 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /sys 2021-03-25T14:14:42.428 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /proc 2021-03-25T14:14:42.428 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /dev 2021-03-25T14:14:42.428 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /run 2021-03-25T14:14:42.428 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /mnt 2021-03-25T14:14:42.428 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /var/tmp 2021-03-25T14:14:42.429 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /home 2021-03-25T14:14:42.429 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /tmp 2021-03-25T14:14:42.429 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /dev 2021-03-25T14:14:42.429 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:14:42.810 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mds-2:17.0.0-1676.gdf88ec38.el8.x86_64 105/145 2021-03-25T14:14:43.171 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mds-2:17.0.0-1676.gdf88ec38.el8.x86_64 105/145 2021-03-25T14:14:43.340 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mon-2:17.0.0-1676.gdf88ec38.el8.x86_64 106/145 2021-03-25T14:14:43.632 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mon-2:17.0.0-1676.gdf88ec38.el8.x86_64 106/145 2021-03-25T14:14:43.864 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-osd-2:17.0.0-1676.gdf88ec38.el8.x86_64 107/145 2021-03-25T14:14:43.889 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-osd-2:17.0.0-1676.gdf88ec38.el8.x86_64 107/145 2021-03-25T14:14:44.767 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mon-2:17.0.0-1676.gdf88ec38.el8.x86_64 106/145 2021-03-25T14:14:45.032 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-osd-2:17.0.0-1676.gdf88ec38.el8.x86_64 107/145 2021-03-25T14:14:45.056 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-osd-2:17.0.0-1676.gdf88ec38.el8.x86_64 107/145 2021-03-25T14:14:46.051 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: cephadm-2:17.0.0-1676.gdf88ec38.el8.noarch 108/145 2021-03-25T14:14:46.459 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephadm-2:17.0.0-1676.gdf88ec38.el8.noarch 108/145 2021-03-25T14:14:47.057 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: cephadm-2:17.0.0-1676.gdf88ec38.el8.noarch 108/145 2021-03-25T14:14:47.238 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-prometheus-alerts-2:17.0.0-1676.gdf88ec38.e 109/145 2021-03-25T14:14:47.669 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-grafana-dashboards-2:17.0.0-1676.gdf88ec38. 110/145 2021-03-25T14:14:47.699 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cephadm-2:17.0.0-1676.gdf88ec38.el8.noarch 108/145 2021-03-25T14:14:47.816 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-cephadm-2:17.0.0-1676.gdf88ec38.el8.noa 111/145 2021-03-25T14:14:47.825 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-prometheus-alerts-2:17.0.0-1676.gdf88ec38.e 109/145 2021-03-25T14:14:48.010 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-grafana-dashboards-2:17.0.0-1676.gdf88ec38. 110/145 2021-03-25T14:14:48.142 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-cephadm-2:17.0.0-1676.gdf88ec38.el8.noa 111/145 2021-03-25T14:14:48.679 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.0.0-1676.gdf88ec38.el8.noa 111/145 2021-03-25T14:14:48.963 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-dashboard-2:17.0.0-1676.gdf88ec38.el8.n 112/145 2021-03-25T14:14:49.033 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.0.0-1676.gdf88ec38.el8.noa 111/145 2021-03-25T14:14:49.289 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-dashboard-2:17.0.0-1676.gdf88ec38.el8.n 112/145 2021-03-25T14:14:49.928 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.0.0-1676.gdf88ec38.el8.n 112/145 2021-03-25T14:14:50.124 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-diskprediction-local-2:17.0.0-1676.gdf8 113/145 2021-03-25T14:14:50.217 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.0.0-1676.gdf8 113/145 2021-03-25T14:14:50.254 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.0.0-1676.gdf88ec38.el8.n 112/145 2021-03-25T14:14:50.475 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-diskprediction-local-2:17.0.0-1676.gdf8 113/145 2021-03-25T14:14:50.572 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.0.0-1676.gdf8 113/145 2021-03-25T14:14:50.596 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-modules-core-2:17.0.0-1676.gdf88ec38.el 114/145 2021-03-25T14:14:50.779 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-2:17.0.0-1676.gdf88ec38.el8.x86_64 115/145 2021-03-25T14:14:50.810 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-2:17.0.0-1676.gdf88ec38.el8.x86_64 115/145 2021-03-25T14:14:50.931 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-modules-core-2:17.0.0-1676.gdf88ec38.el 114/145 2021-03-25T14:14:50.974 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-rook-2:17.0.0-1676.gdf88ec38.el8.noarch 116/145 2021-03-25T14:14:50.990 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-rook-2:17.0.0-1676.gdf88ec38.el8.noarch 116/145 2021-03-25T14:14:51.080 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-2:17.0.0-1676.gdf88ec38.el8.x86_64 115/145 2021-03-25T14:14:51.111 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-2:17.0.0-1676.gdf88ec38.el8.x86_64 115/145 2021-03-25T14:14:51.299 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-rook-2:17.0.0-1676.gdf88ec38.el8.noarch 116/145 2021-03-25T14:14:51.315 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-rook-2:17.0.0-1676.gdf88ec38.el8.noarch 116/145 2021-03-25T14:14:52.061 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-2:17.0.0-1676.gdf88ec38.el8.x86_64 117/145 2021-03-25T14:14:52.288 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-radosgw-2:17.0.0-1676.gdf88ec38.el8.x86_64 118/145 2021-03-25T14:14:52.341 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-2:17.0.0-1676.gdf88ec38.el8.x86_64 117/145 2021-03-25T14:14:52.388 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-radosgw-2:17.0.0-1676.gdf88ec38.el8.x86_64 118/145 2021-03-25T14:14:52.547 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-radosgw-2:17.0.0-1676.gdf88ec38.el8.x86_64 118/145 2021-03-25T14:14:52.582 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephfs-mirror-2:17.0.0-1676.gdf88ec38.el8.x86_64 119/145 2021-03-25T14:14:52.645 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-radosgw-2:17.0.0-1676.gdf88ec38.el8.x86_64 118/145 2021-03-25T14:14:52.944 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: cephfs-mirror-2:17.0.0-1676.gdf88ec38.el8.x86_64 119/145 2021-03-25T14:14:53.049 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cephfs-mirror-2:17.0.0-1676.gdf88ec38.el8.x86_64 119/145 2021-03-25T14:14:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: cephfs-mirror-2:17.0.0-1676.gdf88ec38.el8.x86_64 119/145 2021-03-25T14:14:54.175 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-mirror-2:17.0.0-1676.gdf88ec38.el8.x86_64 120/145 2021-03-25T14:14:54.415 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-mirror-2:17.0.0-1676.gdf88ec38.el8.x86_64 120/145 2021-03-25T14:14:58.385 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: rbd-mirror-2:17.0.0-1676.gdf88ec38.el8.x86_64 120/145 2021-03-25T14:14:58.650 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: rbd-mirror-2:17.0.0-1676.gdf88ec38.el8.x86_64 120/145 2021-03-25T14:14:58.717 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-test-2:17.0.0-1676.gdf88ec38.el8.x86_64 121/145 2021-03-25T14:14:58.898 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libtool-2.4.6-25.el8.x86_64 122/145 2021-03-25T14:14:59.610 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 122/145 2021-03-25T14:14:59.615 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-test-2:17.0.0-1676.gdf88ec38.el8.x86_64 121/145 2021-03-25T14:15:00.030 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openssl-devel-1:1.1.1g-12.el8_3.x86_64 122/145 2021-03-25T14:15:00.155 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openssl-devel-1:1.1.1g-12.el8_3.x86_64 123/145 2021-03-25T14:15:00.184 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-fuse-2:17.0.0-1676.gdf88ec38.el8.x86_64 123/145 2021-03-25T14:15:00.344 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-fuse-2:17.0.0-1676.gdf88ec38.el8.x86_64 124/145 2021-03-25T14:15:00.465 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : xfsprogs-devel-5.0.0-4.el8.x86_64 124/145 2021-03-25T14:15:00.552 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : xfsprogs-devel-5.0.0-4.el8.x86_64 125/145 2021-03-25T14:15:00.639 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libtool-2.4.6-25.el8.x86_64 125/145 2021-03-25T14:15:00.655 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 125/145 2021-03-25T14:15:00.712 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephfs-devel-2:17.0.0-1676.gdf88ec38.el8.x86_ 126/145 2021-03-25T14:15:00.852 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephfs-devel-2:17.0.0-1676.gdf88ec38.el8.x86_ 126/145 2021-03-25T14:15:00.884 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : elfutils-libelf-devel-0.180-1.el8.x86_64 127/145 2021-03-25T14:15:01.067 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : elfutils-libelf-devel-0.180-1.el8.x86_64 127/145 2021-03-25T14:15:01.070 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : NetworkManager-team-1:1.26.0-13.el8_3.x86_64 128/145 2021-03-25T14:15:01.261 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : NetworkManager-tui-1:1.26.0-13.el8_3.x86_64 129/145 2021-03-25T14:15:01.303 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : NetworkManager-team-1:1.26.0-13.el8_3.x86_64 128/145 2021-03-25T14:15:01.440 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cephfs-top-2:17.0.0-1676.gdf88ec38.el8.noarch 130/145 2021-03-25T14:15:01.503 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : NetworkManager-tui-1:1.26.0-13.el8_3.x86_64 129/145 2021-03-25T14:15:01.631 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-fuse-2:17.0.0-1676.gdf88ec38.el8.x86_64 131/145 2021-03-25T14:15:01.706 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephfs-top-2:17.0.0-1676.gdf88ec38.el8.noarch 130/145 2021-03-25T14:15:01.823 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-nbd-2:17.0.0-1676.gdf88ec38.el8.x86_64 132/145 2021-03-25T14:15:01.898 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-fuse-2:17.0.0-1676.gdf88ec38.el8.x86_64 131/145 2021-03-25T14:15:01.982 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-immutable-object-cache-2:17.0.0-1676.gdf88e 133/145 2021-03-25T14:15:02.122 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.0.0-1676.gdf88e 133/145 2021-03-25T14:15:02.122 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-nbd-2:17.0.0-1676.gdf88ec38.el8.x86_64 132/145 2021-03-25T14:15:02.339 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-immutable-object-cache-2:17.0.0-1676.gdf88e 133/145 2021-03-25T14:15:02.383 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : openssl-1:1.1.1g-12.el8_3.x86_64 134/145 2021-03-25T14:15:02.484 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.0.0-1676.gdf88e 133/145 2021-03-25T14:15:02.588 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 135/145 2021-03-25T14:15:02.789 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : bison-3.0.4-10.el8.x86_64 136/145 2021-03-25T14:15:02.842 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 136/145 2021-03-25T14:15:02.872 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : openssl-1:1.1.1g-12.el8_3.x86_64 134/145 2021-03-25T14:15:03.038 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : bison-3.0.4-10.el8.x86_64 135/145 2021-03-25T14:15:03.089 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flex-2.6.1-9.el8.x86_64 137/145 2021-03-25T14:15:03.091 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 135/145 2021-03-25T14:15:03.102 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 137/145 2021-03-25T14:15:03.235 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : NetworkManager-tui-1:1.26.0-8.el8.x86_64 138/145 2021-03-25T14:15:03.271 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flex-2.6.1-9.el8.x86_64 136/145 2021-03-25T14:15:03.285 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 136/145 2021-03-25T14:15:03.442 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : openssl-1:1.1.1g-11.el8.x86_64 139/145 2021-03-25T14:15:03.442 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 140/145 2021-03-25T14:15:03.457 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 137/145 2021-03-25T14:15:03.626 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : NetworkManager-tui-1:1.26.0-8.el8.x86_64 138/145 2021-03-25T14:15:03.650 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 140/145 2021-03-25T14:15:03.775 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : NetworkManager-team-1:1.26.0-8.el8.x86_64 141/145 2021-03-25T14:15:03.788 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-1:1.26.0-8.el8.x86_64 142/145 2021-03-25T14:15:03.789 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : NetworkManager-1:1.26.0-8.el8.x86_64 142/145 2021-03-25T14:15:03.824 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : openssl-1:1.1.1g-11.el8.x86_64 139/145 2021-03-25T14:15:03.824 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 140/145 2021-03-25T14:15:04.049 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 140/145 2021-03-25T14:15:04.174 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : NetworkManager-team-1:1.26.0-8.el8.x86_64 141/145 2021-03-25T14:15:04.188 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-1:1.26.0-8.el8.x86_64 142/145 2021-03-25T14:15:04.189 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : NetworkManager-1:1.26.0-8.el8.x86_64 142/145 2021-03-25T14:15:04.218 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-1:1.26.0-8.el8.x86_64 142/145 2021-03-25T14:15:04.218 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : NetworkManager-libnm-1:1.26.0-8.el8.x86_64 143/145 2021-03-25T14:15:04.467 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-libnm-1:1.26.0-8.el8.x86_64 143/145 2021-03-25T14:15:04.468 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 144/145 2021-03-25T14:15:04.651 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-1:1.26.0-8.el8.x86_64 142/145 2021-03-25T14:15:04.651 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : NetworkManager-libnm-1:1.26.0-8.el8.x86_64 143/145 2021-03-25T14:15:04.686 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 144/145 2021-03-25T14:15:04.686 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : openssl-libs-1:1.1.1g-11.el8.x86_64 145/145 2021-03-25T14:15:04.900 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-libnm-1:1.26.0-8.el8.x86_64 143/145 2021-03-25T14:15:04.900 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 144/145 2021-03-25T14:15:05.110 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 144/145 2021-03-25T14:15:05.110 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : openssl-libs-1:1.1.1g-11.el8.x86_64 145/145 2021-03-25T14:15:05.528 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: openssl-libs-1:1.1.1g-11.el8.x86_64 145/145 2021-03-25T14:15:05.528 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-2:17.0.0-1676.gdf88ec38.el8.x86_64 1/145 2021-03-25T14:15:05.528 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-base-2:17.0.0-1676.gdf88ec38.el8.x86_64 2/145 2021-03-25T14:15:05.528 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-common-2:17.0.0-1676.gdf88ec38.el8.x86_64 3/145 2021-03-25T14:15:05.529 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-fuse-2:17.0.0-1676.gdf88ec38.el8.x86_64 4/145 2021-03-25T14:15:05.529 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-immutable-object-cache-2:17.0.0-1676.gdf88e 5/145 2021-03-25T14:15:05.529 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mds-2:17.0.0-1676.gdf88ec38.el8.x86_64 6/145 2021-03-25T14:15:05.529 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-2:17.0.0-1676.gdf88ec38.el8.x86_64 7/145 2021-03-25T14:15:05.529 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mon-2:17.0.0-1676.gdf88ec38.el8.x86_64 8/145 2021-03-25T14:15:05.529 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-osd-2:17.0.0-1676.gdf88ec38.el8.x86_64 9/145 2021-03-25T14:15:05.529 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-radosgw-2:17.0.0-1676.gdf88ec38.el8.x86_64 10/145 2021-03-25T14:15:05.529 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-selinux-2:17.0.0-1676.gdf88ec38.el8.x86_64 11/145 2021-03-25T14:15:05.529 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-test-2:17.0.0-1676.gdf88ec38.el8.x86_64 12/145 2021-03-25T14:15:05.529 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cephfs-mirror-2:17.0.0-1676.gdf88ec38.el8.x86_64 13/145 2021-03-25T14:15:05.529 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephfs-devel-2:17.0.0-1676.gdf88ec38.el8.x86_ 14/145 2021-03-25T14:15:05.530 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephfs2-2:17.0.0-1676.gdf88ec38.el8.x86_64 15/145 2021-03-25T14:15:05.530 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados-devel-2:17.0.0-1676.gdf88ec38.el8.x86_6 16/145 2021-03-25T14:15:05.530 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libradosstriper1-2:17.0.0-1676.gdf88ec38.el8.x86 17/145 2021-03-25T14:15:05.530 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librgw2-2:17.0.0-1676.gdf88ec38.el8.x86_64 18/145 2021-03-25T14:15:05.530 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ceph-argparse-2:17.0.0-1676.gdf88ec38.el 19/145 2021-03-25T14:15:05.530 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ceph-common-2:17.0.0-1676.gdf88ec38.el8. 20/145 2021-03-25T14:15:05.530 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cephfs-2:17.0.0-1676.gdf88ec38.el8.x86_6 21/145 2021-03-25T14:15:05.530 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rados-2:17.0.0-1676.gdf88ec38.el8.x86_64 22/145 2021-03-25T14:15:05.530 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rbd-2:17.0.0-1676.gdf88ec38.el8.x86_64 23/145 2021-03-25T14:15:05.531 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rgw-2:17.0.0-1676.gdf88ec38.el8.x86_64 24/145 2021-03-25T14:15:05.531 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-fuse-2:17.0.0-1676.gdf88ec38.el8.x86_64 25/145 2021-03-25T14:15:05.531 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-mirror-2:17.0.0-1676.gdf88ec38.el8.x86_64 26/145 2021-03-25T14:15:05.531 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-nbd-2:17.0.0-1676.gdf88ec38.el8.x86_64 27/145 2021-03-25T14:15:05.544 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-grafana-dashboards-2:17.0.0-1676.gdf88ec38. 28/145 2021-03-25T14:15:05.544 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-cephadm-2:17.0.0-1676.gdf88ec38.el8.noa 29/145 2021-03-25T14:15:05.544 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-dashboard-2:17.0.0-1676.gdf88ec38.el8.n 30/145 2021-03-25T14:15:05.545 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.0.0-1676.gdf8 31/145 2021-03-25T14:15:05.545 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-modules-core-2:17.0.0-1676.gdf88ec38.el 32/145 2021-03-25T14:15:05.545 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-rook-2:17.0.0-1676.gdf88ec38.el8.noarch 33/145 2021-03-25T14:15:05.545 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-prometheus-alerts-2:17.0.0-1676.gdf88ec38.e 34/145 2021-03-25T14:15:05.545 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cephadm-2:17.0.0-1676.gdf88ec38.el8.noarch 35/145 2021-03-25T14:15:05.545 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cephfs-top-2:17.0.0-1676.gdf88ec38.el8.noarch 36/145 2021-03-25T14:15:05.545 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 37/145 2021-03-25T14:15:05.545 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 38/145 2021-03-25T14:15:05.545 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : leveldb-1.22-1.el8.x86_64 39/145 2021-03-25T14:15:05.545 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/145 2021-03-25T14:15:05.546 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/145 2021-03-25T14:15:05.546 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 42/145 2021-03-25T14:15:05.546 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/145 2021-03-25T14:15:05.546 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/145 2021-03-25T14:15:05.546 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/145 2021-03-25T14:15:05.546 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/145 2021-03-25T14:15:05.546 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/145 2021-03-25T14:15:05.546 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/145 2021-03-25T14:15:05.546 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 49/145 2021-03-25T14:15:05.546 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 50/145 2021-03-25T14:15:05.547 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 51/145 2021-03-25T14:15:05.547 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 52/145 2021-03-25T14:15:05.547 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 53/145 2021-03-25T14:15:05.547 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 54/145 2021-03-25T14:15:05.547 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 55/145 2021-03-25T14:15:05.547 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 56/145 2021-03-25T14:15:05.547 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 57/145 2021-03-25T14:15:05.547 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-portend-2.6-1.el8.noarch 58/145 2021-03-25T14:15:05.547 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 59/145 2021-03-25T14:15:05.547 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 60/145 2021-03-25T14:15:05.548 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 61/145 2021-03-25T14:15:05.548 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rsa-3.4.2-16.el8.noarch 62/145 2021-03-25T14:15:05.548 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 63/145 2021-03-25T14:15:05.548 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 64/145 2021-03-25T14:15:05.548 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 65/145 2021-03-25T14:15:05.548 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 66/145 2021-03-25T14:15:05.548 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 67/145 2021-03-25T14:15:05.548 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 68/145 2021-03-25T14:15:05.548 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 69/145 2021-03-25T14:15:05.548 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 70/145 2021-03-25T14:15:05.549 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 71/145 2021-03-25T14:15:05.549 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 72/145 2021-03-25T14:15:05.549 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : automake-1.16.1-6.el8.noarch 73/145 2021-03-25T14:15:05.549 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 74/145 2021-03-25T14:15:05.549 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 75/145 2021-03-25T14:15:05.549 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : jq-1.5-12.el8.x86_64 76/145 2021-03-25T14:15:05.549 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyOpenSSL-18.0.0-1.el8.noarch 77/145 2021-03-25T14:15:05.549 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 78/145 2021-03-25T14:15:05.549 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 79/145 2021-03-25T14:15:05.549 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 80/145 2021-03-25T14:15:05.549 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 81/145 2021-03-25T14:15:05.549 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 82/145 2021-03-25T14:15:05.550 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 83/145 2021-03-25T14:15:05.550 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 84/145 2021-03-25T14:15:05.550 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 85/145 2021-03-25T14:15:05.550 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/145 2021-03-25T14:15:05.550 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 87/145 2021-03-25T14:15:05.550 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flex-2.6.1-9.el8.x86_64 88/145 2021-03-25T14:15:05.550 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 89/145 2021-03-25T14:15:05.550 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : bison-3.0.4-10.el8.x86_64 90/145 2021-03-25T14:15:05.550 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 91/145 2021-03-25T14:15:05.550 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 92/145 2021-03-25T14:15:05.551 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 93/145 2021-03-25T14:15:05.551 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 94/145 2021-03-25T14:15:05.551 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 95/145 2021-03-25T14:15:05.551 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 96/145 2021-03-25T14:15:05.551 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 97/145 2021-03-25T14:15:05.551 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openblas-threads-0.3.3-5.el8.x86_64 98/145 2021-03-25T14:15:05.551 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openblas-0.3.3-5.el8.x86_64 99/145 2021-03-25T14:15:05.551 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 100/145 2021-03-25T14:15:05.551 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 101/145 2021-03-25T14:15:05.551 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 102/145 2021-03-25T14:15:05.552 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 103/145 2021-03-25T14:15:05.552 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-asn1crypto-0.24.0-3.el8.noarch 104/145 2021-03-25T14:15:05.552 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 105/145 2021-03-25T14:15:05.552 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 106/145 2021-03-25T14:15:05.552 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 107/145 2021-03-25T14:15:05.552 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 108/145 2021-03-25T14:15:05.552 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 109/145 2021-03-25T14:15:05.552 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 110/145 2021-03-25T14:15:05.552 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 111/145 2021-03-25T14:15:05.552 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 112/145 2021-03-25T14:15:05.553 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/145 2021-03-25T14:15:05.553 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libselinux-devel-2.9-3.el8.x86_64 114/145 2021-03-25T14:15:05.553 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cryptography-2.3-3.el8.x86_64 115/145 2021-03-25T14:15:05.553 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : zlib-devel-1.2.11-16.el8_2.x86_64 116/145 2021-03-25T14:15:05.553 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libuuid-devel-2.32.1-24.el8.x86_64 117/145 2021-03-25T14:15:05.553 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libxslt-1.1.32-5.el8.x86_64 118/145 2021-03-25T14:15:05.553 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 119/145 2021-03-25T14:15:05.553 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libquadmath-8.3.1-5.1.el8.x86_64 120/145 2021-03-25T14:15:05.553 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 121/145 2021-03-25T14:15:05.553 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libgfortran-8.3.1-5.1.el8.x86_64 122/145 2021-03-25T14:15:05.554 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : elfutils-libelf-devel-0.180-1.el8.x86_64 123/145 2021-03-25T14:15:05.554 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 124/145 2021-03-25T14:15:05.554 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 125/145 2021-03-25T14:15:05.554 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : krb5-devel-1.18.2-5.el8.x86_64 126/145 2021-03-25T14:15:05.554 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xfsprogs-devel-5.0.0-4.el8.x86_64 127/145 2021-03-25T14:15:05.554 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librabbitmq-0.9.0-2.el8.x86_64 128/145 2021-03-25T14:15:05.554 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-devel-1:1.1.1g-12.el8_3.x86_64 129/145 2021-03-25T14:15:05.554 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados2-2:17.0.0-1676.gdf88ec38.el8.x86_64 130/145 2021-03-25T14:15:05.554 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 131/145 2021-03-25T14:15:05.554 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librbd1-2:17.0.0-1676.gdf88ec38.el8.x86_64 132/145 2021-03-25T14:15:05.555 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 133/145 2021-03-25T14:15:05.555 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-libs-1:1.1.1g-12.el8_3.x86_64 134/145 2021-03-25T14:15:05.555 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-libs-1:1.1.1g-11.el8.x86_64 135/145 2021-03-25T14:15:05.555 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-1:1.1.1g-12.el8_3.x86_64 136/145 2021-03-25T14:15:05.555 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-1:1.1.1g-11.el8.x86_64 137/145 2021-03-25T14:15:05.555 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-libnm-1:1.26.0-13.el8_3.x86_64 138/145 2021-03-25T14:15:05.555 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-libnm-1:1.26.0-8.el8.x86_64 139/145 2021-03-25T14:15:05.555 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-team-1:1.26.0-13.el8_3.x86_64 140/145 2021-03-25T14:15:05.555 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-team-1:1.26.0-8.el8.x86_64 141/145 2021-03-25T14:15:05.555 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-1:1.26.0-13.el8_3.x86_64 142/145 2021-03-25T14:15:05.556 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-1:1.26.0-8.el8.x86_64 143/145 2021-03-25T14:15:05.556 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-tui-1:1.26.0-13.el8_3.x86_64 144/145 2021-03-25T14:15:05.986 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: openssl-libs-1:1.1.1g-11.el8.x86_64 145/145 2021-03-25T14:15:05.986 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-2:17.0.0-1676.gdf88ec38.el8.x86_64 1/145 2021-03-25T14:15:05.986 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-base-2:17.0.0-1676.gdf88ec38.el8.x86_64 2/145 2021-03-25T14:15:05.986 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-common-2:17.0.0-1676.gdf88ec38.el8.x86_64 3/145 2021-03-25T14:15:05.986 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-fuse-2:17.0.0-1676.gdf88ec38.el8.x86_64 4/145 2021-03-25T14:15:05.986 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-immutable-object-cache-2:17.0.0-1676.gdf88e 5/145 2021-03-25T14:15:05.986 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mds-2:17.0.0-1676.gdf88ec38.el8.x86_64 6/145 2021-03-25T14:15:05.986 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-2:17.0.0-1676.gdf88ec38.el8.x86_64 7/145 2021-03-25T14:15:05.986 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mon-2:17.0.0-1676.gdf88ec38.el8.x86_64 8/145 2021-03-25T14:15:05.986 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-osd-2:17.0.0-1676.gdf88ec38.el8.x86_64 9/145 2021-03-25T14:15:05.987 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-radosgw-2:17.0.0-1676.gdf88ec38.el8.x86_64 10/145 2021-03-25T14:15:05.987 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-selinux-2:17.0.0-1676.gdf88ec38.el8.x86_64 11/145 2021-03-25T14:15:05.987 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-test-2:17.0.0-1676.gdf88ec38.el8.x86_64 12/145 2021-03-25T14:15:05.987 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephfs-mirror-2:17.0.0-1676.gdf88ec38.el8.x86_64 13/145 2021-03-25T14:15:05.987 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephfs-devel-2:17.0.0-1676.gdf88ec38.el8.x86_ 14/145 2021-03-25T14:15:05.987 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephfs2-2:17.0.0-1676.gdf88ec38.el8.x86_64 15/145 2021-03-25T14:15:05.987 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados-devel-2:17.0.0-1676.gdf88ec38.el8.x86_6 16/145 2021-03-25T14:15:05.987 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libradosstriper1-2:17.0.0-1676.gdf88ec38.el8.x86 17/145 2021-03-25T14:15:05.987 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librgw2-2:17.0.0-1676.gdf88ec38.el8.x86_64 18/145 2021-03-25T14:15:05.987 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-ceph-argparse-2:17.0.0-1676.gdf88ec38.el 19/145 2021-03-25T14:15:05.987 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-ceph-common-2:17.0.0-1676.gdf88ec38.el8. 20/145 2021-03-25T14:15:05.987 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cephfs-2:17.0.0-1676.gdf88ec38.el8.x86_6 21/145 2021-03-25T14:15:05.988 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rados-2:17.0.0-1676.gdf88ec38.el8.x86_64 22/145 2021-03-25T14:15:05.988 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rbd-2:17.0.0-1676.gdf88ec38.el8.x86_64 23/145 2021-03-25T14:15:05.988 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rgw-2:17.0.0-1676.gdf88ec38.el8.x86_64 24/145 2021-03-25T14:15:05.988 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-fuse-2:17.0.0-1676.gdf88ec38.el8.x86_64 25/145 2021-03-25T14:15:05.988 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-mirror-2:17.0.0-1676.gdf88ec38.el8.x86_64 26/145 2021-03-25T14:15:05.988 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-nbd-2:17.0.0-1676.gdf88ec38.el8.x86_64 27/145 2021-03-25T14:15:05.988 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-grafana-dashboards-2:17.0.0-1676.gdf88ec38. 28/145 2021-03-25T14:15:05.988 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-cephadm-2:17.0.0-1676.gdf88ec38.el8.noa 29/145 2021-03-25T14:15:05.988 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-dashboard-2:17.0.0-1676.gdf88ec38.el8.n 30/145 2021-03-25T14:15:05.988 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.0.0-1676.gdf8 31/145 2021-03-25T14:15:05.988 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-modules-core-2:17.0.0-1676.gdf88ec38.el 32/145 2021-03-25T14:15:05.988 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-rook-2:17.0.0-1676.gdf88ec38.el8.noarch 33/145 2021-03-25T14:15:05.989 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-prometheus-alerts-2:17.0.0-1676.gdf88ec38.e 34/145 2021-03-25T14:15:05.989 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephadm-2:17.0.0-1676.gdf88ec38.el8.noarch 35/145 2021-03-25T14:15:05.989 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephfs-top-2:17.0.0-1676.gdf88ec38.el8.noarch 36/145 2021-03-25T14:15:05.989 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 37/145 2021-03-25T14:15:05.989 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 38/145 2021-03-25T14:15:05.989 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : leveldb-1.22-1.el8.x86_64 39/145 2021-03-25T14:15:05.989 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/145 2021-03-25T14:15:05.989 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/145 2021-03-25T14:15:05.989 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 42/145 2021-03-25T14:15:05.989 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/145 2021-03-25T14:15:05.989 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/145 2021-03-25T14:15:05.989 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/145 2021-03-25T14:15:05.990 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/145 2021-03-25T14:15:05.990 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/145 2021-03-25T14:15:05.990 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/145 2021-03-25T14:15:05.990 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 49/145 2021-03-25T14:15:05.990 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 50/145 2021-03-25T14:15:05.990 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 51/145 2021-03-25T14:15:05.990 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 52/145 2021-03-25T14:15:05.990 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 53/145 2021-03-25T14:15:05.990 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 54/145 2021-03-25T14:15:05.990 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 55/145 2021-03-25T14:15:05.990 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 56/145 2021-03-25T14:15:05.991 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 57/145 2021-03-25T14:15:05.991 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-portend-2.6-1.el8.noarch 58/145 2021-03-25T14:15:05.991 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 59/145 2021-03-25T14:15:05.991 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 60/145 2021-03-25T14:15:05.991 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 61/145 2021-03-25T14:15:05.991 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rsa-3.4.2-16.el8.noarch 62/145 2021-03-25T14:15:05.991 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 63/145 2021-03-25T14:15:05.991 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 64/145 2021-03-25T14:15:05.991 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 65/145 2021-03-25T14:15:05.991 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 66/145 2021-03-25T14:15:05.991 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 67/145 2021-03-25T14:15:05.991 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 68/145 2021-03-25T14:15:05.991 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 69/145 2021-03-25T14:15:05.992 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 70/145 2021-03-25T14:15:05.992 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 71/145 2021-03-25T14:15:05.992 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 72/145 2021-03-25T14:15:05.992 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 73/145 2021-03-25T14:15:05.992 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 74/145 2021-03-25T14:15:05.992 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-asn1crypto-0.24.0-3.el8.noarch 75/145 2021-03-25T14:15:05.992 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/145 2021-03-25T14:15:05.992 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 77/145 2021-03-25T14:15:05.992 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 78/145 2021-03-25T14:15:05.992 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 79/145 2021-03-25T14:15:05.992 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 80/145 2021-03-25T14:15:05.992 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 81/145 2021-03-25T14:15:05.993 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 82/145 2021-03-25T14:15:05.993 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 83/145 2021-03-25T14:15:05.993 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 84/145 2021-03-25T14:15:05.993 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libselinux-devel-2.9-3.el8.x86_64 85/145 2021-03-25T14:15:05.993 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cryptography-2.3-3.el8.x86_64 86/145 2021-03-25T14:15:05.993 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : zlib-devel-1.2.11-16.el8_2.x86_64 87/145 2021-03-25T14:15:05.993 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libuuid-devel-2.32.1-24.el8.x86_64 88/145 2021-03-25T14:15:05.993 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libxslt-1.1.32-5.el8.x86_64 89/145 2021-03-25T14:15:05.993 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 90/145 2021-03-25T14:15:05.993 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libquadmath-8.3.1-5.1.el8.x86_64 91/145 2021-03-25T14:15:05.993 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 92/145 2021-03-25T14:15:05.993 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libgfortran-8.3.1-5.1.el8.x86_64 93/145 2021-03-25T14:15:05.993 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-libelf-devel-0.180-1.el8.x86_64 94/145 2021-03-25T14:15:05.994 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 95/145 2021-03-25T14:15:05.994 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 96/145 2021-03-25T14:15:05.994 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : krb5-devel-1.18.2-5.el8.x86_64 97/145 2021-03-25T14:15:05.994 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xfsprogs-devel-5.0.0-4.el8.x86_64 98/145 2021-03-25T14:15:05.994 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librabbitmq-0.9.0-2.el8.x86_64 99/145 2021-03-25T14:15:05.994 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-devel-1:1.1.1g-12.el8_3.x86_64 100/145 2021-03-25T14:15:05.994 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : automake-1.16.1-6.el8.noarch 101/145 2021-03-25T14:15:05.994 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 102/145 2021-03-25T14:15:05.994 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 103/145 2021-03-25T14:15:05.994 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : jq-1.5-12.el8.x86_64 104/145 2021-03-25T14:15:05.994 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyOpenSSL-18.0.0-1.el8.noarch 105/145 2021-03-25T14:15:05.995 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 106/145 2021-03-25T14:15:05.995 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 107/145 2021-03-25T14:15:05.995 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 108/145 2021-03-25T14:15:05.995 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 109/145 2021-03-25T14:15:05.995 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 110/145 2021-03-25T14:15:05.995 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 111/145 2021-03-25T14:15:05.995 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 112/145 2021-03-25T14:15:05.995 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 113/145 2021-03-25T14:15:05.995 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 114/145 2021-03-25T14:15:05.995 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 115/145 2021-03-25T14:15:05.995 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flex-2.6.1-9.el8.x86_64 116/145 2021-03-25T14:15:05.995 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 117/145 2021-03-25T14:15:05.995 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : bison-3.0.4-10.el8.x86_64 118/145 2021-03-25T14:15:05.996 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 119/145 2021-03-25T14:15:05.996 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 120/145 2021-03-25T14:15:05.996 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 121/145 2021-03-25T14:15:05.996 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 122/145 2021-03-25T14:15:05.996 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 123/145 2021-03-25T14:15:05.996 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 124/145 2021-03-25T14:15:05.996 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 125/145 2021-03-25T14:15:05.996 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openblas-threads-0.3.3-5.el8.x86_64 126/145 2021-03-25T14:15:05.996 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openblas-0.3.3-5.el8.x86_64 127/145 2021-03-25T14:15:05.996 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 128/145 2021-03-25T14:15:05.996 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 129/145 2021-03-25T14:15:05.996 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados2-2:17.0.0-1676.gdf88ec38.el8.x86_64 130/145 2021-03-25T14:15:05.997 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 131/145 2021-03-25T14:15:05.997 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librbd1-2:17.0.0-1676.gdf88ec38.el8.x86_64 132/145 2021-03-25T14:15:05.997 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 133/145 2021-03-25T14:15:05.997 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-libs-1:1.1.1g-12.el8_3.x86_64 134/145 2021-03-25T14:15:05.997 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-libs-1:1.1.1g-11.el8.x86_64 135/145 2021-03-25T14:15:05.997 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-1:1.1.1g-12.el8_3.x86_64 136/145 2021-03-25T14:15:05.997 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-1:1.1.1g-11.el8.x86_64 137/145 2021-03-25T14:15:05.997 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-libnm-1:1.26.0-13.el8_3.x86_64 138/145 2021-03-25T14:15:05.997 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-libnm-1:1.26.0-8.el8.x86_64 139/145 2021-03-25T14:15:05.997 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-team-1:1.26.0-13.el8_3.x86_64 140/145 2021-03-25T14:15:05.997 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-team-1:1.26.0-8.el8.x86_64 141/145 2021-03-25T14:15:05.998 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-1:1.26.0-13.el8_3.x86_64 142/145 2021-03-25T14:15:05.998 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-1:1.26.0-8.el8.x86_64 143/145 2021-03-25T14:15:05.998 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-tui-1:1.26.0-13.el8_3.x86_64 144/145 2021-03-25T14:15:07.370 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-tui-1:1.26.0-8.el8.x86_64 145/145 2021-03-25T14:15:07.371 INFO:teuthology.orchestra.run.smithi110.stdout:Installed products updated. 2021-03-25T14:15:08.053 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-tui-1:1.26.0-8.el8.x86_64 145/145 2021-03-25T14:15:08.054 INFO:teuthology.orchestra.run.smithi174.stdout:Installed products updated. 2021-03-25T14:15:09.440 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:15:09.440 INFO:teuthology.orchestra.run.smithi110.stdout:Upgraded: 2021-03-25T14:15:09.440 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-1:1.26.0-13.el8_3.x86_64 2021-03-25T14:15:09.440 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-libnm-1:1.26.0-13.el8_3.x86_64 2021-03-25T14:15:09.440 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-team-1:1.26.0-13.el8_3.x86_64 2021-03-25T14:15:09.441 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-tui-1:1.26.0-13.el8_3.x86_64 2021-03-25T14:15:09.441 INFO:teuthology.orchestra.run.smithi110.stdout: librados2-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:09.441 INFO:teuthology.orchestra.run.smithi110.stdout: librbd1-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:09.441 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-1:1.1.1g-12.el8_3.x86_64 2021-03-25T14:15:09.441 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-libs-1:1.1.1g-12.el8_3.x86_64 2021-03-25T14:15:09.441 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:15:09.441 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2021-03-25T14:15:09.441 INFO:teuthology.orchestra.run.smithi110.stdout: automake-1.16.1-6.el8.noarch 2021-03-25T14:15:09.441 INFO:teuthology.orchestra.run.smithi110.stdout: bison-3.0.4-10.el8.x86_64 2021-03-25T14:15:09.441 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:09.441 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:09.441 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-common-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:09.442 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-fuse-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:09.442 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-grafana-dashboards-2:17.0.0-1676.gdf88ec38.el8.noarch 2021-03-25T14:15:09.442 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-immutable-object-cache-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:09.442 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mds-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:09.442 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:09.442 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-cephadm-2:17.0.0-1676.gdf88ec38.el8.noarch 2021-03-25T14:15:09.442 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-dashboard-2:17.0.0-1676.gdf88ec38.el8.noarch 2021-03-25T14:15:09.442 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-diskprediction-local-2:17.0.0-1676.gdf88ec38.el8.noarch 2021-03-25T14:15:09.442 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-modules-core-2:17.0.0-1676.gdf88ec38.el8.noarch 2021-03-25T14:15:09.442 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-rook-2:17.0.0-1676.gdf88ec38.el8.noarch 2021-03-25T14:15:09.443 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mon-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:09.443 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-osd-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:09.443 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-prometheus-alerts-2:17.0.0-1676.gdf88ec38.el8.noarch 2021-03-25T14:15:09.443 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-radosgw-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:09.443 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-selinux-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:09.443 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-test-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:09.443 INFO:teuthology.orchestra.run.smithi110.stdout: cephadm-2:17.0.0-1676.gdf88ec38.el8.noarch 2021-03-25T14:15:09.443 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-mirror-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:09.443 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-top-2:17.0.0-1676.gdf88ec38.el8.noarch 2021-03-25T14:15:09.443 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-libelf-devel-0.180-1.el8.x86_64 2021-03-25T14:15:09.443 INFO:teuthology.orchestra.run.smithi110.stdout: flex-2.6.1-9.el8.x86_64 2021-03-25T14:15:09.443 INFO:teuthology.orchestra.run.smithi110.stdout: fmt-6.2.1-1.el8.x86_64 2021-03-25T14:15:09.443 INFO:teuthology.orchestra.run.smithi110.stdout: fuse-2.9.7-12.el8.x86_64 2021-03-25T14:15:09.444 INFO:teuthology.orchestra.run.smithi110.stdout: fuse-common-3.2.1-12.el8.x86_64 2021-03-25T14:15:09.444 INFO:teuthology.orchestra.run.smithi110.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2021-03-25T14:15:09.444 INFO:teuthology.orchestra.run.smithi110.stdout: jq-1.5-12.el8.x86_64 2021-03-25T14:15:09.444 INFO:teuthology.orchestra.run.smithi110.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2021-03-25T14:15:09.444 INFO:teuthology.orchestra.run.smithi110.stdout: krb5-devel-1.18.2-5.el8.x86_64 2021-03-25T14:15:09.444 INFO:teuthology.orchestra.run.smithi110.stdout: leveldb-1.22-1.el8.x86_64 2021-03-25T14:15:09.444 INFO:teuthology.orchestra.run.smithi110.stdout: libaio-devel-0.3.112-1.el8.x86_64 2021-03-25T14:15:09.444 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs-devel-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:09.444 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs2-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:09.444 INFO:teuthology.orchestra.run.smithi110.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2021-03-25T14:15:09.444 INFO:teuthology.orchestra.run.smithi110.stdout: libgfortran-8.3.1-5.1.el8.x86_64 2021-03-25T14:15:09.444 INFO:teuthology.orchestra.run.smithi110.stdout: liboath-2.6.2-3.el8.x86_64 2021-03-25T14:15:09.445 INFO:teuthology.orchestra.run.smithi110.stdout: libquadmath-8.3.1-5.1.el8.x86_64 2021-03-25T14:15:09.445 INFO:teuthology.orchestra.run.smithi110.stdout: librabbitmq-0.9.0-2.el8.x86_64 2021-03-25T14:15:09.445 INFO:teuthology.orchestra.run.smithi110.stdout: librados-devel-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:09.445 INFO:teuthology.orchestra.run.smithi110.stdout: libradosstriper1-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:09.445 INFO:teuthology.orchestra.run.smithi110.stdout: librdkafka-0.11.4-1.el8.x86_64 2021-03-25T14:15:09.445 INFO:teuthology.orchestra.run.smithi110.stdout: librgw2-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:09.445 INFO:teuthology.orchestra.run.smithi110.stdout: libselinux-devel-2.9-3.el8.x86_64 2021-03-25T14:15:09.445 INFO:teuthology.orchestra.run.smithi110.stdout: libsepol-devel-2.9-1.el8.x86_64 2021-03-25T14:15:09.445 INFO:teuthology.orchestra.run.smithi110.stdout: libtool-2.4.6-25.el8.x86_64 2021-03-25T14:15:09.445 INFO:teuthology.orchestra.run.smithi110.stdout: libunwind-1.3.1-3.el8.x86_64 2021-03-25T14:15:09.445 INFO:teuthology.orchestra.run.smithi110.stdout: libuuid-devel-2.32.1-24.el8.x86_64 2021-03-25T14:15:09.445 INFO:teuthology.orchestra.run.smithi110.stdout: libverto-devel-0.3.0-5.el8.x86_64 2021-03-25T14:15:09.446 INFO:teuthology.orchestra.run.smithi110.stdout: libxslt-1.1.32-5.el8.x86_64 2021-03-25T14:15:09.446 INFO:teuthology.orchestra.run.smithi110.stdout: lttng-ust-2.8.1-11.el8.x86_64 2021-03-25T14:15:09.446 INFO:teuthology.orchestra.run.smithi110.stdout: oniguruma-6.8.2-2.el8.x86_64 2021-03-25T14:15:09.446 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-0.3.3-5.el8.x86_64 2021-03-25T14:15:09.446 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-threads-0.3.3-5.el8.x86_64 2021-03-25T14:15:09.446 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-devel-1:1.1.1g-12.el8_3.x86_64 2021-03-25T14:15:09.446 INFO:teuthology.orchestra.run.smithi110.stdout: pcre2-devel-10.32-2.el8.x86_64 2021-03-25T14:15:09.446 INFO:teuthology.orchestra.run.smithi110.stdout: pcre2-utf16-10.32-2.el8.x86_64 2021-03-25T14:15:09.446 INFO:teuthology.orchestra.run.smithi110.stdout: pcre2-utf32-10.32-2.el8.x86_64 2021-03-25T14:15:09.446 INFO:teuthology.orchestra.run.smithi110.stdout: python3-apipkg-1.5-6.el8.noarch 2021-03-25T14:15:09.446 INFO:teuthology.orchestra.run.smithi110.stdout: python3-asn1crypto-0.24.0-3.el8.noarch 2021-03-25T14:15:09.447 INFO:teuthology.orchestra.run.smithi110.stdout: python3-babel-2.5.1-5.el8.noarch 2021-03-25T14:15:09.447 INFO:teuthology.orchestra.run.smithi110.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2021-03-25T14:15:09.447 INFO:teuthology.orchestra.run.smithi110.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2021-03-25T14:15:09.447 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cachetools-3.1.1-4.el8.noarch 2021-03-25T14:15:09.447 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-argparse-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:09.447 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-common-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:09.447 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cephfs-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:09.447 INFO:teuthology.orchestra.run.smithi110.stdout: python3-certifi-2018.10.15-7.el8.noarch 2021-03-25T14:15:09.447 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cffi-1.11.5-5.el8.x86_64 2021-03-25T14:15:09.447 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cheroot-8.5.2-1.el8.noarch 2021-03-25T14:15:09.447 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2021-03-25T14:15:09.447 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cryptography-2.3-3.el8.x86_64 2021-03-25T14:15:09.447 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cssselect-0.9.2-10.el8.noarch 2021-03-25T14:15:09.448 INFO:teuthology.orchestra.run.smithi110.stdout: python3-execnet-1.7.1-1.el8.noarch 2021-03-25T14:15:09.448 INFO:teuthology.orchestra.run.smithi110.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2021-03-25T14:15:09.448 INFO:teuthology.orchestra.run.smithi110.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2021-03-25T14:15:09.448 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-6.2-6.el8.noarch 2021-03-25T14:15:09.448 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2021-03-25T14:15:09.448 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2021-03-25T14:15:09.448 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpatch-1.21-2.el8.noarch 2021-03-25T14:15:09.448 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpointer-1.10-11.el8.noarch 2021-03-25T14:15:09.448 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jwt-1.6.1-2.el8.noarch 2021-03-25T14:15:09.448 INFO:teuthology.orchestra.run.smithi110.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2021-03-25T14:15:09.448 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils-0.3.5-11.el8.noarch 2021-03-25T14:15:09.448 INFO:teuthology.orchestra.run.smithi110.stdout: python3-lxml-4.2.3-1.el8.x86_64 2021-03-25T14:15:09.449 INFO:teuthology.orchestra.run.smithi110.stdout: python3-mako-1.0.6-13.el8.noarch 2021-03-25T14:15:09.449 INFO:teuthology.orchestra.run.smithi110.stdout: python3-markupsafe-0.23-19.el8.x86_64 2021-03-25T14:15:09.449 INFO:teuthology.orchestra.run.smithi110.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2021-03-25T14:15:09.449 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2021-03-25T14:15:09.449 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2021-03-25T14:15:09.449 INFO:teuthology.orchestra.run.smithi110.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2021-03-25T14:15:09.449 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan-1.3.2-9.el8.noarch 2021-03-25T14:15:09.449 INFO:teuthology.orchestra.run.smithi110.stdout: python3-portend-2.6-1.el8.noarch 2021-03-25T14:15:09.449 INFO:teuthology.orchestra.run.smithi110.stdout: python3-prettytable-0.7.2-14.el8.noarch 2021-03-25T14:15:09.449 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyOpenSSL-18.0.0-1.el8.noarch 2021-03-25T14:15:09.449 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2021-03-25T14:15:09.449 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2021-03-25T14:15:09.450 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pycparser-2.14-14.el8.noarch 2021-03-25T14:15:09.450 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pytz-2017.2-9.el8.noarch 2021-03-25T14:15:09.450 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rados-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:09.450 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rbd-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:09.450 INFO:teuthology.orchestra.run.smithi110.stdout: python3-remoto-1.1.4-4.el8.noarch 2021-03-25T14:15:09.450 INFO:teuthology.orchestra.run.smithi110.stdout: python3-repoze-lru-0.7-6.el8.noarch 2021-03-25T14:15:09.450 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2021-03-25T14:15:09.450 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rgw-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:09.450 INFO:teuthology.orchestra.run.smithi110.stdout: python3-routes-2.4.1-12.el8.noarch 2021-03-25T14:15:09.450 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rsa-3.4.2-16.el8.noarch 2021-03-25T14:15:09.450 INFO:teuthology.orchestra.run.smithi110.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2021-03-25T14:15:09.451 INFO:teuthology.orchestra.run.smithi110.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2021-03-25T14:15:09.451 INFO:teuthology.orchestra.run.smithi110.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2021-03-25T14:15:09.451 INFO:teuthology.orchestra.run.smithi110.stdout: python3-tempora-1.14.1-5.el8.noarch 2021-03-25T14:15:09.451 INFO:teuthology.orchestra.run.smithi110.stdout: python3-trustme-0.6.0-4.el8.noarch 2021-03-25T14:15:09.451 INFO:teuthology.orchestra.run.smithi110.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2021-03-25T14:15:09.451 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webencodings-0.5.1-6.el8.noarch 2021-03-25T14:15:09.451 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webob-1.8.5-1.el8.1.noarch 2021-03-25T14:15:09.451 INFO:teuthology.orchestra.run.smithi110.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2021-03-25T14:15:09.451 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webtest-2.0.33-1.el8.noarch 2021-03-25T14:15:09.451 INFO:teuthology.orchestra.run.smithi110.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2021-03-25T14:15:09.451 INFO:teuthology.orchestra.run.smithi110.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2021-03-25T14:15:09.452 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-fuse-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:09.452 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-mirror-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:09.452 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-nbd-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:09.452 INFO:teuthology.orchestra.run.smithi110.stdout: socat-1.7.3.3-2.el8.x86_64 2021-03-25T14:15:09.452 INFO:teuthology.orchestra.run.smithi110.stdout: xfsprogs-devel-5.0.0-4.el8.x86_64 2021-03-25T14:15:09.452 INFO:teuthology.orchestra.run.smithi110.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2021-03-25T14:15:09.452 INFO:teuthology.orchestra.run.smithi110.stdout: zlib-devel-1.2.11-16.el8_2.x86_64 2021-03-25T14:15:09.452 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:15:09.453 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2021-03-25T14:15:09.699 DEBUG:teuthology.parallel:result is None 2021-03-25T14:15:10.136 INFO:teuthology.orchestra.run.smithi174.stdout: 2021-03-25T14:15:10.136 INFO:teuthology.orchestra.run.smithi174.stdout:Upgraded: 2021-03-25T14:15:10.137 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-1:1.26.0-13.el8_3.x86_64 2021-03-25T14:15:10.137 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-libnm-1:1.26.0-13.el8_3.x86_64 2021-03-25T14:15:10.137 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-team-1:1.26.0-13.el8_3.x86_64 2021-03-25T14:15:10.137 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-tui-1:1.26.0-13.el8_3.x86_64 2021-03-25T14:15:10.137 INFO:teuthology.orchestra.run.smithi174.stdout: librados2-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:10.137 INFO:teuthology.orchestra.run.smithi174.stdout: librbd1-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:10.137 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-1:1.1.1g-12.el8_3.x86_64 2021-03-25T14:15:10.137 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-libs-1:1.1.1g-12.el8_3.x86_64 2021-03-25T14:15:10.137 INFO:teuthology.orchestra.run.smithi174.stdout: 2021-03-25T14:15:10.137 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2021-03-25T14:15:10.137 INFO:teuthology.orchestra.run.smithi174.stdout: automake-1.16.1-6.el8.noarch 2021-03-25T14:15:10.137 INFO:teuthology.orchestra.run.smithi174.stdout: bison-3.0.4-10.el8.x86_64 2021-03-25T14:15:10.138 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:10.138 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-base-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:10.138 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-common-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:10.138 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-fuse-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:10.138 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-grafana-dashboards-2:17.0.0-1676.gdf88ec38.el8.noarch 2021-03-25T14:15:10.138 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-immutable-object-cache-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:10.138 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mds-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:10.138 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:10.138 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-cephadm-2:17.0.0-1676.gdf88ec38.el8.noarch 2021-03-25T14:15:10.138 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-dashboard-2:17.0.0-1676.gdf88ec38.el8.noarch 2021-03-25T14:15:10.138 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-diskprediction-local-2:17.0.0-1676.gdf88ec38.el8.noarch 2021-03-25T14:15:10.139 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-modules-core-2:17.0.0-1676.gdf88ec38.el8.noarch 2021-03-25T14:15:10.139 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-rook-2:17.0.0-1676.gdf88ec38.el8.noarch 2021-03-25T14:15:10.139 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mon-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:10.139 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-osd-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:10.139 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-prometheus-alerts-2:17.0.0-1676.gdf88ec38.el8.noarch 2021-03-25T14:15:10.139 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-radosgw-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:10.139 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-selinux-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:10.139 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-test-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:10.139 INFO:teuthology.orchestra.run.smithi174.stdout: cephadm-2:17.0.0-1676.gdf88ec38.el8.noarch 2021-03-25T14:15:10.139 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-mirror-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:10.139 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-top-2:17.0.0-1676.gdf88ec38.el8.noarch 2021-03-25T14:15:10.139 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libelf-devel-0.180-1.el8.x86_64 2021-03-25T14:15:10.139 INFO:teuthology.orchestra.run.smithi174.stdout: flex-2.6.1-9.el8.x86_64 2021-03-25T14:15:10.140 INFO:teuthology.orchestra.run.smithi174.stdout: fmt-6.2.1-1.el8.x86_64 2021-03-25T14:15:10.140 INFO:teuthology.orchestra.run.smithi174.stdout: fuse-2.9.7-12.el8.x86_64 2021-03-25T14:15:10.140 INFO:teuthology.orchestra.run.smithi174.stdout: fuse-common-3.2.1-12.el8.x86_64 2021-03-25T14:15:10.140 INFO:teuthology.orchestra.run.smithi174.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2021-03-25T14:15:10.140 INFO:teuthology.orchestra.run.smithi174.stdout: jq-1.5-12.el8.x86_64 2021-03-25T14:15:10.140 INFO:teuthology.orchestra.run.smithi174.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2021-03-25T14:15:10.140 INFO:teuthology.orchestra.run.smithi174.stdout: krb5-devel-1.18.2-5.el8.x86_64 2021-03-25T14:15:10.140 INFO:teuthology.orchestra.run.smithi174.stdout: leveldb-1.22-1.el8.x86_64 2021-03-25T14:15:10.140 INFO:teuthology.orchestra.run.smithi174.stdout: libaio-devel-0.3.112-1.el8.x86_64 2021-03-25T14:15:10.140 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs-devel-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:10.140 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs2-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:10.140 INFO:teuthology.orchestra.run.smithi174.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2021-03-25T14:15:10.140 INFO:teuthology.orchestra.run.smithi174.stdout: libgfortran-8.3.1-5.1.el8.x86_64 2021-03-25T14:15:10.141 INFO:teuthology.orchestra.run.smithi174.stdout: liboath-2.6.2-3.el8.x86_64 2021-03-25T14:15:10.141 INFO:teuthology.orchestra.run.smithi174.stdout: libquadmath-8.3.1-5.1.el8.x86_64 2021-03-25T14:15:10.141 INFO:teuthology.orchestra.run.smithi174.stdout: librabbitmq-0.9.0-2.el8.x86_64 2021-03-25T14:15:10.141 INFO:teuthology.orchestra.run.smithi174.stdout: librados-devel-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:10.141 INFO:teuthology.orchestra.run.smithi174.stdout: libradosstriper1-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:10.141 INFO:teuthology.orchestra.run.smithi174.stdout: librdkafka-0.11.4-1.el8.x86_64 2021-03-25T14:15:10.141 INFO:teuthology.orchestra.run.smithi174.stdout: librgw2-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:10.141 INFO:teuthology.orchestra.run.smithi174.stdout: libselinux-devel-2.9-3.el8.x86_64 2021-03-25T14:15:10.141 INFO:teuthology.orchestra.run.smithi174.stdout: libsepol-devel-2.9-1.el8.x86_64 2021-03-25T14:15:10.141 INFO:teuthology.orchestra.run.smithi174.stdout: libtool-2.4.6-25.el8.x86_64 2021-03-25T14:15:10.141 INFO:teuthology.orchestra.run.smithi174.stdout: libunwind-1.3.1-3.el8.x86_64 2021-03-25T14:15:10.141 INFO:teuthology.orchestra.run.smithi174.stdout: libuuid-devel-2.32.1-24.el8.x86_64 2021-03-25T14:15:10.141 INFO:teuthology.orchestra.run.smithi174.stdout: libverto-devel-0.3.0-5.el8.x86_64 2021-03-25T14:15:10.142 INFO:teuthology.orchestra.run.smithi174.stdout: libxslt-1.1.32-5.el8.x86_64 2021-03-25T14:15:10.142 INFO:teuthology.orchestra.run.smithi174.stdout: lttng-ust-2.8.1-11.el8.x86_64 2021-03-25T14:15:10.142 INFO:teuthology.orchestra.run.smithi174.stdout: oniguruma-6.8.2-2.el8.x86_64 2021-03-25T14:15:10.142 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-0.3.3-5.el8.x86_64 2021-03-25T14:15:10.142 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-threads-0.3.3-5.el8.x86_64 2021-03-25T14:15:10.142 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-devel-1:1.1.1g-12.el8_3.x86_64 2021-03-25T14:15:10.142 INFO:teuthology.orchestra.run.smithi174.stdout: pcre2-devel-10.32-2.el8.x86_64 2021-03-25T14:15:10.142 INFO:teuthology.orchestra.run.smithi174.stdout: pcre2-utf16-10.32-2.el8.x86_64 2021-03-25T14:15:10.142 INFO:teuthology.orchestra.run.smithi174.stdout: pcre2-utf32-10.32-2.el8.x86_64 2021-03-25T14:15:10.142 INFO:teuthology.orchestra.run.smithi174.stdout: python3-apipkg-1.5-6.el8.noarch 2021-03-25T14:15:10.142 INFO:teuthology.orchestra.run.smithi174.stdout: python3-asn1crypto-0.24.0-3.el8.noarch 2021-03-25T14:15:10.142 INFO:teuthology.orchestra.run.smithi174.stdout: python3-babel-2.5.1-5.el8.noarch 2021-03-25T14:15:10.143 INFO:teuthology.orchestra.run.smithi174.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2021-03-25T14:15:10.143 INFO:teuthology.orchestra.run.smithi174.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2021-03-25T14:15:10.143 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cachetools-3.1.1-4.el8.noarch 2021-03-25T14:15:10.143 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-argparse-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:10.143 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-common-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:10.143 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cephfs-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:10.143 INFO:teuthology.orchestra.run.smithi174.stdout: python3-certifi-2018.10.15-7.el8.noarch 2021-03-25T14:15:10.143 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cffi-1.11.5-5.el8.x86_64 2021-03-25T14:15:10.143 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cheroot-8.5.2-1.el8.noarch 2021-03-25T14:15:10.143 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2021-03-25T14:15:10.143 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cryptography-2.3-3.el8.x86_64 2021-03-25T14:15:10.143 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cssselect-0.9.2-10.el8.noarch 2021-03-25T14:15:10.143 INFO:teuthology.orchestra.run.smithi174.stdout: python3-execnet-1.7.1-1.el8.noarch 2021-03-25T14:15:10.144 INFO:teuthology.orchestra.run.smithi174.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2021-03-25T14:15:10.144 INFO:teuthology.orchestra.run.smithi174.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2021-03-25T14:15:10.144 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-6.2-6.el8.noarch 2021-03-25T14:15:10.144 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2021-03-25T14:15:10.144 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2021-03-25T14:15:10.144 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpatch-1.21-2.el8.noarch 2021-03-25T14:15:10.144 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpointer-1.10-11.el8.noarch 2021-03-25T14:15:10.144 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jwt-1.6.1-2.el8.noarch 2021-03-25T14:15:10.144 INFO:teuthology.orchestra.run.smithi174.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2021-03-25T14:15:10.144 INFO:teuthology.orchestra.run.smithi174.stdout: python3-logutils-0.3.5-11.el8.noarch 2021-03-25T14:15:10.144 INFO:teuthology.orchestra.run.smithi174.stdout: python3-lxml-4.2.3-1.el8.x86_64 2021-03-25T14:15:10.144 INFO:teuthology.orchestra.run.smithi174.stdout: python3-mako-1.0.6-13.el8.noarch 2021-03-25T14:15:10.145 INFO:teuthology.orchestra.run.smithi174.stdout: python3-markupsafe-0.23-19.el8.x86_64 2021-03-25T14:15:10.145 INFO:teuthology.orchestra.run.smithi174.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2021-03-25T14:15:10.145 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2021-03-25T14:15:10.145 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2021-03-25T14:15:10.145 INFO:teuthology.orchestra.run.smithi174.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2021-03-25T14:15:10.145 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pecan-1.3.2-9.el8.noarch 2021-03-25T14:15:10.145 INFO:teuthology.orchestra.run.smithi174.stdout: python3-portend-2.6-1.el8.noarch 2021-03-25T14:15:10.145 INFO:teuthology.orchestra.run.smithi174.stdout: python3-prettytable-0.7.2-14.el8.noarch 2021-03-25T14:15:10.145 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyOpenSSL-18.0.0-1.el8.noarch 2021-03-25T14:15:10.145 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2021-03-25T14:15:10.145 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2021-03-25T14:15:10.145 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pycparser-2.14-14.el8.noarch 2021-03-25T14:15:10.145 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pytz-2017.2-9.el8.noarch 2021-03-25T14:15:10.146 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rados-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:10.146 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rbd-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:10.146 INFO:teuthology.orchestra.run.smithi174.stdout: python3-remoto-1.1.4-4.el8.noarch 2021-03-25T14:15:10.146 INFO:teuthology.orchestra.run.smithi174.stdout: python3-repoze-lru-0.7-6.el8.noarch 2021-03-25T14:15:10.146 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2021-03-25T14:15:10.146 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rgw-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:10.146 INFO:teuthology.orchestra.run.smithi174.stdout: python3-routes-2.4.1-12.el8.noarch 2021-03-25T14:15:10.146 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rsa-3.4.2-16.el8.noarch 2021-03-25T14:15:10.146 INFO:teuthology.orchestra.run.smithi174.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2021-03-25T14:15:10.146 INFO:teuthology.orchestra.run.smithi174.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2021-03-25T14:15:10.146 INFO:teuthology.orchestra.run.smithi174.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2021-03-25T14:15:10.146 INFO:teuthology.orchestra.run.smithi174.stdout: python3-tempora-1.14.1-5.el8.noarch 2021-03-25T14:15:10.147 INFO:teuthology.orchestra.run.smithi174.stdout: python3-trustme-0.6.0-4.el8.noarch 2021-03-25T14:15:10.147 INFO:teuthology.orchestra.run.smithi174.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2021-03-25T14:15:10.147 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webencodings-0.5.1-6.el8.noarch 2021-03-25T14:15:10.147 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webob-1.8.5-1.el8.1.noarch 2021-03-25T14:15:10.147 INFO:teuthology.orchestra.run.smithi174.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2021-03-25T14:15:10.147 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webtest-2.0.33-1.el8.noarch 2021-03-25T14:15:10.147 INFO:teuthology.orchestra.run.smithi174.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2021-03-25T14:15:10.147 INFO:teuthology.orchestra.run.smithi174.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2021-03-25T14:15:10.147 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-fuse-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:10.147 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-mirror-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:10.147 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-nbd-2:17.0.0-1676.gdf88ec38.el8.x86_64 2021-03-25T14:15:10.147 INFO:teuthology.orchestra.run.smithi174.stdout: socat-1.7.3.3-2.el8.x86_64 2021-03-25T14:15:10.147 INFO:teuthology.orchestra.run.smithi174.stdout: xfsprogs-devel-5.0.0-4.el8.x86_64 2021-03-25T14:15:10.147 INFO:teuthology.orchestra.run.smithi174.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2021-03-25T14:15:10.148 INFO:teuthology.orchestra.run.smithi174.stdout: zlib-devel-1.2.11-16.el8_2.x86_64 2021-03-25T14:15:10.148 INFO:teuthology.orchestra.run.smithi174.stdout: 2021-03-25T14:15:10.148 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2021-03-25T14:15:10.246 DEBUG:teuthology.parallel:result is None 2021-03-25T14:15:10.247 DEBUG:teuthology.orchestra.run.smithi110:> sudo lsb_release -is 2021-03-25T14:15:10.298 INFO:teuthology.orchestra.run.smithi110.stdout:RedHatEnterprise 2021-03-25T14:15:10.300 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2021-03-25T14:15:10.300 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=df88ec382221e0c1a0a6e66961f3fc1519f95986 2021-03-25T14:15:10.442 DEBUG:teuthology.orchestra.run.smithi110:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2021-03-25T14:15:10.462 INFO:teuthology.orchestra.run.smithi110.stdout:17.0.0-1676.gdf88ec38.el8 2021-03-25T14:15:10.462 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-1676.gdf88ec38.el8 2021-03-25T14:15:10.462 INFO:teuthology.task.install:The correct ceph version 17.0.0-1676.gdf88ec38 is installed. 2021-03-25T14:15:10.463 DEBUG:teuthology.orchestra.run.smithi174:> sudo lsb_release -is 2021-03-25T14:15:10.513 INFO:teuthology.orchestra.run.smithi174.stdout:RedHatEnterprise 2021-03-25T14:15:10.514 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2021-03-25T14:15:10.514 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=df88ec382221e0c1a0a6e66961f3fc1519f95986 2021-03-25T14:15:10.649 DEBUG:teuthology.orchestra.run.smithi174:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2021-03-25T14:15:10.668 INFO:teuthology.orchestra.run.smithi174.stdout:17.0.0-1676.gdf88ec38.el8 2021-03-25T14:15:10.668 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-1676.gdf88ec38.el8 2021-03-25T14:15:10.668 INFO:teuthology.task.install:The correct ceph version 17.0.0-1676.gdf88ec38 is installed. 2021-03-25T14:15:10.668 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2021-03-25T14:15:10.671 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2021-03-25T14:15:10.671 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-03-25T14:15:10.695 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2021-03-25T14:15:10.695 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-03-25T14:15:10.732 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2021-03-25T14:15:10.732 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2021-03-25T14:15:10.732 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/daemon-helper 2021-03-25T14:15:10.759 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-03-25T14:15:10.822 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2021-03-25T14:15:10.823 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/daemon-helper 2021-03-25T14:15:10.846 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-03-25T14:15:10.909 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2021-03-25T14:15:10.909 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2021-03-25T14:15:10.909 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/adjust-ulimits 2021-03-25T14:15:10.933 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-03-25T14:15:10.997 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2021-03-25T14:15:10.997 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/adjust-ulimits 2021-03-25T14:15:11.021 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-03-25T14:15:11.084 INFO:teuthology.run_tasks:Running task ceph... 2021-03-25T14:15:11.162 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2021-03-25T14:15:11.162 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 777 /var/log/ceph 2021-03-25T14:15:11.164 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 777 /var/log/ceph 2021-03-25T14:15:11.188 INFO:tasks.ceph:Disabling ceph logrotate... 2021-03-25T14:15:11.188 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/logrotate.d/ceph 2021-03-25T14:15:11.228 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /etc/logrotate.d/ceph 2021-03-25T14:15:11.251 INFO:tasks.ceph:Creating extra log directories... 2021-03-25T14:15:11.252 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-03-25T14:15:11.291 DEBUG:teuthology.orchestra.run.smithi174:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-03-25T14:15:11.344 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2021-03-25T14:15:11.345 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2021-03-25T14:15:11.346 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2021-03-25T14:15:11.346 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2021-03-25T14:15:11.346 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-03-25T14:15:11.366 DEBUG:teuthology.orchestra.run.smithi110:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-03-25T14:15:11.468 DEBUG:teuthology.orchestra.run.smithi110:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2021-03-25T14:15:11.491 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2021-03-25T14:15:11.492 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-03-25T14:15:11.505 DEBUG:teuthology.orchestra.run.smithi174:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-03-25T14:15:11.608 DEBUG:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2021-03-25T14:15:11.637 INFO:tasks.ceph:Creating ceph cluster ceph... 2021-03-25T14:15:11.637 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2021-03-25T14:15:11.638 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2021-03-25_13:58:08-fs-wip-rishabh-vr-set-shell-to-True-distro-basic-smithi/5997902', 'branch': 'wip-rishabh-vr-set-shell-to-True', 'description': 'fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/multifs-auth}', 'email': None, 'first_in_suite': False, 'job_id': '5997902', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2021-03-25_13:58:08-fs-wip-rishabh-vr-set-shell-to-True-distro-basic-smithi', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.3', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-vr-set-shell-to-True'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'log-ignorelist': ['overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'df88ec382221e0c1a0a6e66961f3fc1519f95986'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'sha1': 'df88ec382221e0c1a0a6e66961f3fc1519f95986'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-vr-set-shell-to-True', 'sha1': 'df88ec382221e0c1a0a6e66961f3fc1519f95986'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'git://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'sha1': 'df88ec382221e0c1a0a6e66961f3fc1519f95986', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-rishabh-vr-set-shell-to-True', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_df88ec382221e0c1a0a6e66961f3fc1519f95986/qa', 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'suite_sha1': 'df88ec382221e0c1a0a6e66961f3fc1519f95986', 'targets': {'smithi110.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzFaydq/c422IztJ4TvwTcRzfx2i4qqAqqC27Hs+RHBBAYr/K4S6sVNz/ZwRjVapGr6MZbYAgQof/vGLf4rY7ose+VxAedX9VHPt4a3bVtr5H+FzVOCdf6s8fwli7u42p17QANRGWqNQQ2EvuGkBAGpB4G7h0M/hE4RZ3MVRP9puD8J34/LG3tTOiY3WT3Odg7fT/cEPrtE+Hmh8rihMopKpGqWPDiKzp3/omDKm8TP/WEqH/N6BorPJiJLtmtfvrTB6DqKU5jmQNBrdI0ExaR2JD41iYccNqzZFNiYt4GpU0n+Bz2ob6u38yvndXR2rXpJONFLRDOPCMz0mdTFIV7eWXDSsEoqRZ8dsMP3Fu/uakDR6hCnmhaenSO+QGrse1WkGY+HPjXRB1cd6Pdr/RVbKo1jOVMdl4mT2xKH9xBR3SrVuq7PFloiR9fyTvUjkyLn+reauX7sq4AgXQ4wu9jLmqHG6XZVCYcdHGFTDX2uE2/LYxFlYJ79t/IPqFjzO8=', 'smithi174.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt2YaNg/iFysFF8AlKxk/KeiB6CQlcMuAMNtyKZb5kudCty0eIFWE+v474y5sdXNge8DyqxtrkgrW3n5cAC+/+243UthkI/gka4Q17bhrws/UdcpFxLO1LjHBW1O5/+dTRy6+uOxGIHCCEtm+uZ1Qxxu+VN5Zw7TNId+7mZteTGqHSqunl+cOxiXfHDIbT5x7uu3AICPU3mg/ahqCFafay660G4YSIaDqvgc/gTUyFOTvos+7jFYDV7bZa2U8NQeSeDxWIDPebyGaOXZbx3GSh9kTR3bEVn7JT5Z4ftYonJiSbvWu4RSuK81z2k5IUCecLZ3cYM6fAMlXoeuiITta6yIRti3YKl52mukCkcJG8qsR7mcFWxShmuza/YCWPIlfhJ15G8QZhkISFcAvMTCxAIEQgPHvLMtFHxWLgFdJ3SYnN2TeQ/29a8z5q3dk5Dnl9rQOO76gwhIY57uCkd6uKoxdkuuo2KcA/DW6tZK983qGWOMLI2oz3Feguxq/3As8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': 'df88ec382221e0c1a0a6e66961f3fc1519f95986'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_multifs_auth']}}], 'teuthology_branch': 'master', 'tube': 'smithi', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.12370'} 2021-03-25T14:15:11.638 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-03-25T14:15:11.640 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-03-25T14:15:11.686 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m0777 -- /var/run/ceph 2021-03-25T14:15:11.695 DEBUG:teuthology.orchestra.run.smithi174:> sudo install -d -m0777 -- /var/run/ceph 2021-03-25T14:15:11.749 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2021-03-25T14:15:11.749 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/scratch_devs of=/dev/stdout 2021-03-25T14:15:11.770 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-03-25T14:15:11.771 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-03-25T14:15:11.824 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-03-25T14:15:11.824 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-25T14:15:11.824 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 6h/6d Inode: 109246 Links: 1 2021-03-25T14:15:11.824 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-25T14:15:11.825 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2021-03-25T14:15:11.825 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2021-03-25 14:15:05.164356928 +0000 2021-03-25T14:15:11.825 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2021-03-25 14:12:41.030121284 +0000 2021-03-25T14:15:11.825 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2021-03-25 14:12:41.030121284 +0000 2021-03-25T14:15:11.825 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: - 2021-03-25T14:15:11.833 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2021-03-25T14:15:11.833 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2021-03-25T14:15:11.833 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 7.7924e-05 s, 6.6 MB/s 2021-03-25T14:15:11.836 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-03-25T14:15:11.891 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-03-25T14:15:11.891 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-25T14:15:11.891 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 6h/6d Inode: 107938 Links: 1 2021-03-25T14:15:11.891 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-25T14:15:11.891 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2021-03-25T14:15:11.891 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2021-03-25 14:15:05.164356928 +0000 2021-03-25T14:15:11.891 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2021-03-25 14:12:41.363115520 +0000 2021-03-25T14:15:11.891 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2021-03-25 14:12:41.363115520 +0000 2021-03-25T14:15:11.891 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: - 2021-03-25T14:15:11.900 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2021-03-25T14:15:11.900 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2021-03-25T14:15:11.900 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000101478 s, 5.0 MB/s 2021-03-25T14:15:11.903 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-03-25T14:15:11.956 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-03-25T14:15:11.956 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-25T14:15:11.956 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 6h/6d Inode: 107334 Links: 1 2021-03-25T14:15:11.956 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-25T14:15:11.956 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2021-03-25T14:15:11.957 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2021-03-25 14:15:05.164356928 +0000 2021-03-25T14:15:11.957 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2021-03-25 14:12:41.670110206 +0000 2021-03-25T14:15:11.957 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2021-03-25 14:12:41.670110206 +0000 2021-03-25T14:15:11.957 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: - 2021-03-25T14:15:11.965 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2021-03-25T14:15:11.965 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2021-03-25T14:15:11.966 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 7.9871e-05 s, 6.4 MB/s 2021-03-25T14:15:11.968 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-03-25T14:15:12.022 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-03-25T14:15:12.023 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-25T14:15:12.023 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 6h/6d Inode: 109343 Links: 1 2021-03-25T14:15:12.023 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-25T14:15:12.023 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2021-03-25T14:15:12.023 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2021-03-25 14:15:05.164356928 +0000 2021-03-25T14:15:12.023 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2021-03-25 14:12:41.973104961 +0000 2021-03-25T14:15:12.023 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2021-03-25 14:12:41.973104961 +0000 2021-03-25T14:15:12.023 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: - 2021-03-25T14:15:12.032 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2021-03-25T14:15:12.032 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2021-03-25T14:15:12.032 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000101061 s, 5.1 MB/s 2021-03-25T14:15:12.034 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-03-25T14:15:12.035 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2021-03-25T14:15:12.035 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/scratch_devs of=/dev/stdout 2021-03-25T14:15:12.050 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-03-25T14:15:12.050 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-03-25T14:15:12.105 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-03-25T14:15:12.105 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-25T14:15:12.105 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 6h/6d Inode: 107189 Links: 1 2021-03-25T14:15:12.105 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-25T14:15:12.105 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2021-03-25T14:15:12.105 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2021-03-25 14:15:05.590548073 +0000 2021-03-25T14:15:12.105 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2021-03-25 14:12:43.076267225 +0000 2021-03-25T14:15:12.105 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2021-03-25 14:12:43.076267225 +0000 2021-03-25T14:15:12.105 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: - 2021-03-25T14:15:12.114 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2021-03-25T14:15:12.114 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2021-03-25T14:15:12.115 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000233777 s, 2.2 MB/s 2021-03-25T14:15:12.117 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-03-25T14:15:12.171 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-03-25T14:15:12.171 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-25T14:15:12.171 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 6h/6d Inode: 108991 Links: 1 2021-03-25T14:15:12.171 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-25T14:15:12.171 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2021-03-25T14:15:12.171 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2021-03-25 14:15:05.590548073 +0000 2021-03-25T14:15:12.172 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2021-03-25 14:12:43.397263132 +0000 2021-03-25T14:15:12.172 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2021-03-25 14:12:43.397263132 +0000 2021-03-25T14:15:12.172 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: - 2021-03-25T14:15:12.181 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2021-03-25T14:15:12.181 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2021-03-25T14:15:12.181 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000198916 s, 2.6 MB/s 2021-03-25T14:15:12.183 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-03-25T14:15:12.237 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-03-25T14:15:12.237 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-25T14:15:12.237 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 6h/6d Inode: 110775 Links: 1 2021-03-25T14:15:12.238 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-25T14:15:12.238 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2021-03-25T14:15:12.238 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2021-03-25 14:15:05.590548073 +0000 2021-03-25T14:15:12.238 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2021-03-25 14:12:43.739258770 +0000 2021-03-25T14:15:12.238 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2021-03-25 14:12:43.739258770 +0000 2021-03-25T14:15:12.238 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: - 2021-03-25T14:15:12.247 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2021-03-25T14:15:12.247 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2021-03-25T14:15:12.247 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000232792 s, 2.2 MB/s 2021-03-25T14:15:12.249 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-03-25T14:15:12.304 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-03-25T14:15:12.304 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-25T14:15:12.304 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 6h/6d Inode: 110228 Links: 1 2021-03-25T14:15:12.305 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-25T14:15:12.305 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2021-03-25T14:15:12.305 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2021-03-25 14:15:05.590548073 +0000 2021-03-25T14:15:12.305 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2021-03-25 14:12:44.086254346 +0000 2021-03-25T14:15:12.305 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2021-03-25 14:12:44.086254346 +0000 2021-03-25T14:15:12.305 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: - 2021-03-25T14:15:12.314 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2021-03-25T14:15:12.314 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2021-03-25T14:15:12.314 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000198468 s, 2.6 MB/s 2021-03-25T14:15:12.316 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-03-25T14:15:12.317 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi110.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi174.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2021-03-25T14:15:12.317 INFO:tasks.ceph:Generating config... 2021-03-25T14:15:12.319 INFO:tasks.ceph:[client] client mount timeout = 600 2021-03-25T14:15:12.319 INFO:tasks.ceph:[client] debug client = 20 2021-03-25T14:15:12.319 INFO:tasks.ceph:[client] debug ms = 1 2021-03-25T14:15:12.319 INFO:tasks.ceph:[client] rados mon op timeout = 15m 2021-03-25T14:15:12.319 INFO:tasks.ceph:[client] rados osd op timeout = 15m 2021-03-25T14:15:12.319 INFO:tasks.ceph:[global] ms die on skipped message = False 2021-03-25T14:15:12.319 INFO:tasks.ceph:[mds] debug mds = 20 2021-03-25T14:15:12.320 INFO:tasks.ceph:[mds] debug ms = 1 2021-03-25T14:15:12.320 INFO:tasks.ceph:[mds] mds bal frag = True 2021-03-25T14:15:12.320 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2021-03-25T14:15:12.320 INFO:tasks.ceph:[mds] mds bal merge size = 5 2021-03-25T14:15:12.320 INFO:tasks.ceph:[mds] mds bal split bits = 3 2021-03-25T14:15:12.320 INFO:tasks.ceph:[mds] mds bal split size = 100 2021-03-25T14:15:12.320 INFO:tasks.ceph:[mds] mds debug frag = True 2021-03-25T14:15:12.320 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2021-03-25T14:15:12.320 INFO:tasks.ceph:[mds] mds op complaint time = 180 2021-03-25T14:15:12.320 INFO:tasks.ceph:[mds] mds verify scatter = True 2021-03-25T14:15:12.320 INFO:tasks.ceph:[mds] osd op complaint time = 180 2021-03-25T14:15:12.320 INFO:tasks.ceph:[mds] rados mon op timeout = 15m 2021-03-25T14:15:12.321 INFO:tasks.ceph:[mds] rados osd op timeout = 15m 2021-03-25T14:15:12.321 INFO:tasks.ceph:[mgr] debug mgr = 20 2021-03-25T14:15:12.321 INFO:tasks.ceph:[mgr] debug ms = 1 2021-03-25T14:15:12.321 INFO:tasks.ceph:[mon] debug mon = 20 2021-03-25T14:15:12.321 INFO:tasks.ceph:[mon] debug ms = 1 2021-03-25T14:15:12.321 INFO:tasks.ceph:[mon] debug paxos = 20 2021-03-25T14:15:12.321 INFO:tasks.ceph:[mon] mon op complaint time = 120 2021-03-25T14:15:12.321 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2021-03-25T14:15:12.321 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2021-03-25T14:15:12.321 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2021-03-25T14:15:12.321 INFO:tasks.ceph:[osd] debug bluefs = 20 2021-03-25T14:15:12.321 INFO:tasks.ceph:[osd] debug bluestore = 20 2021-03-25T14:15:12.322 INFO:tasks.ceph:[osd] debug filestore = 20 2021-03-25T14:15:12.322 INFO:tasks.ceph:[osd] debug journal = 20 2021-03-25T14:15:12.322 INFO:tasks.ceph:[osd] debug ms = 20 2021-03-25T14:15:12.322 INFO:tasks.ceph:[osd] debug osd = 25 2021-03-25T14:15:12.322 INFO:tasks.ceph:[osd] debug rocksdb = 10 2021-03-25T14:15:12.322 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2021-03-25T14:15:12.322 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2021-03-25T14:15:12.322 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2021-03-25T14:15:12.322 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2021-03-25T14:15:12.322 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2021-03-25T14:15:12.322 INFO:tasks.ceph:[osd] osd op complaint time = 180 2021-03-25T14:15:12.323 INFO:tasks.ceph:Setting up mon.a... 2021-03-25T14:15:12.323 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2021-03-25T14:15:12.375 INFO:teuthology.orchestra.run.smithi110.stdout:creating /etc/ceph/ceph.keyring 2021-03-25T14:15:12.377 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2021-03-25T14:15:12.414 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-03-25T14:15:12.477 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.110'), ('mon.b', '172.21.15.174'), ('mon.c', '[v2:172.21.15.174:3301,v1:172.21.15.174:6790]')] 2021-03-25T14:15:12.478 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.110,172.21.15.174,[v2:172.21.15.174:3301,v1:172.21.15.174:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}} 2021-03-25T14:15:12.479 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2021-03-25T14:15:12.479 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2021-03-25T14:15:12.531 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.110 --add b 172.21.15.174 --addv c '[v2:172.21.15.174:3301,v1:172.21.15.174:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2021-03-25T14:15:12.610 INFO:teuthology.orchestra.run.smithi110.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2021-03-25T14:15:12.610 INFO:teuthology.orchestra.run.smithi110.stdout:monmaptool: generated fsid 5524cbad-8383-4081-a708-5d9e9f7cc15c 2021-03-25T14:15:12.610 INFO:teuthology.orchestra.run.smithi110.stdout:setting min_mon_release = octopus 2021-03-25T14:15:12.610 INFO:teuthology.orchestra.run.smithi110.stdout:epoch 0 2021-03-25T14:15:12.610 INFO:teuthology.orchestra.run.smithi110.stdout:fsid 5524cbad-8383-4081-a708-5d9e9f7cc15c 2021-03-25T14:15:12.611 INFO:teuthology.orchestra.run.smithi110.stdout:last_changed 2021-03-25T14:15:12.609995+0000 2021-03-25T14:15:12.611 INFO:teuthology.orchestra.run.smithi110.stdout:created 2021-03-25T14:15:12.609995+0000 2021-03-25T14:15:12.611 INFO:teuthology.orchestra.run.smithi110.stdout:min_mon_release 15 (octopus) 2021-03-25T14:15:12.611 INFO:teuthology.orchestra.run.smithi110.stdout:election_strategy: 1 2021-03-25T14:15:12.611 INFO:teuthology.orchestra.run.smithi110.stdout:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2021-03-25T14:15:12.611 INFO:teuthology.orchestra.run.smithi110.stdout:1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.b 2021-03-25T14:15:12.611 INFO:teuthology.orchestra.run.smithi110.stdout:2: [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] mon.c 2021-03-25T14:15:12.611 INFO:teuthology.orchestra.run.smithi110.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2021-03-25T14:15:12.613 DEBUG:teuthology.orchestra.run.smithi110:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2021-03-25T14:15:12.666 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 5524cbad-8383-4081-a708-5d9e9f7cc15c... 2021-03-25T14:15:12.667 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-03-25T14:15:12.709 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-03-25T14:15:12.748 INFO:teuthology.orchestra.run.smithi110.stdout:[global] 2021-03-25T14:15:12.748 INFO:teuthology.orchestra.run.smithi110.stdout: chdir = "" 2021-03-25T14:15:12.748 INFO:teuthology.orchestra.run.smithi110.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-03-25T14:15:12.748 INFO:teuthology.orchestra.run.smithi110.stdout: auth supported = cephx 2021-03-25T14:15:12.748 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:15:12.748 INFO:teuthology.orchestra.run.smithi110.stdout: filestore xattr use omap = true 2021-03-25T14:15:12.748 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:15:12.748 INFO:teuthology.orchestra.run.smithi110.stdout: mon clock drift allowed = 1.000 2021-03-25T14:15:12.749 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:15:12.749 INFO:teuthology.orchestra.run.smithi110.stdout: osd crush chooseleaf type = 0 2021-03-25T14:15:12.749 INFO:teuthology.orchestra.run.smithi110.stdout: auth debug = true 2021-03-25T14:15:12.749 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:15:12.749 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on old message = true 2021-03-25T14:15:12.749 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on bug = true 2021-03-25T14:15:12.749 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:15:12.749 INFO:teuthology.orchestra.run.smithi110.stdout: mon max pg per osd = 10000 # >= luminous 2021-03-25T14:15:12.749 INFO:teuthology.orchestra.run.smithi110.stdout: mon pg warn max object skew = 0 2021-03-25T14:15:12.749 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:15:12.749 INFO:teuthology.orchestra.run.smithi110.stdout: # disable pg_autoscaler by default for new pools 2021-03-25T14:15:12.749 INFO:teuthology.orchestra.run.smithi110.stdout: osd_pool_default_pg_autoscale_mode = off 2021-03-25T14:15:12.749 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:15:12.749 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default size = 2 2021-03-25T14:15:12.750 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:15:12.750 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow primary affinity = true 2021-03-25T14:15:12.750 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow pg remap = true 2021-03-25T14:15:12.750 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on legacy crush tunables = false 2021-03-25T14:15:12.750 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on crush straw calc version zero = false 2021-03-25T14:15:12.750 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on no sortbitwise = false 2021-03-25T14:15:12.750 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on osd down out interval zero = false 2021-03-25T14:15:12.750 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on too few osds = false 2021-03-25T14:15:12.750 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-03-25T14:15:12.750 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_no_redundancy = false 2021-03-25T14:15:12.750 INFO:teuthology.orchestra.run.smithi110.stdout: mon_allow_pool_size_one = true 2021-03-25T14:15:12.751 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:15:12.751 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-03-25T14:15:12.751 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:15:12.751 INFO:teuthology.orchestra.run.smithi110.stdout: osd default data pool replay window = 5 2021-03-25T14:15:12.751 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:15:12.751 INFO:teuthology.orchestra.run.smithi110.stdout: mon allow pool delete = true 2021-03-25T14:15:12.751 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:15:12.751 INFO:teuthology.orchestra.run.smithi110.stdout: mon cluster log file level = debug 2021-03-25T14:15:12.751 INFO:teuthology.orchestra.run.smithi110.stdout: debug asserts on shutdown = true 2021-03-25T14:15:12.751 INFO:teuthology.orchestra.run.smithi110.stdout: mon health detail to clog = false 2021-03-25T14:15:12.751 INFO:teuthology.orchestra.run.smithi110.stdout: mon host = "172.21.15.110,172.21.15.174,[v2:172.21.15.174:3301,v1:172.21.15.174:6790]" 2021-03-25T14:15:12.751 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on skipped message = False 2021-03-25T14:15:12.752 INFO:teuthology.orchestra.run.smithi110.stdout: fsid = 5524cbad-8383-4081-a708-5d9e9f7cc15c 2021-03-25T14:15:12.752 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:15:12.752 INFO:teuthology.orchestra.run.smithi110.stdout:[osd] 2021-03-25T14:15:12.752 INFO:teuthology.orchestra.run.smithi110.stdout: osd journal size = 100 2021-03-25T14:15:12.752 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:15:12.752 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub load threshold = 5.0 2021-03-25T14:15:12.752 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub max interval = 600 2021-03-25T14:15:12.752 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:15:12.752 INFO:teuthology.orchestra.run.smithi110.stdout: osd recover clone overlap = true 2021-03-25T14:15:12.752 INFO:teuthology.orchestra.run.smithi110.stdout: osd recovery max chunk = 1048576 2021-03-25T14:15:12.752 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:15:12.752 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug shutdown = true 2021-03-25T14:15:12.753 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug op order = true 2021-03-25T14:15:12.753 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug verify stray on activate = true 2021-03-25T14:15:12.753 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:15:12.753 INFO:teuthology.orchestra.run.smithi110.stdout: osd open classes on start = true 2021-03-25T14:15:12.753 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug pg log writeout = true 2021-03-25T14:15:12.753 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:15:12.753 INFO:teuthology.orchestra.run.smithi110.stdout: osd deep scrub update digest min age = 30 2021-03-25T14:15:12.753 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:15:12.753 INFO:teuthology.orchestra.run.smithi110.stdout: osd map max advance = 10 2021-03-25T14:15:12.753 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:15:12.753 INFO:teuthology.orchestra.run.smithi110.stdout: journal zero on create = true 2021-03-25T14:15:12.753 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:15:12.753 INFO:teuthology.orchestra.run.smithi110.stdout: filestore ondisk finisher threads = 3 2021-03-25T14:15:12.754 INFO:teuthology.orchestra.run.smithi110.stdout: filestore apply finisher threads = 3 2021-03-25T14:15:12.754 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:15:12.754 INFO:teuthology.orchestra.run.smithi110.stdout: bdev debug aio = true 2021-03-25T14:15:12.754 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug misdirected ops = true 2021-03-25T14:15:12.754 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore block size = 96636764160 2021-03-25T14:15:12.754 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore compression mode = aggressive 2021-03-25T14:15:12.754 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore fsck on mount = True 2021-03-25T14:15:12.754 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluefs = 20 2021-03-25T14:15:12.754 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluestore = 20 2021-03-25T14:15:12.754 INFO:teuthology.orchestra.run.smithi110.stdout: debug filestore = 20 2021-03-25T14:15:12.754 INFO:teuthology.orchestra.run.smithi110.stdout: debug journal = 20 2021-03-25T14:15:12.754 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 20 2021-03-25T14:15:12.755 INFO:teuthology.orchestra.run.smithi110.stdout: debug osd = 25 2021-03-25T14:15:12.755 INFO:teuthology.orchestra.run.smithi110.stdout: debug rocksdb = 10 2021-03-25T14:15:12.755 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd backfillfull_ratio = 0.85 2021-03-25T14:15:12.755 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd full ratio = 0.9 2021-03-25T14:15:12.755 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd nearfull ratio = 0.8 2021-03-25T14:15:12.755 INFO:teuthology.orchestra.run.smithi110.stdout: osd failsafe full ratio = 0.95 2021-03-25T14:15:12.755 INFO:teuthology.orchestra.run.smithi110.stdout: osd objectstore = bluestore 2021-03-25T14:15:12.755 INFO:teuthology.orchestra.run.smithi110.stdout: osd op complaint time = 180 2021-03-25T14:15:12.755 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:15:12.755 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr] 2021-03-25T14:15:12.755 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2021-03-25T14:15:12.755 INFO:teuthology.orchestra.run.smithi110.stdout: debug mgr = 20 2021-03-25T14:15:12.756 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2021-03-25T14:15:12.756 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2021-03-25T14:15:12.756 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2021-03-25T14:15:12.756 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2021-03-25T14:15:12.756 INFO:teuthology.orchestra.run.smithi110.stdout: mgr/telemetry/nag = false 2021-03-25T14:15:12.756 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:15:12.756 INFO:teuthology.orchestra.run.smithi110.stdout:[mon] 2021-03-25T14:15:12.756 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2021-03-25T14:15:12.756 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2021-03-25T14:15:12.756 INFO:teuthology.orchestra.run.smithi110.stdout: debug paxos = 20 2021-03-25T14:15:12.756 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2021-03-25T14:15:12.756 INFO:teuthology.orchestra.run.smithi110.stdout: mon data avail warn = 5 2021-03-25T14:15:12.757 INFO:teuthology.orchestra.run.smithi110.stdout: mon mgr mkfs grace = 240 2021-03-25T14:15:12.757 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2021-03-25T14:15:12.757 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd reporter subtree level = osd 2021-03-25T14:15:12.757 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd prime pg temp = true 2021-03-25T14:15:12.757 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2021-03-25T14:15:12.757 INFO:teuthology.orchestra.run.smithi110.stdout: mon op complaint time = 120 2021-03-25T14:15:12.757 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:15:12.757 INFO:teuthology.orchestra.run.smithi110.stdout:[client] 2021-03-25T14:15:12.757 INFO:teuthology.orchestra.run.smithi110.stdout: rgw cache enabled = true 2021-03-25T14:15:12.757 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable ops log = true 2021-03-25T14:15:12.757 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable usage log = true 2021-03-25T14:15:12.757 INFO:teuthology.orchestra.run.smithi110.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-03-25T14:15:12.757 INFO:teuthology.orchestra.run.smithi110.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-03-25T14:15:12.757 INFO:teuthology.orchestra.run.smithi110.stdout: client mount timeout = 600 2021-03-25T14:15:12.757 INFO:teuthology.orchestra.run.smithi110.stdout: debug client = 20 2021-03-25T14:15:12.758 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2021-03-25T14:15:12.758 INFO:teuthology.orchestra.run.smithi110.stdout: rados mon op timeout = 15m 2021-03-25T14:15:12.758 INFO:teuthology.orchestra.run.smithi110.stdout: rados osd op timeout = 15m 2021-03-25T14:15:12.758 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.a] 2021-03-25T14:15:12.758 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.b] 2021-03-25T14:15:12.758 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.c] 2021-03-25T14:15:12.758 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.a] 2021-03-25T14:15:12.758 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.c] 2021-03-25T14:15:12.758 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.b] 2021-03-25T14:15:12.758 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.d] 2021-03-25T14:15:12.758 INFO:teuthology.orchestra.run.smithi110.stdout:[mds] 2021-03-25T14:15:12.758 INFO:teuthology.orchestra.run.smithi110.stdout: debug mds = 20 2021-03-25T14:15:12.759 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2021-03-25T14:15:12.759 INFO:teuthology.orchestra.run.smithi110.stdout: mds bal frag = True 2021-03-25T14:15:12.759 INFO:teuthology.orchestra.run.smithi110.stdout: mds bal fragment size max = 10000 2021-03-25T14:15:12.759 INFO:teuthology.orchestra.run.smithi110.stdout: mds bal merge size = 5 2021-03-25T14:15:12.759 INFO:teuthology.orchestra.run.smithi110.stdout: mds bal split bits = 3 2021-03-25T14:15:12.759 INFO:teuthology.orchestra.run.smithi110.stdout: mds bal split size = 100 2021-03-25T14:15:12.759 INFO:teuthology.orchestra.run.smithi110.stdout: mds debug frag = True 2021-03-25T14:15:12.759 INFO:teuthology.orchestra.run.smithi110.stdout: mds debug scatterstat = True 2021-03-25T14:15:12.759 INFO:teuthology.orchestra.run.smithi110.stdout: mds op complaint time = 180 2021-03-25T14:15:12.759 INFO:teuthology.orchestra.run.smithi110.stdout: mds verify scatter = True 2021-03-25T14:15:12.759 INFO:teuthology.orchestra.run.smithi110.stdout: osd op complaint time = 180 2021-03-25T14:15:12.759 INFO:teuthology.orchestra.run.smithi110.stdout: rados mon op timeout = 15m 2021-03-25T14:15:12.759 INFO:teuthology.orchestra.run.smithi110.stdout: rados osd op timeout = 15m 2021-03-25T14:15:12.760 INFO:teuthology.orchestra.run.smithi174.stdout:[global] 2021-03-25T14:15:12.760 INFO:teuthology.orchestra.run.smithi174.stdout: chdir = "" 2021-03-25T14:15:12.760 INFO:teuthology.orchestra.run.smithi174.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-03-25T14:15:12.760 INFO:teuthology.orchestra.run.smithi174.stdout: auth supported = cephx 2021-03-25T14:15:12.760 INFO:teuthology.orchestra.run.smithi174.stdout: 2021-03-25T14:15:12.760 INFO:teuthology.orchestra.run.smithi174.stdout: filestore xattr use omap = true 2021-03-25T14:15:12.760 INFO:teuthology.orchestra.run.smithi174.stdout: 2021-03-25T14:15:12.760 INFO:teuthology.orchestra.run.smithi174.stdout: mon clock drift allowed = 1.000 2021-03-25T14:15:12.761 INFO:teuthology.orchestra.run.smithi174.stdout: 2021-03-25T14:15:12.761 INFO:teuthology.orchestra.run.smithi174.stdout: osd crush chooseleaf type = 0 2021-03-25T14:15:12.761 INFO:teuthology.orchestra.run.smithi174.stdout: auth debug = true 2021-03-25T14:15:12.761 INFO:teuthology.orchestra.run.smithi174.stdout: 2021-03-25T14:15:12.761 INFO:teuthology.orchestra.run.smithi174.stdout: ms die on old message = true 2021-03-25T14:15:12.761 INFO:teuthology.orchestra.run.smithi174.stdout: ms die on bug = true 2021-03-25T14:15:12.761 INFO:teuthology.orchestra.run.smithi174.stdout: 2021-03-25T14:15:12.761 INFO:teuthology.orchestra.run.smithi174.stdout: mon max pg per osd = 10000 # >= luminous 2021-03-25T14:15:12.761 INFO:teuthology.orchestra.run.smithi174.stdout: mon pg warn max object skew = 0 2021-03-25T14:15:12.761 INFO:teuthology.orchestra.run.smithi174.stdout: 2021-03-25T14:15:12.761 INFO:teuthology.orchestra.run.smithi174.stdout: # disable pg_autoscaler by default for new pools 2021-03-25T14:15:12.761 INFO:teuthology.orchestra.run.smithi174.stdout: osd_pool_default_pg_autoscale_mode = off 2021-03-25T14:15:12.762 INFO:teuthology.orchestra.run.smithi174.stdout: 2021-03-25T14:15:12.762 INFO:teuthology.orchestra.run.smithi174.stdout: osd pool default size = 2 2021-03-25T14:15:12.762 INFO:teuthology.orchestra.run.smithi174.stdout: 2021-03-25T14:15:12.762 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd allow primary affinity = true 2021-03-25T14:15:12.762 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd allow pg remap = true 2021-03-25T14:15:12.762 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on legacy crush tunables = false 2021-03-25T14:15:12.762 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on crush straw calc version zero = false 2021-03-25T14:15:12.762 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on no sortbitwise = false 2021-03-25T14:15:12.762 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on osd down out interval zero = false 2021-03-25T14:15:12.762 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on too few osds = false 2021-03-25T14:15:12.762 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-03-25T14:15:12.762 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_pool_no_redundancy = false 2021-03-25T14:15:12.762 INFO:teuthology.orchestra.run.smithi174.stdout: mon_allow_pool_size_one = true 2021-03-25T14:15:12.763 INFO:teuthology.orchestra.run.smithi174.stdout: 2021-03-25T14:15:12.763 INFO:teuthology.orchestra.run.smithi174.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-03-25T14:15:12.763 INFO:teuthology.orchestra.run.smithi174.stdout: 2021-03-25T14:15:12.763 INFO:teuthology.orchestra.run.smithi174.stdout: osd default data pool replay window = 5 2021-03-25T14:15:12.763 INFO:teuthology.orchestra.run.smithi174.stdout: 2021-03-25T14:15:12.763 INFO:teuthology.orchestra.run.smithi174.stdout: mon allow pool delete = true 2021-03-25T14:15:12.763 INFO:teuthology.orchestra.run.smithi174.stdout: 2021-03-25T14:15:12.763 INFO:teuthology.orchestra.run.smithi174.stdout: mon cluster log file level = debug 2021-03-25T14:15:12.763 INFO:teuthology.orchestra.run.smithi174.stdout: debug asserts on shutdown = true 2021-03-25T14:15:12.763 INFO:teuthology.orchestra.run.smithi174.stdout: mon health detail to clog = false 2021-03-25T14:15:12.763 INFO:teuthology.orchestra.run.smithi174.stdout: mon host = "172.21.15.110,172.21.15.174,[v2:172.21.15.174:3301,v1:172.21.15.174:6790]" 2021-03-25T14:15:12.763 INFO:teuthology.orchestra.run.smithi174.stdout: ms die on skipped message = False 2021-03-25T14:15:12.763 INFO:teuthology.orchestra.run.smithi174.stdout: fsid = 5524cbad-8383-4081-a708-5d9e9f7cc15c 2021-03-25T14:15:12.763 INFO:teuthology.orchestra.run.smithi174.stdout: 2021-03-25T14:15:12.764 INFO:teuthology.orchestra.run.smithi174.stdout:[osd] 2021-03-25T14:15:12.764 INFO:teuthology.orchestra.run.smithi174.stdout: osd journal size = 100 2021-03-25T14:15:12.764 INFO:teuthology.orchestra.run.smithi174.stdout: 2021-03-25T14:15:12.764 INFO:teuthology.orchestra.run.smithi174.stdout: osd scrub load threshold = 5.0 2021-03-25T14:15:12.764 INFO:teuthology.orchestra.run.smithi174.stdout: osd scrub max interval = 600 2021-03-25T14:15:12.764 INFO:teuthology.orchestra.run.smithi174.stdout: 2021-03-25T14:15:12.764 INFO:teuthology.orchestra.run.smithi174.stdout: osd recover clone overlap = true 2021-03-25T14:15:12.764 INFO:teuthology.orchestra.run.smithi174.stdout: osd recovery max chunk = 1048576 2021-03-25T14:15:12.764 INFO:teuthology.orchestra.run.smithi174.stdout: 2021-03-25T14:15:12.764 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug shutdown = true 2021-03-25T14:15:12.764 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug op order = true 2021-03-25T14:15:12.764 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug verify stray on activate = true 2021-03-25T14:15:12.764 INFO:teuthology.orchestra.run.smithi174.stdout: 2021-03-25T14:15:12.764 INFO:teuthology.orchestra.run.smithi174.stdout: osd open classes on start = true 2021-03-25T14:15:12.765 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug pg log writeout = true 2021-03-25T14:15:12.765 INFO:teuthology.orchestra.run.smithi174.stdout: 2021-03-25T14:15:12.765 INFO:teuthology.orchestra.run.smithi174.stdout: osd deep scrub update digest min age = 30 2021-03-25T14:15:12.765 INFO:teuthology.orchestra.run.smithi174.stdout: 2021-03-25T14:15:12.765 INFO:teuthology.orchestra.run.smithi174.stdout: osd map max advance = 10 2021-03-25T14:15:12.765 INFO:teuthology.orchestra.run.smithi174.stdout: 2021-03-25T14:15:12.765 INFO:teuthology.orchestra.run.smithi174.stdout: journal zero on create = true 2021-03-25T14:15:12.765 INFO:teuthology.orchestra.run.smithi174.stdout: 2021-03-25T14:15:12.765 INFO:teuthology.orchestra.run.smithi174.stdout: filestore ondisk finisher threads = 3 2021-03-25T14:15:12.765 INFO:teuthology.orchestra.run.smithi174.stdout: filestore apply finisher threads = 3 2021-03-25T14:15:12.765 INFO:teuthology.orchestra.run.smithi174.stdout: 2021-03-25T14:15:12.765 INFO:teuthology.orchestra.run.smithi174.stdout: bdev debug aio = true 2021-03-25T14:15:12.765 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug misdirected ops = true 2021-03-25T14:15:12.766 INFO:teuthology.orchestra.run.smithi174.stdout: bluestore block size = 96636764160 2021-03-25T14:15:12.766 INFO:teuthology.orchestra.run.smithi174.stdout: bluestore compression mode = aggressive 2021-03-25T14:15:12.766 INFO:teuthology.orchestra.run.smithi174.stdout: bluestore fsck on mount = True 2021-03-25T14:15:12.766 INFO:teuthology.orchestra.run.smithi174.stdout: debug bluefs = 20 2021-03-25T14:15:12.766 INFO:teuthology.orchestra.run.smithi174.stdout: debug bluestore = 20 2021-03-25T14:15:12.766 INFO:teuthology.orchestra.run.smithi174.stdout: debug filestore = 20 2021-03-25T14:15:12.766 INFO:teuthology.orchestra.run.smithi174.stdout: debug journal = 20 2021-03-25T14:15:12.766 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 20 2021-03-25T14:15:12.766 INFO:teuthology.orchestra.run.smithi174.stdout: debug osd = 25 2021-03-25T14:15:12.766 INFO:teuthology.orchestra.run.smithi174.stdout: debug rocksdb = 10 2021-03-25T14:15:12.766 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd backfillfull_ratio = 0.85 2021-03-25T14:15:12.766 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd full ratio = 0.9 2021-03-25T14:15:12.766 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd nearfull ratio = 0.8 2021-03-25T14:15:12.767 INFO:teuthology.orchestra.run.smithi174.stdout: osd failsafe full ratio = 0.95 2021-03-25T14:15:12.767 INFO:teuthology.orchestra.run.smithi174.stdout: osd objectstore = bluestore 2021-03-25T14:15:12.767 INFO:teuthology.orchestra.run.smithi174.stdout: osd op complaint time = 180 2021-03-25T14:15:12.767 INFO:teuthology.orchestra.run.smithi174.stdout: 2021-03-25T14:15:12.767 INFO:teuthology.orchestra.run.smithi174.stdout:[mgr] 2021-03-25T14:15:12.767 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2021-03-25T14:15:12.767 INFO:teuthology.orchestra.run.smithi174.stdout: debug mgr = 20 2021-03-25T14:15:12.767 INFO:teuthology.orchestra.run.smithi174.stdout: debug mon = 20 2021-03-25T14:15:12.767 INFO:teuthology.orchestra.run.smithi174.stdout: debug auth = 20 2021-03-25T14:15:12.767 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min pgs per osd = 4 2021-03-25T14:15:12.767 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min bytes per osd = 10 2021-03-25T14:15:12.767 INFO:teuthology.orchestra.run.smithi174.stdout: mgr/telemetry/nag = false 2021-03-25T14:15:12.768 INFO:teuthology.orchestra.run.smithi174.stdout: 2021-03-25T14:15:12.768 INFO:teuthology.orchestra.run.smithi174.stdout:[mon] 2021-03-25T14:15:12.768 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2021-03-25T14:15:12.768 INFO:teuthology.orchestra.run.smithi174.stdout: debug mon = 20 2021-03-25T14:15:12.768 INFO:teuthology.orchestra.run.smithi174.stdout: debug paxos = 20 2021-03-25T14:15:12.768 INFO:teuthology.orchestra.run.smithi174.stdout: debug auth = 20 2021-03-25T14:15:12.768 INFO:teuthology.orchestra.run.smithi174.stdout: mon data avail warn = 5 2021-03-25T14:15:12.768 INFO:teuthology.orchestra.run.smithi174.stdout: mon mgr mkfs grace = 240 2021-03-25T14:15:12.768 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min pgs per osd = 4 2021-03-25T14:15:12.768 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd reporter subtree level = osd 2021-03-25T14:15:12.768 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd prime pg temp = true 2021-03-25T14:15:12.768 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min bytes per osd = 10 2021-03-25T14:15:12.768 INFO:teuthology.orchestra.run.smithi174.stdout: mon op complaint time = 120 2021-03-25T14:15:12.769 INFO:teuthology.orchestra.run.smithi174.stdout: 2021-03-25T14:15:12.769 INFO:teuthology.orchestra.run.smithi174.stdout:[client] 2021-03-25T14:15:12.769 INFO:teuthology.orchestra.run.smithi174.stdout: rgw cache enabled = true 2021-03-25T14:15:12.769 INFO:teuthology.orchestra.run.smithi174.stdout: rgw enable ops log = true 2021-03-25T14:15:12.769 INFO:teuthology.orchestra.run.smithi174.stdout: rgw enable usage log = true 2021-03-25T14:15:12.769 INFO:teuthology.orchestra.run.smithi174.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-03-25T14:15:12.769 INFO:teuthology.orchestra.run.smithi174.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-03-25T14:15:12.769 INFO:teuthology.orchestra.run.smithi174.stdout: client mount timeout = 600 2021-03-25T14:15:12.769 INFO:teuthology.orchestra.run.smithi174.stdout: debug client = 20 2021-03-25T14:15:12.769 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2021-03-25T14:15:12.769 INFO:teuthology.orchestra.run.smithi174.stdout: rados mon op timeout = 15m 2021-03-25T14:15:12.769 INFO:teuthology.orchestra.run.smithi174.stdout: rados osd op timeout = 15m 2021-03-25T14:15:12.769 INFO:teuthology.orchestra.run.smithi174.stdout:[mon.a] 2021-03-25T14:15:12.770 INFO:teuthology.orchestra.run.smithi174.stdout:[mon.b] 2021-03-25T14:15:12.770 INFO:teuthology.orchestra.run.smithi174.stdout:[mon.c] 2021-03-25T14:15:12.770 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.a] 2021-03-25T14:15:12.770 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.c] 2021-03-25T14:15:12.770 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.b] 2021-03-25T14:15:12.770 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.d] 2021-03-25T14:15:12.770 INFO:teuthology.orchestra.run.smithi174.stdout:[mds] 2021-03-25T14:15:12.770 INFO:teuthology.orchestra.run.smithi174.stdout: debug mds = 20 2021-03-25T14:15:12.770 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2021-03-25T14:15:12.771 INFO:teuthology.orchestra.run.smithi174.stdout: mds bal frag = True 2021-03-25T14:15:12.771 INFO:teuthology.orchestra.run.smithi174.stdout: mds bal fragment size max = 10000 2021-03-25T14:15:12.771 INFO:teuthology.orchestra.run.smithi174.stdout: mds bal merge size = 5 2021-03-25T14:15:12.771 INFO:teuthology.orchestra.run.smithi174.stdout: mds bal split bits = 3 2021-03-25T14:15:12.771 INFO:teuthology.orchestra.run.smithi174.stdout: mds bal split size = 100 2021-03-25T14:15:12.771 INFO:teuthology.orchestra.run.smithi174.stdout: mds debug frag = True 2021-03-25T14:15:12.771 INFO:teuthology.orchestra.run.smithi174.stdout: mds debug scatterstat = True 2021-03-25T14:15:12.771 INFO:teuthology.orchestra.run.smithi174.stdout: mds op complaint time = 180 2021-03-25T14:15:12.771 INFO:teuthology.orchestra.run.smithi174.stdout: mds verify scatter = True 2021-03-25T14:15:12.771 INFO:teuthology.orchestra.run.smithi174.stdout: osd op complaint time = 180 2021-03-25T14:15:12.771 INFO:teuthology.orchestra.run.smithi174.stdout: rados mon op timeout = 15m 2021-03-25T14:15:12.771 INFO:teuthology.orchestra.run.smithi174.stdout: rados osd op timeout = 15m 2021-03-25T14:15:12.773 INFO:tasks.ceph:Creating admin key on mon.a... 2021-03-25T14:15:12.773 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2021-03-25T14:15:12.860 INFO:tasks.ceph:Copying monmap to all nodes... 2021-03-25T14:15:12.861 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2021-03-25T14:15:12.861 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2021-03-25T14:15:12.875 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2021-03-25T14:15:12.875 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2021-03-25T14:15:12.928 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi110.front.sepia.ceph.com 2021-03-25T14:15:12.928 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2021-03-25T14:15:12.928 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/ceph/ceph.keyring 2021-03-25T14:15:12.928 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-03-25T14:15:13.001 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2021-03-25T14:15:13.001 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-03-25T14:15:13.055 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi174.front.sepia.ceph.com 2021-03-25T14:15:13.056 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2021-03-25T14:15:13.056 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/ceph/ceph.keyring 2021-03-25T14:15:13.056 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-03-25T14:15:13.090 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2021-03-25T14:15:13.090 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-03-25T14:15:13.144 INFO:tasks.ceph:Setting up mon nodes... 2021-03-25T14:15:13.145 INFO:tasks.ceph:Setting up mgr nodes... 2021-03-25T14:15:13.145 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2021-03-25T14:15:13.191 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2021-03-25T14:15:13.193 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2021-03-25T14:15:13.262 INFO:teuthology.orchestra.run.smithi174.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2021-03-25T14:15:13.264 INFO:tasks.ceph:Setting up mds nodes... 2021-03-25T14:15:13.265 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2021-03-25T14:15:13.310 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2021-03-25T14:15:13.313 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2021-03-25T14:15:13.336 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2021-03-25T14:15:13.422 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2021-03-25T14:15:13.425 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2021-03-25T14:15:13.448 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2021-03-25T14:15:13.494 INFO:teuthology.orchestra.run.smithi174.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2021-03-25T14:15:13.497 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2021-03-25T14:15:13.521 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2021-03-25T14:15:13.607 INFO:teuthology.orchestra.run.smithi174.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2021-03-25T14:15:13.609 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2021-03-25T14:15:13.633 INFO:tasks.ceph_client:Setting up client nodes... 2021-03-25T14:15:13.633 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2021-03-25T14:15:13.669 INFO:teuthology.orchestra.run.smithi110.stdout:creating /etc/ceph/ceph.client.0.keyring 2021-03-25T14:15:13.681 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2021-03-25T14:15:13.716 INFO:teuthology.orchestra.run.smithi174.stdout:creating /etc/ceph/ceph.client.1.keyring 2021-03-25T14:15:13.730 INFO:tasks.ceph:Running mkfs on osd nodes... 2021-03-25T14:15:13.730 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi110.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi174.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2021-03-25T14:15:13.730 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2021-03-25T14:15:13.753 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-03-25T14:15:13.753 INFO:tasks.ceph:role: osd.0 2021-03-25T14:15:13.754 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi110.front.sepia.ceph.com 2021-03-25T14:15:13.754 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-03-25T14:15:13.816 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2021-03-25T14:15:13.816 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2021-03-25T14:15:13.816 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-03-25T14:15:13.816 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 2021-03-25T14:15:13.816 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-03-25T14:15:13.816 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2021-03-25T14:15:13.817 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-03-25T14:15:13.817 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-03-25T14:15:13.817 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-03-25T14:15:13.817 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-03-25T14:15:13.840 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2021-03-25T14:15:13.842 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2021-03-25T14:15:13.842 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2021-03-25T14:15:13.918 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2021-03-25T14:15:13.986 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2021-03-25T14:15:14.049 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-03-25T14:15:14.050 INFO:tasks.ceph:role: osd.1 2021-03-25T14:15:14.050 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi110.front.sepia.ceph.com 2021-03-25T14:15:14.050 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-03-25T14:15:14.112 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2021-03-25T14:15:14.112 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2021-03-25T14:15:14.112 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-03-25T14:15:14.112 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 2021-03-25T14:15:14.113 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-03-25T14:15:14.113 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2021-03-25T14:15:14.113 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-03-25T14:15:14.113 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-03-25T14:15:14.113 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-03-25T14:15:14.113 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-03-25T14:15:14.134 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2021-03-25T14:15:14.136 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2021-03-25T14:15:14.136 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2021-03-25T14:15:14.213 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2021-03-25T14:15:14.281 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2021-03-25T14:15:14.344 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-03-25T14:15:14.344 INFO:tasks.ceph:role: osd.2 2021-03-25T14:15:14.344 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi110.front.sepia.ceph.com 2021-03-25T14:15:14.344 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-03-25T14:15:14.407 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2021-03-25T14:15:14.407 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2021-03-25T14:15:14.408 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-03-25T14:15:14.408 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 2021-03-25T14:15:14.408 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-03-25T14:15:14.408 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2021-03-25T14:15:14.408 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-03-25T14:15:14.408 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-03-25T14:15:14.408 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-03-25T14:15:14.408 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-03-25T14:15:14.430 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2021-03-25T14:15:14.431 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2021-03-25T14:15:14.431 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2021-03-25T14:15:14.507 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2021-03-25T14:15:14.574 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2021-03-25T14:15:14.638 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-03-25T14:15:14.638 INFO:tasks.ceph:role: osd.3 2021-03-25T14:15:14.638 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi110.front.sepia.ceph.com 2021-03-25T14:15:14.638 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2021-03-25T14:15:14.701 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2021-03-25T14:15:14.701 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2021-03-25T14:15:14.701 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-03-25T14:15:14.701 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 2021-03-25T14:15:14.702 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-03-25T14:15:14.702 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2021-03-25T14:15:14.702 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-03-25T14:15:14.702 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-03-25T14:15:14.702 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-03-25T14:15:14.702 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-03-25T14:15:14.724 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2021-03-25T14:15:14.726 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2021-03-25T14:15:14.726 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2021-03-25T14:15:14.802 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2021-03-25T14:15:14.868 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-03-25T14:15:14.948 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:14.947+0000 7fdc5e666080 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2021-03-25T14:15:14.948 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:14.947+0000 7fdc5e666080 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2021-03-25T14:15:14.948 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:14.947+0000 7fdc5e666080 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-03-25T14:15:14.948 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:14.947+0000 7fdc5e666080 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-03-25T14:15:14.949 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:14.947+0000 7fdc5e666080 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-03-25T14:15:14.949 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:14.947+0000 7fdc5e666080 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2021-03-25T14:15:17.796 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-03-25T14:15:17.865 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-03-25T14:15:17.951 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:17.950+0000 7f78ce78f080 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2021-03-25T14:15:17.951 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:17.950+0000 7f78ce78f080 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2021-03-25T14:15:17.951 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:17.950+0000 7f78ce78f080 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-03-25T14:15:17.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:17.950+0000 7f78ce78f080 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-03-25T14:15:17.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:17.950+0000 7f78ce78f080 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-03-25T14:15:17.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:17.950+0000 7f78ce78f080 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2021-03-25T14:15:20.798 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-03-25T14:15:20.826 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-03-25T14:15:20.912 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:20.910+0000 7f3b8f0b2080 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2021-03-25T14:15:20.912 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:20.911+0000 7f3b8f0b2080 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2021-03-25T14:15:20.912 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:20.911+0000 7f3b8f0b2080 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-03-25T14:15:20.912 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:20.911+0000 7f3b8f0b2080 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-03-25T14:15:20.912 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:20.911+0000 7f3b8f0b2080 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-03-25T14:15:20.912 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:20.911+0000 7f3b8f0b2080 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2021-03-25T14:15:23.753 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-03-25T14:15:23.782 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-03-25T14:15:23.869 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:23.868+0000 7fbd7d781080 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2021-03-25T14:15:23.869 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:23.868+0000 7fbd7d781080 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2021-03-25T14:15:23.869 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:23.868+0000 7fbd7d781080 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-03-25T14:15:23.870 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:23.868+0000 7fbd7d781080 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-03-25T14:15:23.870 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:23.868+0000 7fbd7d781080 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-03-25T14:15:23.870 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:23.868+0000 7fbd7d781080 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2021-03-25T14:15:26.723 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-03-25T14:15:26.751 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2021-03-25T14:15:26.781 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-03-25T14:15:26.781 INFO:tasks.ceph:role: osd.4 2021-03-25T14:15:26.781 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi174.front.sepia.ceph.com 2021-03-25T14:15:26.781 DEBUG:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-03-25T14:15:26.856 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2021-03-25T14:15:26.856 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2021-03-25T14:15:26.856 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-03-25T14:15:26.856 INFO:teuthology.orchestra.run.smithi174.stdout: = reflink=1 2021-03-25T14:15:26.856 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-03-25T14:15:26.856 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2021-03-25T14:15:26.857 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-03-25T14:15:26.857 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-03-25T14:15:26.857 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-03-25T14:15:26.857 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-03-25T14:15:27.219 INFO:teuthology.orchestra.run.smithi174.stdout:Discarding blocks...Done. 2021-03-25T14:15:27.221 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2021-03-25T14:15:27.221 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2021-03-25T14:15:27.341 DEBUG:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2021-03-25T14:15:27.374 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2021-03-25T14:15:27.440 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-03-25T14:15:27.440 INFO:tasks.ceph:role: osd.5 2021-03-25T14:15:27.440 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi174.front.sepia.ceph.com 2021-03-25T14:15:27.441 DEBUG:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-03-25T14:15:27.513 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2021-03-25T14:15:27.513 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2021-03-25T14:15:27.513 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-03-25T14:15:27.513 INFO:teuthology.orchestra.run.smithi174.stdout: = reflink=1 2021-03-25T14:15:27.513 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-03-25T14:15:27.513 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2021-03-25T14:15:27.513 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-03-25T14:15:27.514 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-03-25T14:15:27.514 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-03-25T14:15:27.514 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-03-25T14:15:27.872 INFO:teuthology.orchestra.run.smithi174.stdout:Discarding blocks...Done. 2021-03-25T14:15:27.874 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2021-03-25T14:15:27.875 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2021-03-25T14:15:27.967 DEBUG:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2021-03-25T14:15:27.997 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2021-03-25T14:15:28.063 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-03-25T14:15:28.063 INFO:tasks.ceph:role: osd.6 2021-03-25T14:15:28.063 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi174.front.sepia.ceph.com 2021-03-25T14:15:28.064 DEBUG:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-03-25T14:15:28.136 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2021-03-25T14:15:28.136 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2021-03-25T14:15:28.136 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-03-25T14:15:28.136 INFO:teuthology.orchestra.run.smithi174.stdout: = reflink=1 2021-03-25T14:15:28.136 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-03-25T14:15:28.136 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2021-03-25T14:15:28.136 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-03-25T14:15:28.136 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-03-25T14:15:28.137 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-03-25T14:15:28.137 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-03-25T14:15:28.500 INFO:teuthology.orchestra.run.smithi174.stdout:Discarding blocks...Done. 2021-03-25T14:15:28.502 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2021-03-25T14:15:28.502 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2021-03-25T14:15:28.610 DEBUG:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2021-03-25T14:15:28.641 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2021-03-25T14:15:28.709 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-03-25T14:15:28.709 INFO:tasks.ceph:role: osd.7 2021-03-25T14:15:28.709 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi174.front.sepia.ceph.com 2021-03-25T14:15:28.709 DEBUG:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2021-03-25T14:15:28.784 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2021-03-25T14:15:28.784 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2021-03-25T14:15:28.784 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-03-25T14:15:28.784 INFO:teuthology.orchestra.run.smithi174.stdout: = reflink=1 2021-03-25T14:15:28.784 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-03-25T14:15:28.785 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2021-03-25T14:15:28.785 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-03-25T14:15:28.785 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-03-25T14:15:28.785 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-03-25T14:15:28.785 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-03-25T14:15:29.153 INFO:teuthology.orchestra.run.smithi174.stdout:Discarding blocks...Done. 2021-03-25T14:15:29.155 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2021-03-25T14:15:29.155 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2021-03-25T14:15:29.283 DEBUG:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2021-03-25T14:15:29.314 DEBUG:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-03-25T14:15:29.399 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:29.398+0000 7f779ed10080 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2021-03-25T14:15:29.401 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:29.399+0000 7f779ed10080 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2021-03-25T14:15:29.401 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:29.399+0000 7f779ed10080 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-03-25T14:15:29.401 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:29.399+0000 7f779ed10080 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-03-25T14:15:29.401 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:29.399+0000 7f779ed10080 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-03-25T14:15:29.409 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:29.408+0000 7f779ed10080 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2021-03-25T14:15:32.254 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-03-25T14:15:32.282 DEBUG:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-03-25T14:15:32.370 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:32.368+0000 7f453d628080 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2021-03-25T14:15:32.370 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:32.368+0000 7f453d628080 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2021-03-25T14:15:32.370 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:32.368+0000 7f453d628080 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-03-25T14:15:32.371 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:32.368+0000 7f453d628080 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-03-25T14:15:32.371 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:32.368+0000 7f453d628080 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-03-25T14:15:32.371 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:32.368+0000 7f453d628080 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2021-03-25T14:15:35.219 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-03-25T14:15:35.247 DEBUG:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-03-25T14:15:35.331 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:35.329+0000 7f6f4f5aa080 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2021-03-25T14:15:35.332 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:35.330+0000 7f6f4f5aa080 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2021-03-25T14:15:35.332 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:35.330+0000 7f6f4f5aa080 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2021-03-25T14:15:35.332 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:35.330+0000 7f6f4f5aa080 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2021-03-25T14:15:35.332 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:35.330+0000 7f6f4f5aa080 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2021-03-25T14:15:35.332 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:35.330+0000 7f6f4f5aa080 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2021-03-25T14:15:38.187 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-03-25T14:15:38.215 DEBUG:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-03-25T14:15:38.301 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:38.299+0000 7f2d60247080 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2021-03-25T14:15:38.302 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:38.299+0000 7f2d60247080 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2021-03-25T14:15:38.302 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:38.299+0000 7f2d60247080 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2021-03-25T14:15:38.302 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:38.299+0000 7f2d60247080 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2021-03-25T14:15:38.302 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:38.299+0000 7f2d60247080 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2021-03-25T14:15:38.302 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:38.300+0000 7f2d60247080 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2021-03-25T14:15:41.151 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-03-25T14:15:41.179 INFO:tasks.ceph:Reading keys from all nodes... 2021-03-25T14:15:41.179 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2021-03-25T14:15:41.179 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2021-03-25T14:15:41.210 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2021-03-25T14:15:41.210 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2021-03-25T14:15:41.276 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2021-03-25T14:15:41.276 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2021-03-25T14:15:41.342 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2021-03-25T14:15:41.343 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2021-03-25T14:15:41.408 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2021-03-25T14:15:41.408 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2021-03-25T14:15:41.472 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2021-03-25T14:15:41.472 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2021-03-25T14:15:41.537 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2021-03-25T14:15:41.537 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2021-03-25T14:15:41.600 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2021-03-25T14:15:41.600 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2021-03-25T14:15:41.629 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2021-03-25T14:15:41.629 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2021-03-25T14:15:41.640 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-03-25T14:15:41.643 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-03-25T14:15:41.697 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2021-03-25T14:15:41.697 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2021-03-25T14:15:41.800 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2021-03-25T14:15:41.800 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2021-03-25T14:15:41.866 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2021-03-25T14:15:41.866 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2021-03-25T14:15:41.931 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2021-03-25T14:15:41.931 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2021-03-25T14:15:41.996 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2021-03-25T14:15:41.996 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2021-03-25T14:15:42.061 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2021-03-25T14:15:42.061 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2021-03-25T14:15:42.076 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2021-03-25T14:15:42.076 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2021-03-25T14:15:42.116 INFO:tasks.ceph:Adding keys to all mons... 2021-03-25T14:15:42.116 DEBUG:teuthology.orchestra.run.smithi110:> sudo tee -a /etc/ceph/ceph.keyring 2021-03-25T14:15:42.118 DEBUG:teuthology.orchestra.run.smithi174:> sudo tee -a /etc/ceph/ceph.keyring 2021-03-25T14:15:42.159 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr.y] 2021-03-25T14:15:42.160 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQDxmlxgil5jCxAAt3504C7TGciH7KF4EIkmhw== 2021-03-25T14:15:42.160 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.a] 2021-03-25T14:15:42.160 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQDxmlxgu8aCEhAA9Q4e7SWq5aDsLFgylcYasw== 2021-03-25T14:15:42.160 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.c] 2021-03-25T14:15:42.160 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQDxmlxgEUUtGRAA88JXgGt3G5BUFrM3XSrcqA== 2021-03-25T14:15:42.160 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.0] 2021-03-25T14:15:42.160 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQDymlxgwZp8OBAAq9v4WdTkWcbGA+npuycbMg== 2021-03-25T14:15:42.160 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.1] 2021-03-25T14:15:42.160 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQD1mlxgGbipOBAA4pnOC/cuKte3/s/OynFO4Q== 2021-03-25T14:15:42.160 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.2] 2021-03-25T14:15:42.160 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQD4mlxgoMlQNhAAX+mGQaqbPBWJ6ML34o+2Ag== 2021-03-25T14:15:42.161 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.3] 2021-03-25T14:15:42.161 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQD7mlxgwMTDMxAASdzfZH/r/hxi4yntbTE44A== 2021-03-25T14:15:42.161 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr.x] 2021-03-25T14:15:42.161 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQDxmlxgW4eaDxAAeURkSVsbMqQMPgz6bES0zw== 2021-03-25T14:15:42.161 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.b] 2021-03-25T14:15:42.161 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQDxmlxgMKt4HRAA2Zg+dO3gKKuJXsTBqargjg== 2021-03-25T14:15:42.161 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.d] 2021-03-25T14:15:42.161 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQDxmlxgW9AxJBAA15D4zF2B1SapEee6SmRcvg== 2021-03-25T14:15:42.161 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.4] 2021-03-25T14:15:42.161 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQABm1xgveHKFxAAxxfuXs2iAaCtDS99y84xUA== 2021-03-25T14:15:42.161 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.5] 2021-03-25T14:15:42.161 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAEm1xgfmgAFhAAS7sBExbnejoEm+RPDBfUbA== 2021-03-25T14:15:42.161 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.6] 2021-03-25T14:15:42.162 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAHm1xg4ve5ExAA/lvAG/VBB5q20gHi8/t7qg== 2021-03-25T14:15:42.162 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.7] 2021-03-25T14:15:42.162 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAKm1xgmgHpERAA5e/kkmZ5/bM9r1eLQn+47Q== 2021-03-25T14:15:42.162 INFO:teuthology.orchestra.run.smithi110.stdout:[client.0] 2021-03-25T14:15:42.162 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQDxmlxg8erbJxAAJisHYL2sfUoCtEM84zXmTQ== 2021-03-25T14:15:42.162 INFO:teuthology.orchestra.run.smithi110.stdout:[client.1] 2021-03-25T14:15:42.162 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQDxmlxg7uW1KhAAkf3kOWqyE6uoDsXybdU8CQ== 2021-03-25T14:15:42.180 INFO:teuthology.orchestra.run.smithi174.stdout:[mgr.y] 2021-03-25T14:15:42.180 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQDxmlxgil5jCxAAt3504C7TGciH7KF4EIkmhw== 2021-03-25T14:15:42.180 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.a] 2021-03-25T14:15:42.180 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQDxmlxgu8aCEhAA9Q4e7SWq5aDsLFgylcYasw== 2021-03-25T14:15:42.180 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.c] 2021-03-25T14:15:42.180 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQDxmlxgEUUtGRAA88JXgGt3G5BUFrM3XSrcqA== 2021-03-25T14:15:42.180 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.0] 2021-03-25T14:15:42.180 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQDymlxgwZp8OBAAq9v4WdTkWcbGA+npuycbMg== 2021-03-25T14:15:42.180 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.1] 2021-03-25T14:15:42.180 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQD1mlxgGbipOBAA4pnOC/cuKte3/s/OynFO4Q== 2021-03-25T14:15:42.181 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.2] 2021-03-25T14:15:42.181 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQD4mlxgoMlQNhAAX+mGQaqbPBWJ6ML34o+2Ag== 2021-03-25T14:15:42.181 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.3] 2021-03-25T14:15:42.181 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQD7mlxgwMTDMxAASdzfZH/r/hxi4yntbTE44A== 2021-03-25T14:15:42.181 INFO:teuthology.orchestra.run.smithi174.stdout:[mgr.x] 2021-03-25T14:15:42.181 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQDxmlxgW4eaDxAAeURkSVsbMqQMPgz6bES0zw== 2021-03-25T14:15:42.181 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.b] 2021-03-25T14:15:42.181 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQDxmlxgMKt4HRAA2Zg+dO3gKKuJXsTBqargjg== 2021-03-25T14:15:42.181 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.d] 2021-03-25T14:15:42.181 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQDxmlxgW9AxJBAA15D4zF2B1SapEee6SmRcvg== 2021-03-25T14:15:42.181 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.4] 2021-03-25T14:15:42.181 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQABm1xgveHKFxAAxxfuXs2iAaCtDS99y84xUA== 2021-03-25T14:15:42.181 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.5] 2021-03-25T14:15:42.182 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQAEm1xgfmgAFhAAS7sBExbnejoEm+RPDBfUbA== 2021-03-25T14:15:42.182 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.6] 2021-03-25T14:15:42.182 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQAHm1xg4ve5ExAA/lvAG/VBB5q20gHi8/t7qg== 2021-03-25T14:15:42.182 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.7] 2021-03-25T14:15:42.182 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQAKm1xgmgHpERAA5e/kkmZ5/bM9r1eLQn+47Q== 2021-03-25T14:15:42.182 INFO:teuthology.orchestra.run.smithi174.stdout:[client.0] 2021-03-25T14:15:42.182 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQDxmlxg8erbJxAAJisHYL2sfUoCtEM84zXmTQ== 2021-03-25T14:15:42.182 INFO:teuthology.orchestra.run.smithi174.stdout:[client.1] 2021-03-25T14:15:42.182 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQDxmlxg7uW1KhAAkf3kOWqyE6uoDsXybdU8CQ== 2021-03-25T14:15:42.184 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-03-25T14:15:42.206 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-03-25T14:15:42.269 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-03-25T14:15:42.271 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-03-25T14:15:42.319 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-03-25T14:15:42.321 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-03-25T14:15:42.368 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-03-25T14:15:42.370 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-03-25T14:15:42.415 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-03-25T14:15:42.418 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-03-25T14:15:42.462 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-03-25T14:15:42.503 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-03-25T14:15:42.547 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-03-25T14:15:42.549 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-03-25T14:15:42.593 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-03-25T14:15:42.595 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-03-25T14:15:42.678 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-03-25T14:15:42.681 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-03-25T14:15:42.728 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-03-25T14:15:42.731 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-03-25T14:15:42.778 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-03-25T14:15:42.781 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-03-25T14:15:42.825 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-03-25T14:15:42.827 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-03-25T14:15:42.910 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-03-25T14:15:42.913 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-03-25T14:15:42.995 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-03-25T14:15:42.997 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-03-25T14:15:43.043 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-03-25T14:15:43.045 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-03-25T14:15:43.093 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-03-25T14:15:43.096 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-03-25T14:15:43.143 INFO:tasks.ceph:Running mkfs on mon nodes... 2021-03-25T14:15:43.143 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2021-03-25T14:15:43.167 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-03-25T14:15:43.257 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2021-03-25T14:15:43.280 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2021-03-25T14:15:43.304 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-03-25T14:15:43.394 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2021-03-25T14:15:43.417 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2021-03-25T14:15:43.481 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-03-25T14:15:43.572 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2021-03-25T14:15:43.597 DEBUG:teuthology.orchestra.run.smithi110:> rm -- /home/ubuntu/cephtest/ceph.monmap 2021-03-25T14:15:43.599 DEBUG:teuthology.orchestra.run.smithi174:> rm -- /home/ubuntu/cephtest/ceph.monmap 2021-03-25T14:15:43.651 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2021-03-25T14:15:43.651 INFO:tasks.ceph.mon.a:Restarting daemon 2021-03-25T14:15:43.652 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2021-03-25T14:15:43.654 INFO:tasks.ceph.mon.a:Started 2021-03-25T14:15:43.654 INFO:tasks.ceph.mon.b:Restarting daemon 2021-03-25T14:15:43.654 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2021-03-25T14:15:43.694 INFO:tasks.ceph.mon.b:Started 2021-03-25T14:15:43.696 INFO:tasks.ceph.mon.c:Restarting daemon 2021-03-25T14:15:43.696 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2021-03-25T14:15:43.698 INFO:tasks.ceph.mon.c:Started 2021-03-25T14:15:43.698 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2021-03-25T14:15:43.698 INFO:tasks.ceph.mgr.y:Restarting daemon 2021-03-25T14:15:43.698 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2021-03-25T14:15:43.700 INFO:tasks.ceph.mgr.y:Started 2021-03-25T14:15:43.701 INFO:tasks.ceph.mgr.x:Restarting daemon 2021-03-25T14:15:43.701 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2021-03-25T14:15:43.702 INFO:tasks.ceph.mgr.x:Started 2021-03-25T14:15:43.703 INFO:tasks.ceph:Setting crush tunables to default 2021-03-25T14:15:43.703 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd crush tunables default 2021-03-25T14:15:43.813 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:43.811+0000 7fc190457700 1 Processor -- start 2021-03-25T14:15:43.813 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:43.811+0000 7fc190457700 1 -- start start 2021-03-25T14:15:43.815 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:43.812+0000 7fc190457700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc18814d850 0x7fc1880bc710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:43.815 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:43.812+0000 7fc190457700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1880691b0 con 0x7fc18814cc90 2021-03-25T14:15:43.815 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:43.812+0000 7fc190457700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1880bc2b0 con 0x7fc18814d470 2021-03-25T14:15:43.815 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:43.812+0000 7fc190457700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc188149dd0 con 0x7fc18814d850 2021-03-25T14:15:43.815 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:43.812+0000 7fc18d9f2700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fc18814cc90 0x7fc1880685d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:39816/0 (socket says 172.21.15.110:39816) 2021-03-25T14:15:43.815 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:43.812+0000 7fc18d9f2700 1 -- 172.21.15.110:0/1238777342 learned_addr learned my addr 172.21.15.110:0/1238777342 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:15:43.815 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:43.812+0000 7fc18e9f4700 1 --2- 172.21.15.110:0/1238777342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc18814d850 0x7fc1880bc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:43.815 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:43.813+0000 7fc18e9f4700 1 -- 172.21.15.110:0/1238777342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc18814d850 msgr2=0x7fc1880bc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-03-25T14:15:43.815 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:43.813+0000 7fc18e9f4700 1 -- 172.21.15.110:0/1238777342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc18814d850 msgr2=0x7fc1880bc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-03-25T14:15:43.815 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:43.813+0000 7fc18e9f4700 1 --2- 172.21.15.110:0/1238777342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc18814d850 0x7fc1880bc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-03-25T14:15:43.815 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:43.813+0000 7fc18e9f4700 1 --2- 172.21.15.110:0/1238777342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc18814d850 0x7fc1880bc710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-03-25T14:15:44.016 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:44.014+0000 7fc18e9f4700 1 --2- 172.21.15.110:0/1238777342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc18814d850 0x7fc1880bc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:44.016 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:44.014+0000 7fc18e9f4700 1 -- 172.21.15.110:0/1238777342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc18814d850 msgr2=0x7fc1880bc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-03-25T14:15:44.016 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:44.014+0000 7fc18e9f4700 1 -- 172.21.15.110:0/1238777342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc18814d850 msgr2=0x7fc1880bc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-03-25T14:15:44.017 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:44.014+0000 7fc18e9f4700 1 --2- 172.21.15.110:0/1238777342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc18814d850 0x7fc1880bc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-03-25T14:15:44.017 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:44.014+0000 7fc18e9f4700 1 --2- 172.21.15.110:0/1238777342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc18814d850 0x7fc1880bc710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2021-03-25T14:15:44.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:44.415+0000 7fc18e9f4700 1 --2- 172.21.15.110:0/1238777342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc18814d850 0x7fc1880bc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:44.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:44.415+0000 7fc18e9f4700 1 -- 172.21.15.110:0/1238777342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc18814d850 msgr2=0x7fc1880bc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-03-25T14:15:44.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:44.415+0000 7fc18e9f4700 1 -- 172.21.15.110:0/1238777342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc18814d850 msgr2=0x7fc1880bc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-03-25T14:15:44.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:44.415+0000 7fc18e9f4700 1 --2- 172.21.15.110:0/1238777342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc18814d850 0x7fc1880bc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-03-25T14:15:44.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:44.415+0000 7fc18e9f4700 1 --2- 172.21.15.110:0/1238777342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc18814d850 0x7fc1880bc710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2021-03-25T14:15:45.219 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:45.216+0000 7fc18e9f4700 1 --2- 172.21.15.110:0/1238777342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc18814d850 0x7fc1880bc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:45.219 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:45.216+0000 7fc18e9f4700 1 -- 172.21.15.110:0/1238777342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc18814d850 msgr2=0x7fc1880bc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-03-25T14:15:45.219 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:45.217+0000 7fc18e9f4700 1 -- 172.21.15.110:0/1238777342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc18814d850 msgr2=0x7fc1880bc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-03-25T14:15:45.219 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:45.217+0000 7fc18e9f4700 1 --2- 172.21.15.110:0/1238777342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc18814d850 0x7fc1880bc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-03-25T14:15:45.219 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:45.217+0000 7fc18e9f4700 1 --2- 172.21.15.110:0/1238777342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc18814d850 0x7fc1880bc710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2021-03-25T14:15:46.815 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:46.813+0000 7fc177fff700 1 -- 172.21.15.110:0/1238777342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc18814d850 msgr2=0x7fc1880bc710 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-03-25T14:15:46.815 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:46.813+0000 7fc177fff700 1 --2- 172.21.15.110:0/1238777342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc18814d850 0x7fc1880bc710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:46.816 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:46.813+0000 7fc177fff700 1 -- 172.21.15.110:0/1238777342 >> v1:172.21.15.174:6789/0 conn(0x7fc18814d470 legacy=0x7fc1881493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:46.816 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:46.813+0000 7fc177fff700 1 -- 172.21.15.110:0/1238777342 >> v1:172.21.15.110:6789/0 conn(0x7fc18814cc90 legacy=0x7fc1880685d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:46.816 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:46.813+0000 7fc177fff700 1 --2- 172.21.15.110:0/1238777342 >> v2:172.21.15.174:3300/0 conn(0x7fc168003410 0x7fc168005890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:46.816 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:46.813+0000 7fc177fff700 1 --2- 172.21.15.110:0/1238777342 >> v2:172.21.15.110:3300/0 conn(0x7fc168005e90 0x7fc168008330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:46.816 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:46.813+0000 7fc177fff700 1 -- 172.21.15.110:0/1238777342 --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc188149dd0 con 0x7fc168005e90 2021-03-25T14:15:46.816 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:46.813+0000 7fc177fff700 1 -- 172.21.15.110:0/1238777342 --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc168008990 con 0x7fc168003410 2021-03-25T14:15:46.816 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:46.813+0000 7fc18d9f2700 1 --2- 172.21.15.110:0/1238777342 >> v2:172.21.15.110:3300/0 conn(0x7fc168005e90 0x7fc168008330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:46.816 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:46.813+0000 7fc18e1f3700 1 --2- 172.21.15.110:0/1238777342 >> v2:172.21.15.174:3300/0 conn(0x7fc168003410 0x7fc168005890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:46.816 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:46.813+0000 7fc18d9f2700 1 -- 172.21.15.110:0/1238777342 >> v2:172.21.15.110:3300/0 conn(0x7fc168005e90 msgr2=0x7fc168008330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-03-25T14:15:46.816 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:46.813+0000 7fc18d9f2700 1 -- 172.21.15.110:0/1238777342 >> v2:172.21.15.110:3300/0 conn(0x7fc168005e90 msgr2=0x7fc168008330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-03-25T14:15:46.817 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:46.813+0000 7fc18d9f2700 1 --2- 172.21.15.110:0/1238777342 >> v2:172.21.15.110:3300/0 conn(0x7fc168005e90 0x7fc168008330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-03-25T14:15:46.817 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:46.813+0000 7fc18e1f3700 1 -- 172.21.15.110:0/1238777342 >> v2:172.21.15.174:3300/0 conn(0x7fc168003410 msgr2=0x7fc168005890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-03-25T14:15:46.817 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:46.813+0000 7fc18e1f3700 1 -- 172.21.15.110:0/1238777342 >> v2:172.21.15.174:3300/0 conn(0x7fc168003410 msgr2=0x7fc168005890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-03-25T14:15:46.817 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:46.813+0000 7fc18d9f2700 1 --2- 172.21.15.110:0/1238777342 >> v2:172.21.15.110:3300/0 conn(0x7fc168005e90 0x7fc168008330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-03-25T14:15:46.817 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:46.813+0000 7fc18e1f3700 1 --2- 172.21.15.110:0/1238777342 >> v2:172.21.15.174:3300/0 conn(0x7fc168003410 0x7fc168005890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-03-25T14:15:46.817 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:46.813+0000 7fc18e1f3700 1 --2- 172.21.15.110:0/1238777342 >> v2:172.21.15.174:3300/0 conn(0x7fc168003410 0x7fc168005890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-03-25T14:15:47.016 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:47.014+0000 7fc18d9f2700 1 --2- 172.21.15.110:0/1238777342 >> v2:172.21.15.110:3300/0 conn(0x7fc168005e90 0x7fc168008330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:47.016 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:47.014+0000 7fc18e1f3700 1 --2- 172.21.15.110:0/1238777342 >> v2:172.21.15.174:3300/0 conn(0x7fc168003410 0x7fc168005890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:47.016 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:47.014+0000 7fc18d9f2700 1 -- 172.21.15.110:0/1238777342 >> v2:172.21.15.110:3300/0 conn(0x7fc168005e90 msgr2=0x7fc168008330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-03-25T14:15:47.016 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:47.014+0000 7fc18d9f2700 1 -- 172.21.15.110:0/1238777342 >> v2:172.21.15.110:3300/0 conn(0x7fc168005e90 msgr2=0x7fc168008330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-03-25T14:15:47.016 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:47.014+0000 7fc18d9f2700 1 --2- 172.21.15.110:0/1238777342 >> v2:172.21.15.110:3300/0 conn(0x7fc168005e90 0x7fc168008330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-03-25T14:15:47.017 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:47.014+0000 7fc18d9f2700 1 --2- 172.21.15.110:0/1238777342 >> v2:172.21.15.110:3300/0 conn(0x7fc168005e90 0x7fc168008330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2021-03-25T14:15:47.017 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:47.014+0000 7fc18e1f3700 1 -- 172.21.15.110:0/1238777342 >> v2:172.21.15.174:3300/0 conn(0x7fc168003410 msgr2=0x7fc168005890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-03-25T14:15:47.017 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:47.014+0000 7fc18e1f3700 1 -- 172.21.15.110:0/1238777342 >> v2:172.21.15.174:3300/0 conn(0x7fc168003410 msgr2=0x7fc168005890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-03-25T14:15:47.017 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:47.014+0000 7fc18e1f3700 1 --2- 172.21.15.110:0/1238777342 >> v2:172.21.15.174:3300/0 conn(0x7fc168003410 0x7fc168005890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-03-25T14:15:47.017 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:47.014+0000 7fc18e1f3700 1 --2- 172.21.15.110:0/1238777342 >> v2:172.21.15.174:3300/0 conn(0x7fc168003410 0x7fc168005890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2021-03-25T14:15:47.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:47.415+0000 7fc18d9f2700 1 --2- 172.21.15.110:0/1238777342 >> v2:172.21.15.110:3300/0 conn(0x7fc168005e90 0x7fc168008330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:47.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:47.415+0000 7fc18d9f2700 1 -- 172.21.15.110:0/1238777342 >> v2:172.21.15.110:3300/0 conn(0x7fc168005e90 msgr2=0x7fc168008330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-03-25T14:15:47.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:47.415+0000 7fc18d9f2700 1 -- 172.21.15.110:0/1238777342 >> v2:172.21.15.110:3300/0 conn(0x7fc168005e90 msgr2=0x7fc168008330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-03-25T14:15:47.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:47.415+0000 7fc18d9f2700 1 --2- 172.21.15.110:0/1238777342 >> v2:172.21.15.110:3300/0 conn(0x7fc168005e90 0x7fc168008330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-03-25T14:15:47.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:47.415+0000 7fc18e1f3700 1 --2- 172.21.15.110:0/1238777342 >> v2:172.21.15.174:3300/0 conn(0x7fc168003410 0x7fc168005890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:47.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:47.415+0000 7fc18d9f2700 1 --2- 172.21.15.110:0/1238777342 >> v2:172.21.15.110:3300/0 conn(0x7fc168005e90 0x7fc168008330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2021-03-25T14:15:47.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:47.415+0000 7fc18e1f3700 1 -- 172.21.15.110:0/1238777342 >> v2:172.21.15.174:3300/0 conn(0x7fc168003410 msgr2=0x7fc168005890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-03-25T14:15:47.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:47.415+0000 7fc18e1f3700 1 -- 172.21.15.110:0/1238777342 >> v2:172.21.15.174:3300/0 conn(0x7fc168003410 msgr2=0x7fc168005890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-03-25T14:15:47.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:47.415+0000 7fc18e1f3700 1 --2- 172.21.15.110:0/1238777342 >> v2:172.21.15.174:3300/0 conn(0x7fc168003410 0x7fc168005890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-03-25T14:15:47.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:47.415+0000 7fc18e1f3700 1 --2- 172.21.15.110:0/1238777342 >> v2:172.21.15.174:3300/0 conn(0x7fc168003410 0x7fc168005890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2021-03-25T14:15:48.219 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:48.216+0000 7fc18d9f2700 1 --2- 172.21.15.110:0/1238777342 >> v2:172.21.15.110:3300/0 conn(0x7fc168005e90 0x7fc168008330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:48.219 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:48.216+0000 7fc18d9f2700 1 -- 172.21.15.110:0/1238777342 >> v2:172.21.15.110:3300/0 conn(0x7fc168005e90 msgr2=0x7fc168008330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-03-25T14:15:48.219 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:48.216+0000 7fc18d9f2700 1 -- 172.21.15.110:0/1238777342 >> v2:172.21.15.110:3300/0 conn(0x7fc168005e90 msgr2=0x7fc168008330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-03-25T14:15:48.219 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:48.216+0000 7fc18d9f2700 1 --2- 172.21.15.110:0/1238777342 >> v2:172.21.15.110:3300/0 conn(0x7fc168005e90 0x7fc168008330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-03-25T14:15:48.219 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:48.216+0000 7fc18d9f2700 1 --2- 172.21.15.110:0/1238777342 >> v2:172.21.15.110:3300/0 conn(0x7fc168005e90 0x7fc168008330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2021-03-25T14:15:48.219 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:48.216+0000 7fc18e1f3700 1 --2- 172.21.15.110:0/1238777342 >> v2:172.21.15.174:3300/0 conn(0x7fc168003410 0x7fc168005890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:48.219 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:48.216+0000 7fc18e1f3700 1 -- 172.21.15.110:0/1238777342 >> v2:172.21.15.174:3300/0 conn(0x7fc168003410 msgr2=0x7fc168005890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-03-25T14:15:48.220 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:48.216+0000 7fc18e1f3700 1 -- 172.21.15.110:0/1238777342 >> v2:172.21.15.174:3300/0 conn(0x7fc168003410 msgr2=0x7fc168005890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-03-25T14:15:48.220 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:48.216+0000 7fc18e1f3700 1 --2- 172.21.15.110:0/1238777342 >> v2:172.21.15.174:3300/0 conn(0x7fc168003410 0x7fc168005890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-03-25T14:15:48.220 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:48.216+0000 7fc18e1f3700 1 --2- 172.21.15.110:0/1238777342 >> v2:172.21.15.174:3300/0 conn(0x7fc168003410 0x7fc168005890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2021-03-25T14:15:49.817 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.812+0000 7fc177fff700 1 -- 172.21.15.110:0/1238777342 >> v2:172.21.15.174:3300/0 conn(0x7fc168003410 msgr2=0x7fc168005890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-03-25T14:15:49.817 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.812+0000 7fc177fff700 1 --2- 172.21.15.110:0/1238777342 >> v2:172.21.15.174:3300/0 conn(0x7fc168003410 0x7fc168005890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:49.817 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.812+0000 7fc177fff700 1 -- 172.21.15.110:0/1238777342 >> v2:172.21.15.110:3300/0 conn(0x7fc168005e90 msgr2=0x7fc168008330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-03-25T14:15:49.817 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.812+0000 7fc177fff700 1 --2- 172.21.15.110:0/1238777342 >> v2:172.21.15.110:3300/0 conn(0x7fc168005e90 0x7fc168008330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:49.817 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.812+0000 7fc18e9f4700 1 -- 172.21.15.110:0/1238777342 reap_dead start 2021-03-25T14:15:49.817 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.812+0000 7fc177fff700 1 --2- 172.21.15.110:0/1238777342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc18814d850 0x7fc16800ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:49.817 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.812+0000 7fc177fff700 1 --2- 172.21.15.110:0/1238777342 >> v2:172.21.15.174:3300/0 conn(0x7fc168003860 0x7fc168006270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:49.817 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.813+0000 7fc177fff700 1 -- 172.21.15.110:0/1238777342 --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc18814a070 con 0x7fc168006760 2021-03-25T14:15:49.817 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.813+0000 7fc177fff700 1 -- 172.21.15.110:0/1238777342 --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc188149dd0 con 0x7fc168003860 2021-03-25T14:15:49.817 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.813+0000 7fc177fff700 1 -- 172.21.15.110:0/1238777342 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc168008990 con 0x7fc18814d850 2021-03-25T14:15:49.818 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.813+0000 7fc18d9f2700 1 --2- 172.21.15.110:0/1238777342 >> v2:172.21.15.174:3300/0 conn(0x7fc168003860 0x7fc168006270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:49.818 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.813+0000 7fc18e1f3700 1 --2- 172.21.15.110:0/1238777342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc18814d850 0x7fc16800ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:49.818 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.813+0000 7fc18d1f1700 1 -- 172.21.15.110:0/1238777342 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1079140390 0 0) 0x7fc18814a070 con 0x7fc168006760 2021-03-25T14:15:49.818 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.813+0000 7fc18d1f1700 1 -- 172.21.15.110:0/1238777342 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc170003270 con 0x7fc168006760 2021-03-25T14:15:49.818 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.813+0000 7fc18e1f3700 1 -- 172.21.15.110:0/1238777342 >> v2:172.21.15.174:3300/0 conn(0x7fc168003860 msgr2=0x7fc168006270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:15:49.818 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.813+0000 7fc18e1f3700 1 --2- 172.21.15.110:0/1238777342 >> v2:172.21.15.174:3300/0 conn(0x7fc168003860 0x7fc168006270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:49.818 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.813+0000 7fc18e1f3700 1 -- 172.21.15.110:0/1238777342 >> v1:172.21.15.110:6789/0 conn(0x7fc168006760 legacy=0x7fc168006be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:49.818 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.813+0000 7fc18e1f3700 1 -- 172.21.15.110:0/1238777342 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1680084e0 con 0x7fc18814d850 2021-03-25T14:15:49.818 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.813+0000 7fc18d9f2700 1 --2- 172.21.15.110:0/1238777342 >> v2:172.21.15.174:3300/0 conn(0x7fc168003860 0x7fc168006270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:15:49.818 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.813+0000 7fc18e1f3700 1 --2- 172.21.15.110:0/1238777342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc18814d850 0x7fc16800ae10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fc1840079d0 tx=0x7fc184009040).ready entity=mon.2 client_cookie=8c2c3996a6430454 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:15:49.818 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.814+0000 7fc18d1f1700 1 -- 172.21.15.110:0/1238777342 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1840166a0 con 0x7fc18814d850 2021-03-25T14:15:49.818 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.814+0000 7fc18d1f1700 1 -- 172.21.15.110:0/1238777342 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc184016800 con 0x7fc18814d850 2021-03-25T14:15:49.819 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.814+0000 7fc18d1f1700 1 -- 172.21.15.110:0/1238777342 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc184016ba0 con 0x7fc18814d850 2021-03-25T14:15:49.819 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.814+0000 7fc190457700 1 -- 172.21.15.110:0/1238777342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc18814d850 msgr2=0x7fc16800ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:49.819 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.814+0000 7fc190457700 1 --2- 172.21.15.110:0/1238777342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc18814d850 0x7fc16800ae10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fc1840079d0 tx=0x7fc184009040).stop 2021-03-25T14:15:49.819 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.814+0000 7fc190457700 1 -- 172.21.15.110:0/1238777342 shutdown_connections 2021-03-25T14:15:49.819 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.814+0000 7fc190457700 1 --2- 172.21.15.110:0/1238777342 >> v2:172.21.15.174:3300/0 conn(0x7fc168003860 0x7fc168006270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:49.819 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.814+0000 7fc190457700 1 --2- 172.21.15.110:0/1238777342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc18814d850 0x7fc16800ae10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:49.819 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.814+0000 7fc190457700 1 -- 172.21.15.110:0/1238777342 >> 172.21.15.110:0/1238777342 conn(0x7fc188060c40 msgr2=0x7fc188061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:15:49.819 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.814+0000 7fc190457700 1 -- 172.21.15.110:0/1238777342 shutdown_connections 2021-03-25T14:15:49.819 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.814+0000 7fc190457700 1 -- 172.21.15.110:0/1238777342 wait complete. 2021-03-25T14:15:49.822 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.816+0000 7fc190457700 1 Processor -- start 2021-03-25T14:15:49.822 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.816+0000 7fc190457700 1 -- start start 2021-03-25T14:15:49.822 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.816+0000 7fc190457700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc168003860 0x7fc1880b86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:49.822 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.816+0000 7fc190457700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc168006760 0x7fc1880b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:49.822 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.816+0000 7fc190457700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc18814d850 0x7fc1880b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:49.822 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.816+0000 7fc190457700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1880a2160 con 0x7fc168003860 2021-03-25T14:15:49.822 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.816+0000 7fc190457700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1881594b0 con 0x7fc168006760 2021-03-25T14:15:49.823 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.816+0000 7fc190457700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc188159750 con 0x7fc18814d850 2021-03-25T14:15:49.823 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.816+0000 7fc18e1f3700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc168003860 0x7fc1880b86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:49.823 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.817+0000 7fc18e1f3700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc168003860 0x7fc1880b86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46950/0 (socket says 172.21.15.110:46950) 2021-03-25T14:15:49.823 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.817+0000 7fc18e1f3700 1 -- 172.21.15.110:0/2402188580 learned_addr learned my addr 172.21.15.110:0/2402188580 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:15:49.823 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.817+0000 7fc18d9f2700 1 --2- 172.21.15.110:0/2402188580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc168006760 0x7fc1880b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:49.823 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.817+0000 7fc18e9f4700 1 --2- 172.21.15.110:0/2402188580 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc18814d850 0x7fc1880b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:49.823 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.817+0000 7fc18e1f3700 1 -- 172.21.15.110:0/2402188580 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc18814d850 msgr2=0x7fc1880b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:49.823 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.817+0000 7fc18e1f3700 1 --2- 172.21.15.110:0/2402188580 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc18814d850 0x7fc1880b93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:49.823 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.817+0000 7fc18e1f3700 1 -- 172.21.15.110:0/2402188580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc168006760 msgr2=0x7fc1880b8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:49.823 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.817+0000 7fc18e1f3700 1 --2- 172.21.15.110:0/2402188580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc168006760 0x7fc1880b8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:49.823 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.817+0000 7fc18e1f3700 1 -- 172.21.15.110:0/2402188580 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1880a2390 con 0x7fc168003860 2021-03-25T14:15:49.823 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.817+0000 7fc18e1f3700 1 --2- 172.21.15.110:0/2402188580 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc168003860 0x7fc1880b86a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fc1680084b0 tx=0x7fc184009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:15:49.823 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.817+0000 7fc1767fc700 1 -- 172.21.15.110:0/2402188580 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc184026030 con 0x7fc168003860 2021-03-25T14:15:49.823 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.817+0000 7fc1767fc700 1 -- 172.21.15.110:0/2402188580 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc184000ed0 con 0x7fc168003860 2021-03-25T14:15:49.824 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.817+0000 7fc190457700 1 -- 172.21.15.110:0/2402188580 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1880a2630 con 0x7fc168003860 2021-03-25T14:15:49.824 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.817+0000 7fc1767fc700 1 -- 172.21.15.110:0/2402188580 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc184007240 con 0x7fc168003860 2021-03-25T14:15:49.824 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.817+0000 7fc190457700 1 -- 172.21.15.110:0/2402188580 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1880a55e0 con 0x7fc168003860 2021-03-25T14:15:49.824 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.817+0000 7fc1767fc700 1 -- 172.21.15.110:0/2402188580 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) v1 ==== 623+0+0 (secure 0 0 0) 0x7fc184013040 con 0x7fc168003860 2021-03-25T14:15:49.824 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.817+0000 7fc1767fc700 1 -- 172.21.15.110:0/2402188580 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7fc184027070 con 0x7fc168003860 2021-03-25T14:15:49.824 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.818+0000 7fc190457700 1 -- 172.21.15.110:0/2402188580 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1880b91e0 con 0x7fc168003860 2021-03-25T14:15:49.824 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.820+0000 7fc1767fc700 1 -- 172.21.15.110:0/2402188580 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72044 (secure 0 0 0) 0x7fc184006dd0 con 0x7fc168003860 2021-03-25T14:15:49.894 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.892+0000 7fc190457700 1 -- 172.21.15.110:0/2402188580 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fc1880b91e0 con 0x7fc168003860 2021-03-25T14:15:49.896 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.895+0000 7fc1767fc700 1 -- 172.21.15.110:0/2402188580 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fc18403a090 con 0x7fc168003860 2021-03-25T14:15:49.898 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.895+0000 7fc190457700 1 -- 172.21.15.110:0/2402188580 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc168003860 msgr2=0x7fc1880b86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:49.898 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.895+0000 7fc190457700 1 --2- 172.21.15.110:0/2402188580 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc168003860 0x7fc1880b86a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fc1680084b0 tx=0x7fc184009040).stop 2021-03-25T14:15:49.898 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.895+0000 7fc190457700 1 -- 172.21.15.110:0/2402188580 shutdown_connections 2021-03-25T14:15:49.898 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.895+0000 7fc190457700 1 --2- 172.21.15.110:0/2402188580 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc18814d850 0x7fc1880b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:49.898 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.895+0000 7fc190457700 1 --2- 172.21.15.110:0/2402188580 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc168003860 0x7fc1880b86a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:49.898 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.895+0000 7fc190457700 1 --2- 172.21.15.110:0/2402188580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc168006760 0x7fc1880b8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:49.898 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.896+0000 7fc190457700 1 -- 172.21.15.110:0/2402188580 >> 172.21.15.110:0/2402188580 conn(0x7fc188060c40 msgr2=0x7fc188148000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:15:49.898 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.896+0000 7fc190457700 1 -- 172.21.15.110:0/2402188580 shutdown_connections 2021-03-25T14:15:49.898 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:15:49.896+0000 7fc190457700 1 -- 172.21.15.110:0/2402188580 wait complete. 2021-03-25T14:15:49.898 INFO:teuthology.orchestra.run.smithi110.stderr:adjusted tunables profile to default 2021-03-25T14:15:49.910 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2021-03-25T14:15:49.910 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2021-03-25T14:15:49.910 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2021-03-25T14:15:49.935 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2021-03-25T14:15:49.935 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2021-03-25T14:15:49.999 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2021-03-25T14:15:50.000 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2021-03-25T14:15:50.065 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2021-03-25T14:15:50.065 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2021-03-25T14:15:50.128 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2021-03-25T14:15:50.128 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2021-03-25T14:15:50.152 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2021-03-25T14:15:50.152 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2021-03-25T14:15:50.216 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2021-03-25T14:15:50.216 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2021-03-25T14:15:50.280 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2021-03-25T14:15:50.280 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2021-03-25T14:15:50.345 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new e307a1d3-b0e0-4ee4-b163-a060d9b0df2f 0 2021-03-25T14:15:50.496 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.495+0000 7f6e47fd4700 1 Processor -- start 2021-03-25T14:15:50.496 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.495+0000 7f6e47fd4700 1 -- start start 2021-03-25T14:15:50.499 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.495+0000 7f6e47fd4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e40064800 0x7f6e40064be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:50.499 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.495+0000 7f6e47fd4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6e40066c30 0x7f6e40065620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:50.500 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.495+0000 7f6e47fd4700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e4014cf60 con 0x7f6e40065b10 2021-03-25T14:15:50.500 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.495+0000 7f6e47fd4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e4014d200 con 0x7f6e40066c30 2021-03-25T14:15:50.500 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.495+0000 7f6e47fd4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4014d4a0 con 0x7f6e40064800 2021-03-25T14:15:50.500 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.496+0000 7f6e45d70700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e40064800 0x7f6e40064be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:50.500 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.496+0000 7f6e4556f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6e40066c30 0x7f6e40065620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:50.500 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.496+0000 7f6e4556f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6e40066c30 0x7f6e40065620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:46704/0 (socket says 172.21.15.174:46704) 2021-03-25T14:15:50.500 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.496+0000 7f6e45d70700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e40064800 0x7f6e40064be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:34356/0 (socket says 172.21.15.174:34356) 2021-03-25T14:15:50.500 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.496+0000 7f6e4556f700 1 -- 172.21.15.174:0/425340087 learned_addr learned my addr 172.21.15.174:0/425340087 (peer_addr_for_me v2:172.21.15.174:0/0) 2021-03-25T14:15:50.500 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.496+0000 7f6e4556f700 1 -- 172.21.15.174:0/425340087 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e40064800 msgr2=0x7f6e40064be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:15:50.500 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.496+0000 7f6e4556f700 1 --2- 172.21.15.174:0/425340087 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e40064800 0x7f6e40064be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:50.501 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.496+0000 7f6e4556f700 1 -- 172.21.15.174:0/425340087 >> v1:172.21.15.110:6789/0 conn(0x7f6e40065b10 legacy=0x7f6e40148db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:50.501 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.496+0000 7f6e4556f700 1 -- 172.21.15.174:0/425340087 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e4014d740 con 0x7f6e40066c30 2021-03-25T14:15:50.501 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.496+0000 7f6e45d70700 1 --2- 172.21.15.174:0/425340087 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e40064800 0x7f6e40064be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:15:50.501 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.496+0000 7f6e4556f700 1 --2- 172.21.15.174:0/425340087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e40066c30 0x7f6e40065620 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f6e3c00ba20 tx=0x7f6e3c006ee0).ready entity=mon.1 client_cookie=e614d8aaace99eed server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:15:50.501 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.496+0000 7f6e44d6e700 1 -- 172.21.15.174:0/425340087 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c009840 con 0x7f6e40066c30 2021-03-25T14:15:50.501 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.496+0000 7f6e44d6e700 1 -- 172.21.15.174:0/425340087 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3c0099a0 con 0x7f6e40066c30 2021-03-25T14:15:50.501 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.496+0000 7f6e44d6e700 1 -- 172.21.15.174:0/425340087 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c009d20 con 0x7f6e40066c30 2021-03-25T14:15:50.501 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.497+0000 7f6e47fd4700 1 -- 172.21.15.174:0/425340087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e40066c30 msgr2=0x7f6e40065620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:50.501 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.497+0000 7f6e47fd4700 1 --2- 172.21.15.174:0/425340087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e40066c30 0x7f6e40065620 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f6e3c00ba20 tx=0x7f6e3c006ee0).stop 2021-03-25T14:15:50.501 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.497+0000 7f6e47fd4700 1 -- 172.21.15.174:0/425340087 shutdown_connections 2021-03-25T14:15:50.501 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.497+0000 7f6e47fd4700 1 --2- 172.21.15.174:0/425340087 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e40064800 0x7f6e40064be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:50.501 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.497+0000 7f6e47fd4700 1 --2- 172.21.15.174:0/425340087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e40066c30 0x7f6e40065620 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:50.501 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.497+0000 7f6e47fd4700 1 -- 172.21.15.174:0/425340087 >> 172.21.15.174:0/425340087 conn(0x7f6e40060c40 msgr2=0x7f6e40061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:15:50.502 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.497+0000 7f6e47fd4700 1 -- 172.21.15.174:0/425340087 shutdown_connections 2021-03-25T14:15:50.502 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.497+0000 7f6e47fd4700 1 -- 172.21.15.174:0/425340087 wait complete. 2021-03-25T14:15:50.502 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.498+0000 7f6e47fd4700 1 Processor -- start 2021-03-25T14:15:50.502 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.498+0000 7f6e47fd4700 1 -- start start 2021-03-25T14:15:50.505 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.499+0000 7f6e47fd4700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e40064800 0x7f6e400b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:50.505 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.499+0000 7f6e47fd4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e40065b10 0x7f6e40147b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:50.505 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.499+0000 7f6e47fd4700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e40066c30 0x7f6e400b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:50.505 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.499+0000 7f6e47fd4700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e400b4e00 con 0x7f6e40066c30 2021-03-25T14:15:50.505 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.499+0000 7f6e47fd4700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e400a0e60 con 0x7f6e40064800 2021-03-25T14:15:50.505 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.499+0000 7f6e47fd4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e400a1100 con 0x7f6e40065b10 2021-03-25T14:15:50.505 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.499+0000 7f6e45d70700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e40064800 0x7f6e400b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:50.505 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.499+0000 7f6e4556f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e40065b10 0x7f6e40147b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:50.506 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.499+0000 7f6e45d70700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e40064800 0x7f6e400b7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:46706/0 (socket says 172.21.15.174:46706) 2021-03-25T14:15:50.506 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.499+0000 7f6e45d70700 1 -- 172.21.15.174:0/1984372048 learned_addr learned my addr 172.21.15.174:0/1984372048 (peer_addr_for_me v2:172.21.15.174:0/0) 2021-03-25T14:15:50.506 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.499+0000 7f6e46571700 1 --2- 172.21.15.174:0/1984372048 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e40066c30 0x7f6e400b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:50.506 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.499+0000 7f6e45d70700 1 -- 172.21.15.174:0/1984372048 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e40065b10 msgr2=0x7f6e40147b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:50.506 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.499+0000 7f6e45d70700 1 --2- 172.21.15.174:0/1984372048 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e40065b10 0x7f6e40147b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:50.506 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.499+0000 7f6e45d70700 1 -- 172.21.15.174:0/1984372048 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e40066c30 msgr2=0x7f6e400b63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:50.506 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.499+0000 7f6e45d70700 1 --2- 172.21.15.174:0/1984372048 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e40066c30 0x7f6e400b63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:50.506 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.499+0000 7f6e45d70700 1 -- 172.21.15.174:0/1984372048 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e400a13a0 con 0x7f6e40064800 2021-03-25T14:15:50.506 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.499+0000 7f6e45d70700 1 --2- 172.21.15.174:0/1984372048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e40064800 0x7f6e400b7850 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f6e3000ef20 tx=0x7f6e30006e20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:15:50.506 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.499+0000 7f6e2dffb700 1 -- 172.21.15.174:0/1984372048 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3000cbc0 con 0x7f6e40064800 2021-03-25T14:15:50.506 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.499+0000 7f6e2dffb700 1 -- 172.21.15.174:0/1984372048 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3000cd20 con 0x7f6e40064800 2021-03-25T14:15:50.506 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.499+0000 7f6e47fd4700 1 -- 172.21.15.174:0/1984372048 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e400a35a0 con 0x7f6e40064800 2021-03-25T14:15:50.507 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.499+0000 7f6e2dffb700 1 -- 172.21.15.174:0/1984372048 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e30012600 con 0x7f6e40064800 2021-03-25T14:15:50.507 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.499+0000 7f6e47fd4700 1 -- 172.21.15.174:0/1984372048 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e400b7d40 con 0x7f6e40064800 2021-03-25T14:15:50.507 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.500+0000 7f6e2dffb700 1 -- 172.21.15.174:0/1984372048 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 1) v1 ==== 623+0+0 (secure 0 0 0) 0x7f6e30012970 con 0x7f6e40064800 2021-03-25T14:15:50.507 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.500+0000 7f6e2dffb700 1 -- 172.21.15.174:0/1984372048 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7f6e3001ca90 con 0x7f6e40064800 2021-03-25T14:15:50.507 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.500+0000 7f6e47fd4700 1 -- 172.21.15.174:0/1984372048 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e400a3a00 con 0x7f6e40064800 2021-03-25T14:15:50.507 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.504+0000 7f6e2dffb700 1 -- 172.21.15.174:0/1984372048 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72044 (secure 0 0 0) 0x7f6e3000ce90 con 0x7f6e40064800 2021-03-25T14:15:50.581 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.580+0000 7f6e47fd4700 1 -- 172.21.15.174:0/1984372048 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e307a1d3-b0e0-4ee4-b163-a060d9b0df2f", "id": 0} v 0) v1 -- 0x7f6e400a1530 con 0x7f6e40064800 2021-03-25T14:15:50.586 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.584+0000 7f6e2dffb700 1 -- 172.21.15.174:0/1984372048 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e307a1d3-b0e0-4ee4-b163-a060d9b0df2f", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6e30012d90 con 0x7f6e40064800 2021-03-25T14:15:50.586 INFO:teuthology.orchestra.run.smithi174.stdout:0 2021-03-25T14:15:50.587 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.585+0000 7f6e47fd4700 1 -- 172.21.15.174:0/1984372048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e40064800 msgr2=0x7f6e400b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:50.587 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.585+0000 7f6e47fd4700 1 --2- 172.21.15.174:0/1984372048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e40064800 0x7f6e400b7850 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f6e3000ef20 tx=0x7f6e30006e20).stop 2021-03-25T14:15:50.587 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.585+0000 7f6e47fd4700 1 -- 172.21.15.174:0/1984372048 shutdown_connections 2021-03-25T14:15:50.587 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.585+0000 7f6e47fd4700 1 --2- 172.21.15.174:0/1984372048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e40064800 0x7f6e400b7850 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:50.587 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.585+0000 7f6e47fd4700 1 --2- 172.21.15.174:0/1984372048 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e40066c30 0x7f6e400b63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:50.587 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.585+0000 7f6e47fd4700 1 --2- 172.21.15.174:0/1984372048 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e40065b10 0x7f6e40147b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:50.587 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.585+0000 7f6e47fd4700 1 -- 172.21.15.174:0/1984372048 >> 172.21.15.174:0/1984372048 conn(0x7f6e40060c40 msgr2=0x7f6e400a0200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:15:50.588 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.585+0000 7f6e47fd4700 1 -- 172.21.15.174:0/1984372048 shutdown_connections 2021-03-25T14:15:50.588 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.585+0000 7f6e47fd4700 1 -- 172.21.15.174:0/1984372048 wait complete. 2021-03-25T14:15:50.598 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new 4da77e5e-0b28-4b7d-abd6-21a2769adb41 1 2021-03-25T14:15:50.710 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.708+0000 7f243c1a4700 1 Processor -- start 2021-03-25T14:15:50.710 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.708+0000 7f243c1a4700 1 -- start start 2021-03-25T14:15:50.713 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.709+0000 7f243c1a4700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f24340b0cc0 0x7f2434145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:50.713 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.709+0000 7f243c1a4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f24340b5d00 0x7f2434067250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:50.713 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.709+0000 7f243c1a4700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2434149c50 con 0x7f24340648a0 2021-03-25T14:15:50.713 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.709+0000 7f243c1a4700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24341461b0 con 0x7f24340b0cc0 2021-03-25T14:15:50.713 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.709+0000 7f243c1a4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2434149e80 con 0x7f24340b5d00 2021-03-25T14:15:50.713 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.709+0000 7f243973f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f24340b5d00 0x7f2434067250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:50.714 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.709+0000 7f243973f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f24340b5d00 0x7f2434067250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:46712/0 (socket says 172.21.15.174:46712) 2021-03-25T14:15:50.714 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.709+0000 7f243973f700 1 -- 172.21.15.174:0/2274330532 learned_addr learned my addr 172.21.15.174:0/2274330532 (peer_addr_for_me v2:172.21.15.174:0/0) 2021-03-25T14:15:50.714 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.709+0000 7f2439f40700 1 --2- 172.21.15.174:0/2274330532 >> v2:172.21.15.110:3300/0 conn(0x7f24340b0cc0 0x7f2434145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:50.714 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.710+0000 7f243973f700 1 -- 172.21.15.174:0/2274330532 >> v2:172.21.15.110:3300/0 conn(0x7f24340b0cc0 msgr2=0x7f2434145cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:15:50.714 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.710+0000 7f243973f700 1 --2- 172.21.15.174:0/2274330532 >> v2:172.21.15.110:3300/0 conn(0x7f24340b0cc0 0x7f2434145cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:50.714 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.710+0000 7f243973f700 1 -- 172.21.15.174:0/2274330532 >> v1:172.21.15.110:6789/0 conn(0x7f24340648a0 legacy=0x7f243409db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:50.714 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.710+0000 7f243973f700 1 -- 172.21.15.174:0/2274330532 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24340b6650 con 0x7f24340b5d00 2021-03-25T14:15:50.714 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.710+0000 7f2438f3e700 1 -- 172.21.15.174:0/2274330532 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3862348051 0 0) 0x7f2434149c50 con 0x7f24340648a0 2021-03-25T14:15:50.714 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.710+0000 7f243973f700 1 --2- 172.21.15.174:0/2274330532 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24340b5d00 0x7f2434067250 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f24340a1db0 tx=0x7f2430006ee0).ready entity=mon.1 client_cookie=35d68ce65a1f68a7 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:15:50.715 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.710+0000 7f2438f3e700 1 -- 172.21.15.174:0/2274330532 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24300098d0 con 0x7f24340b5d00 2021-03-25T14:15:50.715 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.710+0000 7f2438f3e700 1 -- 172.21.15.174:0/2274330532 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2430009a30 con 0x7f24340b5d00 2021-03-25T14:15:50.715 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.710+0000 7f2438f3e700 1 -- 172.21.15.174:0/2274330532 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2430009db0 con 0x7f24340b5d00 2021-03-25T14:15:50.715 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.710+0000 7f243c1a4700 1 -- 172.21.15.174:0/2274330532 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24340b5d00 msgr2=0x7f2434067250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:50.715 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.710+0000 7f243c1a4700 1 --2- 172.21.15.174:0/2274330532 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24340b5d00 0x7f2434067250 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f24340a1db0 tx=0x7f2430006ee0).stop 2021-03-25T14:15:50.715 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.710+0000 7f243c1a4700 1 -- 172.21.15.174:0/2274330532 shutdown_connections 2021-03-25T14:15:50.715 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.710+0000 7f243c1a4700 1 --2- 172.21.15.174:0/2274330532 >> v2:172.21.15.110:3300/0 conn(0x7f24340b0cc0 0x7f2434145cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:50.715 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.710+0000 7f243c1a4700 1 --2- 172.21.15.174:0/2274330532 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24340b5d00 0x7f2434067250 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:50.715 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.710+0000 7f243c1a4700 1 -- 172.21.15.174:0/2274330532 >> 172.21.15.174:0/2274330532 conn(0x7f24340664e0 msgr2=0x7f24340668f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:15:50.715 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.711+0000 7f243c1a4700 1 -- 172.21.15.174:0/2274330532 shutdown_connections 2021-03-25T14:15:50.715 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.711+0000 7f243c1a4700 1 -- 172.21.15.174:0/2274330532 wait complete. 2021-03-25T14:15:50.715 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.712+0000 7f243c1a4700 1 Processor -- start 2021-03-25T14:15:50.715 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.712+0000 7f243c1a4700 1 -- start start 2021-03-25T14:15:50.718 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.712+0000 7f243c1a4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24340648a0 0x7f24340a12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:50.718 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.712+0000 7f243c1a4700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24340b0cc0 0x7f24340b4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:50.718 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.712+0000 7f243c1a4700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24340b5d00 0x7f243414b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:50.718 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.712+0000 7f243c1a4700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243409e290 con 0x7f24340b5d00 2021-03-25T14:15:50.718 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.712+0000 7f243c1a4700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24340b2ac0 con 0x7f24340b0cc0 2021-03-25T14:15:50.718 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.712+0000 7f243c1a4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24340b2d60 con 0x7f24340648a0 2021-03-25T14:15:50.718 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.712+0000 7f243973f700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24340b0cc0 0x7f24340b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:50.719 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.712+0000 7f2439f40700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24340648a0 0x7f24340a12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:50.719 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.712+0000 7f243973f700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24340b0cc0 0x7f24340b4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:46720/0 (socket says 172.21.15.174:46720) 2021-03-25T14:15:50.719 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.712+0000 7f243973f700 1 -- 172.21.15.174:0/259038232 learned_addr learned my addr 172.21.15.174:0/259038232 (peer_addr_for_me v2:172.21.15.174:0/0) 2021-03-25T14:15:50.719 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.712+0000 7f243a741700 1 --2- 172.21.15.174:0/259038232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24340b5d00 0x7f243414b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:50.719 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.713+0000 7f243973f700 1 -- 172.21.15.174:0/259038232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24340648a0 msgr2=0x7f24340a12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:50.719 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.713+0000 7f243973f700 1 --2- 172.21.15.174:0/259038232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24340648a0 0x7f24340a12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:50.719 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.713+0000 7f243973f700 1 -- 172.21.15.174:0/259038232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24340b5d00 msgr2=0x7f243414b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:50.719 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.713+0000 7f243973f700 1 --2- 172.21.15.174:0/259038232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24340b5d00 0x7f243414b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:50.719 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.713+0000 7f243973f700 1 -- 172.21.15.174:0/259038232 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24340b3000 con 0x7f24340b0cc0 2021-03-25T14:15:50.719 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.713+0000 7f2439f40700 1 --2- 172.21.15.174:0/259038232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24340648a0 0x7f24340a12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:15:50.720 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.713+0000 7f243973f700 1 --2- 172.21.15.174:0/259038232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24340b0cc0 0x7f24340b4620 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f2430006f20 tx=0x7f2430016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:15:50.720 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.713+0000 7f2421ffb700 1 -- 172.21.15.174:0/259038232 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2430012c90 con 0x7f24340b0cc0 2021-03-25T14:15:50.720 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.713+0000 7f2421ffb700 1 -- 172.21.15.174:0/259038232 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2430012df0 con 0x7f24340b0cc0 2021-03-25T14:15:50.720 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.713+0000 7f2421ffb700 1 -- 172.21.15.174:0/259038232 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243001c650 con 0x7f24340b0cc0 2021-03-25T14:15:50.720 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.713+0000 7f243c1a4700 1 -- 172.21.15.174:0/259038232 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24340b86a0 con 0x7f24340b0cc0 2021-03-25T14:15:50.720 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.713+0000 7f243c1a4700 1 -- 172.21.15.174:0/259038232 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24340b4b10 con 0x7f24340b0cc0 2021-03-25T14:15:50.720 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.713+0000 7f2421ffb700 1 -- 172.21.15.174:0/259038232 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 1) v1 ==== 623+0+0 (secure 0 0 0) 0x7f243000f070 con 0x7f24340b0cc0 2021-03-25T14:15:50.721 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.713+0000 7f2421ffb700 1 -- 172.21.15.174:0/259038232 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7f2430026cd0 con 0x7f24340b0cc0 2021-03-25T14:15:50.721 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.714+0000 7f243c1a4700 1 -- 172.21.15.174:0/259038232 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2434149080 con 0x7f24340b0cc0 2021-03-25T14:15:50.721 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.718+0000 7f2421ffb700 1 -- 172.21.15.174:0/259038232 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72044 (secure 0 0 0) 0x7f2430016070 con 0x7f24340b0cc0 2021-03-25T14:15:50.798 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.796+0000 7f243c1a4700 1 -- 172.21.15.174:0/259038232 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4da77e5e-0b28-4b7d-abd6-21a2769adb41", "id": 1} v 0) v1 -- 0x7f24340b3a80 con 0x7f24340b0cc0 2021-03-25T14:15:50.802 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.801+0000 7f2421ffb700 1 -- 172.21.15.174:0/259038232 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4da77e5e-0b28-4b7d-abd6-21a2769adb41", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f243001cde0 con 0x7f24340b0cc0 2021-03-25T14:15:50.803 INFO:teuthology.orchestra.run.smithi174.stdout:1 2021-03-25T14:15:50.804 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.802+0000 7f243c1a4700 1 -- 172.21.15.174:0/259038232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24340b0cc0 msgr2=0x7f24340b4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:50.804 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.802+0000 7f243c1a4700 1 --2- 172.21.15.174:0/259038232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24340b0cc0 0x7f24340b4620 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f2430006f20 tx=0x7f2430016000).stop 2021-03-25T14:15:50.804 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.802+0000 7f243c1a4700 1 -- 172.21.15.174:0/259038232 shutdown_connections 2021-03-25T14:15:50.804 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.802+0000 7f243c1a4700 1 --2- 172.21.15.174:0/259038232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24340b5d00 0x7f243414b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:50.804 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.802+0000 7f243c1a4700 1 --2- 172.21.15.174:0/259038232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24340648a0 0x7f24340a12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:50.804 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.802+0000 7f243c1a4700 1 --2- 172.21.15.174:0/259038232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24340b0cc0 0x7f24340b4620 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:50.804 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.802+0000 7f243c1a4700 1 -- 172.21.15.174:0/259038232 >> 172.21.15.174:0/259038232 conn(0x7f24340664e0 msgr2=0x7f24341464b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:15:50.804 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.802+0000 7f243c1a4700 1 -- 172.21.15.174:0/259038232 shutdown_connections 2021-03-25T14:15:50.804 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.802+0000 7f243c1a4700 1 -- 172.21.15.174:0/259038232 wait complete. 2021-03-25T14:15:50.815 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new 99589dc9-e1d0-461a-aa93-fa6b4bca4411 2 2021-03-25T14:15:50.926 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.924+0000 7fd22d71e700 1 Processor -- start 2021-03-25T14:15:50.926 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.925+0000 7fd22d71e700 1 -- start start 2021-03-25T14:15:50.929 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.925+0000 7fd22d71e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd22814cc90 0x7fd22814d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:50.929 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.925+0000 7fd22d71e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd2280685d0 0x7fd228068a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:50.929 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.925+0000 7fd22d71e700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2280691b0 con 0x7fd22814d470 2021-03-25T14:15:50.929 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.925+0000 7fd22d71e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2280bc2b0 con 0x7fd2280685d0 2021-03-25T14:15:50.929 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.925+0000 7fd22d71e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd228149dd0 con 0x7fd22814cc90 2021-03-25T14:15:50.930 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.925+0000 7fd21ffff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd22814cc90 0x7fd22814d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:50.930 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.925+0000 7fd2277fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd2280685d0 0x7fd228068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:50.930 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.925+0000 7fd21ffff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd22814cc90 0x7fd22814d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:34380/0 (socket says 172.21.15.174:34380) 2021-03-25T14:15:50.930 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.925+0000 7fd21ffff700 1 -- 172.21.15.174:0/603511661 learned_addr learned my addr 172.21.15.174:0/603511661 (peer_addr_for_me v2:172.21.15.174:0/0) 2021-03-25T14:15:50.930 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.926+0000 7fd2277fe700 1 -- 172.21.15.174:0/603511661 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd22814cc90 msgr2=0x7fd22814d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:15:50.930 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.926+0000 7fd2277fe700 1 --2- 172.21.15.174:0/603511661 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd22814cc90 0x7fd22814d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:50.930 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.926+0000 7fd2277fe700 1 -- 172.21.15.174:0/603511661 >> v1:172.21.15.110:6789/0 conn(0x7fd22814d470 legacy=0x7fd2281493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:50.930 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.926+0000 7fd2277fe700 1 -- 172.21.15.174:0/603511661 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22814a070 con 0x7fd2280685d0 2021-03-25T14:15:50.930 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.926+0000 7fd2277fe700 1 --2- 172.21.15.174:0/603511661 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2280685d0 0x7fd228068a40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fd220009cc0 tx=0x7fd220009220).ready entity=mon.1 client_cookie=91b301273757ab44 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:15:50.930 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.926+0000 7fd2267fc700 1 -- 172.21.15.174:0/603511661 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22000ba10 con 0x7fd2280685d0 2021-03-25T14:15:50.930 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.926+0000 7fd2267fc700 1 -- 172.21.15.174:0/603511661 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22000bb70 con 0x7fd2280685d0 2021-03-25T14:15:50.930 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.926+0000 7fd2267fc700 1 -- 172.21.15.174:0/603511661 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd220011400 con 0x7fd2280685d0 2021-03-25T14:15:50.931 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.927+0000 7fd22d71e700 1 -- 172.21.15.174:0/603511661 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2280685d0 msgr2=0x7fd228068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:50.931 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.927+0000 7fd22d71e700 1 --2- 172.21.15.174:0/603511661 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2280685d0 0x7fd228068a40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fd220009cc0 tx=0x7fd220009220).stop 2021-03-25T14:15:50.931 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.927+0000 7fd22d71e700 1 -- 172.21.15.174:0/603511661 shutdown_connections 2021-03-25T14:15:50.931 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.927+0000 7fd22d71e700 1 --2- 172.21.15.174:0/603511661 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2280685d0 0x7fd228068a40 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:50.931 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.927+0000 7fd22d71e700 1 --2- 172.21.15.174:0/603511661 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd22814cc90 0x7fd22814d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:50.931 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.927+0000 7fd22d71e700 1 -- 172.21.15.174:0/603511661 >> 172.21.15.174:0/603511661 conn(0x7fd228060c40 msgr2=0x7fd228061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:15:50.931 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.927+0000 7fd22d71e700 1 -- 172.21.15.174:0/603511661 shutdown_connections 2021-03-25T14:15:50.931 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.927+0000 7fd22d71e700 1 -- 172.21.15.174:0/603511661 wait complete. 2021-03-25T14:15:50.931 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.928+0000 7fd22d71e700 1 Processor -- start 2021-03-25T14:15:50.931 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.928+0000 7fd22d71e700 1 -- start start 2021-03-25T14:15:50.934 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.928+0000 7fd22d71e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2280685d0 0x7fd22815c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:50.934 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.928+0000 7fd22d71e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd22814cc90 0x7fd228158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:50.934 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.928+0000 7fd22d71e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd22814d470 0x7fd2280bf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:50.934 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.928+0000 7fd22d71e700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2280a4ad0 con 0x7fd2280685d0 2021-03-25T14:15:50.934 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.928+0000 7fd22d71e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2280b8150 con 0x7fd22814cc90 2021-03-25T14:15:50.934 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.928+0000 7fd22d71e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2280b83f0 con 0x7fd22814d470 2021-03-25T14:15:50.934 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.929+0000 7fd21ffff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd22814cc90 0x7fd228158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:50.935 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.929+0000 7fd2277fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd22814d470 0x7fd2280bf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:50.935 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.929+0000 7fd21ffff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd22814cc90 0x7fd228158730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:46730/0 (socket says 172.21.15.174:46730) 2021-03-25T14:15:50.935 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.929+0000 7fd21ffff700 1 -- 172.21.15.174:0/1030556269 learned_addr learned my addr 172.21.15.174:0/1030556269 (peer_addr_for_me v2:172.21.15.174:0/0) 2021-03-25T14:15:50.935 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.929+0000 7fd226ffd700 1 --2- 172.21.15.174:0/1030556269 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2280685d0 0x7fd22815c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:50.935 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.929+0000 7fd21ffff700 1 -- 172.21.15.174:0/1030556269 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd22814d470 msgr2=0x7fd2280bf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:50.935 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.929+0000 7fd21ffff700 1 --2- 172.21.15.174:0/1030556269 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd22814d470 0x7fd2280bf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:50.935 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.929+0000 7fd21ffff700 1 -- 172.21.15.174:0/1030556269 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2280685d0 msgr2=0x7fd22815c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:50.935 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.929+0000 7fd21ffff700 1 --2- 172.21.15.174:0/1030556269 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2280685d0 0x7fd22815c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:50.935 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.929+0000 7fd21ffff700 1 -- 172.21.15.174:0/1030556269 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22815bdd0 con 0x7fd22814cc90 2021-03-25T14:15:50.935 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.929+0000 7fd21ffff700 1 --2- 172.21.15.174:0/1030556269 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd22814cc90 0x7fd228158730 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fd21000f8b0 tx=0x7fd210008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:15:50.935 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.929+0000 7fd21effd700 1 -- 172.21.15.174:0/1030556269 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd210014670 con 0x7fd22814cc90 2021-03-25T14:15:50.935 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.929+0000 7fd21effd700 1 -- 172.21.15.174:0/1030556269 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2100147d0 con 0x7fd22814cc90 2021-03-25T14:15:50.935 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.929+0000 7fd22d71e700 1 -- 172.21.15.174:0/1030556269 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd22815c070 con 0x7fd22814cc90 2021-03-25T14:15:50.936 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.929+0000 7fd21effd700 1 -- 172.21.15.174:0/1030556269 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd210014b50 con 0x7fd22814cc90 2021-03-25T14:15:50.936 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.929+0000 7fd22d71e700 1 -- 172.21.15.174:0/1030556269 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2280b7e40 con 0x7fd22814cc90 2021-03-25T14:15:50.936 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.929+0000 7fd21effd700 1 -- 172.21.15.174:0/1030556269 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 1) v1 ==== 623+0+0 (secure 0 0 0) 0x7fd21001d6f0 con 0x7fd22814cc90 2021-03-25T14:15:50.936 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.929+0000 7fd21effd700 1 -- 172.21.15.174:0/1030556269 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7fd210013b50 con 0x7fd22814cc90 2021-03-25T14:15:50.936 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.930+0000 7fd22d71e700 1 -- 172.21.15.174:0/1030556269 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd22815c4d0 con 0x7fd22814cc90 2021-03-25T14:15:50.936 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:50.932+0000 7fd21effd700 1 -- 172.21.15.174:0/1030556269 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72044 (secure 0 0 0) 0x7fd210018030 con 0x7fd22814cc90 2021-03-25T14:15:51.013 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.011+0000 7fd22d71e700 1 -- 172.21.15.174:0/1030556269 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd new", "uuid": "99589dc9-e1d0-461a-aa93-fa6b4bca4411", "id": 2} v 0) v1 -- 0x7fd22805d7b0 con 0x7fd22814cc90 2021-03-25T14:15:51.017 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.015+0000 7fd21effd700 1 -- 172.21.15.174:0/1030556269 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "99589dc9-e1d0-461a-aa93-fa6b4bca4411", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd210013de0 con 0x7fd22814cc90 2021-03-25T14:15:51.017 INFO:teuthology.orchestra.run.smithi174.stdout:2 2021-03-25T14:15:51.019 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.017+0000 7fd22d71e700 1 -- 172.21.15.174:0/1030556269 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd22814cc90 msgr2=0x7fd228158730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:51.019 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.017+0000 7fd22d71e700 1 --2- 172.21.15.174:0/1030556269 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd22814cc90 0x7fd228158730 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fd21000f8b0 tx=0x7fd210008040).stop 2021-03-25T14:15:51.019 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.017+0000 7fd22d71e700 1 -- 172.21.15.174:0/1030556269 shutdown_connections 2021-03-25T14:15:51.019 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.017+0000 7fd22d71e700 1 --2- 172.21.15.174:0/1030556269 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd22814d470 0x7fd2280bf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:51.019 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.017+0000 7fd22d71e700 1 --2- 172.21.15.174:0/1030556269 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2280685d0 0x7fd22815c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:51.019 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.017+0000 7fd22d71e700 1 --2- 172.21.15.174:0/1030556269 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd22814cc90 0x7fd228158730 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:51.019 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.017+0000 7fd22d71e700 1 -- 172.21.15.174:0/1030556269 >> 172.21.15.174:0/1030556269 conn(0x7fd228060c40 msgr2=0x7fd2280b4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:15:51.019 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.017+0000 7fd22d71e700 1 -- 172.21.15.174:0/1030556269 shutdown_connections 2021-03-25T14:15:51.019 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.017+0000 7fd22d71e700 1 -- 172.21.15.174:0/1030556269 wait complete. 2021-03-25T14:15:51.034 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new 0dd70ec1-946c-451f-b4db-731f2183b73a 3 2021-03-25T14:15:51.169 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.168+0000 7fe2fa707700 1 Processor -- start 2021-03-25T14:15:51.169 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.168+0000 7fe2fa707700 1 -- start start 2021-03-25T14:15:51.172 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.168+0000 7fe2fa707700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe2f4060e00 0x7fe2f40a2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:51.172 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.168+0000 7fe2fa707700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2f414da00 0x7fe2f41434b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:51.173 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.168+0000 7fe2fa707700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f40b6c90 con 0x7fe2f4068440 2021-03-25T14:15:51.173 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.168+0000 7fe2fa707700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2f414deb0 con 0x7fe2f4060e00 2021-03-25T14:15:51.173 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.168+0000 7fe2fa707700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f414a080 con 0x7fe2f414da00 2021-03-25T14:15:51.173 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.168+0000 7fe2f8ca4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2f414da00 0x7fe2f41434b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:51.173 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.169+0000 7fe2f8ca4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2f414da00 0x7fe2f41434b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:34396/0 (socket says 172.21.15.174:34396) 2021-03-25T14:15:51.173 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.169+0000 7fe2f8ca4700 1 -- 172.21.15.174:0/3176912292 learned_addr learned my addr 172.21.15.174:0/3176912292 (peer_addr_for_me v2:172.21.15.174:0/0) 2021-03-25T14:15:51.173 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.169+0000 7fe2f3fff700 1 --2- 172.21.15.174:0/3176912292 >> v2:172.21.15.110:3300/0 conn(0x7fe2f4060e00 0x7fe2f40a2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:51.173 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.169+0000 7fe2f8ca4700 1 -- 172.21.15.174:0/3176912292 >> v2:172.21.15.110:3300/0 conn(0x7fe2f4060e00 msgr2=0x7fe2f40a2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:15:51.173 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.169+0000 7fe2f8ca4700 1 --2- 172.21.15.174:0/3176912292 >> v2:172.21.15.110:3300/0 conn(0x7fe2f4060e00 0x7fe2f40a2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:51.173 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.169+0000 7fe2f8ca4700 1 -- 172.21.15.174:0/3176912292 >> v1:172.21.15.110:6789/0 conn(0x7fe2f4068440 legacy=0x7fe2f4149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:51.173 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.169+0000 7fe2f8ca4700 1 -- 172.21.15.174:0/3176912292 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f4068ca0 con 0x7fe2f414da00 2021-03-25T14:15:51.173 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.169+0000 7fe2f8ca4700 1 --2- 172.21.15.174:0/3176912292 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2f414da00 0x7fe2f41434b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fe2ec009d90 tx=0x7fe2ec0092d0).ready entity=mon.2 client_cookie=64db8071fa2f26a7 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:15:51.173 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.169+0000 7fe2f2ffd700 1 -- 172.21.15.174:0/3176912292 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec00bc80 con 0x7fe2f414da00 2021-03-25T14:15:51.174 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.169+0000 7fe2f2ffd700 1 -- 172.21.15.174:0/3176912292 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ec00bde0 con 0x7fe2f414da00 2021-03-25T14:15:51.174 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.169+0000 7fe2f2ffd700 1 -- 172.21.15.174:0/3176912292 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec011610 con 0x7fe2f414da00 2021-03-25T14:15:51.174 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.170+0000 7fe2fa707700 1 -- 172.21.15.174:0/3176912292 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2f414da00 msgr2=0x7fe2f41434b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:51.174 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.170+0000 7fe2fa707700 1 --2- 172.21.15.174:0/3176912292 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2f414da00 0x7fe2f41434b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fe2ec009d90 tx=0x7fe2ec0092d0).stop 2021-03-25T14:15:51.174 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.170+0000 7fe2fa707700 1 -- 172.21.15.174:0/3176912292 shutdown_connections 2021-03-25T14:15:51.174 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.170+0000 7fe2fa707700 1 --2- 172.21.15.174:0/3176912292 >> v2:172.21.15.110:3300/0 conn(0x7fe2f4060e00 0x7fe2f40a2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:51.174 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.170+0000 7fe2fa707700 1 --2- 172.21.15.174:0/3176912292 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2f414da00 0x7fe2f41434b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:51.174 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.170+0000 7fe2fa707700 1 -- 172.21.15.174:0/3176912292 >> 172.21.15.174:0/3176912292 conn(0x7fe2f4061d50 msgr2=0x7fe2f4062160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:15:51.174 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.170+0000 7fe2fa707700 1 -- 172.21.15.174:0/3176912292 shutdown_connections 2021-03-25T14:15:51.174 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.170+0000 7fe2fa707700 1 -- 172.21.15.174:0/3176912292 wait complete. 2021-03-25T14:15:51.174 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.171+0000 7fe2fa707700 1 Processor -- start 2021-03-25T14:15:51.175 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.171+0000 7fe2fa707700 1 -- start start 2021-03-25T14:15:51.177 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.172+0000 7fe2fa707700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2f4060e00 0x7fe2f4158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:51.177 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.172+0000 7fe2fa707700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2f4068440 0x7fe2f4144da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:51.177 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.172+0000 7fe2fa707700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2f414da00 0x7fe2f40bd620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:51.178 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.172+0000 7fe2fa707700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f415c240 con 0x7fe2f4068440 2021-03-25T14:15:51.178 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.172+0000 7fe2fa707700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f4144130 con 0x7fe2f414da00 2021-03-25T14:15:51.178 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.172+0000 7fe2fa707700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f41443d0 con 0x7fe2f4060e00 2021-03-25T14:15:51.178 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.172+0000 7fe2f3fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2f4060e00 0x7fe2f4158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:51.178 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.172+0000 7fe2f3fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2f4060e00 0x7fe2f4158cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:34398/0 (socket says 172.21.15.174:34398) 2021-03-25T14:15:51.178 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.172+0000 7fe2f3fff700 1 -- 172.21.15.174:0/3635226457 learned_addr learned my addr 172.21.15.174:0/3635226457 (peer_addr_for_me v2:172.21.15.174:0/0) 2021-03-25T14:15:51.178 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.172+0000 7fe2f8ca4700 1 --2- 172.21.15.174:0/3635226457 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2f414da00 0x7fe2f40bd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:51.178 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.172+0000 7fe2f37fe700 1 --2- 172.21.15.174:0/3635226457 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2f4068440 0x7fe2f4144da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:51.178 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.172+0000 7fe2f3fff700 1 -- 172.21.15.174:0/3635226457 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2f414da00 msgr2=0x7fe2f40bd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:51.178 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.172+0000 7fe2f3fff700 1 --2- 172.21.15.174:0/3635226457 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2f414da00 0x7fe2f40bd620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:51.178 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.172+0000 7fe2f3fff700 1 -- 172.21.15.174:0/3635226457 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2f4068440 msgr2=0x7fe2f4144da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:51.178 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.172+0000 7fe2f3fff700 1 --2- 172.21.15.174:0/3635226457 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2f4068440 0x7fe2f4144da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:51.179 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.172+0000 7fe2f3fff700 1 -- 172.21.15.174:0/3635226457 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f4144670 con 0x7fe2f4060e00 2021-03-25T14:15:51.179 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.172+0000 7fe2f37fe700 1 --2- 172.21.15.174:0/3635226457 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2f4068440 0x7fe2f4144da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:15:51.179 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.172+0000 7fe2f8ca4700 1 --2- 172.21.15.174:0/3635226457 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2f414da00 0x7fe2f40bd620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:15:51.179 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.172+0000 7fe2f3fff700 1 --2- 172.21.15.174:0/3635226457 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2f4060e00 0x7fe2f4158cb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fe2dc00ebd0 tx=0x7fe2dc006e20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:15:51.179 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.172+0000 7fe2ebfff700 1 -- 172.21.15.174:0/3635226457 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc00c8e0 con 0x7fe2f4060e00 2021-03-25T14:15:51.179 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.172+0000 7fe2ebfff700 1 -- 172.21.15.174:0/3635226457 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2dc00ca40 con 0x7fe2f4060e00 2021-03-25T14:15:51.179 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.172+0000 7fe2fa707700 1 -- 172.21.15.174:0/3635226457 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f415c4a0 con 0x7fe2f4060e00 2021-03-25T14:15:51.179 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.172+0000 7fe2ebfff700 1 -- 172.21.15.174:0/3635226457 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc00cdc0 con 0x7fe2f4060e00 2021-03-25T14:15:51.179 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.172+0000 7fe2fa707700 1 -- 172.21.15.174:0/3635226457 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f4145290 con 0x7fe2f4060e00 2021-03-25T14:15:51.179 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.173+0000 7fe2ebfff700 1 -- 172.21.15.174:0/3635226457 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 1) v1 ==== 623+0+0 (secure 0 0 0) 0x7fe2dc012600 con 0x7fe2f4060e00 2021-03-25T14:15:51.179 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.173+0000 7fe2ebfff700 1 -- 172.21.15.174:0/3635226457 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7fe2dc012d50 con 0x7fe2f4060e00 2021-03-25T14:15:51.179 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.173+0000 7fe2fa707700 1 -- 172.21.15.174:0/3635226457 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2f405d7b0 con 0x7fe2f4060e00 2021-03-25T14:15:51.180 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.175+0000 7fe2ebfff700 1 -- 172.21.15.174:0/3635226457 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72044 (secure 0 0 0) 0x7fe2dc012890 con 0x7fe2f4060e00 2021-03-25T14:15:51.255 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.253+0000 7fe2fa707700 1 -- 172.21.15.174:0/3635226457 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0dd70ec1-946c-451f-b4db-731f2183b73a", "id": 3} v 0) v1 -- 0x7fe2f405d0e0 con 0x7fe2f4060e00 2021-03-25T14:15:51.259 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.258+0000 7fe2ebfff700 1 -- 172.21.15.174:0/3635226457 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0dd70ec1-946c-451f-b4db-731f2183b73a", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe2dc01c4b0 con 0x7fe2f4060e00 2021-03-25T14:15:51.259 INFO:teuthology.orchestra.run.smithi174.stdout:3 2021-03-25T14:15:51.260 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.259+0000 7fe2fa707700 1 -- 172.21.15.174:0/3635226457 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2f4060e00 msgr2=0x7fe2f4158cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:51.261 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.259+0000 7fe2fa707700 1 --2- 172.21.15.174:0/3635226457 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2f4060e00 0x7fe2f4158cb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fe2dc00ebd0 tx=0x7fe2dc006e20).stop 2021-03-25T14:15:51.261 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.259+0000 7fe2fa707700 1 -- 172.21.15.174:0/3635226457 shutdown_connections 2021-03-25T14:15:51.261 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.259+0000 7fe2fa707700 1 --2- 172.21.15.174:0/3635226457 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2f414da00 0x7fe2f40bd620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:51.261 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.259+0000 7fe2fa707700 1 --2- 172.21.15.174:0/3635226457 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2f4060e00 0x7fe2f4158cb0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:51.261 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.259+0000 7fe2fa707700 1 --2- 172.21.15.174:0/3635226457 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2f4068440 0x7fe2f4144da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:51.261 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.259+0000 7fe2fa707700 1 -- 172.21.15.174:0/3635226457 >> 172.21.15.174:0/3635226457 conn(0x7fe2f4061d50 msgr2=0x7fe2f41496d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:15:51.261 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.259+0000 7fe2fa707700 1 -- 172.21.15.174:0/3635226457 shutdown_connections 2021-03-25T14:15:51.261 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.259+0000 7fe2fa707700 1 -- 172.21.15.174:0/3635226457 wait complete. 2021-03-25T14:15:51.271 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new e89c627c-3c0b-4696-b76a-267ac80f4280 4 2021-03-25T14:15:51.386 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.384+0000 7f26bfafb700 1 Processor -- start 2021-03-25T14:15:51.386 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.384+0000 7f26bfafb700 1 -- start start 2021-03-25T14:15:51.389 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.385+0000 7f26bfafb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f26b80bbfd0 0x7f26b80bc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:51.389 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.385+0000 7f26bfafb700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f26b8147130 0x7f26b80b0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:51.389 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.385+0000 7f26bfafb700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26b814a790 con 0x7f26b80b6780 2021-03-25T14:15:51.389 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.385+0000 7f26bfafb700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26b8146750 con 0x7f26b8147130 2021-03-25T14:15:51.389 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.385+0000 7f26bfafb700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26b81469f0 con 0x7f26b80bbfd0 2021-03-25T14:15:51.389 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.385+0000 7f26bd897700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f26b80bbfd0 0x7f26b80bc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:51.389 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.385+0000 7f26bd897700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f26b80bbfd0 0x7f26b80bc3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:46748/0 (socket says 172.21.15.174:46748) 2021-03-25T14:15:51.389 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.385+0000 7f26bd897700 1 -- 172.21.15.174:0/2227961738 learned_addr learned my addr 172.21.15.174:0/2227961738 (peer_addr_for_me v2:172.21.15.174:0/0) 2021-03-25T14:15:51.389 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.385+0000 7f26bd096700 1 --2- 172.21.15.174:0/2227961738 >> v2:172.21.15.110:3300/0 conn(0x7f26b8147130 0x7f26b80b0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:51.389 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.386+0000 7f26bd897700 1 -- 172.21.15.174:0/2227961738 >> v2:172.21.15.110:3300/0 conn(0x7f26b8147130 msgr2=0x7f26b80b0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:15:51.389 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.386+0000 7f26bd897700 1 --2- 172.21.15.174:0/2227961738 >> v2:172.21.15.110:3300/0 conn(0x7f26b8147130 0x7f26b80b0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:51.390 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.386+0000 7f26bd897700 1 -- 172.21.15.174:0/2227961738 >> v1:172.21.15.110:6789/0 conn(0x7f26b80b6780 legacy=0x7f26b8145a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:51.390 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.386+0000 7f26bd897700 1 -- 172.21.15.174:0/2227961738 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b8146c90 con 0x7f26b80bbfd0 2021-03-25T14:15:51.390 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.386+0000 7f26bd897700 1 --2- 172.21.15.174:0/2227961738 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26b80bbfd0 0x7f26b80bc3b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f26b8065700 tx=0x7f26a8006ee0).ready entity=mon.1 client_cookie=77e9fb19e522a6c3 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:15:51.390 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.386+0000 7f26bc895700 1 -- 172.21.15.174:0/2227961738 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a80098d0 con 0x7f26b80bbfd0 2021-03-25T14:15:51.390 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.386+0000 7f26bc895700 1 -- 172.21.15.174:0/2227961738 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a8009a30 con 0x7f26b80bbfd0 2021-03-25T14:15:51.390 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.386+0000 7f26bc895700 1 -- 172.21.15.174:0/2227961738 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a8009db0 con 0x7f26b80bbfd0 2021-03-25T14:15:51.390 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.386+0000 7f26bfafb700 1 -- 172.21.15.174:0/2227961738 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26b80bbfd0 msgr2=0x7f26b80bc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:51.390 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.386+0000 7f26bfafb700 1 --2- 172.21.15.174:0/2227961738 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26b80bbfd0 0x7f26b80bc3b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f26b8065700 tx=0x7f26a8006ee0).stop 2021-03-25T14:15:51.390 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.386+0000 7f26bfafb700 1 -- 172.21.15.174:0/2227961738 shutdown_connections 2021-03-25T14:15:51.390 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.386+0000 7f26bfafb700 1 --2- 172.21.15.174:0/2227961738 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26b80bbfd0 0x7f26b80bc3b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:51.390 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.386+0000 7f26bfafb700 1 --2- 172.21.15.174:0/2227961738 >> v2:172.21.15.110:3300/0 conn(0x7f26b8147130 0x7f26b80b0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:51.390 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.386+0000 7f26bfafb700 1 -- 172.21.15.174:0/2227961738 >> 172.21.15.174:0/2227961738 conn(0x7f26b80664e0 msgr2=0x7f26b80668f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:15:51.391 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.387+0000 7f26bfafb700 1 -- 172.21.15.174:0/2227961738 shutdown_connections 2021-03-25T14:15:51.391 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.387+0000 7f26bfafb700 1 -- 172.21.15.174:0/2227961738 wait complete. 2021-03-25T14:15:51.393 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.388+0000 7f26bfafb700 1 Processor -- start 2021-03-25T14:15:51.394 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.388+0000 7f26bfafb700 1 -- start start 2021-03-25T14:15:51.394 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.388+0000 7f26bfafb700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26b80b6780 0x7f26b809da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:51.394 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.388+0000 7f26bfafb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f26b80bbfd0 0x7f26b809f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:51.394 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.388+0000 7f26bfafb700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26b8147130 0x7f26b809f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:51.394 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.388+0000 7f26bfafb700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b809fa50 con 0x7f26b80b6780 2021-03-25T14:15:51.394 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.388+0000 7f26bfafb700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b815a4e0 con 0x7f26b8147130 2021-03-25T14:15:51.394 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.388+0000 7f26bfafb700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26b8063d60 con 0x7f26b80bbfd0 2021-03-25T14:15:51.394 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.388+0000 7f26be098700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26b8147130 0x7f26b809f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:51.394 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.388+0000 7f26bd096700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f26b80bbfd0 0x7f26b809f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:51.394 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.388+0000 7f26be098700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26b8147130 0x7f26b809f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:46758/0 (socket says 172.21.15.174:46758) 2021-03-25T14:15:51.394 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.388+0000 7f26be098700 1 -- 172.21.15.174:0/1219851590 learned_addr learned my addr 172.21.15.174:0/1219851590 (peer_addr_for_me v2:172.21.15.174:0/0) 2021-03-25T14:15:51.395 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.388+0000 7f26bd897700 1 --2- 172.21.15.174:0/1219851590 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26b80b6780 0x7f26b809da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:51.395 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.389+0000 7f26be098700 1 -- 172.21.15.174:0/1219851590 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f26b80bbfd0 msgr2=0x7f26b809f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:51.395 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.389+0000 7f26be098700 1 --2- 172.21.15.174:0/1219851590 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f26b80bbfd0 0x7f26b809f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:51.395 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.389+0000 7f26be098700 1 -- 172.21.15.174:0/1219851590 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26b80b6780 msgr2=0x7f26b809da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:51.395 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.389+0000 7f26be098700 1 --2- 172.21.15.174:0/1219851590 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26b80b6780 0x7f26b809da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:51.395 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.389+0000 7f26be098700 1 -- 172.21.15.174:0/1219851590 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b8149c30 con 0x7f26b8147130 2021-03-25T14:15:51.395 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.389+0000 7f26bd096700 1 --2- 172.21.15.174:0/1219851590 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f26b80bbfd0 0x7f26b809f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:15:51.395 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.389+0000 7f26be098700 1 --2- 172.21.15.174:0/1219851590 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26b8147130 0x7f26b809f560 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f26b000ca90 tx=0x7f26b0007f70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:15:51.395 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.389+0000 7f26a5ffb700 1 -- 172.21.15.174:0/1219851590 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b000ce70 con 0x7f26b8147130 2021-03-25T14:15:51.395 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.389+0000 7f26a5ffb700 1 -- 172.21.15.174:0/1219851590 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b000a760 con 0x7f26b8147130 2021-03-25T14:15:51.395 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.389+0000 7f26bfafb700 1 -- 172.21.15.174:0/1219851590 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26b8149ed0 con 0x7f26b8147130 2021-03-25T14:15:51.395 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.389+0000 7f26a5ffb700 1 -- 172.21.15.174:0/1219851590 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b000aae0 con 0x7f26b8147130 2021-03-25T14:15:51.395 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.389+0000 7f26a5ffb700 1 -- 172.21.15.174:0/1219851590 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 1) v1 ==== 623+0+0 (secure 0 0 0) 0x7f26b0019030 con 0x7f26b8147130 2021-03-25T14:15:51.396 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.389+0000 7f26bfafb700 1 -- 172.21.15.174:0/1219851590 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26b8148ec0 con 0x7f26b8147130 2021-03-25T14:15:51.396 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.389+0000 7f26a5ffb700 1 -- 172.21.15.174:0/1219851590 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7f26b001b3b0 con 0x7f26b8147130 2021-03-25T14:15:51.396 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.390+0000 7f26bfafb700 1 -- 172.21.15.174:0/1219851590 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26b8064000 con 0x7f26b8147130 2021-03-25T14:15:51.396 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.394+0000 7f26a5ffb700 1 -- 172.21.15.174:0/1219851590 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72044 (secure 0 0 0) 0x7f26b8064000 con 0x7f26b8147130 2021-03-25T14:15:51.474 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.473+0000 7f26bfafb700 1 -- 172.21.15.174:0/1219851590 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e89c627c-3c0b-4696-b76a-267ac80f4280", "id": 4} v 0) v1 -- 0x7f26b809eda0 con 0x7f26b8147130 2021-03-25T14:15:51.479 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.477+0000 7f26a5ffb700 1 -- 172.21.15.174:0/1219851590 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e89c627c-3c0b-4696-b76a-267ac80f4280", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f26b0017070 con 0x7f26b8147130 2021-03-25T14:15:51.479 INFO:teuthology.orchestra.run.smithi174.stdout:4 2021-03-25T14:15:51.480 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.478+0000 7f26bfafb700 1 -- 172.21.15.174:0/1219851590 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26b8147130 msgr2=0x7f26b809f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:51.480 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.478+0000 7f26bfafb700 1 --2- 172.21.15.174:0/1219851590 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26b8147130 0x7f26b809f560 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f26b000ca90 tx=0x7f26b0007f70).stop 2021-03-25T14:15:51.480 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.478+0000 7f26bfafb700 1 -- 172.21.15.174:0/1219851590 shutdown_connections 2021-03-25T14:15:51.481 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.478+0000 7f26bfafb700 1 --2- 172.21.15.174:0/1219851590 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26b8147130 0x7f26b809f560 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:51.481 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.478+0000 7f26bfafb700 1 --2- 172.21.15.174:0/1219851590 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26b80b6780 0x7f26b809da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:51.481 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.478+0000 7f26bfafb700 1 --2- 172.21.15.174:0/1219851590 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f26b80bbfd0 0x7f26b809f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:51.481 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.478+0000 7f26bfafb700 1 -- 172.21.15.174:0/1219851590 >> 172.21.15.174:0/1219851590 conn(0x7f26b80664e0 msgr2=0x7f26b80668c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:15:51.481 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.478+0000 7f26bfafb700 1 -- 172.21.15.174:0/1219851590 shutdown_connections 2021-03-25T14:15:51.481 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.479+0000 7f26bfafb700 1 -- 172.21.15.174:0/1219851590 wait complete. 2021-03-25T14:15:51.491 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new c4c6a6e5-98df-4239-9dba-53ed311acd70 5 2021-03-25T14:15:51.602 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.601+0000 7f158b9bf700 1 Processor -- start 2021-03-25T14:15:51.603 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.601+0000 7f158b9bf700 1 -- start start 2021-03-25T14:15:51.609 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.602+0000 7f158b9bf700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f158414d470 0x7f158414d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:51.609 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.602+0000 7f158b9bf700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f158414cc90 0x7f15841493c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:51.609 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.602+0000 7f158b9bf700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15840691b0 con 0x7f15841498b0 2021-03-25T14:15:51.609 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.602+0000 7f158b9bf700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15840bc2b0 con 0x7f158414d470 2021-03-25T14:15:51.609 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.602+0000 7f158b9bf700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1584149dd0 con 0x7f158414cc90 2021-03-25T14:15:51.609 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.602+0000 7f1588f5a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f158414cc90 0x7f15841493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:51.609 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.602+0000 7f1588f5a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f158414cc90 0x7f15841493c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:34416/0 (socket says 172.21.15.174:34416) 2021-03-25T14:15:51.609 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.602+0000 7f1588f5a700 1 -- 172.21.15.174:0/3364956140 learned_addr learned my addr 172.21.15.174:0/3364956140 (peer_addr_for_me v2:172.21.15.174:0/0) 2021-03-25T14:15:51.609 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.602+0000 7f158975b700 1 --2- 172.21.15.174:0/3364956140 >> v2:172.21.15.110:3300/0 conn(0x7f158414d470 0x7f158414d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:51.609 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.602+0000 7f1588f5a700 1 -- 172.21.15.174:0/3364956140 >> v2:172.21.15.110:3300/0 conn(0x7f158414d470 msgr2=0x7f158414d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:15:51.609 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.602+0000 7f1588f5a700 1 --2- 172.21.15.174:0/3364956140 >> v2:172.21.15.110:3300/0 conn(0x7f158414d470 0x7f158414d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:51.610 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.602+0000 7f1588f5a700 1 -- 172.21.15.174:0/3364956140 >> v1:172.21.15.110:6789/0 conn(0x7f15841498b0 legacy=0x7f15840685d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:51.610 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.602+0000 7f1588f5a700 1 -- 172.21.15.174:0/3364956140 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f158414a070 con 0x7f158414cc90 2021-03-25T14:15:51.610 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.602+0000 7f158975b700 1 --2- 172.21.15.174:0/3364956140 >> v2:172.21.15.110:3300/0 conn(0x7f158414d470 0x7f158414d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:15:51.610 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.602+0000 7f1588f5a700 1 --2- 172.21.15.174:0/3364956140 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f158414cc90 0x7f15841493c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f158000ba20 tx=0x7f1580006ee0).ready entity=mon.2 client_cookie=b654ce4a9a168940 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:15:51.610 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.602+0000 7f1573fff700 1 -- 172.21.15.174:0/3364956140 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1580009840 con 0x7f158414cc90 2021-03-25T14:15:51.610 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.602+0000 7f1573fff700 1 -- 172.21.15.174:0/3364956140 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15800099a0 con 0x7f158414cc90 2021-03-25T14:15:51.610 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.602+0000 7f1573fff700 1 -- 172.21.15.174:0/3364956140 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1580009d20 con 0x7f158414cc90 2021-03-25T14:15:51.610 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.603+0000 7f158b9bf700 1 -- 172.21.15.174:0/3364956140 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f158414cc90 msgr2=0x7f15841493c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:51.610 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.603+0000 7f158b9bf700 1 --2- 172.21.15.174:0/3364956140 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f158414cc90 0x7f15841493c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f158000ba20 tx=0x7f1580006ee0).stop 2021-03-25T14:15:51.610 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.603+0000 7f158b9bf700 1 -- 172.21.15.174:0/3364956140 shutdown_connections 2021-03-25T14:15:51.610 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.603+0000 7f158b9bf700 1 --2- 172.21.15.174:0/3364956140 >> v2:172.21.15.110:3300/0 conn(0x7f158414d470 0x7f158414d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:51.610 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.603+0000 7f158b9bf700 1 --2- 172.21.15.174:0/3364956140 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f158414cc90 0x7f15841493c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:51.611 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.603+0000 7f158b9bf700 1 -- 172.21.15.174:0/3364956140 >> 172.21.15.174:0/3364956140 conn(0x7f1584060c40 msgr2=0x7f1584061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:15:51.611 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.603+0000 7f158b9bf700 1 -- 172.21.15.174:0/3364956140 shutdown_connections 2021-03-25T14:15:51.611 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.603+0000 7f158b9bf700 1 -- 172.21.15.174:0/3364956140 wait complete. 2021-03-25T14:15:51.611 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.604+0000 7f158b9bf700 1 Processor -- start 2021-03-25T14:15:51.611 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.604+0000 7f158b9bf700 1 -- start start 2021-03-25T14:15:51.611 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.605+0000 7f158b9bf700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15841498b0 0x7f15840b6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:51.611 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.605+0000 7f158b9bf700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f158414cc90 0x7f15840a44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:51.611 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.605+0000 7f158b9bf700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f158414d470 0x7f15840a49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:51.611 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.605+0000 7f158b9bf700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15840b9a30 con 0x7f15841498b0 2021-03-25T14:15:51.611 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.605+0000 7f158b9bf700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15840b9f00 con 0x7f158414d470 2021-03-25T14:15:51.611 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.605+0000 7f158b9bf700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15840a2660 con 0x7f158414cc90 2021-03-25T14:15:51.611 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.605+0000 7f1588f5a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f158414cc90 0x7f15840a44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:51.611 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.605+0000 7f1589f5c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f158414d470 0x7f15840a49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:51.612 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.605+0000 7f1588f5a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f158414cc90 0x7f15840a44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:34424/0 (socket says 172.21.15.174:34424) 2021-03-25T14:15:51.612 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.605+0000 7f1588f5a700 1 -- 172.21.15.174:0/2153444000 learned_addr learned my addr 172.21.15.174:0/2153444000 (peer_addr_for_me v2:172.21.15.174:0/0) 2021-03-25T14:15:51.612 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.605+0000 7f158975b700 1 --2- 172.21.15.174:0/2153444000 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15841498b0 0x7f15840b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:51.612 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.605+0000 7f1588f5a700 1 -- 172.21.15.174:0/2153444000 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f158414d470 msgr2=0x7f15840a49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:51.612 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.605+0000 7f1588f5a700 1 --2- 172.21.15.174:0/2153444000 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f158414d470 0x7f15840a49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:51.612 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.605+0000 7f1588f5a700 1 -- 172.21.15.174:0/2153444000 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15841498b0 msgr2=0x7f15840b6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:51.612 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.605+0000 7f1588f5a700 1 --2- 172.21.15.174:0/2153444000 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15841498b0 0x7f15840b6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:51.612 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.605+0000 7f1588f5a700 1 -- 172.21.15.174:0/2153444000 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15840b9c60 con 0x7f158414cc90 2021-03-25T14:15:51.612 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.605+0000 7f1589f5c700 1 --2- 172.21.15.174:0/2153444000 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f158414d470 0x7f15840a49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:15:51.612 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.605+0000 7f1588f5a700 1 --2- 172.21.15.174:0/2153444000 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f158414cc90 0x7f15840a44b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f1580009e40 tx=0x7f1580016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:15:51.612 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.606+0000 7f15717fa700 1 -- 172.21.15.174:0/2153444000 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15800093d0 con 0x7f158414cc90 2021-03-25T14:15:51.612 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.606+0000 7f15717fa700 1 -- 172.21.15.174:0/2153444000 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1580011c80 con 0x7f158414cc90 2021-03-25T14:15:51.613 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.606+0000 7f158b9bf700 1 -- 172.21.15.174:0/2153444000 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15840b7560 con 0x7f158414cc90 2021-03-25T14:15:51.613 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.606+0000 7f15717fa700 1 -- 172.21.15.174:0/2153444000 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158001c420 con 0x7f158414cc90 2021-03-25T14:15:51.613 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.606+0000 7f158b9bf700 1 -- 172.21.15.174:0/2153444000 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15840b6900 con 0x7f158414cc90 2021-03-25T14:15:51.613 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.606+0000 7f15717fa700 1 -- 172.21.15.174:0/2153444000 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 1) v1 ==== 623+0+0 (secure 0 0 0) 0x7f158000f070 con 0x7f158414cc90 2021-03-25T14:15:51.613 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.606+0000 7f158b9bf700 1 -- 172.21.15.174:0/2153444000 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15840b76f0 con 0x7f158414cc90 2021-03-25T14:15:51.613 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.606+0000 7f15717fa700 1 -- 172.21.15.174:0/2153444000 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7f158001b930 con 0x7f158414cc90 2021-03-25T14:15:51.613 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.609+0000 7f15717fa700 1 -- 172.21.15.174:0/2153444000 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72044 (secure 0 0 0) 0x7f1580016070 con 0x7f158414cc90 2021-03-25T14:15:51.688 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.686+0000 7f158b9bf700 1 -- 172.21.15.174:0/2153444000 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c4c6a6e5-98df-4239-9dba-53ed311acd70", "id": 5} v 0) v1 -- 0x7f158405d7b0 con 0x7f158414cc90 2021-03-25T14:15:51.691 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.689+0000 7f15717fa700 1 -- 172.21.15.174:0/2153444000 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c4c6a6e5-98df-4239-9dba-53ed311acd70", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f158001cc50 con 0x7f158414cc90 2021-03-25T14:15:51.691 INFO:teuthology.orchestra.run.smithi174.stdout:5 2021-03-25T14:15:51.692 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.691+0000 7f158b9bf700 1 -- 172.21.15.174:0/2153444000 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f158414cc90 msgr2=0x7f15840a44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:51.693 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.691+0000 7f158b9bf700 1 --2- 172.21.15.174:0/2153444000 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f158414cc90 0x7f15840a44b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f1580009e40 tx=0x7f1580016000).stop 2021-03-25T14:15:51.693 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.691+0000 7f158b9bf700 1 -- 172.21.15.174:0/2153444000 shutdown_connections 2021-03-25T14:15:51.693 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.691+0000 7f158b9bf700 1 --2- 172.21.15.174:0/2153444000 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f158414d470 0x7f15840a49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:51.693 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.691+0000 7f158b9bf700 1 --2- 172.21.15.174:0/2153444000 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15841498b0 0x7f15840b6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:51.693 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.691+0000 7f158b9bf700 1 --2- 172.21.15.174:0/2153444000 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f158414cc90 0x7f15840a44b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:51.693 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.691+0000 7f158b9bf700 1 -- 172.21.15.174:0/2153444000 >> 172.21.15.174:0/2153444000 conn(0x7f1584060c40 msgr2=0x7f1584069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:15:51.693 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.691+0000 7f158b9bf700 1 -- 172.21.15.174:0/2153444000 shutdown_connections 2021-03-25T14:15:51.693 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.691+0000 7f158b9bf700 1 -- 172.21.15.174:0/2153444000 wait complete. 2021-03-25T14:15:51.705 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new 6912beba-0704-442b-af14-b804dea8d7ce 6 2021-03-25T14:15:51.818 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.816+0000 7f6bb22a5700 1 Processor -- start 2021-03-25T14:15:51.818 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.816+0000 7f6bb22a5700 1 -- start start 2021-03-25T14:15:51.821 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.817+0000 7f6bb22a5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6bac0bc190 0x7f6bac063e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:51.821 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.817+0000 7f6bb22a5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bac063620 0x7f6bac0b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:51.821 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.817+0000 7f6bb22a5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bac0b6d20 con 0x7f6bac0b13b0 2021-03-25T14:15:51.821 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.817+0000 7f6bb22a5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bac0b7060 con 0x7f6bac0bc190 2021-03-25T14:15:51.821 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.817+0000 7f6bb22a5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac0b7300 con 0x7f6bac063620 2021-03-25T14:15:51.821 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.817+0000 7f6bab7fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bac063620 0x7f6bac0b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:51.821 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.817+0000 7f6babfff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6bac0bc190 0x7f6bac063e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:51.822 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.817+0000 7f6bab7fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bac063620 0x7f6bac0b0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:34428/0 (socket says 172.21.15.174:34428) 2021-03-25T14:15:51.822 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.817+0000 7f6babfff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6bac0bc190 0x7f6bac063e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:46772/0 (socket says 172.21.15.174:46772) 2021-03-25T14:15:51.822 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.817+0000 7f6bb0842700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f6bac0b13b0 0x7f6bac149db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:49020/0 (socket says 172.21.15.174:49020) 2021-03-25T14:15:51.823 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.817+0000 7f6bab7fe700 1 -- 172.21.15.174:0/4021201443 learned_addr learned my addr 172.21.15.174:0/4021201443 (peer_addr_for_me v2:172.21.15.174:0/0) 2021-03-25T14:15:51.823 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.817+0000 7f6babfff700 1 -- 172.21.15.174:0/4021201443 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bac063620 msgr2=0x7f6bac0b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:15:51.823 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.817+0000 7f6babfff700 1 --2- 172.21.15.174:0/4021201443 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bac063620 0x7f6bac0b0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:51.823 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.817+0000 7f6babfff700 1 -- 172.21.15.174:0/4021201443 >> v1:172.21.15.174:6789/0 conn(0x7f6bac0b13b0 legacy=0x7f6bac149db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:51.823 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.817+0000 7f6baaffd700 1 -- 172.21.15.174:0/4021201443 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 373172334 0 0) 0x7f6bac0b6d20 con 0x7f6bac0b13b0 2021-03-25T14:15:51.823 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.817+0000 7f6babfff700 1 -- 172.21.15.174:0/4021201443 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bac0b65e0 con 0x7f6bac0bc190 2021-03-25T14:15:51.823 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.818+0000 7f6bab7fe700 1 --2- 172.21.15.174:0/4021201443 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bac063620 0x7f6bac0b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:15:51.823 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.818+0000 7f6babfff700 1 --2- 172.21.15.174:0/4021201443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6bac0bc190 0x7f6bac063e00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f6ba000b9c0 tx=0x7f6ba0006e20).ready entity=mon.1 client_cookie=b6e57182476b6005 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:15:51.823 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.818+0000 7f6baaffd700 1 -- 172.21.15.174:0/4021201443 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0009870 con 0x7f6bac0bc190 2021-03-25T14:15:51.823 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.818+0000 7f6baaffd700 1 -- 172.21.15.174:0/4021201443 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba00099d0 con 0x7f6bac0bc190 2021-03-25T14:15:51.823 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.818+0000 7f6baaffd700 1 -- 172.21.15.174:0/4021201443 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0009d50 con 0x7f6bac0bc190 2021-03-25T14:15:51.823 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.818+0000 7f6bb22a5700 1 -- 172.21.15.174:0/4021201443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6bac0bc190 msgr2=0x7f6bac063e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:51.824 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.818+0000 7f6bb22a5700 1 --2- 172.21.15.174:0/4021201443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6bac0bc190 0x7f6bac063e00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f6ba000b9c0 tx=0x7f6ba0006e20).stop 2021-03-25T14:15:51.824 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.818+0000 7f6bb22a5700 1 -- 172.21.15.174:0/4021201443 shutdown_connections 2021-03-25T14:15:51.824 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.818+0000 7f6bb22a5700 1 --2- 172.21.15.174:0/4021201443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6bac0bc190 0x7f6bac063e00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:51.824 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.818+0000 7f6bb22a5700 1 --2- 172.21.15.174:0/4021201443 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bac063620 0x7f6bac0b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:51.824 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.818+0000 7f6bb22a5700 1 -- 172.21.15.174:0/4021201443 >> 172.21.15.174:0/4021201443 conn(0x7f6bac0664e0 msgr2=0x7f6bac0668f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:15:51.824 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.818+0000 7f6bb22a5700 1 -- 172.21.15.174:0/4021201443 shutdown_connections 2021-03-25T14:15:51.824 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.818+0000 7f6bb22a5700 1 -- 172.21.15.174:0/4021201443 wait complete. 2021-03-25T14:15:51.824 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.819+0000 7f6bb22a5700 1 Processor -- start 2021-03-25T14:15:51.824 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.820+0000 7f6bb22a5700 1 -- start start 2021-03-25T14:15:51.827 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.820+0000 7f6bb22a5700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6bac063620 0x7f6bac157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:51.827 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.820+0000 7f6bb22a5700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6bac0b13b0 0x7f6bac156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:51.827 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.820+0000 7f6bb22a5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bac0bc190 0x7f6bac0b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:51.827 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.820+0000 7f6bb22a5700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac09f280 con 0x7f6bac063620 2021-03-25T14:15:51.827 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.820+0000 7f6bb22a5700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac09f4e0 con 0x7f6bac0b13b0 2021-03-25T14:15:51.828 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.820+0000 7f6bb22a5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac09f780 con 0x7f6bac0bc190 2021-03-25T14:15:51.828 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.820+0000 7f6bab7fe700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6bac0b13b0 0x7f6bac156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:51.828 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.820+0000 7f6bb0842700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bac0bc190 0x7f6bac0b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:51.828 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.820+0000 7f6bab7fe700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6bac0b13b0 0x7f6bac156b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:46780/0 (socket says 172.21.15.174:46780) 2021-03-25T14:15:51.828 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.820+0000 7f6bab7fe700 1 -- 172.21.15.174:0/3516480854 learned_addr learned my addr 172.21.15.174:0/3516480854 (peer_addr_for_me v2:172.21.15.174:0/0) 2021-03-25T14:15:51.828 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.821+0000 7f6babfff700 1 --2- 172.21.15.174:0/3516480854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6bac063620 0x7f6bac157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:51.828 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.821+0000 7f6bb0842700 1 -- 172.21.15.174:0/3516480854 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6bac0b13b0 msgr2=0x7f6bac156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:51.828 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.821+0000 7f6bb0842700 1 --2- 172.21.15.174:0/3516480854 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6bac0b13b0 0x7f6bac156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:51.828 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.821+0000 7f6bb0842700 1 -- 172.21.15.174:0/3516480854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6bac063620 msgr2=0x7f6bac157490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:51.828 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.821+0000 7f6bb0842700 1 --2- 172.21.15.174:0/3516480854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6bac063620 0x7f6bac157490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:51.828 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.821+0000 7f6bb0842700 1 -- 172.21.15.174:0/3516480854 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bac09fa20 con 0x7f6bac0bc190 2021-03-25T14:15:51.828 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.821+0000 7f6bab7fe700 1 --2- 172.21.15.174:0/3516480854 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6bac0b13b0 0x7f6bac156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:15:51.828 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.821+0000 7f6bb0842700 1 --2- 172.21.15.174:0/3516480854 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bac0bc190 0x7f6bac0b4df0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f6ba4001560 tx=0x7f6ba4007d10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:15:51.829 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.821+0000 7f6b93fff700 1 -- 172.21.15.174:0/3516480854 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba400ce40 con 0x7f6bac0bc190 2021-03-25T14:15:51.829 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.821+0000 7f6b93fff700 1 -- 172.21.15.174:0/3516480854 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba4005af0 con 0x7f6bac0bc190 2021-03-25T14:15:51.829 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.821+0000 7f6b93fff700 1 -- 172.21.15.174:0/3516480854 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba4007110 con 0x7f6bac0bc190 2021-03-25T14:15:51.829 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.821+0000 7f6bb22a5700 1 -- 172.21.15.174:0/3516480854 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bac14cae0 con 0x7f6bac0bc190 2021-03-25T14:15:51.829 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.821+0000 7f6bb22a5700 1 -- 172.21.15.174:0/3516480854 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bac157040 con 0x7f6bac0bc190 2021-03-25T14:15:51.829 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.821+0000 7f6b93fff700 1 -- 172.21.15.174:0/3516480854 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 1) v1 ==== 623+0+0 (secure 0 0 0) 0x7f6ba4010030 con 0x7f6bac0bc190 2021-03-25T14:15:51.829 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.821+0000 7f6b93fff700 1 -- 172.21.15.174:0/3516480854 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7f6ba4013410 con 0x7f6bac0bc190 2021-03-25T14:15:51.829 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.822+0000 7f6bb22a5700 1 -- 172.21.15.174:0/3516480854 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bac05d7b0 con 0x7f6bac0bc190 2021-03-25T14:15:51.829 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.824+0000 7f6b93fff700 1 -- 172.21.15.174:0/3516480854 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72044 (secure 0 0 0) 0x7f6ba4007500 con 0x7f6bac0bc190 2021-03-25T14:15:51.905 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.903+0000 7f6bb22a5700 1 -- 172.21.15.174:0/3516480854 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6912beba-0704-442b-af14-b804dea8d7ce", "id": 6} v 0) v1 -- 0x7f6bac061c50 con 0x7f6bac0bc190 2021-03-25T14:15:51.907 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.906+0000 7f6b93fff700 1 -- 172.21.15.174:0/3516480854 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6912beba-0704-442b-af14-b804dea8d7ce", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6ba40076a0 con 0x7f6bac0bc190 2021-03-25T14:15:51.907 INFO:teuthology.orchestra.run.smithi174.stdout:6 2021-03-25T14:15:51.908 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.907+0000 7f6bb22a5700 1 -- 172.21.15.174:0/3516480854 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bac0bc190 msgr2=0x7f6bac0b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:51.909 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.907+0000 7f6bb22a5700 1 --2- 172.21.15.174:0/3516480854 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bac0bc190 0x7f6bac0b4df0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f6ba4001560 tx=0x7f6ba4007d10).stop 2021-03-25T14:15:51.909 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.907+0000 7f6bb22a5700 1 -- 172.21.15.174:0/3516480854 shutdown_connections 2021-03-25T14:15:51.909 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.907+0000 7f6bb22a5700 1 --2- 172.21.15.174:0/3516480854 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bac0bc190 0x7f6bac0b4df0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:51.909 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.907+0000 7f6bb22a5700 1 --2- 172.21.15.174:0/3516480854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6bac063620 0x7f6bac157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:51.909 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.907+0000 7f6bb22a5700 1 --2- 172.21.15.174:0/3516480854 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6bac0b13b0 0x7f6bac156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:51.909 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.907+0000 7f6bb22a5700 1 -- 172.21.15.174:0/3516480854 >> 172.21.15.174:0/3516480854 conn(0x7f6bac0664e0 msgr2=0x7f6bac063bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:15:51.909 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.907+0000 7f6bb22a5700 1 -- 172.21.15.174:0/3516480854 shutdown_connections 2021-03-25T14:15:51.909 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:51.907+0000 7f6bb22a5700 1 -- 172.21.15.174:0/3516480854 wait complete. 2021-03-25T14:15:51.920 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new aa93635b-7039-4052-a0a5-1242f674e068 7 2021-03-25T14:15:52.031 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.029+0000 7f151f1cd700 1 Processor -- start 2021-03-25T14:15:52.031 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.030+0000 7f151f1cd700 1 -- start start 2021-03-25T14:15:52.034 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.030+0000 7f151f1cd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f151814ab30 0x7f15180b4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:52.035 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.030+0000 7f151f1cd700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1518066cd0 0x7f15180b4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:52.035 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.030+0000 7f151f1cd700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1518148a30 con 0x7f15181471c0 2021-03-25T14:15:52.035 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.030+0000 7f151f1cd700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15180b3ba0 con 0x7f1518066cd0 2021-03-25T14:15:52.035 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.030+0000 7f151f1cd700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f151814b0b0 con 0x7f151814ab30 2021-03-25T14:15:52.035 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.030+0000 7f1517fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f151814ab30 0x7f15180b4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:52.035 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.030+0000 7f151cf69700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f15181471c0 0x7f15180be2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:49032/0 (socket says 172.21.15.174:49032) 2021-03-25T14:15:52.035 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.030+0000 7f151cf69700 1 -- 172.21.15.174:0/312090570 learned_addr learned my addr 172.21.15.174:0/312090570 (peer_addr_for_me v1:172.21.15.174:0/0) 2021-03-25T14:15:52.035 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.031+0000 7f151d76a700 1 --2- 172.21.15.174:0/312090570 >> v2:172.21.15.110:3300/0 conn(0x7f1518066cd0 0x7f15180b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:52.035 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.031+0000 7f15177fe700 1 -- 172.21.15.174:0/312090570 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 903661323 0 0) 0x7f1518148a30 con 0x7f15181471c0 2021-03-25T14:15:52.035 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.031+0000 7f15177fe700 1 -- 172.21.15.174:0/312090570 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14fc003270 con 0x7f15181471c0 2021-03-25T14:15:52.035 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.031+0000 7f1517fff700 1 -- 172.21.15.174:0/312090570 >> v2:172.21.15.110:3300/0 conn(0x7f1518066cd0 msgr2=0x7f15180b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:15:52.035 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.031+0000 7f1517fff700 1 --2- 172.21.15.174:0/312090570 >> v2:172.21.15.110:3300/0 conn(0x7f1518066cd0 0x7f15180b4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:52.036 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.031+0000 7f1517fff700 1 -- 172.21.15.174:0/312090570 >> v1:172.21.15.174:6789/0 conn(0x7f15181471c0 legacy=0x7f15180be2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:52.036 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.031+0000 7f1517fff700 1 -- 172.21.15.174:0/312090570 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f151814b350 con 0x7f151814ab30 2021-03-25T14:15:52.036 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.031+0000 7f151d76a700 1 --2- 172.21.15.174:0/312090570 >> v2:172.21.15.110:3300/0 conn(0x7f1518066cd0 0x7f15180b4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:15:52.036 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.031+0000 7f1517fff700 1 --2- 172.21.15.174:0/312090570 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f151814ab30 0x7f15180b4430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f150400b9c0 tx=0x7f1504006e20).ready entity=mon.2 client_cookie=2ac85a136402b352 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:15:52.036 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.031+0000 7f15177fe700 1 -- 172.21.15.174:0/312090570 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15040097e0 con 0x7f151814ab30 2021-03-25T14:15:52.036 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.031+0000 7f15177fe700 1 -- 172.21.15.174:0/312090570 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1504009940 con 0x7f151814ab30 2021-03-25T14:15:52.036 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.031+0000 7f15177fe700 1 -- 172.21.15.174:0/312090570 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1504009cc0 con 0x7f151814ab30 2021-03-25T14:15:52.036 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.032+0000 7f151f1cd700 1 -- 172.21.15.174:0/312090570 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f151814ab30 msgr2=0x7f15180b4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:52.036 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.032+0000 7f151f1cd700 1 --2- 172.21.15.174:0/312090570 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f151814ab30 0x7f15180b4430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f150400b9c0 tx=0x7f1504006e20).stop 2021-03-25T14:15:52.036 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.032+0000 7f151f1cd700 1 -- 172.21.15.174:0/312090570 shutdown_connections 2021-03-25T14:15:52.036 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.032+0000 7f151f1cd700 1 --2- 172.21.15.174:0/312090570 >> v2:172.21.15.110:3300/0 conn(0x7f1518066cd0 0x7f15180b4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:52.036 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.032+0000 7f151f1cd700 1 --2- 172.21.15.174:0/312090570 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f151814ab30 0x7f15180b4430 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:52.037 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.032+0000 7f151f1cd700 1 -- 172.21.15.174:0/312090570 >> 172.21.15.174:0/312090570 conn(0x7f15180686f0 msgr2=0x7f1518068b00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:15:52.037 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.032+0000 7f151f1cd700 1 -- 172.21.15.174:0/312090570 shutdown_connections 2021-03-25T14:15:52.037 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.032+0000 7f151f1cd700 1 -- 172.21.15.174:0/312090570 wait complete. 2021-03-25T14:15:52.037 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.033+0000 7f151f1cd700 1 Processor -- start 2021-03-25T14:15:52.037 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.033+0000 7f151f1cd700 1 -- start start 2021-03-25T14:15:52.039 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.034+0000 7f151f1cd700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1518066cd0 0x7f1518147680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:52.040 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.034+0000 7f151f1cd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15181471c0 0x7f15181567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:52.040 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.034+0000 7f151f1cd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f151814ab30 0x7f15180b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:52.040 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.034+0000 7f151f1cd700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15180a3850 con 0x7f15181471c0 2021-03-25T14:15:52.040 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.034+0000 7f151f1cd700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15180a3af0 con 0x7f1518066cd0 2021-03-25T14:15:52.040 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.034+0000 7f151f1cd700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15180b4ed0 con 0x7f151814ab30 2021-03-25T14:15:52.040 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.034+0000 7f151cf69700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1518066cd0 0x7f1518147680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:52.040 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.034+0000 7f151d76a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f151814ab30 0x7f15180b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:52.040 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.034+0000 7f151cf69700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1518066cd0 0x7f1518147680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:46790/0 (socket says 172.21.15.174:46790) 2021-03-25T14:15:52.040 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.034+0000 7f151d76a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f151814ab30 0x7f15180b6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:34450/0 (socket says 172.21.15.174:34450) 2021-03-25T14:15:52.040 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.034+0000 7f151cf69700 1 -- 172.21.15.174:0/2979038779 learned_addr learned my addr 172.21.15.174:0/2979038779 (peer_addr_for_me v2:172.21.15.174:0/0) 2021-03-25T14:15:52.040 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.034+0000 7f1517fff700 1 --2- 172.21.15.174:0/2979038779 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15181471c0 0x7f15181567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:52.040 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.034+0000 7f151d76a700 1 -- 172.21.15.174:0/2979038779 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1518066cd0 msgr2=0x7f1518147680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:52.041 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.034+0000 7f151d76a700 1 --2- 172.21.15.174:0/2979038779 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1518066cd0 0x7f1518147680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:52.041 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.034+0000 7f151d76a700 1 -- 172.21.15.174:0/2979038779 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15181471c0 msgr2=0x7f15181567f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:52.041 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.034+0000 7f151d76a700 1 --2- 172.21.15.174:0/2979038779 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15181471c0 0x7f15181567f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:52.041 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.034+0000 7f151d76a700 1 -- 172.21.15.174:0/2979038779 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15180b5170 con 0x7f151814ab30 2021-03-25T14:15:52.041 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.034+0000 7f151cf69700 1 --2- 172.21.15.174:0/2979038779 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1518066cd0 0x7f1518147680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:15:52.041 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.034+0000 7f151d76a700 1 --2- 172.21.15.174:0/2979038779 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f151814ab30 0x7f15180b6b00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f151000ebc0 tx=0x7f1510008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:15:52.041 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.034+0000 7f1514ff9700 1 -- 172.21.15.174:0/2979038779 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151000c580 con 0x7f151814ab30 2021-03-25T14:15:52.041 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.034+0000 7f1514ff9700 1 -- 172.21.15.174:0/2979038779 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151000c6e0 con 0x7f151814ab30 2021-03-25T14:15:52.041 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.034+0000 7f1514ff9700 1 -- 172.21.15.174:0/2979038779 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151000ca80 con 0x7f151814ab30 2021-03-25T14:15:52.041 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.034+0000 7f151f1cd700 1 -- 172.21.15.174:0/2979038779 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15180b5410 con 0x7f151814ab30 2021-03-25T14:15:52.041 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.034+0000 7f151f1cd700 1 -- 172.21.15.174:0/2979038779 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1518147d30 con 0x7f151814ab30 2021-03-25T14:15:52.041 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.035+0000 7f1514ff9700 1 -- 172.21.15.174:0/2979038779 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 1) v1 ==== 623+0+0 (secure 0 0 0) 0x7f1510005d60 con 0x7f151814ab30 2021-03-25T14:15:52.041 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.035+0000 7f1514ff9700 1 -- 172.21.15.174:0/2979038779 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7f151000cdf0 con 0x7f151814ab30 2021-03-25T14:15:52.042 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.035+0000 7f151f1cd700 1 -- 172.21.15.174:0/2979038779 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15180beb60 con 0x7f151814ab30 2021-03-25T14:15:52.042 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.037+0000 7f1514ff9700 1 -- 172.21.15.174:0/2979038779 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72044 (secure 0 0 0) 0x7f151000f040 con 0x7f151814ab30 2021-03-25T14:15:52.116 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.114+0000 7f151f1cd700 1 -- 172.21.15.174:0/2979038779 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd new", "uuid": "aa93635b-7039-4052-a0a5-1242f674e068", "id": 7} v 0) v1 -- 0x7f151805d7b0 con 0x7f151814ab30 2021-03-25T14:15:52.125 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.123+0000 7f1514ff9700 1 -- 172.21.15.174:0/2979038779 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "aa93635b-7039-4052-a0a5-1242f674e068", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f151002b0b0 con 0x7f151814ab30 2021-03-25T14:15:52.125 INFO:teuthology.orchestra.run.smithi174.stdout:7 2021-03-25T14:15:52.126 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.124+0000 7f151f1cd700 1 -- 172.21.15.174:0/2979038779 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f151814ab30 msgr2=0x7f15180b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:52.126 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.124+0000 7f151f1cd700 1 --2- 172.21.15.174:0/2979038779 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f151814ab30 0x7f15180b6b00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f151000ebc0 tx=0x7f1510008040).stop 2021-03-25T14:15:52.127 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.124+0000 7f151f1cd700 1 -- 172.21.15.174:0/2979038779 shutdown_connections 2021-03-25T14:15:52.127 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.124+0000 7f151f1cd700 1 --2- 172.21.15.174:0/2979038779 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1518066cd0 0x7f1518147680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:52.127 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.124+0000 7f151f1cd700 1 --2- 172.21.15.174:0/2979038779 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f151814ab30 0x7f15180b6b00 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:52.127 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.124+0000 7f151f1cd700 1 --2- 172.21.15.174:0/2979038779 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15181471c0 0x7f15181567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:52.127 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.124+0000 7f151f1cd700 1 -- 172.21.15.174:0/2979038779 >> 172.21.15.174:0/2979038779 conn(0x7f15180686f0 msgr2=0x7f15180bd490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:15:52.127 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.125+0000 7f151f1cd700 1 -- 172.21.15.174:0/2979038779 shutdown_connections 2021-03-25T14:15:52.127 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:15:52.125+0000 7f151f1cd700 1 -- 172.21.15.174:0/2979038779 wait complete. 2021-03-25T14:15:52.139 INFO:tasks.ceph.osd.0:Restarting daemon 2021-03-25T14:15:52.139 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2021-03-25T14:15:52.141 INFO:tasks.ceph.osd.0:Started 2021-03-25T14:15:52.141 INFO:tasks.ceph.osd.1:Restarting daemon 2021-03-25T14:15:52.142 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2021-03-25T14:15:52.143 INFO:tasks.ceph.osd.1:Started 2021-03-25T14:15:52.143 INFO:tasks.ceph.osd.2:Restarting daemon 2021-03-25T14:15:52.144 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2021-03-25T14:15:52.145 INFO:tasks.ceph.osd.2:Started 2021-03-25T14:15:52.146 INFO:tasks.ceph.osd.3:Restarting daemon 2021-03-25T14:15:52.146 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2021-03-25T14:15:52.147 INFO:tasks.ceph.osd.3:Started 2021-03-25T14:15:52.148 INFO:tasks.ceph.osd.4:Restarting daemon 2021-03-25T14:15:52.148 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2021-03-25T14:15:52.150 INFO:tasks.ceph.osd.4:Started 2021-03-25T14:15:52.150 INFO:tasks.ceph.osd.5:Restarting daemon 2021-03-25T14:15:52.150 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2021-03-25T14:15:52.152 INFO:tasks.ceph.osd.5:Started 2021-03-25T14:15:52.152 INFO:tasks.ceph.osd.6:Restarting daemon 2021-03-25T14:15:52.152 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2021-03-25T14:15:52.154 INFO:tasks.ceph.osd.6:Started 2021-03-25T14:15:52.154 INFO:tasks.ceph.osd.7:Restarting daemon 2021-03-25T14:15:52.155 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2021-03-25T14:15:52.156 INFO:tasks.ceph.osd.7:Started 2021-03-25T14:15:52.157 INFO:tasks.ceph:Waiting for OSDs to come up 2021-03-25T14:15:52.733 INFO:tasks.ceph.osd.0.smithi110.stderr:2021-03-25T14:15:52.731+0000 7f9b49b76080 -1 Falling back to public interface 2021-03-25T14:15:52.738 INFO:tasks.ceph.osd.1.smithi110.stderr:2021-03-25T14:15:52.736+0000 7f71aed50080 -1 Falling back to public interface 2021-03-25T14:15:52.741 INFO:tasks.ceph.osd.5.smithi174.stderr:2021-03-25T14:15:52.739+0000 7ff693f1b080 -1 Falling back to public interface 2021-03-25T14:15:52.741 INFO:tasks.ceph.osd.4.smithi174.stderr:2021-03-25T14:15:52.739+0000 7f22a20c2080 -1 Falling back to public interface 2021-03-25T14:15:52.741 INFO:tasks.ceph.osd.4.smithi174.stderr:2021-03-25T14:15:52.739+0000 7f229c051700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2021-03-25T14:15:52.744 INFO:tasks.ceph.osd.4.smithi174.stderr:2021-03-25T14:15:52.743+0000 7f229c051700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6814/0: (98) Address already in use 2021-03-25T14:15:52.755 INFO:tasks.ceph.osd.7.smithi174.stderr:2021-03-25T14:15:52.753+0000 7fe1d6fa2080 -1 Falling back to public interface 2021-03-25T14:15:52.755 INFO:tasks.ceph.osd.2.smithi110.stderr:2021-03-25T14:15:52.753+0000 7f9dab600080 -1 Falling back to public interface 2021-03-25T14:15:52.766 INFO:tasks.ceph.osd.3.smithi110.stderr:2021-03-25T14:15:52.764+0000 7f353fc8c080 -1 Falling back to public interface 2021-03-25T14:15:52.771 INFO:tasks.ceph.osd.6.smithi174.stderr:2021-03-25T14:15:52.769+0000 7f6fe65d4080 -1 Falling back to public interface 2021-03-25T14:15:52.962 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-03-25T14:15:53.066 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.065+0000 7f7493099700 1 Processor -- start 2021-03-25T14:15:53.067 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.065+0000 7f7493099700 1 -- start start 2021-03-25T14:15:53.069 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.065+0000 7f7493099700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f748c0b6470 0x7f748c0bb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:53.070 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.065+0000 7f7493099700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f748c14d700 0x7f748c0bb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:53.070 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.065+0000 7f7493099700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f748c0bf5c0 0x7f748c148cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:53.070 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.066+0000 7f7493099700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f748c0a2a30 con 0x7f748c14d700 2021-03-25T14:15:53.070 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.066+0000 7f7493099700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f748c0bbce0 con 0x7f748c0b6470 2021-03-25T14:15:53.070 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.066+0000 7f7493099700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f748c14dc40 con 0x7f748c0bf5c0 2021-03-25T14:15:53.070 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.066+0000 7f7491896700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f748c14d700 0x7f748c0bb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:53.070 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.066+0000 7f7491896700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f748c14d700 0x7f748c0bb7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46980/0 (socket says 172.21.15.110:46980) 2021-03-25T14:15:53.070 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.066+0000 7f7491896700 1 -- 172.21.15.110:0/3481715214 learned_addr learned my addr 172.21.15.110:0/3481715214 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:15:53.070 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.066+0000 7f7492097700 1 --2- 172.21.15.110:0/3481715214 >> v2:172.21.15.174:3300/0 conn(0x7f748c0b6470 0x7f748c0bb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:53.070 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.066+0000 7f7492898700 1 --2- 172.21.15.110:0/3481715214 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f748c0bf5c0 0x7f748c148cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:53.070 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.066+0000 7f7491896700 1 -- 172.21.15.110:0/3481715214 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f748c0bf5c0 msgr2=0x7f748c148cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:15:53.071 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.066+0000 7f7491896700 1 --2- 172.21.15.110:0/3481715214 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f748c0bf5c0 0x7f748c148cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:53.071 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.066+0000 7f7491896700 1 -- 172.21.15.110:0/3481715214 >> v2:172.21.15.174:3300/0 conn(0x7f748c0b6470 msgr2=0x7f748c0bb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:15:53.071 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.066+0000 7f7491896700 1 --2- 172.21.15.110:0/3481715214 >> v2:172.21.15.174:3300/0 conn(0x7f748c0b6470 0x7f748c0bb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:53.071 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.066+0000 7f7491896700 1 -- 172.21.15.110:0/3481715214 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748c149930 con 0x7f748c14d700 2021-03-25T14:15:53.071 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.066+0000 7f7492097700 1 --2- 172.21.15.110:0/3481715214 >> v2:172.21.15.174:3300/0 conn(0x7f748c0b6470 0x7f748c0bb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:15:53.071 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.066+0000 7f7492898700 1 --2- 172.21.15.110:0/3481715214 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f748c0bf5c0 0x7f748c148cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:15:53.071 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.066+0000 7f7491896700 1 --2- 172.21.15.110:0/3481715214 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f748c14d700 0x7f748c0bb7f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f748c065260 tx=0x7f7488006ee0).ready entity=mon.0 client_cookie=7fc3c1489a800567 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:15:53.071 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.066+0000 7f7491095700 1 -- 172.21.15.110:0/3481715214 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7488009890 con 0x7f748c14d700 2021-03-25T14:15:53.071 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.066+0000 7f7491095700 1 -- 172.21.15.110:0/3481715214 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74880099f0 con 0x7f748c14d700 2021-03-25T14:15:53.071 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.066+0000 7f7491095700 1 -- 172.21.15.110:0/3481715214 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7488009d70 con 0x7f748c14d700 2021-03-25T14:15:53.071 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.067+0000 7f7493099700 1 -- 172.21.15.110:0/3481715214 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f748c14d700 msgr2=0x7f748c0bb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:53.071 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.067+0000 7f7493099700 1 --2- 172.21.15.110:0/3481715214 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f748c14d700 0x7f748c0bb7f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f748c065260 tx=0x7f7488006ee0).stop 2021-03-25T14:15:53.071 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.067+0000 7f7493099700 1 -- 172.21.15.110:0/3481715214 shutdown_connections 2021-03-25T14:15:53.072 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.067+0000 7f7493099700 1 --2- 172.21.15.110:0/3481715214 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f748c0bf5c0 0x7f748c148cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:53.072 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.067+0000 7f7493099700 1 --2- 172.21.15.110:0/3481715214 >> v2:172.21.15.174:3300/0 conn(0x7f748c0b6470 0x7f748c0bb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:53.072 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.067+0000 7f7493099700 1 --2- 172.21.15.110:0/3481715214 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f748c14d700 0x7f748c0bb7f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:53.072 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.067+0000 7f7493099700 1 -- 172.21.15.110:0/3481715214 >> 172.21.15.110:0/3481715214 conn(0x7f748c060c40 msgr2=0x7f748c061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:15:53.072 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.067+0000 7f7493099700 1 -- 172.21.15.110:0/3481715214 shutdown_connections 2021-03-25T14:15:53.072 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.067+0000 7f7493099700 1 -- 172.21.15.110:0/3481715214 wait complete. 2021-03-25T14:15:53.072 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.068+0000 7f7493099700 1 Processor -- start 2021-03-25T14:15:53.072 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.068+0000 7f7493099700 1 -- start start 2021-03-25T14:15:53.076 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.069+0000 7f7493099700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f748c0b6470 0x7f748c063760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:53.076 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.069+0000 7f7493099700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f748c0bf5c0 0x7f748c0a4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:53.076 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.069+0000 7f7493099700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f748c14d700 0x7f748c146400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:15:53.076 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.069+0000 7f7493099700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748c0a2f60 con 0x7f748c0b6470 2021-03-25T14:15:53.076 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.069+0000 7f7493099700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748c0a3200 con 0x7f748c14d700 2021-03-25T14:15:53.076 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.069+0000 7f7493099700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f748c0a34a0 con 0x7f748c0bf5c0 2021-03-25T14:15:53.076 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.069+0000 7f7492097700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f748c0b6470 0x7f748c063760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:53.076 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.069+0000 7f7492097700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f748c0b6470 0x7f748c063760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46986/0 (socket says 172.21.15.110:46986) 2021-03-25T14:15:53.076 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.069+0000 7f7492097700 1 -- 172.21.15.110:0/1667696736 learned_addr learned my addr 172.21.15.110:0/1667696736 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:15:53.077 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.069+0000 7f7491896700 1 --2- 172.21.15.110:0/1667696736 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f748c0bf5c0 0x7f748c0a4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:53.077 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.069+0000 7f7492898700 1 --2- 172.21.15.110:0/1667696736 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f748c14d700 0x7f748c146400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:15:53.077 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.069+0000 7f7492097700 1 -- 172.21.15.110:0/1667696736 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f748c0bf5c0 msgr2=0x7f748c0a4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:53.077 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.069+0000 7f7492097700 1 --2- 172.21.15.110:0/1667696736 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f748c0bf5c0 0x7f748c0a4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:53.077 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.069+0000 7f7492097700 1 -- 172.21.15.110:0/1667696736 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f748c14d700 msgr2=0x7f748c146400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:53.077 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.069+0000 7f7492097700 1 --2- 172.21.15.110:0/1667696736 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f748c14d700 0x7f748c146400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:53.077 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.069+0000 7f7492097700 1 -- 172.21.15.110:0/1667696736 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748c0a3740 con 0x7f748c0b6470 2021-03-25T14:15:53.077 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.069+0000 7f7492097700 1 --2- 172.21.15.110:0/1667696736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f748c0b6470 0x7f748c063760 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f747c00db60 tx=0x7f747c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:15:53.077 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.069+0000 7f747a7fc700 1 -- 172.21.15.110:0/1667696736 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747c00de70 con 0x7f748c0b6470 2021-03-25T14:15:53.077 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.069+0000 7f747a7fc700 1 -- 172.21.15.110:0/1667696736 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f747c0097c0 con 0x7f748c0b6470 2021-03-25T14:15:53.077 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.069+0000 7f7493099700 1 -- 172.21.15.110:0/1667696736 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f748c0a3be0 con 0x7f748c0b6470 2021-03-25T14:15:53.077 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.069+0000 7f747a7fc700 1 -- 172.21.15.110:0/1667696736 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747c009b80 con 0x7f748c0b6470 2021-03-25T14:15:53.078 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.069+0000 7f7493099700 1 -- 172.21.15.110:0/1667696736 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f748c063c50 con 0x7f748c0b6470 2021-03-25T14:15:53.078 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.069+0000 7f747a7fc700 1 -- 172.21.15.110:0/1667696736 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) v1 ==== 623+0+0 (secure 0 0 0) 0x7f747c013760 con 0x7f748c0b6470 2021-03-25T14:15:53.078 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.069+0000 7f747a7fc700 1 -- 172.21.15.110:0/1667696736 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7f747c012ae0 con 0x7f748c0b6470 2021-03-25T14:15:53.078 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.070+0000 7f7493099700 1 -- 172.21.15.110:0/1667696736 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f748c14a2d0 con 0x7f748c0b6470 2021-03-25T14:15:53.078 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.072+0000 7f747a7fc700 1 -- 172.21.15.110:0/1667696736 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72044 (secure 0 0 0) 0x7f747c012e00 con 0x7f748c0b6470 2021-03-25T14:15:53.138 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.136+0000 7f7493099700 1 -- 172.21.15.110:0/1667696736 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f748c045ae0 con 0x7f748c0b6470 2021-03-25T14:15:53.139 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.137+0000 7f747a7fc700 1 -- 172.21.15.110:0/1667696736 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7023 (secure 0 0 0) 0x7f747c013bf0 con 0x7f748c0b6470 2021-03-25T14:15:53.139 INFO:teuthology.misc.health.smithi110.stdout: 2021-03-25T14:15:53.139 INFO:teuthology.misc.health.smithi110.stdout:{"epoch":10,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:15:52.116422+0000","last_up_change":"0.000000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:15:53.140 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.138+0000 7f7493099700 1 -- 172.21.15.110:0/1667696736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f748c0b6470 msgr2=0x7f748c063760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:15:53.140 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.138+0000 7f7493099700 1 --2- 172.21.15.110:0/1667696736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f748c0b6470 0x7f748c063760 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f747c00db60 tx=0x7f747c008040).stop 2021-03-25T14:15:53.140 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.138+0000 7f7493099700 1 -- 172.21.15.110:0/1667696736 shutdown_connections 2021-03-25T14:15:53.140 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.138+0000 7f7493099700 1 --2- 172.21.15.110:0/1667696736 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f748c14d700 0x7f748c146400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:53.140 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.138+0000 7f7493099700 1 --2- 172.21.15.110:0/1667696736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f748c0b6470 0x7f748c063760 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:53.140 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.138+0000 7f7493099700 1 --2- 172.21.15.110:0/1667696736 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f748c0bf5c0 0x7f748c0a4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:15:53.140 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.138+0000 7f7493099700 1 -- 172.21.15.110:0/1667696736 >> 172.21.15.110:0/1667696736 conn(0x7f748c060c40 msgr2=0x7f748c064280 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:15:53.141 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.138+0000 7f7493099700 1 -- 172.21.15.110:0/1667696736 shutdown_connections 2021-03-25T14:15:53.141 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:15:53.138+0000 7f7493099700 1 -- 172.21.15.110:0/1667696736 wait complete. 2021-03-25T14:15:53.151 DEBUG:teuthology.misc:0 of 8 OSDs are up 2021-03-25T14:15:56.198 INFO:tasks.ceph.osd.0.smithi110.stderr:2021-03-25T14:15:56.196+0000 7f9b49b76080 -1 osd.0 0 log_to_monitors {default=true} 2021-03-25T14:15:56.202 INFO:tasks.ceph.osd.5.smithi174.stderr:2021-03-25T14:15:56.200+0000 7ff693f1b080 -1 osd.5 0 log_to_monitors {default=true} 2021-03-25T14:15:56.215 INFO:tasks.ceph.osd.4.smithi174.stderr:2021-03-25T14:15:56.214+0000 7f22a20c2080 -1 osd.4 0 log_to_monitors {default=true} 2021-03-25T14:15:56.232 INFO:tasks.ceph.osd.1.smithi110.stderr:2021-03-25T14:15:56.230+0000 7f71aed50080 -1 osd.1 0 log_to_monitors {default=true} 2021-03-25T14:15:56.246 INFO:tasks.ceph.osd.7.smithi174.stderr:2021-03-25T14:15:56.245+0000 7fe1d6fa2080 -1 osd.7 0 log_to_monitors {default=true} 2021-03-25T14:15:56.250 INFO:tasks.ceph.osd.3.smithi110.stderr:2021-03-25T14:15:56.248+0000 7f353fc8c080 -1 osd.3 0 log_to_monitors {default=true} 2021-03-25T14:15:56.255 INFO:tasks.ceph.osd.2.smithi110.stderr:2021-03-25T14:15:56.253+0000 7f9dab600080 -1 osd.2 0 log_to_monitors {default=true} 2021-03-25T14:15:56.258 INFO:tasks.ceph.osd.6.smithi174.stderr:2021-03-25T14:15:56.257+0000 7f6fe65d4080 -1 osd.6 0 log_to_monitors {default=true} 2021-03-25T14:15:58.010 INFO:tasks.ceph.osd.7.smithi174.stderr:2021-03-25T14:15:58.008+0000 7fe1cd72a700 -1 osd.7 0 waiting for initial osdmap 2021-03-25T14:15:58.011 INFO:tasks.ceph.osd.5.smithi174.stderr:2021-03-25T14:15:58.010+0000 7ff68a6a3700 -1 osd.5 0 waiting for initial osdmap 2021-03-25T14:15:58.011 INFO:tasks.ceph.osd.6.smithi174.stderr:2021-03-25T14:15:58.010+0000 7f6fdcd5c700 -1 osd.6 0 waiting for initial osdmap 2021-03-25T14:15:58.012 INFO:tasks.ceph.osd.1.smithi110.stderr:2021-03-25T14:15:58.009+0000 7f71a54d8700 -1 osd.1 0 waiting for initial osdmap 2021-03-25T14:15:58.012 INFO:tasks.ceph.osd.3.smithi110.stderr:2021-03-25T14:15:58.010+0000 7f3536414700 -1 osd.3 0 waiting for initial osdmap 2021-03-25T14:15:58.012 INFO:tasks.ceph.osd.0.smithi110.stderr:2021-03-25T14:15:58.010+0000 7f9b402fe700 -1 osd.0 0 waiting for initial osdmap 2021-03-25T14:15:58.013 INFO:tasks.ceph.osd.4.smithi174.stderr:2021-03-25T14:15:58.010+0000 7f229884a700 -1 osd.4 0 waiting for initial osdmap 2021-03-25T14:15:58.014 INFO:tasks.ceph.osd.2.smithi110.stderr:2021-03-25T14:15:58.012+0000 7f9da1d88700 -1 osd.2 0 waiting for initial osdmap 2021-03-25T14:15:59.958 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-03-25T14:16:00.074 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.072+0000 7fbc7c174700 1 Processor -- start 2021-03-25T14:16:00.074 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.072+0000 7fbc7c174700 1 -- start start 2021-03-25T14:16:00.077 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.073+0000 7fbc7c174700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbc7413fff0 0x7fbc741403d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:00.077 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.073+0000 7fbc7c174700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbc7414a230 0x7fbc740b83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:00.077 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.073+0000 7fbc7c174700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc74146420 con 0x7fbc740b01b0 2021-03-25T14:16:00.077 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.073+0000 7fbc7c174700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc741466c0 con 0x7fbc7413fff0 2021-03-25T14:16:00.077 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.073+0000 7fbc7c174700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc74146960 con 0x7fbc7414a230 2021-03-25T14:16:00.077 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.073+0000 7fbc79f10700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbc7413fff0 0x7fbc741403d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:00.077 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.073+0000 7fbc79f10700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbc7413fff0 0x7fbc741403d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47190/0 (socket says 172.21.15.110:47190) 2021-03-25T14:16:00.078 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.073+0000 7fbc79f10700 1 -- 172.21.15.110:0/1320941785 learned_addr learned my addr 172.21.15.110:0/1320941785 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:00.078 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.074+0000 7fbc7a711700 1 --2- 172.21.15.110:0/1320941785 >> v2:172.21.15.174:3300/0 conn(0x7fbc7414a230 0x7fbc740b83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:00.078 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.074+0000 7fbc79f10700 1 -- 172.21.15.110:0/1320941785 >> v2:172.21.15.174:3300/0 conn(0x7fbc7414a230 msgr2=0x7fbc740b83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:00.078 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.074+0000 7fbc79f10700 1 --2- 172.21.15.110:0/1320941785 >> v2:172.21.15.174:3300/0 conn(0x7fbc7414a230 0x7fbc740b83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:00.078 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.074+0000 7fbc79f10700 1 -- 172.21.15.110:0/1320941785 >> v1:172.21.15.174:6789/0 conn(0x7fbc740b01b0 legacy=0x7fbc740bbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:00.078 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.074+0000 7fbc79f10700 1 -- 172.21.15.110:0/1320941785 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc74146c00 con 0x7fbc7413fff0 2021-03-25T14:16:00.078 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.074+0000 7fbc7a711700 1 --2- 172.21.15.110:0/1320941785 >> v2:172.21.15.174:3300/0 conn(0x7fbc7414a230 0x7fbc740b83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:00.078 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.074+0000 7fbc79f10700 1 --2- 172.21.15.110:0/1320941785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc7413fff0 0x7fbc741403d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fbc740670c0 tx=0x7fbc70006ee0).ready entity=mon.0 client_cookie=c0a320b3a8e6a479 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:00.078 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.074+0000 7fbc78f0e700 1 -- 172.21.15.110:0/1320941785 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc700098d0 con 0x7fbc7413fff0 2021-03-25T14:16:00.078 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.074+0000 7fbc78f0e700 1 -- 172.21.15.110:0/1320941785 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc70009a30 con 0x7fbc7413fff0 2021-03-25T14:16:00.079 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.074+0000 7fbc78f0e700 1 -- 172.21.15.110:0/1320941785 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc70009db0 con 0x7fbc7413fff0 2021-03-25T14:16:00.079 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.074+0000 7fbc7c174700 1 -- 172.21.15.110:0/1320941785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc7413fff0 msgr2=0x7fbc741403d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:00.079 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.074+0000 7fbc7c174700 1 --2- 172.21.15.110:0/1320941785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc7413fff0 0x7fbc741403d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fbc740670c0 tx=0x7fbc70006ee0).stop 2021-03-25T14:16:00.079 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.074+0000 7fbc7c174700 1 -- 172.21.15.110:0/1320941785 shutdown_connections 2021-03-25T14:16:00.079 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.074+0000 7fbc7c174700 1 --2- 172.21.15.110:0/1320941785 >> v2:172.21.15.174:3300/0 conn(0x7fbc7414a230 0x7fbc740b83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:00.079 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.074+0000 7fbc7c174700 1 --2- 172.21.15.110:0/1320941785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc7413fff0 0x7fbc741403d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:00.079 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.074+0000 7fbc7c174700 1 -- 172.21.15.110:0/1320941785 >> 172.21.15.110:0/1320941785 conn(0x7fbc74063850 msgr2=0x7fbc7405c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:00.079 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.075+0000 7fbc7c174700 1 -- 172.21.15.110:0/1320941785 shutdown_connections 2021-03-25T14:16:00.079 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.075+0000 7fbc7c174700 1 -- 172.21.15.110:0/1320941785 wait complete. 2021-03-25T14:16:00.082 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.076+0000 7fbc7c174700 1 Processor -- start 2021-03-25T14:16:00.082 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.076+0000 7fbc7c174700 1 -- start start 2021-03-25T14:16:00.082 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.076+0000 7fbc7c174700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc740b01b0 0x7fbc741433d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:00.082 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.076+0000 7fbc7c174700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc7413fff0 0x7fbc74148300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:00.082 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.076+0000 7fbc7c174700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbc7414a230 0x7fbc7413f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:00.083 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.076+0000 7fbc7c174700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc74142990 con 0x7fbc7413fff0 2021-03-25T14:16:00.083 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.076+0000 7fbc7c174700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc74142c30 con 0x7fbc740b01b0 2021-03-25T14:16:00.083 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.076+0000 7fbc7c174700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc74142ed0 con 0x7fbc7414a230 2021-03-25T14:16:00.083 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.076+0000 7fbc7970f700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc7413fff0 0x7fbc74148300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:00.083 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.076+0000 7fbc7970f700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc7413fff0 0x7fbc74148300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47198/0 (socket says 172.21.15.110:47198) 2021-03-25T14:16:00.083 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.076+0000 7fbc7970f700 1 -- 172.21.15.110:0/3268846738 learned_addr learned my addr 172.21.15.110:0/3268846738 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:00.083 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.076+0000 7fbc79f10700 1 --2- 172.21.15.110:0/3268846738 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc740b01b0 0x7fbc741433d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:00.083 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.077+0000 7fbc7a711700 1 --2- 172.21.15.110:0/3268846738 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbc7414a230 0x7fbc7413f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:00.083 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.077+0000 7fbc7970f700 1 -- 172.21.15.110:0/3268846738 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbc7414a230 msgr2=0x7fbc7413f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:00.083 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.077+0000 7fbc7970f700 1 --2- 172.21.15.110:0/3268846738 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbc7414a230 0x7fbc7413f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:00.083 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.077+0000 7fbc7970f700 1 -- 172.21.15.110:0/3268846738 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc740b01b0 msgr2=0x7fbc741433d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:00.083 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.077+0000 7fbc7970f700 1 --2- 172.21.15.110:0/3268846738 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc740b01b0 0x7fbc741433d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:00.084 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.077+0000 7fbc7970f700 1 -- 172.21.15.110:0/3268846738 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc74143170 con 0x7fbc7413fff0 2021-03-25T14:16:00.084 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.077+0000 7fbc7970f700 1 --2- 172.21.15.110:0/3268846738 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc7413fff0 0x7fbc74148300 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fbc6400c710 tx=0x7fbc64007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:00.084 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.077+0000 7fbc61ffb700 1 -- 172.21.15.110:0/3268846738 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc64007020 con 0x7fbc7413fff0 2021-03-25T14:16:00.084 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.077+0000 7fbc61ffb700 1 -- 172.21.15.110:0/3268846738 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc64007180 con 0x7fbc7413fff0 2021-03-25T14:16:00.084 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.077+0000 7fbc7c174700 1 -- 172.21.15.110:0/3268846738 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc74158d20 con 0x7fbc7413fff0 2021-03-25T14:16:00.084 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.077+0000 7fbc61ffb700 1 -- 172.21.15.110:0/3268846738 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc64006520 con 0x7fbc7413fff0 2021-03-25T14:16:00.084 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.077+0000 7fbc7c174700 1 -- 172.21.15.110:0/3268846738 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc741487f0 con 0x7fbc7413fff0 2021-03-25T14:16:00.084 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.078+0000 7fbc7c174700 1 -- 172.21.15.110:0/3268846738 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc740b9410 con 0x7fbc7413fff0 2021-03-25T14:16:00.084 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.078+0000 7fbc61ffb700 1 -- 172.21.15.110:0/3268846738 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fbc64010070 con 0x7fbc7413fff0 2021-03-25T14:16:00.084 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.079+0000 7fbc61ffb700 1 --2- 172.21.15.110:0/3268846738 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fbc5405a0b0 0x7fbc5405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:00.084 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.079+0000 7fbc61ffb700 1 -- 172.21.15.110:0/3268846738 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4876+0+0 (secure 0 0 0) 0x7fbc64072bb0 con 0x7fbc7413fff0 2021-03-25T14:16:00.084 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.079+0000 7fbc79f10700 1 --2- 172.21.15.110:0/3268846738 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fbc5405a0b0 0x7fbc5405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:00.084 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.079+0000 7fbc79f10700 1 --2- 172.21.15.110:0/3268846738 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fbc5405a0b0 0x7fbc5405c570 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fbc70006f20 tx=0x7fbc70016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:00.085 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.083+0000 7fbc61ffb700 1 -- 172.21.15.110:0/3268846738 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fbc64079080 con 0x7fbc7413fff0 2021-03-25T14:16:00.236 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.235+0000 7fbc7c174700 1 -- 172.21.15.110:0/3268846738 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc74158eb0 con 0x7fbc7413fff0 2021-03-25T14:16:00.237 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.235+0000 7fbc61ffb700 1 -- 172.21.15.110:0/3268846738 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+12190 (secure 0 0 0) 0x7fbc6404a430 con 0x7fbc7413fff0 2021-03-25T14:16:00.238 INFO:teuthology.misc.health.smithi110.stdout: 2021-03-25T14:16:00.238 INFO:teuthology.misc.health.smithi110.stdout:{"epoch":14,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:16:00.015444+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:16:00.240 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.237+0000 7fbc7c174700 1 -- 172.21.15.110:0/3268846738 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fbc5405a0b0 msgr2=0x7fbc5405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:00.240 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.237+0000 7fbc7c174700 1 --2- 172.21.15.110:0/3268846738 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fbc5405a0b0 0x7fbc5405c570 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fbc70006f20 tx=0x7fbc70016000).stop 2021-03-25T14:16:00.240 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.237+0000 7fbc7c174700 1 -- 172.21.15.110:0/3268846738 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc7413fff0 msgr2=0x7fbc74148300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:00.240 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.237+0000 7fbc7c174700 1 --2- 172.21.15.110:0/3268846738 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc7413fff0 0x7fbc74148300 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fbc6400c710 tx=0x7fbc64007c80).stop 2021-03-25T14:16:00.240 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.237+0000 7fbc7c174700 1 -- 172.21.15.110:0/3268846738 shutdown_connections 2021-03-25T14:16:00.240 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.237+0000 7fbc7c174700 1 --2- 172.21.15.110:0/3268846738 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fbc5405a0b0 0x7fbc5405c570 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:00.240 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.237+0000 7fbc7c174700 1 --2- 172.21.15.110:0/3268846738 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc740b01b0 0x7fbc741433d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:00.240 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.237+0000 7fbc7c174700 1 --2- 172.21.15.110:0/3268846738 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbc7414a230 0x7fbc7413f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:00.240 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.237+0000 7fbc7c174700 1 --2- 172.21.15.110:0/3268846738 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc7413fff0 0x7fbc74148300 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:00.240 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.237+0000 7fbc7c174700 1 -- 172.21.15.110:0/3268846738 >> 172.21.15.110:0/3268846738 conn(0x7fbc74063850 msgr2=0x7fbc74145b40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:00.241 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.237+0000 7fbc7c174700 1 -- 172.21.15.110:0/3268846738 shutdown_connections 2021-03-25T14:16:00.241 INFO:teuthology.misc.health.smithi110.stderr:2021-03-25T14:16:00.237+0000 7fbc7c174700 1 -- 172.21.15.110:0/3268846738 wait complete. 2021-03-25T14:16:00.249 DEBUG:teuthology.misc:8 of 8 OSDs are up 2021-03-25T14:16:00.250 INFO:tasks.ceph:Creating RBD pool 2021-03-25T14:16:00.250 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd pool create rbd 8 2021-03-25T14:16:00.358 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.356+0000 7f92d9266700 1 Processor -- start 2021-03-25T14:16:00.358 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.356+0000 7f92d9266700 1 -- start start 2021-03-25T14:16:00.365 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.357+0000 7f92d9266700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92d40b1500 0x7f92d4067780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:00.365 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.357+0000 7f92d9266700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92d414cea0 con 0x7f92d40c0a80 2021-03-25T14:16:00.365 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.357+0000 7f92d9266700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92d414d140 con 0x7f92d40bfef0 2021-03-25T14:16:00.365 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.357+0000 7f92d9266700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d414d3e0 con 0x7f92d40b1500 2021-03-25T14:16:00.365 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.357+0000 7f92d37fe700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f92d40c0a80 0x7f92d4149c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:40140/0 (socket says 172.21.15.110:40140) 2021-03-25T14:16:00.365 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.357+0000 7f92d37fe700 1 -- 172.21.15.110:0/3964083385 learned_addr learned my addr 172.21.15.110:0/3964083385 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:00.365 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.357+0000 7f92d27fc700 1 -- 172.21.15.110:0/3964083385 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1703886194 0 0) 0x7f92d414cea0 con 0x7f92d40c0a80 2021-03-25T14:16:00.365 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.357+0000 7f92d2ffd700 1 --2- 172.21.15.110:0/3964083385 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92d40b1500 0x7f92d4067780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:00.366 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.357+0000 7f92d27fc700 1 -- 172.21.15.110:0/3964083385 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92b4003270 con 0x7f92d40c0a80 2021-03-25T14:16:00.366 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.358+0000 7f92d27fc700 1 -- 172.21.15.110:0/3964083385 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3719834526 0 0) 0x7f92b4003270 con 0x7f92d40c0a80 2021-03-25T14:16:00.366 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.358+0000 7f92d27fc700 1 -- 172.21.15.110:0/3964083385 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92d40b1500 msgr2=0x7f92d4067780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:00.366 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.358+0000 7f92d27fc700 1 --2- 172.21.15.110:0/3964083385 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92d40b1500 0x7f92d4067780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:00.366 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.358+0000 7f92d27fc700 1 -- 172.21.15.110:0/3964083385 >> v1:172.21.15.174:6789/0 conn(0x7f92d40bfef0 legacy=0x7f92d40c0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:00.366 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.358+0000 7f92d27fc700 1 -- 172.21.15.110:0/3964083385 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d414d680 con 0x7f92d40c0a80 2021-03-25T14:16:00.366 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.358+0000 7f92d27fc700 1 -- 172.21.15.110:0/3964083385 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f92cc0018a0 con 0x7f92d40c0a80 2021-03-25T14:16:00.366 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.358+0000 7f92d27fc700 1 -- 172.21.15.110:0/3964083385 >> v1:172.21.15.110:6789/0 conn(0x7f92d40c0a80 legacy=0x7f92d4149c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:00.366 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.358+0000 7f92d27fc700 1 --2- 172.21.15.110:0/3964083385 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92b4003790 0x7f92b4003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:00.366 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.358+0000 7f92d27fc700 1 --2- 172.21.15.110:0/3964083385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f92b40040d0 0x7f92b40045b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:00.366 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.358+0000 7f92d27fc700 1 --2- 172.21.15.110:0/3964083385 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92d40b1500 0x7f92b4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:00.366 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.358+0000 7f92d27fc700 1 -- 172.21.15.110:0/3964083385 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d414d3e0 con 0x7f92b4003790 2021-03-25T14:16:00.367 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.358+0000 7f92d27fc700 1 -- 172.21.15.110:0/3964083385 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b4005150 con 0x7f92b40040d0 2021-03-25T14:16:00.367 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.358+0000 7f92d27fc700 1 -- 172.21.15.110:0/3964083385 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92b4005310 con 0x7f92d40b1500 2021-03-25T14:16:00.367 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.358+0000 7f92d2ffd700 1 --2- 172.21.15.110:0/3964083385 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92b4003790 0x7f92b4003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:00.367 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.358+0000 7f92cbfff700 1 --2- 172.21.15.110:0/3964083385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f92b40040d0 0x7f92b40045b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:00.367 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.358+0000 7f92d37fe700 1 --2- 172.21.15.110:0/3964083385 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92d40b1500 0x7f92b4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:00.368 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.358+0000 7f92d2ffd700 1 -- 172.21.15.110:0/3964083385 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92d40b1500 msgr2=0x7f92b4004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:00.368 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.358+0000 7f92d2ffd700 1 --2- 172.21.15.110:0/3964083385 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92d40b1500 0x7f92b4004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:00.368 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.358+0000 7f92d2ffd700 1 -- 172.21.15.110:0/3964083385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f92b40040d0 msgr2=0x7f92b40045b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:00.368 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.358+0000 7f92d2ffd700 1 --2- 172.21.15.110:0/3964083385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f92b40040d0 0x7f92b40045b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:00.368 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.358+0000 7f92d2ffd700 1 -- 172.21.15.110:0/3964083385 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b4003270 con 0x7f92b4003790 2021-03-25T14:16:00.368 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.358+0000 7f92cbfff700 1 --2- 172.21.15.110:0/3964083385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f92b40040d0 0x7f92b40045b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:00.368 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.358+0000 7f92d37fe700 1 --2- 172.21.15.110:0/3964083385 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92d40b1500 0x7f92b4004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:00.368 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.358+0000 7f92d2ffd700 1 --2- 172.21.15.110:0/3964083385 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92b4003790 0x7f92b4003b70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f92c400bc30 tx=0x7f92c4006e20).ready entity=mon.0 client_cookie=c200104d1c5f74be server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:00.368 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.358+0000 7f92d27fc700 1 -- 172.21.15.110:0/3964083385 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c400b310 con 0x7f92b4003790 2021-03-25T14:16:00.368 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.358+0000 7f92d27fc700 1 -- 172.21.15.110:0/3964083385 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c400eab0 con 0x7f92b4003790 2021-03-25T14:16:00.368 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.358+0000 7f92d27fc700 1 -- 172.21.15.110:0/3964083385 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c400ee30 con 0x7f92b4003790 2021-03-25T14:16:00.369 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.359+0000 7f92d9266700 1 -- 172.21.15.110:0/3964083385 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92b4003790 msgr2=0x7f92b4003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:00.369 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.359+0000 7f92d9266700 1 --2- 172.21.15.110:0/3964083385 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92b4003790 0x7f92b4003b70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f92c400bc30 tx=0x7f92c4006e20).stop 2021-03-25T14:16:00.369 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.359+0000 7f92d37fe700 1 -- 172.21.15.110:0/3964083385 reap_dead start 2021-03-25T14:16:00.369 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.359+0000 7f92d9266700 1 -- 172.21.15.110:0/3964083385 shutdown_connections 2021-03-25T14:16:00.369 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.359+0000 7f92d9266700 1 -- 172.21.15.110:0/3964083385 >> 172.21.15.110:0/3964083385 conn(0x7f92d40649a0 msgr2=0x7f92d405c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:00.369 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.359+0000 7f92d9266700 1 -- 172.21.15.110:0/3964083385 shutdown_connections 2021-03-25T14:16:00.369 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.359+0000 7f92d9266700 1 -- 172.21.15.110:0/3964083385 wait complete. 2021-03-25T14:16:00.369 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.360+0000 7f92d9266700 1 Processor -- start 2021-03-25T14:16:00.369 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.360+0000 7f92d9266700 1 -- start start 2021-03-25T14:16:00.369 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.361+0000 7f92d9266700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92b4003790 0x7f92d415c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:00.369 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.361+0000 7f92d9266700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f92d40b2310 0x7f92d40b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:00.369 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.361+0000 7f92d9266700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92d4145870 0x7f92d4145cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:00.370 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.361+0000 7f92d9266700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d40b1a60 con 0x7f92b4003790 2021-03-25T14:16:00.370 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.361+0000 7f92d9266700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d40b1d00 con 0x7f92d40b2310 2021-03-25T14:16:00.370 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.361+0000 7f92d9266700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d40b1fa0 con 0x7f92d4145870 2021-03-25T14:16:00.370 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.361+0000 7f92d2ffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92b4003790 0x7f92d415c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:00.370 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.361+0000 7f92d2ffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92b4003790 0x7f92d415c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47214/0 (socket says 172.21.15.110:47214) 2021-03-25T14:16:00.370 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.361+0000 7f92d2ffd700 1 -- 172.21.15.110:0/614309964 learned_addr learned my addr 172.21.15.110:0/614309964 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:00.370 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.361+0000 7f92cbfff700 1 --2- 172.21.15.110:0/614309964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f92d40b2310 0x7f92d40b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:00.370 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.361+0000 7f92d2ffd700 1 -- 172.21.15.110:0/614309964 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92d4145870 msgr2=0x7f92d4145cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:00.370 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.361+0000 7f92d2ffd700 1 --2- 172.21.15.110:0/614309964 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92d4145870 0x7f92d4145cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:16:00.370 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.361+0000 7f92d2ffd700 1 -- 172.21.15.110:0/614309964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f92d40b2310 msgr2=0x7f92d40b54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:00.370 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.361+0000 7f92d2ffd700 1 --2- 172.21.15.110:0/614309964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f92d40b2310 0x7f92d40b54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:00.370 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.361+0000 7f92d2ffd700 1 -- 172.21.15.110:0/614309964 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d40b2b70 con 0x7f92b4003790 2021-03-25T14:16:00.371 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.361+0000 7f92cbfff700 1 --2- 172.21.15.110:0/614309964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f92d40b2310 0x7f92d40b54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:00.371 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.361+0000 7f92d2ffd700 1 --2- 172.21.15.110:0/614309964 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92b4003790 0x7f92d415c870 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f92c4007fd0 tx=0x7f92c4019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:00.371 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.361+0000 7f92caffd700 1 -- 172.21.15.110:0/614309964 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c4026420 con 0x7f92b4003790 2021-03-25T14:16:00.371 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.361+0000 7f92caffd700 1 -- 172.21.15.110:0/614309964 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c4026580 con 0x7f92b4003790 2021-03-25T14:16:00.371 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.361+0000 7f92d9266700 1 -- 172.21.15.110:0/614309964 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92d414c8f0 con 0x7f92b4003790 2021-03-25T14:16:00.371 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.361+0000 7f92caffd700 1 -- 172.21.15.110:0/614309964 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c4026710 con 0x7f92b4003790 2021-03-25T14:16:00.371 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.361+0000 7f92d9266700 1 -- 172.21.15.110:0/614309964 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92d40b59b0 con 0x7f92b4003790 2021-03-25T14:16:00.371 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.362+0000 7f92d9266700 1 -- 172.21.15.110:0/614309964 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92d414d860 con 0x7f92b4003790 2021-03-25T14:16:00.371 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.363+0000 7f92caffd700 1 -- 172.21.15.110:0/614309964 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f92c402d070 con 0x7f92b4003790 2021-03-25T14:16:00.371 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.363+0000 7f92caffd700 1 --2- 172.21.15.110:0/614309964 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f92b805a0e0 0x7f92b805c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:00.371 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.363+0000 7f92caffd700 1 -- 172.21.15.110:0/614309964 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4876+0+0 (secure 0 0 0) 0x7f92c4075490 con 0x7f92b4003790 2021-03-25T14:16:00.371 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.363+0000 7f92cbfff700 1 --2- 172.21.15.110:0/614309964 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f92b805a0e0 0x7f92b805c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:00.371 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.363+0000 7f92cbfff700 1 --2- 172.21.15.110:0/614309964 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f92b805a0e0 0x7f92b805c5a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f92bc000f60 tx=0x7f92bc009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:00.372 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.367+0000 7f92caffd700 1 -- 172.21.15.110:0/614309964 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f92c4072620 con 0x7f92b4003790 2021-03-25T14:16:00.516 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:00.514+0000 7f92d9266700 1 -- 172.21.15.110:0/614309964 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f92d405d7b0 con 0x7f92b4003790 2021-03-25T14:16:01.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.021+0000 7f92caffd700 1 -- 172.21.15.110:0/614309964 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) v1 ==== 109+0+0 (secure 0 0 0) 0x7f92c402b070 con 0x7f92b4003790 2021-03-25T14:16:01.026 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.023+0000 7f92d9266700 1 -- 172.21.15.110:0/614309964 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f92b805a0e0 msgr2=0x7f92b805c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:01.026 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.023+0000 7f92d9266700 1 --2- 172.21.15.110:0/614309964 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f92b805a0e0 0x7f92b805c5a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f92bc000f60 tx=0x7f92bc009040).stop 2021-03-25T14:16:01.026 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.023+0000 7f92d9266700 1 -- 172.21.15.110:0/614309964 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92b4003790 msgr2=0x7f92d415c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:01.026 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.023+0000 7f92d9266700 1 --2- 172.21.15.110:0/614309964 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92b4003790 0x7f92d415c870 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f92c4007fd0 tx=0x7f92c4019000).stop 2021-03-25T14:16:01.026 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.023+0000 7f92d9266700 1 -- 172.21.15.110:0/614309964 shutdown_connections 2021-03-25T14:16:01.026 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.024+0000 7f92d9266700 1 --2- 172.21.15.110:0/614309964 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f92b805a0e0 0x7f92b805c5a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:01.026 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.024+0000 7f92d9266700 1 --2- 172.21.15.110:0/614309964 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92d4145870 0x7f92d4145cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:16:01.026 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.024+0000 7f92d9266700 1 --2- 172.21.15.110:0/614309964 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92b4003790 0x7f92d415c870 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:01.026 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.024+0000 7f92d9266700 1 --2- 172.21.15.110:0/614309964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f92d40b2310 0x7f92d40b54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:01.026 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.024+0000 7f92d9266700 1 -- 172.21.15.110:0/614309964 >> 172.21.15.110:0/614309964 conn(0x7f92d40649a0 msgr2=0x7f92d40663b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:01.026 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.024+0000 7f92d9266700 1 -- 172.21.15.110:0/614309964 shutdown_connections 2021-03-25T14:16:01.027 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.024+0000 7f92d9266700 1 -- 172.21.15.110:0/614309964 wait complete. 2021-03-25T14:16:01.027 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'rbd' created 2021-03-25T14:16:01.039 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2021-03-25T14:16:01.151 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.149+0000 7f4b6cb2c700 1 Processor -- start 2021-03-25T14:16:01.151 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.149+0000 7f4b6cb2c700 1 -- start start 2021-03-25T14:16:01.153 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.150+0000 7f4b6cb2c700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4b6814aa20 0x7f4b680672a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:01.153 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.150+0000 7f4b6cb2c700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b680bb060 con 0x7f4b680c0130 2021-03-25T14:16:01.153 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.150+0000 7f4b6cb2c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b6814ae50 con 0x7f4b680bfd50 2021-03-25T14:16:01.154 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.150+0000 7f4b6cb2c700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b68067790 con 0x7f4b6814aa20 2021-03-25T14:16:01.154 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.150+0000 7f4b67fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4b6814aa20 0x7f4b680672a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:01.154 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.150+0000 7f4b66ffd700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f4b680c0130 0x7f4b681431e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:40158/0 (socket says 172.21.15.110:40158) 2021-03-25T14:16:01.154 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.150+0000 7f4b67fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4b6814aa20 0x7f4b680672a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47224/0 (socket says 172.21.15.110:47224) 2021-03-25T14:16:01.154 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.150+0000 7f4b66ffd700 1 -- 172.21.15.110:0/1938764460 learned_addr learned my addr 172.21.15.110:0/1938764460 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:01.154 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.150+0000 7f4b67fff700 1 -- 172.21.15.110:0/1938764460 >> v1:172.21.15.174:6789/0 conn(0x7f4b680bfd50 legacy=0x7f4b68149e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:01.154 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.150+0000 7f4b67fff700 1 -- 172.21.15.110:0/1938764460 >> v1:172.21.15.110:6789/0 conn(0x7f4b680c0130 legacy=0x7f4b681431e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:01.154 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.150+0000 7f4b667fc700 1 -- 172.21.15.110:0/1938764460 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1039000180 0 0) 0x7f4b680bb060 con 0x7f4b680c0130 2021-03-25T14:16:01.154 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.150+0000 7f4b67fff700 1 -- 172.21.15.110:0/1938764460 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b680bab20 con 0x7f4b6814aa20 2021-03-25T14:16:01.154 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.150+0000 7f4b67fff700 1 --2- 172.21.15.110:0/1938764460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b6814aa20 0x7f4b680672a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f4b60009cc0 tx=0x7f4b60009220).ready entity=mon.0 client_cookie=356d492e5e0aad0b server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:01.154 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.151+0000 7f4b667fc700 1 -- 172.21.15.110:0/1938764460 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6000bc40 con 0x7f4b6814aa20 2021-03-25T14:16:01.154 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.151+0000 7f4b667fc700 1 -- 172.21.15.110:0/1938764460 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6000bda0 con 0x7f4b6814aa20 2021-03-25T14:16:01.155 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.151+0000 7f4b667fc700 1 -- 172.21.15.110:0/1938764460 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b60011610 con 0x7f4b6814aa20 2021-03-25T14:16:01.155 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.151+0000 7f4b6cb2c700 1 -- 172.21.15.110:0/1938764460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b6814aa20 msgr2=0x7f4b680672a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:01.155 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.151+0000 7f4b6cb2c700 1 --2- 172.21.15.110:0/1938764460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b6814aa20 0x7f4b680672a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f4b60009cc0 tx=0x7f4b60009220).stop 2021-03-25T14:16:01.155 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.151+0000 7f4b6cb2c700 1 -- 172.21.15.110:0/1938764460 shutdown_connections 2021-03-25T14:16:01.155 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.151+0000 7f4b6cb2c700 1 --2- 172.21.15.110:0/1938764460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b6814aa20 0x7f4b680672a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:01.155 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.151+0000 7f4b6cb2c700 1 -- 172.21.15.110:0/1938764460 >> 172.21.15.110:0/1938764460 conn(0x7f4b68066370 msgr2=0x7f4b68066780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:01.155 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.151+0000 7f4b6cb2c700 1 -- 172.21.15.110:0/1938764460 shutdown_connections 2021-03-25T14:16:01.155 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.151+0000 7f4b6cb2c700 1 -- 172.21.15.110:0/1938764460 wait complete. 2021-03-25T14:16:01.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.152+0000 7f4b6cb2c700 1 Processor -- start 2021-03-25T14:16:01.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.152+0000 7f4b6cb2c700 1 -- start start 2021-03-25T14:16:01.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.153+0000 7f4b6cb2c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b680bfd50 0x7f4b68141620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:01.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.153+0000 7f4b6cb2c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4b680c0130 0x7f4b680bcba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:01.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.153+0000 7f4b6cb2c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b6814aa20 0x7f4b6813d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:01.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.153+0000 7f4b6cb2c700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b680bc990 con 0x7f4b6814aa20 2021-03-25T14:16:01.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.153+0000 7f4b6cb2c700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b680bbf10 con 0x7f4b680bfd50 2021-03-25T14:16:01.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.153+0000 7f4b6cb2c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b680bc1b0 con 0x7f4b680c0130 2021-03-25T14:16:01.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.153+0000 7f4b67fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b6814aa20 0x7f4b6813d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:01.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.153+0000 7f4b67fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b6814aa20 0x7f4b6813d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47232/0 (socket says 172.21.15.110:47232) 2021-03-25T14:16:01.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.153+0000 7f4b67fff700 1 -- 172.21.15.110:0/4055210912 learned_addr learned my addr 172.21.15.110:0/4055210912 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:01.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.153+0000 7f4b677fe700 1 --2- 172.21.15.110:0/4055210912 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b680bfd50 0x7f4b68141620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:01.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.153+0000 7f4b66ffd700 1 --2- 172.21.15.110:0/4055210912 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4b680c0130 0x7f4b680bcba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:01.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.153+0000 7f4b67fff700 1 -- 172.21.15.110:0/4055210912 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4b680c0130 msgr2=0x7f4b680bcba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:01.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.153+0000 7f4b67fff700 1 --2- 172.21.15.110:0/4055210912 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4b680c0130 0x7f4b680bcba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:01.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.153+0000 7f4b67fff700 1 -- 172.21.15.110:0/4055210912 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b680bfd50 msgr2=0x7f4b68141620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:01.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.153+0000 7f4b67fff700 1 --2- 172.21.15.110:0/4055210912 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b680bfd50 0x7f4b68141620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:01.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.153+0000 7f4b67fff700 1 -- 172.21.15.110:0/4055210912 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b680bc450 con 0x7f4b6814aa20 2021-03-25T14:16:01.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.153+0000 7f4b677fe700 1 --2- 172.21.15.110:0/4055210912 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b680bfd50 0x7f4b68141620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:01.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.154+0000 7f4b67fff700 1 --2- 172.21.15.110:0/4055210912 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b6814aa20 0x7f4b6813d5c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f4b600090b0 tx=0x7f4b60017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:01.160 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.154+0000 7f4b4f7fe700 1 -- 172.21.15.110:0/4055210912 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b60011e30 con 0x7f4b6814aa20 2021-03-25T14:16:01.160 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.154+0000 7f4b4f7fe700 1 -- 172.21.15.110:0/4055210912 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b60009e00 con 0x7f4b6814aa20 2021-03-25T14:16:01.160 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.154+0000 7f4b6cb2c700 1 -- 172.21.15.110:0/4055210912 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b680bc6f0 con 0x7f4b6814aa20 2021-03-25T14:16:01.160 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.154+0000 7f4b4f7fe700 1 -- 172.21.15.110:0/4055210912 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b60010e50 con 0x7f4b6814aa20 2021-03-25T14:16:01.160 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.154+0000 7f4b6cb2c700 1 -- 172.21.15.110:0/4055210912 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b68141b10 con 0x7f4b6814aa20 2021-03-25T14:16:01.160 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.155+0000 7f4b6cb2c700 1 -- 172.21.15.110:0/4055210912 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b68068b90 con 0x7f4b6814aa20 2021-03-25T14:16:01.160 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.155+0000 7f4b4f7fe700 1 -- 172.21.15.110:0/4055210912 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f4b6002b070 con 0x7f4b6814aa20 2021-03-25T14:16:01.160 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.155+0000 7f4b4f7fe700 1 --2- 172.21.15.110:0/4055210912 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4b4805a0e0 0x7f4b4805c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:01.160 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.155+0000 7f4b4f7fe700 1 -- 172.21.15.110:0/4055210912 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5242+0+0 (secure 0 0 0) 0x7f4b600759b0 con 0x7f4b6814aa20 2021-03-25T14:16:01.160 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.155+0000 7f4b677fe700 1 --2- 172.21.15.110:0/4055210912 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4b4805a0e0 0x7f4b4805c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:01.160 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.156+0000 7f4b677fe700 1 --2- 172.21.15.110:0/4055210912 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4b4805a0e0 0x7f4b4805c5a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f4b58002570 tx=0x7f4b58009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:01.161 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.160+0000 7f4b4f7fe700 1 -- 172.21.15.110:0/4055210912 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f4b60049690 con 0x7f4b6814aa20 2021-03-25T14:16:01.314 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:01.312+0000 7f4b6cb2c700 1 -- 172.21.15.110:0/4055210912 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4b680614a0 con 0x7f4b6814aa20 2021-03-25T14:16:02.036 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.034+0000 7f4b4f7fe700 1 -- 172.21.15.110:0/4055210912 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v16) v1 ==== 173+0+0 (secure 0 0 0) 0x7f4b6001f030 con 0x7f4b6814aa20 2021-03-25T14:16:02.039 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.037+0000 7f4b6cb2c700 1 -- 172.21.15.110:0/4055210912 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4b4805a0e0 msgr2=0x7f4b4805c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:02.039 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.037+0000 7f4b6cb2c700 1 --2- 172.21.15.110:0/4055210912 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4b4805a0e0 0x7f4b4805c5a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f4b58002570 tx=0x7f4b58009040).stop 2021-03-25T14:16:02.039 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.037+0000 7f4b6cb2c700 1 -- 172.21.15.110:0/4055210912 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b6814aa20 msgr2=0x7f4b6813d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:02.040 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.037+0000 7f4b6cb2c700 1 --2- 172.21.15.110:0/4055210912 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b6814aa20 0x7f4b6813d5c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f4b600090b0 tx=0x7f4b60017000).stop 2021-03-25T14:16:02.040 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.037+0000 7f4b6cb2c700 1 -- 172.21.15.110:0/4055210912 shutdown_connections 2021-03-25T14:16:02.040 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.037+0000 7f4b6cb2c700 1 --2- 172.21.15.110:0/4055210912 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4b4805a0e0 0x7f4b4805c5a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:02.040 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.037+0000 7f4b6cb2c700 1 --2- 172.21.15.110:0/4055210912 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b680bfd50 0x7f4b68141620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:02.040 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.037+0000 7f4b6cb2c700 1 --2- 172.21.15.110:0/4055210912 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b6814aa20 0x7f4b6813d5c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:02.040 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.037+0000 7f4b6cb2c700 1 --2- 172.21.15.110:0/4055210912 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4b680c0130 0x7f4b680bcba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:02.040 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.037+0000 7f4b6cb2c700 1 -- 172.21.15.110:0/4055210912 >> 172.21.15.110:0/4055210912 conn(0x7f4b68066370 msgr2=0x7f4b68149d30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:02.040 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.037+0000 7f4b6cb2c700 1 -- 172.21.15.110:0/4055210912 shutdown_connections 2021-03-25T14:16:02.040 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.037+0000 7f4b6cb2c700 1 -- 172.21.15.110:0/4055210912 wait complete. 2021-03-25T14:16:02.041 INFO:teuthology.orchestra.run.smithi110.stderr:enabled application 'rbd' on pool 'rbd' 2021-03-25T14:16:02.053 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2021-03-25T14:16:02.053 INFO:tasks.ceph.mds.a:Restarting daemon 2021-03-25T14:16:02.053 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-03-25T14:16:02.055 INFO:tasks.ceph.mds.a:Started 2021-03-25T14:16:02.055 INFO:tasks.ceph.mds.c:Restarting daemon 2021-03-25T14:16:02.056 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-03-25T14:16:02.057 INFO:tasks.ceph.mds.c:Started 2021-03-25T14:16:02.058 INFO:tasks.ceph.mds.b:Restarting daemon 2021-03-25T14:16:02.058 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-03-25T14:16:02.060 INFO:tasks.ceph.mds.b:Started 2021-03-25T14:16:02.060 INFO:tasks.ceph.mds.d:Restarting daemon 2021-03-25T14:16:02.061 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2021-03-25T14:16:02.062 INFO:tasks.ceph.mds.d:Started 2021-03-25T14:16:02.063 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2021-03-25T14:16:02.063 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:16:02.132 INFO:tasks.ceph.mds.a.smithi110.stdout:starting mds.a at 2021-03-25T14:16:02.132 INFO:tasks.ceph.mds.c.smithi110.stdout:starting mds.c at 2021-03-25T14:16:02.144 INFO:tasks.ceph.mds.b.smithi174.stdout:starting mds.b at 2021-03-25T14:16:02.146 INFO:tasks.ceph.mds.d.smithi174.stdout:starting mds.d at 2021-03-25T14:16:02.191 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.189+0000 7fefb6b9b700 1 Processor -- start 2021-03-25T14:16:02.191 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.189+0000 7fefb6b9b700 1 -- start start 2021-03-25T14:16:02.194 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.190+0000 7fefb6b9b700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fefb00bbca0 0x7fefb0067840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:02.194 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.190+0000 7fefb6b9b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fefb0144960 0x7fefb0144da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:02.194 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.190+0000 7fefb6b9b700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefb00afee0 con 0x7fefb0068ac0 2021-03-25T14:16:02.194 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.190+0000 7fefb6b9b700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefb0145d40 con 0x7fefb00bbca0 2021-03-25T14:16:02.194 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.190+0000 7fefb6b9b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb0145fe0 con 0x7fefb0144960 2021-03-25T14:16:02.194 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.190+0000 7fefb4937700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fefb00bbca0 0x7fefb0067840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:02.194 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.190+0000 7fefaffff700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fefb0068ac0 0x7fefb00acf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:40242/0 (socket says 172.21.15.110:40242) 2021-03-25T14:16:02.194 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.190+0000 7fefaffff700 1 -- 172.21.15.110:0/3378628082 learned_addr learned my addr 172.21.15.110:0/3378628082 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:02.194 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.190+0000 7fefb5138700 1 --2- 172.21.15.110:0/3378628082 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fefb0144960 0x7fefb0144da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:02.194 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.191+0000 7fefb4937700 1 -- 172.21.15.110:0/3378628082 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fefb0144960 msgr2=0x7fefb0144da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:02.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.191+0000 7fefb4937700 1 --2- 172.21.15.110:0/3378628082 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fefb0144960 0x7fefb0144da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:02.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.191+0000 7fefb4937700 1 -- 172.21.15.110:0/3378628082 >> v1:172.21.15.110:6789/0 conn(0x7fefb0068ac0 legacy=0x7fefb00acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:02.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.191+0000 7fefb4937700 1 -- 172.21.15.110:0/3378628082 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb0145b10 con 0x7fefb00bbca0 2021-03-25T14:16:02.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.191+0000 7fefb4937700 1 --2- 172.21.15.110:0/3378628082 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefb00bbca0 0x7fefb0067840 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fefa400b9c0 tx=0x7fefa4006e20).ready entity=mon.0 client_cookie=be32f1910c5a18d9 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:02.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.191+0000 7fefaf7fe700 1 -- 172.21.15.110:0/3378628082 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa4009870 con 0x7fefb00bbca0 2021-03-25T14:16:02.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.191+0000 7fefaf7fe700 1 -- 172.21.15.110:0/3378628082 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa40099d0 con 0x7fefb00bbca0 2021-03-25T14:16:02.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.191+0000 7fefaf7fe700 1 -- 172.21.15.110:0/3378628082 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa4009d50 con 0x7fefb00bbca0 2021-03-25T14:16:02.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.191+0000 7fefb6b9b700 1 -- 172.21.15.110:0/3378628082 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefb00bbca0 msgr2=0x7fefb0067840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:02.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.191+0000 7fefb6b9b700 1 --2- 172.21.15.110:0/3378628082 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefb00bbca0 0x7fefb0067840 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fefa400b9c0 tx=0x7fefa4006e20).stop 2021-03-25T14:16:02.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.191+0000 7fefb6b9b700 1 -- 172.21.15.110:0/3378628082 shutdown_connections 2021-03-25T14:16:02.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.191+0000 7fefb6b9b700 1 --2- 172.21.15.110:0/3378628082 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefb00bbca0 0x7fefb0067840 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:02.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.191+0000 7fefb6b9b700 1 --2- 172.21.15.110:0/3378628082 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fefb0144960 0x7fefb0144da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:02.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.191+0000 7fefb6b9b700 1 -- 172.21.15.110:0/3378628082 >> 172.21.15.110:0/3378628082 conn(0x7fefb0063850 msgr2=0x7fefb005c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:02.196 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.191+0000 7fefb6b9b700 1 -- 172.21.15.110:0/3378628082 shutdown_connections 2021-03-25T14:16:02.196 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.191+0000 7fefb6b9b700 1 -- 172.21.15.110:0/3378628082 wait complete. 2021-03-25T14:16:02.196 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.192+0000 7fefb6b9b700 1 Processor -- start 2021-03-25T14:16:02.199 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.193+0000 7fefb6b9b700 1 -- start start 2021-03-25T14:16:02.199 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.193+0000 7fefb6b9b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefb0068ac0 0x7fefb01419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:02.199 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.193+0000 7fefb6b9b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fefb00bbca0 0x7fefb0147f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:02.199 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.193+0000 7fefb6b9b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefb0144960 0x7fefb0137640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:02.199 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.193+0000 7fefb6b9b700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb0143560 con 0x7fefb0068ac0 2021-03-25T14:16:02.199 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.193+0000 7fefb6b9b700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb0143790 con 0x7fefb0144960 2021-03-25T14:16:02.199 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.193+0000 7fefb6b9b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb0143a30 con 0x7fefb00bbca0 2021-03-25T14:16:02.199 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.193+0000 7fefb4937700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefb0068ac0 0x7fefb01419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:02.199 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.193+0000 7fefb4937700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefb0068ac0 0x7fefb01419d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47312/0 (socket says 172.21.15.110:47312) 2021-03-25T14:16:02.199 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.193+0000 7fefb4937700 1 -- 172.21.15.110:0/2598414794 learned_addr learned my addr 172.21.15.110:0/2598414794 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:02.199 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.193+0000 7fefaffff700 1 --2- 172.21.15.110:0/2598414794 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fefb00bbca0 0x7fefb0147f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:02.200 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.193+0000 7fefb5138700 1 --2- 172.21.15.110:0/2598414794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefb0144960 0x7fefb0137640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:02.200 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.193+0000 7fefb4937700 1 -- 172.21.15.110:0/2598414794 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fefb00bbca0 msgr2=0x7fefb0147f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:02.200 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.194+0000 7fefb4937700 1 --2- 172.21.15.110:0/2598414794 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fefb00bbca0 0x7fefb0147f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:02.200 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.194+0000 7fefb4937700 1 -- 172.21.15.110:0/2598414794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefb0144960 msgr2=0x7fefb0137640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:02.200 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.194+0000 7fefb4937700 1 --2- 172.21.15.110:0/2598414794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefb0144960 0x7fefb0137640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:02.200 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.194+0000 7fefb4937700 1 -- 172.21.15.110:0/2598414794 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb01489d0 con 0x7fefb0068ac0 2021-03-25T14:16:02.200 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.194+0000 7fefaffff700 1 --2- 172.21.15.110:0/2598414794 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fefb00bbca0 0x7fefb0147f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:02.200 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.194+0000 7fefb5138700 1 --2- 172.21.15.110:0/2598414794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefb0144960 0x7fefb0137640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:02.200 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.194+0000 7fefb4937700 1 --2- 172.21.15.110:0/2598414794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefb0068ac0 0x7fefb01419d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fefa400b170 tx=0x7fefa4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:02.200 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.194+0000 7fefacff9700 1 -- 172.21.15.110:0/2598414794 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa401c420 con 0x7fefb0068ac0 2021-03-25T14:16:02.200 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.194+0000 7fefacff9700 1 -- 172.21.15.110:0/2598414794 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa401c580 con 0x7fefb0068ac0 2021-03-25T14:16:02.200 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.194+0000 7fefacff9700 1 -- 172.21.15.110:0/2598414794 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa401c920 con 0x7fefb0068ac0 2021-03-25T14:16:02.200 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.194+0000 7fefb6b9b700 1 -- 172.21.15.110:0/2598414794 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefb0141380 con 0x7fefb0068ac0 2021-03-25T14:16:02.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.194+0000 7fefb6b9b700 1 -- 172.21.15.110:0/2598414794 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb0141ec0 con 0x7fefb0068ac0 2021-03-25T14:16:02.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.195+0000 7fefb6b9b700 1 -- 172.21.15.110:0/2598414794 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefb005d7b0 con 0x7fefb0068ac0 2021-03-25T14:16:02.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.195+0000 7fefacff9700 1 -- 172.21.15.110:0/2598414794 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fefa400f070 con 0x7fefb0068ac0 2021-03-25T14:16:02.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.195+0000 7fefacff9700 1 --2- 172.21.15.110:0/2598414794 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fef9005a0b0 0x7fef9005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:02.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.195+0000 7fefacff9700 1 -- 172.21.15.110:0/2598414794 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fefa4075270 con 0x7fefb0068ac0 2021-03-25T14:16:02.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.195+0000 7fefaffff700 1 --2- 172.21.15.110:0/2598414794 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fef9005a0b0 0x7fef9005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:02.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.196+0000 7fefaffff700 1 --2- 172.21.15.110:0/2598414794 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fef9005a0b0 0x7fef9005c570 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fef9c0055d0 tx=0x7fef9c009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:02.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.199+0000 7fefacff9700 1 -- 172.21.15.110:0/2598414794 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fefa4048f40 con 0x7fefb0068ac0 2021-03-25T14:16:02.350 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.348+0000 7fefb6b9b700 1 -- 172.21.15.110:0/2598414794 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fefb0061c50 con 0x7fefb0068ac0 2021-03-25T14:16:02.351 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.349+0000 7fefacff9700 1 -- 172.21.15.110:0/2598414794 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+13732 (secure 0 0 0) 0x7fefa404c560 con 0x7fefb0068ac0 2021-03-25T14:16:02.351 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:16:02.351 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":16,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:16:02.030170+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:16:02.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.351+0000 7fefb6b9b700 1 -- 172.21.15.110:0/2598414794 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fef9005a0b0 msgr2=0x7fef9005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:02.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.351+0000 7fefb6b9b700 1 --2- 172.21.15.110:0/2598414794 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fef9005a0b0 0x7fef9005c570 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fef9c0055d0 tx=0x7fef9c009040).stop 2021-03-25T14:16:02.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.351+0000 7fefb6b9b700 1 -- 172.21.15.110:0/2598414794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefb0068ac0 msgr2=0x7fefb01419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:02.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.351+0000 7fefb6b9b700 1 --2- 172.21.15.110:0/2598414794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefb0068ac0 0x7fefb01419d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fefa400b170 tx=0x7fefa4016000).stop 2021-03-25T14:16:02.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.351+0000 7fefb6b9b700 1 -- 172.21.15.110:0/2598414794 shutdown_connections 2021-03-25T14:16:02.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.351+0000 7fefb6b9b700 1 --2- 172.21.15.110:0/2598414794 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fef9005a0b0 0x7fef9005c570 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:02.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.351+0000 7fefb6b9b700 1 --2- 172.21.15.110:0/2598414794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefb0144960 0x7fefb0137640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:02.354 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.351+0000 7fefb6b9b700 1 --2- 172.21.15.110:0/2598414794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefb0068ac0 0x7fefb01419d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:02.354 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.351+0000 7fefb6b9b700 1 --2- 172.21.15.110:0/2598414794 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fefb00bbca0 0x7fefb0147f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:02.354 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.351+0000 7fefb6b9b700 1 -- 172.21.15.110:0/2598414794 >> 172.21.15.110:0/2598414794 conn(0x7fefb0063850 msgr2=0x7fefb00b9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:02.354 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.351+0000 7fefb6b9b700 1 -- 172.21.15.110:0/2598414794 shutdown_connections 2021-03-25T14:16:02.354 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.351+0000 7fefb6b9b700 1 -- 172.21.15.110:0/2598414794 wait complete. 2021-03-25T14:16:02.364 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-03-25T14:15:59.047299+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-03-25T14:16:00.537926+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-03-25T14:16:02.365 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-03-25T14:16:02.479 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.474+0000 7f7cee057700 1 Processor -- start 2021-03-25T14:16:02.479 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.474+0000 7f7cee057700 1 -- start start 2021-03-25T14:16:02.479 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.475+0000 7f7cee057700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ce814cc90 0x7f7ce814d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:02.479 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.475+0000 7f7cee057700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7ce80685d0 0x7f7ce8068a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:02.479 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.475+0000 7f7cee057700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ce80691b0 con 0x7f7ce814d470 2021-03-25T14:16:02.479 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.475+0000 7f7cee057700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ce80bc2b0 con 0x7f7ce80685d0 2021-03-25T14:16:02.479 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.475+0000 7f7cee057700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce8149dd0 con 0x7f7ce814cc90 2021-03-25T14:16:02.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.475+0000 7f7ce7fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7ce80685d0 0x7f7ce8068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:02.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.475+0000 7f7ce7fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7ce80685d0 0x7f7ce8068a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47324/0 (socket says 172.21.15.110:47324) 2021-03-25T14:16:02.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.475+0000 7f7ce7fff700 1 -- 172.21.15.110:0/2131734796 learned_addr learned my addr 172.21.15.110:0/2131734796 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:02.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.475+0000 7f7ce6ffd700 1 --2- 172.21.15.110:0/2131734796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ce814cc90 0x7f7ce814d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:02.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.476+0000 7f7ce7fff700 1 -- 172.21.15.110:0/2131734796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ce814cc90 msgr2=0x7f7ce814d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:02.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.476+0000 7f7ce7fff700 1 --2- 172.21.15.110:0/2131734796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ce814cc90 0x7f7ce814d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:02.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.476+0000 7f7ce7fff700 1 -- 172.21.15.110:0/2131734796 >> v1:172.21.15.174:6789/0 conn(0x7f7ce814d470 legacy=0x7f7ce81493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:02.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.476+0000 7f7ce7fff700 1 -- 172.21.15.110:0/2131734796 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce814a070 con 0x7f7ce80685d0 2021-03-25T14:16:02.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.476+0000 7f7ce7fff700 1 --2- 172.21.15.110:0/2131734796 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ce80685d0 0x7f7ce8068a40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f7ce0009d90 tx=0x7f7ce00092d0).ready entity=mon.0 client_cookie=bcd80ac0a3f6adb0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:02.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.476+0000 7f7ce67fc700 1 -- 172.21.15.110:0/2131734796 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce000bbf0 con 0x7f7ce80685d0 2021-03-25T14:16:02.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.476+0000 7f7ce67fc700 1 -- 172.21.15.110:0/2131734796 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce000bd50 con 0x7f7ce80685d0 2021-03-25T14:16:02.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.476+0000 7f7ce67fc700 1 -- 172.21.15.110:0/2131734796 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce0011610 con 0x7f7ce80685d0 2021-03-25T14:16:02.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.476+0000 7f7cee057700 1 -- 172.21.15.110:0/2131734796 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ce80685d0 msgr2=0x7f7ce8068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:02.481 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.476+0000 7f7cee057700 1 --2- 172.21.15.110:0/2131734796 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ce80685d0 0x7f7ce8068a40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f7ce0009d90 tx=0x7f7ce00092d0).stop 2021-03-25T14:16:02.481 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.476+0000 7f7cee057700 1 -- 172.21.15.110:0/2131734796 shutdown_connections 2021-03-25T14:16:02.481 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.476+0000 7f7cee057700 1 --2- 172.21.15.110:0/2131734796 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ce80685d0 0x7f7ce8068a40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:02.481 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.476+0000 7f7cee057700 1 --2- 172.21.15.110:0/2131734796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ce814cc90 0x7f7ce814d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:02.481 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.476+0000 7f7cee057700 1 -- 172.21.15.110:0/2131734796 >> 172.21.15.110:0/2131734796 conn(0x7f7ce8060c40 msgr2=0x7f7ce8061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:02.481 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.476+0000 7f7cee057700 1 -- 172.21.15.110:0/2131734796 shutdown_connections 2021-03-25T14:16:02.481 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.476+0000 7f7cee057700 1 -- 172.21.15.110:0/2131734796 wait complete. 2021-03-25T14:16:02.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.478+0000 7f7cee057700 1 Processor -- start 2021-03-25T14:16:02.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.478+0000 7f7cee057700 1 -- start start 2021-03-25T14:16:02.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.478+0000 7f7cee057700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ce80685d0 0x7f7ce80bef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:02.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.478+0000 7f7cee057700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ce814cc90 0x7f7ce8158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:02.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.478+0000 7f7cee057700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ce814d470 0x7f7ce8158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:02.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.478+0000 7f7cee057700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce80a5c20 con 0x7f7ce80685d0 2021-03-25T14:16:02.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.478+0000 7f7cee057700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce81442a0 con 0x7f7ce814cc90 2021-03-25T14:16:02.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.478+0000 7f7cee057700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce80a30c0 con 0x7f7ce814d470 2021-03-25T14:16:02.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.478+0000 7f7ce77fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ce80685d0 0x7f7ce80bef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:02.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.478+0000 7f7ce77fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ce80685d0 0x7f7ce80bef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47326/0 (socket says 172.21.15.110:47326) 2021-03-25T14:16:02.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.478+0000 7f7ce77fe700 1 -- 172.21.15.110:0/1787375336 learned_addr learned my addr 172.21.15.110:0/1787375336 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:02.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.478+0000 7f7ce6ffd700 1 --2- 172.21.15.110:0/1787375336 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ce814cc90 0x7f7ce8158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:02.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.478+0000 7f7ce7fff700 1 --2- 172.21.15.110:0/1787375336 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ce814d470 0x7f7ce8158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:02.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.479+0000 7f7ce77fe700 1 -- 172.21.15.110:0/1787375336 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ce814d470 msgr2=0x7f7ce8158e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:02.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.479+0000 7f7ce77fe700 1 --2- 172.21.15.110:0/1787375336 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ce814d470 0x7f7ce8158e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:02.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.479+0000 7f7ce77fe700 1 -- 172.21.15.110:0/1787375336 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ce814cc90 msgr2=0x7f7ce8158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:02.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.479+0000 7f7ce77fe700 1 --2- 172.21.15.110:0/1787375336 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ce814cc90 0x7f7ce8158920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:02.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.479+0000 7f7ce77fe700 1 -- 172.21.15.110:0/1787375336 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce80bf460 con 0x7f7ce80685d0 2021-03-25T14:16:02.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.479+0000 7f7ce77fe700 1 --2- 172.21.15.110:0/1787375336 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ce80685d0 0x7f7ce80bef70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f7cd800c6e0 tx=0x7f7cd8007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:02.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.479+0000 7f7ccf7fe700 1 -- 172.21.15.110:0/1787375336 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd8013410 con 0x7f7ce80685d0 2021-03-25T14:16:02.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.479+0000 7f7ccf7fe700 1 -- 172.21.15.110:0/1787375336 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd8013570 con 0x7f7ce80685d0 2021-03-25T14:16:02.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.479+0000 7f7cee057700 1 -- 172.21.15.110:0/1787375336 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ce80a5780 con 0x7f7ce80685d0 2021-03-25T14:16:02.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.479+0000 7f7ccf7fe700 1 -- 172.21.15.110:0/1787375336 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd8013910 con 0x7f7ce80685d0 2021-03-25T14:16:02.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.479+0000 7f7cee057700 1 -- 172.21.15.110:0/1787375336 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ce81462a0 con 0x7f7ce80685d0 2021-03-25T14:16:02.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.480+0000 7f7cee057700 1 -- 172.21.15.110:0/1787375336 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ce805d7b0 con 0x7f7ce80685d0 2021-03-25T14:16:02.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.480+0000 7f7ccf7fe700 1 -- 172.21.15.110:0/1787375336 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f7cd8010030 con 0x7f7ce80685d0 2021-03-25T14:16:02.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.480+0000 7f7ccf7fe700 1 --2- 172.21.15.110:0/1787375336 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f7cc805a0b0 0x7f7cc805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:02.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.480+0000 7f7ccf7fe700 1 -- 172.21.15.110:0/1787375336 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f7cd8073650 con 0x7f7ce80685d0 2021-03-25T14:16:02.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.481+0000 7f7ce6ffd700 1 --2- 172.21.15.110:0/1787375336 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f7cc805a0b0 0x7f7cc805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:02.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.481+0000 7f7ce6ffd700 1 --2- 172.21.15.110:0/1787375336 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f7cc805a0b0 0x7f7cc805c570 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f7cdc00ba40 tx=0x7f7cdc008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:02.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.484+0000 7f7ccf7fe700 1 -- 172.21.15.110:0/1787375336 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f7cd8047320 con 0x7f7ce80685d0 2021-03-25T14:16:02.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.637+0000 7f7cee057700 1 -- 172.21.15.110:0/1787375336 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f7ce8061c50 con 0x7f7ce80685d0 2021-03-25T14:16:02.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.637+0000 7f7ccf7fe700 1 -- 172.21.15.110:0/1787375336 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v16) v1 ==== 110+0+10 (secure 0 0 0) 0x7f7cd804a940 con 0x7f7ce80685d0 2021-03-25T14:16:02.640 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 1 2021-03-25T14:16:02.641 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.639+0000 7f7cee057700 1 -- 172.21.15.110:0/1787375336 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f7cc805a0b0 msgr2=0x7f7cc805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:02.641 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.639+0000 7f7cee057700 1 --2- 172.21.15.110:0/1787375336 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f7cc805a0b0 0x7f7cc805c570 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f7cdc00ba40 tx=0x7f7cdc008040).stop 2021-03-25T14:16:02.641 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.639+0000 7f7cee057700 1 -- 172.21.15.110:0/1787375336 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ce80685d0 msgr2=0x7f7ce80bef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:02.641 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.639+0000 7f7cee057700 1 --2- 172.21.15.110:0/1787375336 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ce80685d0 0x7f7ce80bef70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f7cd800c6e0 tx=0x7f7cd8007c30).stop 2021-03-25T14:16:02.641 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.639+0000 7f7cee057700 1 -- 172.21.15.110:0/1787375336 shutdown_connections 2021-03-25T14:16:02.641 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.639+0000 7f7cee057700 1 --2- 172.21.15.110:0/1787375336 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f7cc805a0b0 0x7f7cc805c570 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:02.642 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.639+0000 7f7cee057700 1 --2- 172.21.15.110:0/1787375336 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ce814d470 0x7f7ce8158e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:02.642 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.639+0000 7f7cee057700 1 --2- 172.21.15.110:0/1787375336 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ce80685d0 0x7f7ce80bef70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:02.642 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.639+0000 7f7cee057700 1 --2- 172.21.15.110:0/1787375336 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ce814cc90 0x7f7ce8158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:02.642 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.639+0000 7f7cee057700 1 -- 172.21.15.110:0/1787375336 >> 172.21.15.110:0/1787375336 conn(0x7f7ce8060c40 msgr2=0x7f7ce8147970 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:02.642 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.639+0000 7f7cee057700 1 -- 172.21.15.110:0/1787375336 shutdown_connections 2021-03-25T14:16:02.642 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.639+0000 7f7cee057700 1 -- 172.21.15.110:0/1787375336 wait complete. 2021-03-25T14:16:02.652 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-03-25T14:16:02.764 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.762+0000 7f7ee299e700 1 Processor -- start 2021-03-25T14:16:02.764 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.762+0000 7f7ee299e700 1 -- start start 2021-03-25T14:16:02.767 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.763+0000 7f7ee299e700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7edc0bd330 0x7f7edc0b3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:02.767 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.763+0000 7f7ee299e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7edc0683b0 0x7f7edc068810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:02.767 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.763+0000 7f7ee299e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7edc146710 con 0x7f7edc068d00 2021-03-25T14:16:02.767 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.763+0000 7f7ee299e700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7edc1469b0 con 0x7f7edc0bd330 2021-03-25T14:16:02.767 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.763+0000 7f7ee299e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc146c50 con 0x7f7edc0683b0 2021-03-25T14:16:02.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.763+0000 7f7ee199c700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7edc0bd330 0x7f7edc0b3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:02.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.763+0000 7f7ee199c700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7edc0bd330 0x7f7edc0b3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47334/0 (socket says 172.21.15.110:47334) 2021-03-25T14:16:02.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.763+0000 7f7ee199c700 1 -- 172.21.15.110:0/2226400376 learned_addr learned my addr 172.21.15.110:0/2226400376 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:02.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.764+0000 7f7ee119b700 1 --2- 172.21.15.110:0/2226400376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7edc0683b0 0x7f7edc068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:02.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.764+0000 7f7ee199c700 1 -- 172.21.15.110:0/2226400376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7edc0683b0 msgr2=0x7f7edc068810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:02.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.764+0000 7f7ee199c700 1 --2- 172.21.15.110:0/2226400376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7edc0683b0 0x7f7edc068810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:02.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.764+0000 7f7ee199c700 1 -- 172.21.15.110:0/2226400376 >> v1:172.21.15.174:6789/0 conn(0x7f7edc068d00 legacy=0x7f7edc149870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:02.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.764+0000 7f7ee199c700 1 -- 172.21.15.110:0/2226400376 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7edc146ef0 con 0x7f7edc0bd330 2021-03-25T14:16:02.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.764+0000 7f7ee199c700 1 --2- 172.21.15.110:0/2226400376 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7edc0bd330 0x7f7edc0b3500 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f7ed800ba20 tx=0x7f7ed8006ee0).ready entity=mon.0 client_cookie=1c05dbbb1922d519 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:02.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.764+0000 7f7ee099a700 1 -- 172.21.15.110:0/2226400376 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed8009840 con 0x7f7edc0bd330 2021-03-25T14:16:02.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.764+0000 7f7ee099a700 1 -- 172.21.15.110:0/2226400376 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed80099a0 con 0x7f7edc0bd330 2021-03-25T14:16:02.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.764+0000 7f7ee099a700 1 -- 172.21.15.110:0/2226400376 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed8009d20 con 0x7f7edc0bd330 2021-03-25T14:16:02.769 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.764+0000 7f7ee299e700 1 -- 172.21.15.110:0/2226400376 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7edc0bd330 msgr2=0x7f7edc0b3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:02.769 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.764+0000 7f7ee299e700 1 --2- 172.21.15.110:0/2226400376 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7edc0bd330 0x7f7edc0b3500 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f7ed800ba20 tx=0x7f7ed8006ee0).stop 2021-03-25T14:16:02.769 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.764+0000 7f7ee299e700 1 -- 172.21.15.110:0/2226400376 shutdown_connections 2021-03-25T14:16:02.769 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.764+0000 7f7ee299e700 1 --2- 172.21.15.110:0/2226400376 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7edc0bd330 0x7f7edc0b3500 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:02.769 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.764+0000 7f7ee299e700 1 --2- 172.21.15.110:0/2226400376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7edc0683b0 0x7f7edc068810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:02.769 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.764+0000 7f7ee299e700 1 -- 172.21.15.110:0/2226400376 >> 172.21.15.110:0/2226400376 conn(0x7f7edc0627e0 msgr2=0x7f7edc0bca60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:02.769 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.765+0000 7f7ee299e700 1 -- 172.21.15.110:0/2226400376 shutdown_connections 2021-03-25T14:16:02.769 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.765+0000 7f7ee299e700 1 -- 172.21.15.110:0/2226400376 wait complete. 2021-03-25T14:16:02.769 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.766+0000 7f7ee299e700 1 Processor -- start 2021-03-25T14:16:02.769 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.766+0000 7f7ee299e700 1 -- start start 2021-03-25T14:16:02.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.766+0000 7f7ee299e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7edc0683b0 0x7f7edc0b6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:02.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.766+0000 7f7ee299e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7edc068d00 0x7f7edc0af490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:02.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.766+0000 7f7ee299e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7edc0bd330 0x7f7edc0af980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:02.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.766+0000 7f7ee299e700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc0aec30 con 0x7f7edc0bd330 2021-03-25T14:16:02.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.766+0000 7f7ee299e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc0ad920 con 0x7f7edc068d00 2021-03-25T14:16:02.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.766+0000 7f7ee299e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc0addf0 con 0x7f7edc0683b0 2021-03-25T14:16:02.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.766+0000 7f7ee219d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7edc0bd330 0x7f7edc0af980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:02.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.766+0000 7f7ee219d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7edc0bd330 0x7f7edc0af980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47342/0 (socket says 172.21.15.110:47342) 2021-03-25T14:16:02.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.766+0000 7f7ee219d700 1 -- 172.21.15.110:0/2476877298 learned_addr learned my addr 172.21.15.110:0/2476877298 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:02.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.766+0000 7f7ee119b700 1 --2- 172.21.15.110:0/2476877298 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7edc068d00 0x7f7edc0af490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:02.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.766+0000 7f7ee199c700 1 --2- 172.21.15.110:0/2476877298 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7edc0683b0 0x7f7edc0b6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:02.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.767+0000 7f7ee219d700 1 -- 172.21.15.110:0/2476877298 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7edc0683b0 msgr2=0x7f7edc0b6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:02.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.767+0000 7f7ee219d700 1 --2- 172.21.15.110:0/2476877298 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7edc0683b0 0x7f7edc0b6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:02.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.767+0000 7f7ee219d700 1 -- 172.21.15.110:0/2476877298 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7edc068d00 msgr2=0x7f7edc0af490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:02.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.767+0000 7f7ee219d700 1 --2- 172.21.15.110:0/2476877298 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7edc068d00 0x7f7edc0af490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:02.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.767+0000 7f7ee219d700 1 -- 172.21.15.110:0/2476877298 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7edc0adb50 con 0x7f7edc0bd330 2021-03-25T14:16:02.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.767+0000 7f7ee219d700 1 --2- 172.21.15.110:0/2476877298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7edc0bd330 0x7f7edc0af980 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f7ed400ca90 tx=0x7f7ed4007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:02.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.767+0000 7f7ec9ffb700 1 -- 172.21.15.110:0/2476877298 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed400ce70 con 0x7f7edc0bd330 2021-03-25T14:16:02.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.767+0000 7f7ec9ffb700 1 -- 172.21.15.110:0/2476877298 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed400a760 con 0x7f7edc0bd330 2021-03-25T14:16:02.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.767+0000 7f7ee299e700 1 -- 172.21.15.110:0/2476877298 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7edc148a70 con 0x7f7edc0bd330 2021-03-25T14:16:02.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.767+0000 7f7ec9ffb700 1 -- 172.21.15.110:0/2476877298 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed400aae0 con 0x7f7edc0bd330 2021-03-25T14:16:02.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.767+0000 7f7ee299e700 1 -- 172.21.15.110:0/2476877298 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7edc148fb0 con 0x7f7edc0bd330 2021-03-25T14:16:02.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.768+0000 7f7ec9ffb700 1 -- 172.21.15.110:0/2476877298 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f7ed4019030 con 0x7f7edc0bd330 2021-03-25T14:16:02.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.768+0000 7f7ee299e700 1 -- 172.21.15.110:0/2476877298 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7edc0baf60 con 0x7f7edc0bd330 2021-03-25T14:16:02.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.768+0000 7f7ec9ffb700 1 --2- 172.21.15.110:0/2476877298 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f7ebc05a0e0 0x7f7ebc05c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:02.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.768+0000 7f7ec9ffb700 1 -- 172.21.15.110:0/2476877298 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f7ed40731b0 con 0x7f7edc0bd330 2021-03-25T14:16:02.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.768+0000 7f7ee199c700 1 --2- 172.21.15.110:0/2476877298 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f7ebc05a0e0 0x7f7ebc05c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:02.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.769+0000 7f7ee199c700 1 --2- 172.21.15.110:0/2476877298 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f7ebc05a0e0 0x7f7ebc05c5a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f7ed8006f20 tx=0x7f7ed8016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:02.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.772+0000 7f7ec9ffb700 1 -- 172.21.15.110:0/2476877298 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f7ed4045620 con 0x7f7edc0bd330 2021-03-25T14:16:02.924 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.922+0000 7f7ee299e700 1 -- 172.21.15.110:0/2476877298 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7edc045ae0 con 0x7f7edc0bd330 2021-03-25T14:16:02.924 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.922+0000 7f7ec9ffb700 1 -- 172.21.15.110:0/2476877298 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7ed4046eb0 con 0x7f7edc0bd330 2021-03-25T14:16:02.924 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:16:02.926 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.924+0000 7f7ee299e700 1 -- 172.21.15.110:0/2476877298 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f7ebc05a0e0 msgr2=0x7f7ebc05c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:02.926 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.924+0000 7f7ee299e700 1 --2- 172.21.15.110:0/2476877298 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f7ebc05a0e0 0x7f7ebc05c5a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f7ed8006f20 tx=0x7f7ed8016000).stop 2021-03-25T14:16:02.926 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.924+0000 7f7ee299e700 1 -- 172.21.15.110:0/2476877298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7edc0bd330 msgr2=0x7f7edc0af980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:02.926 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.924+0000 7f7ee299e700 1 --2- 172.21.15.110:0/2476877298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7edc0bd330 0x7f7edc0af980 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f7ed400ca90 tx=0x7f7ed4007f70).stop 2021-03-25T14:16:02.926 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.924+0000 7f7ee299e700 1 -- 172.21.15.110:0/2476877298 shutdown_connections 2021-03-25T14:16:02.927 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.924+0000 7f7ee299e700 1 --2- 172.21.15.110:0/2476877298 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f7ebc05a0e0 0x7f7ebc05c5a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:02.927 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.924+0000 7f7ee299e700 1 --2- 172.21.15.110:0/2476877298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7edc0bd330 0x7f7edc0af980 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:02.927 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.924+0000 7f7ee299e700 1 --2- 172.21.15.110:0/2476877298 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7edc0683b0 0x7f7edc0b6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:02.927 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.924+0000 7f7ee299e700 1 --2- 172.21.15.110:0/2476877298 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7edc068d00 0x7f7edc0af490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:02.927 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.924+0000 7f7ee299e700 1 -- 172.21.15.110:0/2476877298 >> 172.21.15.110:0/2476877298 conn(0x7f7edc0627e0 msgr2=0x7f7edc0bbe50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:02.927 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.924+0000 7f7ee299e700 1 -- 172.21.15.110:0/2476877298 shutdown_connections 2021-03-25T14:16:02.927 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:02.924+0000 7f7ee299e700 1 -- 172.21.15.110:0/2476877298 wait complete. 2021-03-25T14:16:02.937 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-03-25T14:16:03.048 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.046+0000 7f6c07ff8700 1 Processor -- start 2021-03-25T14:16:03.048 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.047+0000 7f6c07ff8700 1 -- start start 2021-03-25T14:16:03.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.047+0000 7f6c07ff8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6c000bbca0 0x7f6c00067840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:03.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.047+0000 7f6c07ff8700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6c00068ac0 0x7f6c000acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:03.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.047+0000 7f6c07ff8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c000afee0 con 0x7f6c000ad420 2021-03-25T14:16:03.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.047+0000 7f6c07ff8700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c00145d40 con 0x7f6c00068ac0 2021-03-25T14:16:03.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.047+0000 7f6c07ff8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c00145fe0 con 0x7f6c000bbca0 2021-03-25T14:16:03.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.047+0000 7f6c05593700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6c00068ac0 0x7f6c000acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:03.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.047+0000 7f6c05593700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6c00068ac0 0x7f6c000acf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47348/0 (socket says 172.21.15.110:47348) 2021-03-25T14:16:03.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.047+0000 7f6c05593700 1 -- 172.21.15.110:0/3896445708 learned_addr learned my addr 172.21.15.110:0/3896445708 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:03.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.048+0000 7f6c05d94700 1 --2- 172.21.15.110:0/3896445708 >> v2:172.21.15.174:3300/0 conn(0x7f6c000bbca0 0x7f6c00067840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:03.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.048+0000 7f6c05593700 1 -- 172.21.15.110:0/3896445708 >> v2:172.21.15.174:3300/0 conn(0x7f6c000bbca0 msgr2=0x7f6c00067840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:03.055 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.048+0000 7f6c05593700 1 --2- 172.21.15.110:0/3896445708 >> v2:172.21.15.174:3300/0 conn(0x7f6c000bbca0 0x7f6c00067840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:03.055 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.048+0000 7f6c05593700 1 -- 172.21.15.110:0/3896445708 >> v1:172.21.15.174:6789/0 conn(0x7f6c000ad420 legacy=0x7f6c00148fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:03.055 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.048+0000 7f6c05593700 1 -- 172.21.15.110:0/3896445708 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c000ad860 con 0x7f6c00068ac0 2021-03-25T14:16:03.055 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.048+0000 7f6c05d94700 1 --2- 172.21.15.110:0/3896445708 >> v2:172.21.15.174:3300/0 conn(0x7f6c000bbca0 0x7f6c00067840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:03.055 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.048+0000 7f6c05593700 1 --2- 172.21.15.110:0/3896445708 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c00068ac0 0x7f6c000acf30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f6c00067140 tx=0x7f6bf0006ee0).ready entity=mon.0 client_cookie=d9a018a7d4e88848 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:03.055 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.048+0000 7f6c04d92700 1 -- 172.21.15.110:0/3896445708 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf00098d0 con 0x7f6c00068ac0 2021-03-25T14:16:03.055 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.048+0000 7f6c04d92700 1 -- 172.21.15.110:0/3896445708 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf0009a30 con 0x7f6c00068ac0 2021-03-25T14:16:03.055 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.048+0000 7f6c04d92700 1 -- 172.21.15.110:0/3896445708 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf0009db0 con 0x7f6c00068ac0 2021-03-25T14:16:03.055 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.048+0000 7f6c07ff8700 1 -- 172.21.15.110:0/3896445708 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c00068ac0 msgr2=0x7f6c000acf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:03.055 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.048+0000 7f6c07ff8700 1 --2- 172.21.15.110:0/3896445708 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c00068ac0 0x7f6c000acf30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f6c00067140 tx=0x7f6bf0006ee0).stop 2021-03-25T14:16:03.055 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.048+0000 7f6c07ff8700 1 -- 172.21.15.110:0/3896445708 shutdown_connections 2021-03-25T14:16:03.055 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.048+0000 7f6c07ff8700 1 --2- 172.21.15.110:0/3896445708 >> v2:172.21.15.174:3300/0 conn(0x7f6c000bbca0 0x7f6c00067840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:03.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.048+0000 7f6c07ff8700 1 --2- 172.21.15.110:0/3896445708 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c00068ac0 0x7f6c000acf30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:03.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.048+0000 7f6c07ff8700 1 -- 172.21.15.110:0/3896445708 >> 172.21.15.110:0/3896445708 conn(0x7f6c00063850 msgr2=0x7f6c0005c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:03.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.049+0000 7f6c07ff8700 1 -- 172.21.15.110:0/3896445708 shutdown_connections 2021-03-25T14:16:03.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.049+0000 7f6c07ff8700 1 -- 172.21.15.110:0/3896445708 wait complete. 2021-03-25T14:16:03.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.050+0000 7f6c07ff8700 1 Processor -- start 2021-03-25T14:16:03.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.050+0000 7f6c07ff8700 1 -- start start 2021-03-25T14:16:03.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.050+0000 7f6c07ff8700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c00068ac0 0x7f6c00148ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:03.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.050+0000 7f6c07ff8700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c000ad420 0x7f6c0014c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:03.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.050+0000 7f6c07ff8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c000bbca0 0x7f6c0015a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:03.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.050+0000 7f6c07ff8700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0015a330 con 0x7f6c000ad420 2021-03-25T14:16:03.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.050+0000 7f6c07ff8700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0014a130 con 0x7f6c00068ac0 2021-03-25T14:16:03.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.050+0000 7f6c07ff8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0014a3d0 con 0x7f6c000bbca0 2021-03-25T14:16:03.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.050+0000 7f6c05593700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c000ad420 0x7f6c0014c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:03.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.050+0000 7f6c05593700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c000ad420 0x7f6c0014c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47356/0 (socket says 172.21.15.110:47356) 2021-03-25T14:16:03.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.050+0000 7f6c05593700 1 -- 172.21.15.110:0/1162927888 learned_addr learned my addr 172.21.15.110:0/1162927888 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:03.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.050+0000 7f6c05d94700 1 --2- 172.21.15.110:0/1162927888 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c00068ac0 0x7f6c00148ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:03.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.050+0000 7f6c06595700 1 --2- 172.21.15.110:0/1162927888 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c000bbca0 0x7f6c0015a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:03.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.051+0000 7f6c05593700 1 -- 172.21.15.110:0/1162927888 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c000bbca0 msgr2=0x7f6c0015a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:03.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.051+0000 7f6c05593700 1 --2- 172.21.15.110:0/1162927888 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c000bbca0 0x7f6c0015a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:03.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.051+0000 7f6c05593700 1 -- 172.21.15.110:0/1162927888 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c00068ac0 msgr2=0x7f6c00148ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:03.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.051+0000 7f6c05593700 1 --2- 172.21.15.110:0/1162927888 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c00068ac0 0x7f6c00148ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:03.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.051+0000 7f6c05593700 1 -- 172.21.15.110:0/1162927888 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c00145b10 con 0x7f6c000ad420 2021-03-25T14:16:03.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.051+0000 7f6c05593700 1 --2- 172.21.15.110:0/1162927888 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c000ad420 0x7f6c0014c030 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f6bf0006f20 tx=0x7f6bf0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:03.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.051+0000 7f6bedffb700 1 -- 172.21.15.110:0/1162927888 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf001f070 con 0x7f6c000ad420 2021-03-25T14:16:03.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.051+0000 7f6bedffb700 1 -- 172.21.15.110:0/1162927888 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf0012d40 con 0x7f6c000ad420 2021-03-25T14:16:03.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.051+0000 7f6c07ff8700 1 -- 172.21.15.110:0/1162927888 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c0014a670 con 0x7f6c000ad420 2021-03-25T14:16:03.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.051+0000 7f6bedffb700 1 -- 172.21.15.110:0/1162927888 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf001b640 con 0x7f6c000ad420 2021-03-25T14:16:03.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.051+0000 7f6c07ff8700 1 -- 172.21.15.110:0/1162927888 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c001493d0 con 0x7f6c000ad420 2021-03-25T14:16:03.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.052+0000 7f6c07ff8700 1 -- 172.21.15.110:0/1162927888 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c0005d7b0 con 0x7f6c000ad420 2021-03-25T14:16:03.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.052+0000 7f6bedffb700 1 -- 172.21.15.110:0/1162927888 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f6bf000f070 con 0x7f6c000ad420 2021-03-25T14:16:03.059 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.053+0000 7f6bedffb700 1 --2- 172.21.15.110:0/1162927888 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6be005a0b0 0x7f6be005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:03.060 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.053+0000 7f6bedffb700 1 -- 172.21.15.110:0/1162927888 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f6bf0074990 con 0x7f6c000ad420 2021-03-25T14:16:03.060 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.053+0000 7f6c05d94700 1 --2- 172.21.15.110:0/1162927888 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6be005a0b0 0x7f6be005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:03.060 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.053+0000 7f6c05d94700 1 --2- 172.21.15.110:0/1162927888 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6be005a0b0 0x7f6be005c570 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f6bfc00ba80 tx=0x7f6bfc006f90).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:03.060 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.056+0000 7f6bedffb700 1 -- 172.21.15.110:0/1162927888 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f6bf0048660 con 0x7f6c000ad420 2021-03-25T14:16:03.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.242+0000 7f6c07ff8700 1 -- 172.21.15.110:0/1162927888 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c00066d00 con 0x7f6c000ad420 2021-03-25T14:16:03.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.242+0000 7f6bedffb700 1 -- 172.21.15.110:0/1162927888 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+1565 (secure 0 0 0) 0x7f6bf004bc80 con 0x7f6c000ad420 2021-03-25T14:16:03.244 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:16:03.245 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1177985428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6833","nonce":1177985428},{"type":"v1","addr":"172.21.15.174:6835","nonce":1177985428}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1613822797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1613822797},{"type":"v1","addr":"172.21.15.110:6837","nonce":1613822797}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":2},{"gid":4284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6834/1564441351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1564441351},{"type":"v1","addr":"172.21.15.174:6834","nonce":1564441351}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":3}],"filesystems":[]} 2021-03-25T14:16:03.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.244+0000 7f6c07ff8700 1 -- 172.21.15.110:0/1162927888 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6be005a0b0 msgr2=0x7f6be005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:03.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.244+0000 7f6c07ff8700 1 --2- 172.21.15.110:0/1162927888 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6be005a0b0 0x7f6be005c570 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f6bfc00ba80 tx=0x7f6bfc006f90).stop 2021-03-25T14:16:03.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.244+0000 7f6c07ff8700 1 -- 172.21.15.110:0/1162927888 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c000ad420 msgr2=0x7f6c0014c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:03.247 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.244+0000 7f6c07ff8700 1 --2- 172.21.15.110:0/1162927888 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c000ad420 0x7f6c0014c030 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f6bf0006f20 tx=0x7f6bf0016000).stop 2021-03-25T14:16:03.247 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.244+0000 7f6c07ff8700 1 -- 172.21.15.110:0/1162927888 shutdown_connections 2021-03-25T14:16:03.247 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.244+0000 7f6c07ff8700 1 --2- 172.21.15.110:0/1162927888 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6be005a0b0 0x7f6be005c570 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:03.247 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.244+0000 7f6c07ff8700 1 --2- 172.21.15.110:0/1162927888 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c00068ac0 0x7f6c00148ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:03.247 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.244+0000 7f6c07ff8700 1 --2- 172.21.15.110:0/1162927888 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c000bbca0 0x7f6c0015a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:03.247 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.244+0000 7f6c07ff8700 1 --2- 172.21.15.110:0/1162927888 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c000ad420 0x7f6c0014c030 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:03.247 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.244+0000 7f6c07ff8700 1 -- 172.21.15.110:0/1162927888 >> 172.21.15.110:0/1162927888 conn(0x7f6c00063850 msgr2=0x7f6c0013a710 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:03.247 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.244+0000 7f6c07ff8700 1 -- 172.21.15.110:0/1162927888 shutdown_connections 2021-03-25T14:16:03.247 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:03.244+0000 7f6c07ff8700 1 -- 172.21.15.110:0/1162927888 wait complete. 2021-03-25T14:16:03.247 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 3 2021-03-25T14:16:05.258 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-03-25T14:16:05.381 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.380+0000 7f7016d0b700 1 Processor -- start 2021-03-25T14:16:05.381 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.380+0000 7f7016d0b700 1 -- start start 2021-03-25T14:16:05.384 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.381+0000 7f7016d0b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7010148fc0 0x7f701014a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:05.385 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.381+0000 7f7016d0b700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f701014a540 con 0x7f70100ba4f0 2021-03-25T14:16:05.385 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.381+0000 7f7016d0b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7010149450 con 0x7f70100b99b0 2021-03-25T14:16:05.385 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.381+0000 7f7016d0b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70100ba950 con 0x7f7010148fc0 2021-03-25T14:16:05.385 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.381+0000 7f700ffff700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f70100ba4f0 0x7f70100a3190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:40300/0 (socket says 172.21.15.110:40300) 2021-03-25T14:16:05.385 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.381+0000 7f700ffff700 1 -- 172.21.15.110:0/3408964050 learned_addr learned my addr 172.21.15.110:0/3408964050 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:05.385 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.381+0000 7f70152a8700 1 --2- 172.21.15.110:0/3408964050 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7010148fc0 0x7f701014a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:05.385 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.381+0000 7f700f7fe700 1 -- 172.21.15.110:0/3408964050 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1753372327 0 0) 0x7f701014a540 con 0x7f70100ba4f0 2021-03-25T14:16:05.385 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.382+0000 7f700f7fe700 1 -- 172.21.15.110:0/3408964050 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ff4003270 con 0x7f70100ba4f0 2021-03-25T14:16:05.385 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.382+0000 7f700f7fe700 1 -- 172.21.15.110:0/3408964050 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2619538130 0 0) 0x7f7010149450 con 0x7f70100b99b0 2021-03-25T14:16:05.385 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.382+0000 7f700f7fe700 1 -- 172.21.15.110:0/3408964050 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f701014a540 con 0x7f70100b99b0 2021-03-25T14:16:05.385 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.382+0000 7f70152a8700 1 -- 172.21.15.110:0/3408964050 >> v1:172.21.15.174:6789/0 conn(0x7f70100b99b0 legacy=0x7f70101488b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:05.385 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.382+0000 7f70152a8700 1 -- 172.21.15.110:0/3408964050 >> v1:172.21.15.110:6789/0 conn(0x7f70100ba4f0 legacy=0x7f70100a3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:05.386 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.382+0000 7f70152a8700 1 -- 172.21.15.110:0/3408964050 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70100babc0 con 0x7f7010148fc0 2021-03-25T14:16:05.386 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.382+0000 7f70152a8700 1 --2- 172.21.15.110:0/3408964050 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7010148fc0 0x7f701014a050 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f7008009cf0 tx=0x7f7008009220).ready entity=mon.2 client_cookie=6b88122f36a50521 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:05.386 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.382+0000 7f700f7fe700 1 -- 172.21.15.110:0/3408964050 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700800ba20 con 0x7f7010148fc0 2021-03-25T14:16:05.386 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.382+0000 7f700f7fe700 1 -- 172.21.15.110:0/3408964050 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700800bb80 con 0x7f7010148fc0 2021-03-25T14:16:05.386 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.382+0000 7f700f7fe700 1 -- 172.21.15.110:0/3408964050 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7008011400 con 0x7f7010148fc0 2021-03-25T14:16:05.386 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.383+0000 7f7016d0b700 1 -- 172.21.15.110:0/3408964050 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7010148fc0 msgr2=0x7f701014a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:05.386 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.383+0000 7f7016d0b700 1 --2- 172.21.15.110:0/3408964050 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7010148fc0 0x7f701014a050 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f7008009cf0 tx=0x7f7008009220).stop 2021-03-25T14:16:05.386 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.383+0000 7f7016d0b700 1 -- 172.21.15.110:0/3408964050 shutdown_connections 2021-03-25T14:16:05.386 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.383+0000 7f7016d0b700 1 --2- 172.21.15.110:0/3408964050 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7010148fc0 0x7f701014a050 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:05.386 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.383+0000 7f7016d0b700 1 -- 172.21.15.110:0/3408964050 >> 172.21.15.110:0/3408964050 conn(0x7f7010060c40 msgr2=0x7f7010061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:05.386 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.383+0000 7f7016d0b700 1 -- 172.21.15.110:0/3408964050 shutdown_connections 2021-03-25T14:16:05.386 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.383+0000 7f7016d0b700 1 -- 172.21.15.110:0/3408964050 wait complete. 2021-03-25T14:16:05.387 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.384+0000 7f7016d0b700 1 Processor -- start 2021-03-25T14:16:05.387 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.384+0000 7f7016d0b700 1 -- start start 2021-03-25T14:16:05.390 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.384+0000 7f7016d0b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70100b99b0 0x7f70101445b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:05.390 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.384+0000 7f7016d0b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70100ba4f0 0x7f7010144aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:05.390 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.385+0000 7f7016d0b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7010148fc0 0x7f7010063f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:05.390 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.385+0000 7f7016d0b700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7010146540 con 0x7f70100ba4f0 2021-03-25T14:16:05.390 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.385+0000 7f7016d0b700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70100bc6b0 con 0x7f7010148fc0 2021-03-25T14:16:05.390 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.385+0000 7f7016d0b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7010158b90 con 0x7f70100b99b0 2021-03-25T14:16:05.390 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.385+0000 7f700ffff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70100ba4f0 0x7f7010144aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:05.390 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.385+0000 7f700ffff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70100ba4f0 0x7f7010144aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47370/0 (socket says 172.21.15.110:47370) 2021-03-25T14:16:05.390 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.385+0000 7f700ffff700 1 -- 172.21.15.110:0/2329417169 learned_addr learned my addr 172.21.15.110:0/2329417169 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:05.391 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.385+0000 7f70152a8700 1 --2- 172.21.15.110:0/2329417169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7010148fc0 0x7f7010063f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:05.391 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.385+0000 7f7014aa7700 1 --2- 172.21.15.110:0/2329417169 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70100b99b0 0x7f70101445b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:05.391 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.385+0000 7f700ffff700 1 -- 172.21.15.110:0/2329417169 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70100b99b0 msgr2=0x7f70101445b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:05.391 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.385+0000 7f700ffff700 1 --2- 172.21.15.110:0/2329417169 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70100b99b0 0x7f70101445b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:05.391 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.385+0000 7f700ffff700 1 -- 172.21.15.110:0/2329417169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7010148fc0 msgr2=0x7f7010063f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:05.391 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.385+0000 7f700ffff700 1 --2- 172.21.15.110:0/2329417169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7010148fc0 0x7f7010063f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:05.391 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.385+0000 7f700ffff700 1 -- 172.21.15.110:0/2329417169 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7010158e30 con 0x7f70100ba4f0 2021-03-25T14:16:05.391 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.385+0000 7f70152a8700 1 --2- 172.21.15.110:0/2329417169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7010148fc0 0x7f7010063f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:05.391 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.385+0000 7f700ffff700 1 --2- 172.21.15.110:0/2329417169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70100ba4f0 0x7f7010144aa0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f6ffc00c830 tx=0x7f6ffc007ba0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:05.391 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.385+0000 7f700cff9700 1 -- 172.21.15.110:0/2329417169 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc007320 con 0x7f70100ba4f0 2021-03-25T14:16:05.391 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.385+0000 7f700cff9700 1 -- 172.21.15.110:0/2329417169 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ffc007480 con 0x7f70100ba4f0 2021-03-25T14:16:05.391 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.385+0000 7f7016d0b700 1 -- 172.21.15.110:0/2329417169 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70101590d0 con 0x7f70100ba4f0 2021-03-25T14:16:05.392 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.385+0000 7f700cff9700 1 -- 172.21.15.110:0/2329417169 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc005830 con 0x7f70100ba4f0 2021-03-25T14:16:05.392 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.385+0000 7f7016d0b700 1 -- 172.21.15.110:0/2329417169 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7010159810 con 0x7f70100ba4f0 2021-03-25T14:16:05.392 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.386+0000 7f7016d0b700 1 -- 172.21.15.110:0/2329417169 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7010159530 con 0x7f70100ba4f0 2021-03-25T14:16:05.392 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.386+0000 7f700cff9700 1 -- 172.21.15.110:0/2329417169 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f6ffc010030 con 0x7f70100ba4f0 2021-03-25T14:16:05.392 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.387+0000 7f700cff9700 1 --2- 172.21.15.110:0/2329417169 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6ff005a0b0 0x7f6ff005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:05.392 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.387+0000 7f700cff9700 1 -- 172.21.15.110:0/2329417169 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f6ffc073710 con 0x7f70100ba4f0 2021-03-25T14:16:05.392 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.387+0000 7f7014aa7700 1 --2- 172.21.15.110:0/2329417169 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6ff005a0b0 0x7f6ff005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:05.392 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.387+0000 7f7014aa7700 1 --2- 172.21.15.110:0/2329417169 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6ff005a0b0 0x7f6ff005c570 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f7004002520 tx=0x7f7004009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:05.392 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.390+0000 7f700cff9700 1 -- 172.21.15.110:0/2329417169 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f6ffc0473e0 con 0x7f70100ba4f0 2021-03-25T14:16:05.577 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.577+0000 7f7016d0b700 1 -- 172.21.15.110:0/2329417169 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f701014ba70 con 0x7f70100ba4f0 2021-03-25T14:16:05.707 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.577+0000 7f700cff9700 1 -- 172.21.15.110:0/2329417169 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+1565 (secure 0 0 0) 0x7f6ffc007ce0 con 0x7f70100ba4f0 2021-03-25T14:16:05.708 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:16:05.708 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1177985428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6833","nonce":1177985428},{"type":"v1","addr":"172.21.15.174:6835","nonce":1177985428}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1613822797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1613822797},{"type":"v1","addr":"172.21.15.110:6837","nonce":1613822797}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":2},{"gid":4284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6834/1564441351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1564441351},{"type":"v1","addr":"172.21.15.174:6834","nonce":1564441351}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":3}],"filesystems":[]} 2021-03-25T14:16:05.710 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.579+0000 7f7016d0b700 1 -- 172.21.15.110:0/2329417169 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6ff005a0b0 msgr2=0x7f6ff005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:05.711 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.579+0000 7f7016d0b700 1 --2- 172.21.15.110:0/2329417169 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6ff005a0b0 0x7f6ff005c570 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f7004002520 tx=0x7f7004009040).stop 2021-03-25T14:16:05.711 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.579+0000 7f7016d0b700 1 -- 172.21.15.110:0/2329417169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70100ba4f0 msgr2=0x7f7010144aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:05.711 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.579+0000 7f7016d0b700 1 --2- 172.21.15.110:0/2329417169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70100ba4f0 0x7f7010144aa0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f6ffc00c830 tx=0x7f6ffc007ba0).stop 2021-03-25T14:16:05.711 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.579+0000 7f7016d0b700 1 -- 172.21.15.110:0/2329417169 shutdown_connections 2021-03-25T14:16:05.712 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.579+0000 7f7016d0b700 1 --2- 172.21.15.110:0/2329417169 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6ff005a0b0 0x7f6ff005c570 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:05.712 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.579+0000 7f7016d0b700 1 --2- 172.21.15.110:0/2329417169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7010148fc0 0x7f7010063f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:05.712 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.579+0000 7f7016d0b700 1 --2- 172.21.15.110:0/2329417169 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70100b99b0 0x7f70101445b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:05.712 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.579+0000 7f7016d0b700 1 --2- 172.21.15.110:0/2329417169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70100ba4f0 0x7f7010144aa0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:05.712 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.579+0000 7f7016d0b700 1 -- 172.21.15.110:0/2329417169 >> 172.21.15.110:0/2329417169 conn(0x7f7010060c40 msgr2=0x7f7010146e20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:05.712 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.579+0000 7f7016d0b700 1 -- 172.21.15.110:0/2329417169 shutdown_connections 2021-03-25T14:16:05.712 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:05.579+0000 7f7016d0b700 1 -- 172.21.15.110:0/2329417169 wait complete. 2021-03-25T14:16:05.712 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 3 2021-03-25T14:16:07.714 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-03-25T14:16:07.836 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.835+0000 7f8683405700 1 Processor -- start 2021-03-25T14:16:07.836 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.835+0000 7f8683405700 1 -- start start 2021-03-25T14:16:07.839 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.836+0000 7f8683405700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f867c0b1340 0x7f867c0b1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:07.839 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.836+0000 7f8683405700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f867c066420 0x7f867c0668a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:07.839 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.836+0000 7f8683405700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f867c067510 con 0x7f867c149cf0 2021-03-25T14:16:07.839 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.836+0000 7f8683405700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f867c0677b0 con 0x7f867c066420 2021-03-25T14:16:07.839 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.836+0000 7f8683405700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867c067a50 con 0x7f867c0b1340 2021-03-25T14:16:07.839 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.836+0000 7f86809a0700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f867c066420 0x7f867c0668a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:07.839 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.836+0000 7f86819a2700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f867c149cf0 0x7f867c14cee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:40316/0 (socket says 172.21.15.110:40316) 2021-03-25T14:16:07.839 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.836+0000 7f86819a2700 1 -- 172.21.15.110:0/1261757077 learned_addr learned my addr 172.21.15.110:0/1261757077 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:07.839 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.836+0000 7f86811a1700 1 --2- 172.21.15.110:0/1261757077 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f867c0b1340 0x7f867c0b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:07.840 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.837+0000 7f86809a0700 1 -- 172.21.15.110:0/1261757077 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f867c0b1340 msgr2=0x7f867c0b1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:07.840 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.837+0000 7f86809a0700 1 --2- 172.21.15.110:0/1261757077 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f867c0b1340 0x7f867c0b1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:07.840 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.837+0000 7f86809a0700 1 -- 172.21.15.110:0/1261757077 >> v1:172.21.15.110:6789/0 conn(0x7f867c149cf0 legacy=0x7f867c14cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:07.840 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.837+0000 7f866bfff700 1 -- 172.21.15.110:0/1261757077 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 323923065 0 0) 0x7f867c067510 con 0x7f867c149cf0 2021-03-25T14:16:07.840 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.837+0000 7f86809a0700 1 -- 172.21.15.110:0/1261757077 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867c067cf0 con 0x7f867c066420 2021-03-25T14:16:07.840 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.837+0000 7f86811a1700 1 --2- 172.21.15.110:0/1261757077 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f867c0b1340 0x7f867c0b1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:07.840 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.837+0000 7f86809a0700 1 --2- 172.21.15.110:0/1261757077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f867c066420 0x7f867c0668a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f866c00b9c0 tx=0x7f866c006e20).ready entity=mon.0 client_cookie=9a1d73c19ec225b5 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:07.840 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.837+0000 7f866bfff700 1 -- 172.21.15.110:0/1261757077 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866c009870 con 0x7f867c066420 2021-03-25T14:16:07.840 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.837+0000 7f866bfff700 1 -- 172.21.15.110:0/1261757077 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f866c0099d0 con 0x7f867c066420 2021-03-25T14:16:07.840 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.837+0000 7f866bfff700 1 -- 172.21.15.110:0/1261757077 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866c009d50 con 0x7f867c066420 2021-03-25T14:16:07.841 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.837+0000 7f8683405700 1 -- 172.21.15.110:0/1261757077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f867c066420 msgr2=0x7f867c0668a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:07.841 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.837+0000 7f8683405700 1 --2- 172.21.15.110:0/1261757077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f867c066420 0x7f867c0668a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f866c00b9c0 tx=0x7f866c006e20).stop 2021-03-25T14:16:07.841 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.837+0000 7f8683405700 1 -- 172.21.15.110:0/1261757077 shutdown_connections 2021-03-25T14:16:07.841 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.837+0000 7f8683405700 1 --2- 172.21.15.110:0/1261757077 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f867c0b1340 0x7f867c0b1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:07.841 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.837+0000 7f8683405700 1 --2- 172.21.15.110:0/1261757077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f867c066420 0x7f867c0668a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:07.841 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.837+0000 7f8683405700 1 -- 172.21.15.110:0/1261757077 >> 172.21.15.110:0/1261757077 conn(0x7f867c0649a0 msgr2=0x7f867c05c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:07.841 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.837+0000 7f8683405700 1 -- 172.21.15.110:0/1261757077 shutdown_connections 2021-03-25T14:16:07.841 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.837+0000 7f8683405700 1 -- 172.21.15.110:0/1261757077 wait complete. 2021-03-25T14:16:07.844 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.838+0000 7f8683405700 1 Processor -- start 2021-03-25T14:16:07.844 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.838+0000 7f8683405700 1 -- start start 2021-03-25T14:16:07.844 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.839+0000 7f8683405700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f867c066420 0x7f867c150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:07.844 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.839+0000 7f8683405700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f867c0b1340 0x7f867c13d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:07.844 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.839+0000 7f8683405700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f867c149cf0 0x7f867c13d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:07.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.839+0000 7f8683405700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c159c20 con 0x7f867c0b1340 2021-03-25T14:16:07.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.839+0000 7f8683405700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c1591a0 con 0x7f867c066420 2021-03-25T14:16:07.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.839+0000 7f8683405700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867c159440 con 0x7f867c149cf0 2021-03-25T14:16:07.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.839+0000 7f86809a0700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f867c0b1340 0x7f867c13d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:07.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.839+0000 7f86809a0700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f867c0b1340 0x7f867c13d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47386/0 (socket says 172.21.15.110:47386) 2021-03-25T14:16:07.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.839+0000 7f86809a0700 1 -- 172.21.15.110:0/402089918 learned_addr learned my addr 172.21.15.110:0/402089918 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:07.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.840+0000 7f86819a2700 1 --2- 172.21.15.110:0/402089918 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f867c149cf0 0x7f867c13d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:07.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.840+0000 7f86811a1700 1 --2- 172.21.15.110:0/402089918 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f867c066420 0x7f867c150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:07.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.840+0000 7f86809a0700 1 -- 172.21.15.110:0/402089918 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f867c149cf0 msgr2=0x7f867c13d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:07.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.840+0000 7f86809a0700 1 --2- 172.21.15.110:0/402089918 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f867c149cf0 0x7f867c13d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:07.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.840+0000 7f86809a0700 1 -- 172.21.15.110:0/402089918 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f867c066420 msgr2=0x7f867c150100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:07.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.840+0000 7f86809a0700 1 --2- 172.21.15.110:0/402089918 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f867c066420 0x7f867c150100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:07.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.840+0000 7f86809a0700 1 -- 172.21.15.110:0/402089918 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867c1596e0 con 0x7f867c0b1340 2021-03-25T14:16:07.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.840+0000 7f86809a0700 1 --2- 172.21.15.110:0/402089918 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f867c0b1340 0x7f867c13d390 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f866c007fd0 tx=0x7f866c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:07.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.840+0000 7f86697fa700 1 -- 172.21.15.110:0/402089918 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866c011e20 con 0x7f867c0b1340 2021-03-25T14:16:07.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.840+0000 7f86697fa700 1 -- 172.21.15.110:0/402089918 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f866c01c420 con 0x7f867c0b1340 2021-03-25T14:16:07.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.840+0000 7f8683405700 1 -- 172.21.15.110:0/402089918 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f867c159980 con 0x7f867c0b1340 2021-03-25T14:16:07.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.840+0000 7f86697fa700 1 -- 172.21.15.110:0/402089918 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866c01c7c0 con 0x7f867c0b1340 2021-03-25T14:16:07.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.840+0000 7f8683405700 1 -- 172.21.15.110:0/402089918 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f867c144db0 con 0x7f867c0b1340 2021-03-25T14:16:07.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.841+0000 7f8683405700 1 -- 172.21.15.110:0/402089918 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f867c05d7b0 con 0x7f867c0b1340 2021-03-25T14:16:07.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.842+0000 7f86697fa700 1 -- 172.21.15.110:0/402089918 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f866c00f070 con 0x7f867c0b1340 2021-03-25T14:16:07.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.842+0000 7f86697fa700 1 --2- 172.21.15.110:0/402089918 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f865c05a0b0 0x7f865c05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:07.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.842+0000 7f86697fa700 1 -- 172.21.15.110:0/402089918 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f866c075b70 con 0x7f867c0b1340 2021-03-25T14:16:07.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.842+0000 7f86811a1700 1 --2- 172.21.15.110:0/402089918 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f865c05a0b0 0x7f865c05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:07.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.842+0000 7f86811a1700 1 --2- 172.21.15.110:0/402089918 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f865c05a0b0 0x7f865c05c570 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f867800aa50 tx=0x7f8678008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:07.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:07.845+0000 7f86697fa700 1 -- 172.21.15.110:0/402089918 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f866c0498c0 con 0x7f867c0b1340 2021-03-25T14:16:08.032 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.031+0000 7f8683405700 1 -- 172.21.15.110:0/402089918 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f867c067210 con 0x7f867c0b1340 2021-03-25T14:16:08.032 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.031+0000 7f86697fa700 1 -- 172.21.15.110:0/402089918 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+1920 (secure 0 0 0) 0x7f866c04cee0 con 0x7f867c0b1340 2021-03-25T14:16:08.032 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:16:08.033 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1177985428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6833","nonce":1177985428},{"type":"v1","addr":"172.21.15.174:6835","nonce":1177985428}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.110:6836/3814723779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3814723779},{"type":"v1","addr":"172.21.15.110:6836","nonce":3814723779}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":4},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1613822797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1613822797},{"type":"v1","addr":"172.21.15.110:6837","nonce":1613822797}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":2},{"gid":4284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6834/1564441351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1564441351},{"type":"v1","addr":"172.21.15.174:6834","nonce":1564441351}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":3}],"filesystems":[]} 2021-03-25T14:16:08.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.033+0000 7f8683405700 1 -- 172.21.15.110:0/402089918 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f865c05a0b0 msgr2=0x7f865c05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:08.035 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.033+0000 7f8683405700 1 --2- 172.21.15.110:0/402089918 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f865c05a0b0 0x7f865c05c570 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f867800aa50 tx=0x7f8678008040).stop 2021-03-25T14:16:08.035 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.033+0000 7f8683405700 1 -- 172.21.15.110:0/402089918 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f867c0b1340 msgr2=0x7f867c13d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:08.035 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.033+0000 7f8683405700 1 --2- 172.21.15.110:0/402089918 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f867c0b1340 0x7f867c13d390 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f866c007fd0 tx=0x7f866c016000).stop 2021-03-25T14:16:08.035 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.033+0000 7f8683405700 1 -- 172.21.15.110:0/402089918 shutdown_connections 2021-03-25T14:16:08.035 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.033+0000 7f8683405700 1 --2- 172.21.15.110:0/402089918 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f865c05a0b0 0x7f865c05c570 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:08.035 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.033+0000 7f8683405700 1 --2- 172.21.15.110:0/402089918 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f867c066420 0x7f867c150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:08.035 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.033+0000 7f8683405700 1 --2- 172.21.15.110:0/402089918 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f867c149cf0 0x7f867c13d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:08.035 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.033+0000 7f8683405700 1 --2- 172.21.15.110:0/402089918 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f867c0b1340 0x7f867c13d390 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:08.035 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.033+0000 7f8683405700 1 -- 172.21.15.110:0/402089918 >> 172.21.15.110:0/402089918 conn(0x7f867c0649a0 msgr2=0x7f867c14ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:08.035 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.033+0000 7f8683405700 1 -- 172.21.15.110:0/402089918 shutdown_connections 2021-03-25T14:16:08.035 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.033+0000 7f8683405700 1 -- 172.21.15.110:0/402089918 wait complete. 2021-03-25T14:16:08.035 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 4 2021-03-25T14:16:08.046 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:16:08.155 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.154+0000 7f4760a03700 1 Processor -- start 2021-03-25T14:16:08.155 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.154+0000 7f4760a03700 1 -- start start 2021-03-25T14:16:08.157 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.155+0000 7f4760a03700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f475c0672a0 0x7f475c068d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:08.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.155+0000 7f4760a03700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f475c14d580 0x7f475c149a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:08.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.155+0000 7f4760a03700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f475c0b75b0 con 0x7f475c0c09d0 2021-03-25T14:16:08.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.155+0000 7f4760a03700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f475c068820 con 0x7f475c14d580 2021-03-25T14:16:08.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.155+0000 7f4760a03700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f475c069210 con 0x7f475c0672a0 2021-03-25T14:16:08.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.155+0000 7f475bfff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f475c14d580 0x7f475c149a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:08.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.155+0000 7f475bfff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f475c14d580 0x7f475c149a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47392/0 (socket says 172.21.15.110:47392) 2021-03-25T14:16:08.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.155+0000 7f475bfff700 1 -- 172.21.15.110:0/1337971152 learned_addr learned my addr 172.21.15.110:0/1337971152 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:08.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.155+0000 7f475b7fe700 1 --2- 172.21.15.110:0/1337971152 >> v2:172.21.15.174:3300/0 conn(0x7f475c0672a0 0x7f475c068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:08.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.155+0000 7f475bfff700 1 -- 172.21.15.110:0/1337971152 >> v2:172.21.15.174:3300/0 conn(0x7f475c0672a0 msgr2=0x7f475c068d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:08.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.155+0000 7f475bfff700 1 --2- 172.21.15.110:0/1337971152 >> v2:172.21.15.174:3300/0 conn(0x7f475c0672a0 0x7f475c068d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:08.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.155+0000 7f475bfff700 1 -- 172.21.15.110:0/1337971152 >> v1:172.21.15.174:6789/0 conn(0x7f475c0c09d0 legacy=0x7f475c14ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:08.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.155+0000 7f475bfff700 1 -- 172.21.15.110:0/1337971152 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f475c069430 con 0x7f475c14d580 2021-03-25T14:16:08.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.155+0000 7f475bfff700 1 --2- 172.21.15.110:0/1337971152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f475c14d580 0x7f475c149a50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f475c0644d0 tx=0x7f47540092d0).ready entity=mon.0 client_cookie=ccad6db8e94ac4ea server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:08.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.155+0000 7f475a7fc700 1 -- 172.21.15.110:0/1337971152 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475400bc00 con 0x7f475c14d580 2021-03-25T14:16:08.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.156+0000 7f475a7fc700 1 -- 172.21.15.110:0/1337971152 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475400bd60 con 0x7f475c14d580 2021-03-25T14:16:08.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.156+0000 7f475a7fc700 1 -- 172.21.15.110:0/1337971152 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4754011610 con 0x7f475c14d580 2021-03-25T14:16:08.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.156+0000 7f4760a03700 1 -- 172.21.15.110:0/1337971152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f475c14d580 msgr2=0x7f475c149a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:08.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.156+0000 7f4760a03700 1 --2- 172.21.15.110:0/1337971152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f475c14d580 0x7f475c149a50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f475c0644d0 tx=0x7f47540092d0).stop 2021-03-25T14:16:08.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.156+0000 7f4760a03700 1 -- 172.21.15.110:0/1337971152 shutdown_connections 2021-03-25T14:16:08.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.156+0000 7f4760a03700 1 --2- 172.21.15.110:0/1337971152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f475c14d580 0x7f475c149a50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:08.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.156+0000 7f4760a03700 1 --2- 172.21.15.110:0/1337971152 >> v2:172.21.15.174:3300/0 conn(0x7f475c0672a0 0x7f475c068d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:08.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.156+0000 7f4760a03700 1 -- 172.21.15.110:0/1337971152 >> 172.21.15.110:0/1337971152 conn(0x7f475c0633a0 msgr2=0x7f475c0663e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:08.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.156+0000 7f4760a03700 1 -- 172.21.15.110:0/1337971152 shutdown_connections 2021-03-25T14:16:08.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.156+0000 7f4760a03700 1 -- 172.21.15.110:0/1337971152 wait complete. 2021-03-25T14:16:08.162 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.157+0000 7f4760a03700 1 Processor -- start 2021-03-25T14:16:08.163 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.157+0000 7f4760a03700 1 -- start start 2021-03-25T14:16:08.163 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.158+0000 7f4760a03700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f475c0672a0 0x7f475c0b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:08.163 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.158+0000 7f4760a03700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f475c0c09d0 0x7f475c0bb360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:08.163 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.158+0000 7f4760a03700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f475c14d580 0x7f475c0bf470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:08.163 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.158+0000 7f4760a03700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475c0b25a0 con 0x7f475c0c09d0 2021-03-25T14:16:08.163 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.158+0000 7f4760a03700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475c0bc3d0 con 0x7f475c0672a0 2021-03-25T14:16:08.163 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.158+0000 7f4760a03700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f475c0b3120 con 0x7f475c14d580 2021-03-25T14:16:08.163 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.158+0000 7f475affd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f475c0c09d0 0x7f475c0bb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:08.163 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.158+0000 7f475affd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f475c0c09d0 0x7f475c0bb360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47400/0 (socket says 172.21.15.110:47400) 2021-03-25T14:16:08.163 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.158+0000 7f475affd700 1 -- 172.21.15.110:0/1897106666 learned_addr learned my addr 172.21.15.110:0/1897106666 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:08.163 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.158+0000 7f475bfff700 1 --2- 172.21.15.110:0/1897106666 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f475c14d580 0x7f475c0bf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:08.163 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.158+0000 7f475b7fe700 1 --2- 172.21.15.110:0/1897106666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f475c0672a0 0x7f475c0b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:08.163 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.158+0000 7f475affd700 1 -- 172.21.15.110:0/1897106666 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f475c14d580 msgr2=0x7f475c0bf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:08.164 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.158+0000 7f475affd700 1 --2- 172.21.15.110:0/1897106666 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f475c14d580 0x7f475c0bf470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:08.164 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.158+0000 7f475affd700 1 -- 172.21.15.110:0/1897106666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f475c0672a0 msgr2=0x7f475c0b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:08.164 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.158+0000 7f475affd700 1 --2- 172.21.15.110:0/1897106666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f475c0672a0 0x7f475c0b2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:08.164 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.158+0000 7f475affd700 1 -- 172.21.15.110:0/1897106666 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f475c0bc630 con 0x7f475c0c09d0 2021-03-25T14:16:08.164 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.158+0000 7f475b7fe700 1 --2- 172.21.15.110:0/1897106666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f475c0672a0 0x7f475c0b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:08.164 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.159+0000 7f475affd700 1 --2- 172.21.15.110:0/1897106666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f475c0c09d0 0x7f475c0bb360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f4750009760 tx=0x7f4750006e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:08.164 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.159+0000 7f47437fe700 1 -- 172.21.15.110:0/1897106666 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475000d4a0 con 0x7f475c0c09d0 2021-03-25T14:16:08.164 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.159+0000 7f47437fe700 1 -- 172.21.15.110:0/1897106666 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475000d620 con 0x7f475c0c09d0 2021-03-25T14:16:08.164 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.159+0000 7f4760a03700 1 -- 172.21.15.110:0/1897106666 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f475c0bc8d0 con 0x7f475c0c09d0 2021-03-25T14:16:08.164 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.159+0000 7f47437fe700 1 -- 172.21.15.110:0/1897106666 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475000d9e0 con 0x7f475c0c09d0 2021-03-25T14:16:08.164 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.159+0000 7f4760a03700 1 -- 172.21.15.110:0/1897106666 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f475c0b2790 con 0x7f475c0c09d0 2021-03-25T14:16:08.164 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.160+0000 7f4760a03700 1 -- 172.21.15.110:0/1897106666 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f475c045ae0 con 0x7f475c0c09d0 2021-03-25T14:16:08.164 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.160+0000 7f47437fe700 1 -- 172.21.15.110:0/1897106666 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f475000f070 con 0x7f475c0c09d0 2021-03-25T14:16:08.165 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.160+0000 7f47437fe700 1 --2- 172.21.15.110:0/1897106666 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f473c05a0b0 0x7f473c05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:08.165 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.160+0000 7f47437fe700 1 -- 172.21.15.110:0/1897106666 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f4750073450 con 0x7f475c0c09d0 2021-03-25T14:16:08.165 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.160+0000 7f475b7fe700 1 --2- 172.21.15.110:0/1897106666 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f473c05a0b0 0x7f473c05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:08.165 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.161+0000 7f475b7fe700 1 --2- 172.21.15.110:0/1897106666 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f473c05a0b0 0x7f473c05c570 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f474c006fd0 tx=0x7f474c008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:08.165 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.164+0000 7f47437fe700 1 -- 172.21.15.110:0/1897106666 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f475004ab50 con 0x7f475c0c09d0 2021-03-25T14:16:08.313 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.313+0000 7f4760a03700 1 -- 172.21.15.110:0/1897106666 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f475c063c70 con 0x7f475c0c09d0 2021-03-25T14:16:08.314 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.314+0000 7f47437fe700 1 -- 172.21.15.110:0/1897106666 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+13719 (secure 0 0 0) 0x7f475004a740 con 0x7f475c0c09d0 2021-03-25T14:16:08.314 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:16:08.315 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":17,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:16:03.033665+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:16:08.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.315+0000 7f4760a03700 1 -- 172.21.15.110:0/1897106666 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f473c05a0b0 msgr2=0x7f473c05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:08.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.315+0000 7f4760a03700 1 --2- 172.21.15.110:0/1897106666 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f473c05a0b0 0x7f473c05c570 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f474c006fd0 tx=0x7f474c008040).stop 2021-03-25T14:16:08.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.315+0000 7f4760a03700 1 -- 172.21.15.110:0/1897106666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f475c0c09d0 msgr2=0x7f475c0bb360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:08.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.315+0000 7f4760a03700 1 --2- 172.21.15.110:0/1897106666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f475c0c09d0 0x7f475c0bb360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f4750009760 tx=0x7f4750006e20).stop 2021-03-25T14:16:08.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.315+0000 7f4760a03700 1 -- 172.21.15.110:0/1897106666 shutdown_connections 2021-03-25T14:16:08.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.315+0000 7f4760a03700 1 --2- 172.21.15.110:0/1897106666 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f473c05a0b0 0x7f473c05c570 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:08.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.315+0000 7f4760a03700 1 --2- 172.21.15.110:0/1897106666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f475c0672a0 0x7f475c0b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:08.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.315+0000 7f4760a03700 1 --2- 172.21.15.110:0/1897106666 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f475c14d580 0x7f475c0bf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:08.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.315+0000 7f4760a03700 1 --2- 172.21.15.110:0/1897106666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f475c0c09d0 0x7f475c0bb360 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:08.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.315+0000 7f4760a03700 1 -- 172.21.15.110:0/1897106666 >> 172.21.15.110:0/1897106666 conn(0x7f475c0633a0 msgr2=0x7f475c14c350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:08.318 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.316+0000 7f4760a03700 1 -- 172.21.15.110:0/1897106666 shutdown_connections 2021-03-25T14:16:08.318 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.316+0000 7f4760a03700 1 -- 172.21.15.110:0/1897106666 wait complete. 2021-03-25T14:16:08.328 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-03-25T14:15:59.047299+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-03-25T14:16:00.537926+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-03-25T14:16:08.328 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-03-25T14:16:08.441 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.440+0000 7f3ec993a700 1 Processor -- start 2021-03-25T14:16:08.441 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.440+0000 7f3ec993a700 1 -- start start 2021-03-25T14:16:08.447 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.441+0000 7f3ec993a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ec414cc90 0x7f3ec414d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:08.448 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.441+0000 7f3ec993a700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ec40691b0 con 0x7f3ec40685d0 2021-03-25T14:16:08.448 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.441+0000 7f3ec993a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ec40bc2b0 con 0x7f3ec414d470 2021-03-25T14:16:08.448 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.441+0000 7f3ec993a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec4149dd0 con 0x7f3ec414cc90 2021-03-25T14:16:08.448 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.441+0000 7f3ec37fe700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f3ec40685d0 0x7f3ec40bc710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:40344/0 (socket says 172.21.15.110:40344) 2021-03-25T14:16:08.448 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.441+0000 7f3ec37fe700 1 -- 172.21.15.110:0/1287230409 learned_addr learned my addr 172.21.15.110:0/1287230409 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:08.448 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.441+0000 7f3ebbfff700 1 --2- 172.21.15.110:0/1287230409 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ec414cc90 0x7f3ec414d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:08.448 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.441+0000 7f3ec27fc700 1 -- 172.21.15.110:0/1287230409 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3398686265 0 0) 0x7f3ec40691b0 con 0x7f3ec40685d0 2021-03-25T14:16:08.448 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.441+0000 7f3ec27fc700 1 -- 172.21.15.110:0/1287230409 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ea4003270 con 0x7f3ec40685d0 2021-03-25T14:16:08.448 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.441+0000 7f3ec27fc700 1 -- 172.21.15.110:0/1287230409 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3005651688 0 0) 0x7f3ea4003270 con 0x7f3ec40685d0 2021-03-25T14:16:08.448 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.441+0000 7f3ec27fc700 1 -- 172.21.15.110:0/1287230409 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ec414cc90 msgr2=0x7f3ec414d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:08.448 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.441+0000 7f3ec27fc700 1 --2- 172.21.15.110:0/1287230409 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ec414cc90 0x7f3ec414d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:08.448 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.441+0000 7f3ec27fc700 1 -- 172.21.15.110:0/1287230409 >> v1:172.21.15.174:6789/0 conn(0x7f3ec414d470 legacy=0x7f3ec41493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:08.449 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.441+0000 7f3ec27fc700 1 -- 172.21.15.110:0/1287230409 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec414a070 con 0x7f3ec40685d0 2021-03-25T14:16:08.449 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.441+0000 7f3ec27fc700 1 -- 172.21.15.110:0/1287230409 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f3ebc0018a0 con 0x7f3ec40685d0 2021-03-25T14:16:08.449 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.442+0000 7f3ec27fc700 1 -- 172.21.15.110:0/1287230409 >> v1:172.21.15.110:6789/0 conn(0x7f3ec40685d0 legacy=0x7f3ec40bc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:08.449 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.442+0000 7f3ec27fc700 1 --2- 172.21.15.110:0/1287230409 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ea4003790 0x7f3ea4003bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:08.449 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.442+0000 7f3ec27fc700 1 --2- 172.21.15.110:0/1287230409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ea4004510 0x7f3ea4004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:08.449 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.442+0000 7f3ec27fc700 1 --2- 172.21.15.110:0/1287230409 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ec414cc90 0x7f3ea4004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:08.449 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.442+0000 7f3ec27fc700 1 -- 172.21.15.110:0/1287230409 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec4149dd0 con 0x7f3ea4004510 2021-03-25T14:16:08.449 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.442+0000 7f3ec27fc700 1 -- 172.21.15.110:0/1287230409 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea4004300 con 0x7f3ea4003790 2021-03-25T14:16:08.449 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.442+0000 7f3ec27fc700 1 -- 172.21.15.110:0/1287230409 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea400b760 con 0x7f3ec414cc90 2021-03-25T14:16:08.449 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.442+0000 7f3ebbfff700 1 --2- 172.21.15.110:0/1287230409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ea4004510 0x7f3ea4004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:08.449 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.442+0000 7f3ec2ffd700 1 --2- 172.21.15.110:0/1287230409 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ea4003790 0x7f3ea4003bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:08.449 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.442+0000 7f3ec37fe700 1 --2- 172.21.15.110:0/1287230409 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ec414cc90 0x7f3ea4004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:08.450 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.442+0000 7f3ebbfff700 1 -- 172.21.15.110:0/1287230409 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ec414cc90 msgr2=0x7f3ea4004e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:08.450 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.442+0000 7f3ebbfff700 1 --2- 172.21.15.110:0/1287230409 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ec414cc90 0x7f3ea4004e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:08.450 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.442+0000 7f3ebbfff700 1 -- 172.21.15.110:0/1287230409 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ea4003790 msgr2=0x7f3ea4003bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:08.450 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.442+0000 7f3ebbfff700 1 --2- 172.21.15.110:0/1287230409 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ea4003790 0x7f3ea4003bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:08.450 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.442+0000 7f3ebbfff700 1 -- 172.21.15.110:0/1287230409 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea4003270 con 0x7f3ea4004510 2021-03-25T14:16:08.450 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.442+0000 7f3ec37fe700 1 --2- 172.21.15.110:0/1287230409 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ec414cc90 0x7f3ea4004e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:08.450 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.442+0000 7f3ebbfff700 1 --2- 172.21.15.110:0/1287230409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ea4004510 0x7f3ea4004990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f3eac00bc30 tx=0x7f3eac006e20).ready entity=mon.0 client_cookie=b83496a5284d067b server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:08.450 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.442+0000 7f3ec27fc700 1 -- 172.21.15.110:0/1287230409 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eac00b310 con 0x7f3ea4004510 2021-03-25T14:16:08.450 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.442+0000 7f3ec27fc700 1 -- 172.21.15.110:0/1287230409 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eac00ea00 con 0x7f3ea4004510 2021-03-25T14:16:08.450 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.442+0000 7f3ec27fc700 1 -- 172.21.15.110:0/1287230409 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eac00ed80 con 0x7f3ea4004510 2021-03-25T14:16:08.450 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.443+0000 7f3ec993a700 1 -- 172.21.15.110:0/1287230409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ea4004510 msgr2=0x7f3ea4004990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:08.450 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.443+0000 7f3ec993a700 1 --2- 172.21.15.110:0/1287230409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ea4004510 0x7f3ea4004990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f3eac00bc30 tx=0x7f3eac006e20).stop 2021-03-25T14:16:08.451 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.443+0000 7f3ec37fe700 1 -- 172.21.15.110:0/1287230409 reap_dead start 2021-03-25T14:16:08.451 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.443+0000 7f3ec993a700 1 -- 172.21.15.110:0/1287230409 shutdown_connections 2021-03-25T14:16:08.451 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.443+0000 7f3ec993a700 1 -- 172.21.15.110:0/1287230409 >> 172.21.15.110:0/1287230409 conn(0x7f3ec4060c40 msgr2=0x7f3ec4061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:08.451 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.443+0000 7f3ec993a700 1 -- 172.21.15.110:0/1287230409 shutdown_connections 2021-03-25T14:16:08.451 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.443+0000 7f3ec993a700 1 -- 172.21.15.110:0/1287230409 wait complete. 2021-03-25T14:16:08.451 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.444+0000 7f3ec993a700 1 Processor -- start 2021-03-25T14:16:08.451 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.444+0000 7f3ec993a700 1 -- start start 2021-03-25T14:16:08.451 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.444+0000 7f3ec993a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ea4004510 0x7f3ec414c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:08.451 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.444+0000 7f3ec993a700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ec40b9610 0x7f3ec40644b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:08.451 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.444+0000 7f3ec993a700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ec40b61b0 0x7f3ec4063090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:08.451 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.444+0000 7f3ec993a700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec40b87e0 con 0x7f3ec40b9610 2021-03-25T14:16:08.451 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.444+0000 7f3ec993a700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec40b8ce0 con 0x7f3ec40b61b0 2021-03-25T14:16:08.452 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.444+0000 7f3ec993a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec414be20 con 0x7f3ea4004510 2021-03-25T14:16:08.452 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.444+0000 7f3ebbfff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ec40b9610 0x7f3ec40644b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:08.452 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.444+0000 7f3ebbfff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ec40b9610 0x7f3ec40644b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47418/0 (socket says 172.21.15.110:47418) 2021-03-25T14:16:08.452 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.444+0000 7f3ebbfff700 1 -- 172.21.15.110:0/1427804828 learned_addr learned my addr 172.21.15.110:0/1427804828 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:08.452 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.445+0000 7f3ec2ffd700 1 --2- 172.21.15.110:0/1427804828 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ea4004510 0x7f3ec414c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:08.452 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.445+0000 7f3ec37fe700 1 --2- 172.21.15.110:0/1427804828 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ec40b61b0 0x7f3ec4063090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:08.452 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.445+0000 7f3ebbfff700 1 -- 172.21.15.110:0/1427804828 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ea4004510 msgr2=0x7f3ec414c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:08.452 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.445+0000 7f3ebbfff700 1 --2- 172.21.15.110:0/1427804828 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ea4004510 0x7f3ec414c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:08.452 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.445+0000 7f3ebbfff700 1 -- 172.21.15.110:0/1427804828 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ec40b61b0 msgr2=0x7f3ec4063090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:08.452 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.445+0000 7f3ebbfff700 1 --2- 172.21.15.110:0/1427804828 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ec40b61b0 0x7f3ec4063090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:08.452 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.445+0000 7f3ebbfff700 1 -- 172.21.15.110:0/1427804828 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec4064b10 con 0x7f3ec40b9610 2021-03-25T14:16:08.452 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.445+0000 7f3ebbfff700 1 --2- 172.21.15.110:0/1427804828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ec40b9610 0x7f3ec40644b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f3eac0129b0 tx=0x7f3eac019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:08.453 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.445+0000 7f3ebaffd700 1 -- 172.21.15.110:0/1427804828 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eac012e50 con 0x7f3ec40b9610 2021-03-25T14:16:08.453 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.445+0000 7f3ebaffd700 1 -- 172.21.15.110:0/1427804828 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eac022070 con 0x7f3ec40b9610 2021-03-25T14:16:08.453 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.445+0000 7f3ec993a700 1 -- 172.21.15.110:0/1427804828 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec4064db0 con 0x7f3ec40b9610 2021-03-25T14:16:08.453 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.445+0000 7f3ebaffd700 1 -- 172.21.15.110:0/1427804828 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eac01b450 con 0x7f3ec40b9610 2021-03-25T14:16:08.453 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.445+0000 7f3ec993a700 1 -- 172.21.15.110:0/1427804828 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec40b6610 con 0x7f3ec40b9610 2021-03-25T14:16:08.453 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.446+0000 7f3ec993a700 1 -- 172.21.15.110:0/1427804828 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ec40b6830 con 0x7f3ec40b9610 2021-03-25T14:16:08.453 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.446+0000 7f3ebaffd700 1 -- 172.21.15.110:0/1427804828 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f3eac02e070 con 0x7f3ec40b9610 2021-03-25T14:16:08.453 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.446+0000 7f3ebaffd700 1 --2- 172.21.15.110:0/1427804828 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3ea805a0b0 0x7f3ea805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:08.453 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.447+0000 7f3ebaffd700 1 -- 172.21.15.110:0/1427804828 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f3eac0756b0 con 0x7f3ec40b9610 2021-03-25T14:16:08.453 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.447+0000 7f3ec2ffd700 1 --2- 172.21.15.110:0/1427804828 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3ea805a0b0 0x7f3ea805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:08.453 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.447+0000 7f3ec2ffd700 1 --2- 172.21.15.110:0/1427804828 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3ea805a0b0 0x7f3ea805c570 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f3eb4000c00 tx=0x7f3eb4007bc0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:08.454 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.450+0000 7f3ebaffd700 1 -- 172.21.15.110:0/1427804828 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f3ec40b6830 con 0x7f3ec40b9610 2021-03-25T14:16:08.602 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.601+0000 7f3ec993a700 1 -- 172.21.15.110:0/1427804828 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3ec40b6830 con 0x7f3ec40b9610 2021-03-25T14:16:08.602 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.601+0000 7f3ebaffd700 1 -- 172.21.15.110:0/1427804828 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3ec40b6830 con 0x7f3ec40b9610 2021-03-25T14:16:08.602 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 1 2021-03-25T14:16:08.604 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.603+0000 7f3ec993a700 1 -- 172.21.15.110:0/1427804828 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3ea805a0b0 msgr2=0x7f3ea805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:08.604 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.603+0000 7f3ec993a700 1 --2- 172.21.15.110:0/1427804828 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3ea805a0b0 0x7f3ea805c570 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f3eb4000c00 tx=0x7f3eb4007bc0).stop 2021-03-25T14:16:08.604 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.603+0000 7f3ec993a700 1 -- 172.21.15.110:0/1427804828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ec40b9610 msgr2=0x7f3ec40644b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:08.604 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.603+0000 7f3ec993a700 1 --2- 172.21.15.110:0/1427804828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ec40b9610 0x7f3ec40644b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f3eac0129b0 tx=0x7f3eac019000).stop 2021-03-25T14:16:08.605 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.603+0000 7f3ec993a700 1 -- 172.21.15.110:0/1427804828 shutdown_connections 2021-03-25T14:16:08.605 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.603+0000 7f3ec993a700 1 --2- 172.21.15.110:0/1427804828 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3ea805a0b0 0x7f3ea805c570 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:08.605 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.603+0000 7f3ec993a700 1 --2- 172.21.15.110:0/1427804828 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ec40b61b0 0x7f3ec4063090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:08.605 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.603+0000 7f3ec993a700 1 --2- 172.21.15.110:0/1427804828 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ea4004510 0x7f3ec414c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:08.605 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.603+0000 7f3ec993a700 1 --2- 172.21.15.110:0/1427804828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ec40b9610 0x7f3ec40644b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:08.605 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.603+0000 7f3ec993a700 1 -- 172.21.15.110:0/1427804828 >> 172.21.15.110:0/1427804828 conn(0x7f3ec4060c40 msgr2=0x7f3ec40b4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:08.605 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.603+0000 7f3ec993a700 1 -- 172.21.15.110:0/1427804828 shutdown_connections 2021-03-25T14:16:08.605 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.603+0000 7f3ec993a700 1 -- 172.21.15.110:0/1427804828 wait complete. 2021-03-25T14:16:08.615 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-03-25T14:16:08.727 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.726+0000 7f23f5640700 1 Processor -- start 2021-03-25T14:16:08.727 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.726+0000 7f23f5640700 1 -- start start 2021-03-25T14:16:08.730 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.727+0000 7f23f5640700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23f00b4740 0x7f23f0148d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:08.730 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.727+0000 7f23f5640700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f23f00b8670 0x7f23f0149210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:08.730 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.727+0000 7f23f5640700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f23f0149a00 0x7f23f0149e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:08.730 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.727+0000 7f23f5640700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23f00b5540 con 0x7f23f00b8670 2021-03-25T14:16:08.730 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.727+0000 7f23f5640700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23f00bdd60 con 0x7f23f0149a00 2021-03-25T14:16:08.730 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.727+0000 7f23f5640700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f00be000 con 0x7f23f00b4740 2021-03-25T14:16:08.730 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.727+0000 7f23ee7fc700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f23f00b8670 0x7f23f0149210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:08.730 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.727+0000 7f23ee7fc700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f23f00b8670 0x7f23f0149210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47426/0 (socket says 172.21.15.110:47426) 2021-03-25T14:16:08.730 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.727+0000 7f23ee7fc700 1 -- 172.21.15.110:0/3581709182 learned_addr learned my addr 172.21.15.110:0/3581709182 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:08.730 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.728+0000 7f23ef7fe700 1 --2- 172.21.15.110:0/3581709182 >> v2:172.21.15.174:3300/0 conn(0x7f23f0149a00 0x7f23f0149e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:08.731 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.728+0000 7f23eeffd700 1 --2- 172.21.15.110:0/3581709182 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23f00b4740 0x7f23f0148d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:08.731 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.728+0000 7f23ee7fc700 1 -- 172.21.15.110:0/3581709182 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23f00b4740 msgr2=0x7f23f0148d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:08.731 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.728+0000 7f23ee7fc700 1 --2- 172.21.15.110:0/3581709182 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23f00b4740 0x7f23f0148d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:08.731 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.728+0000 7f23ee7fc700 1 -- 172.21.15.110:0/3581709182 >> v2:172.21.15.174:3300/0 conn(0x7f23f0149a00 msgr2=0x7f23f0149e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:08.731 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.728+0000 7f23ee7fc700 1 --2- 172.21.15.110:0/3581709182 >> v2:172.21.15.174:3300/0 conn(0x7f23f0149a00 0x7f23f0149e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:08.731 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.728+0000 7f23ee7fc700 1 -- 172.21.15.110:0/3581709182 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f00be2a0 con 0x7f23f00b8670 2021-03-25T14:16:08.731 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.728+0000 7f23ee7fc700 1 --2- 172.21.15.110:0/3581709182 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23f00b8670 0x7f23f0149210 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f23f00bb730 tx=0x7f23e4006ee0).ready entity=mon.0 client_cookie=3e5a579240ee0b1b server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:08.731 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.728+0000 7f23edffb700 1 -- 172.21.15.110:0/3581709182 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e4009840 con 0x7f23f00b8670 2021-03-25T14:16:08.731 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.728+0000 7f23edffb700 1 -- 172.21.15.110:0/3581709182 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e40099a0 con 0x7f23f00b8670 2021-03-25T14:16:08.731 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.728+0000 7f23edffb700 1 -- 172.21.15.110:0/3581709182 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e4009d20 con 0x7f23f00b8670 2021-03-25T14:16:08.731 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.728+0000 7f23f5640700 1 -- 172.21.15.110:0/3581709182 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23f00b8670 msgr2=0x7f23f0149210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:08.731 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.728+0000 7f23f5640700 1 --2- 172.21.15.110:0/3581709182 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23f00b8670 0x7f23f0149210 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f23f00bb730 tx=0x7f23e4006ee0).stop 2021-03-25T14:16:08.731 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.728+0000 7f23f5640700 1 -- 172.21.15.110:0/3581709182 shutdown_connections 2021-03-25T14:16:08.732 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.728+0000 7f23f5640700 1 --2- 172.21.15.110:0/3581709182 >> v2:172.21.15.174:3300/0 conn(0x7f23f0149a00 0x7f23f0149e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:08.732 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.728+0000 7f23f5640700 1 --2- 172.21.15.110:0/3581709182 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23f00b4740 0x7f23f0148d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:08.732 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.728+0000 7f23f5640700 1 --2- 172.21.15.110:0/3581709182 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23f00b8670 0x7f23f0149210 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:08.732 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.728+0000 7f23f5640700 1 -- 172.21.15.110:0/3581709182 >> 172.21.15.110:0/3581709182 conn(0x7f23f00652a0 msgr2=0x7f23f00656b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:08.732 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.728+0000 7f23f5640700 1 -- 172.21.15.110:0/3581709182 shutdown_connections 2021-03-25T14:16:08.732 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.728+0000 7f23f5640700 1 -- 172.21.15.110:0/3581709182 wait complete. 2021-03-25T14:16:08.735 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.730+0000 7f23f5640700 1 Processor -- start 2021-03-25T14:16:08.735 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.730+0000 7f23f5640700 1 -- start start 2021-03-25T14:16:08.735 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.730+0000 7f23f5640700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23f00b4740 0x7f23f00ba5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:08.735 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.730+0000 7f23f5640700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23f00b8670 0x7f23f01415c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:08.735 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.730+0000 7f23f5640700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23f0149a00 0x7f23f0141ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:08.735 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.730+0000 7f23f5640700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f0158ff0 con 0x7f23f00b4740 2021-03-25T14:16:08.735 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.730+0000 7f23f5640700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f0063990 con 0x7f23f0149a00 2021-03-25T14:16:08.735 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.730+0000 7f23f5640700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f014cd50 con 0x7f23f00b8670 2021-03-25T14:16:08.735 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.730+0000 7f23eeffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23f00b4740 0x7f23f00ba5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:08.735 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.730+0000 7f23eeffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23f00b4740 0x7f23f00ba5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47432/0 (socket says 172.21.15.110:47432) 2021-03-25T14:16:08.735 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.730+0000 7f23eeffd700 1 -- 172.21.15.110:0/2544299233 learned_addr learned my addr 172.21.15.110:0/2544299233 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:08.736 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.730+0000 7f23ee7fc700 1 --2- 172.21.15.110:0/2544299233 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23f00b8670 0x7f23f01415c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:08.736 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.731+0000 7f23ef7fe700 1 --2- 172.21.15.110:0/2544299233 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23f0149a00 0x7f23f0141ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:08.736 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.731+0000 7f23eeffd700 1 -- 172.21.15.110:0/2544299233 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23f00b8670 msgr2=0x7f23f01415c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:08.736 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.731+0000 7f23eeffd700 1 --2- 172.21.15.110:0/2544299233 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23f00b8670 0x7f23f01415c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:08.736 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.731+0000 7f23eeffd700 1 -- 172.21.15.110:0/2544299233 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23f0149a00 msgr2=0x7f23f0141ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:08.736 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.731+0000 7f23eeffd700 1 --2- 172.21.15.110:0/2544299233 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23f0149a00 0x7f23f0141ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:08.736 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.731+0000 7f23eeffd700 1 -- 172.21.15.110:0/2544299233 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f00b31e0 con 0x7f23f00b4740 2021-03-25T14:16:08.736 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.731+0000 7f23eeffd700 1 --2- 172.21.15.110:0/2544299233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23f00b4740 0x7f23f00ba5e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f23e000db60 tx=0x7f23e0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:08.736 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.731+0000 7f23d6ffd700 1 -- 172.21.15.110:0/2544299233 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e000be50 con 0x7f23f00b4740 2021-03-25T14:16:08.736 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.731+0000 7f23d6ffd700 1 -- 172.21.15.110:0/2544299233 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e00097f0 con 0x7f23f00b4740 2021-03-25T14:16:08.736 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.731+0000 7f23f5640700 1 -- 172.21.15.110:0/2544299233 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23f0141fa0 con 0x7f23f00b4740 2021-03-25T14:16:08.736 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.731+0000 7f23d6ffd700 1 -- 172.21.15.110:0/2544299233 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e0009b70 con 0x7f23f00b4740 2021-03-25T14:16:08.736 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.731+0000 7f23f5640700 1 -- 172.21.15.110:0/2544299233 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23f014c810 con 0x7f23f00b4740 2021-03-25T14:16:08.737 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.732+0000 7f23f5640700 1 -- 172.21.15.110:0/2544299233 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23f0045ae0 con 0x7f23f00b4740 2021-03-25T14:16:08.737 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.732+0000 7f23d6ffd700 1 -- 172.21.15.110:0/2544299233 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f23e0013480 con 0x7f23f00b4740 2021-03-25T14:16:08.737 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.732+0000 7f23d6ffd700 1 --2- 172.21.15.110:0/2544299233 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f23d005a0b0 0x7f23d005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:08.737 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.732+0000 7f23d6ffd700 1 -- 172.21.15.110:0/2544299233 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f23e00738e0 con 0x7f23f00b4740 2021-03-25T14:16:08.737 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.733+0000 7f23ee7fc700 1 --2- 172.21.15.110:0/2544299233 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f23d005a0b0 0x7f23d005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:08.737 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.733+0000 7f23ee7fc700 1 --2- 172.21.15.110:0/2544299233 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f23d005a0b0 0x7f23d005c570 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f23f00bb730 tx=0x7f23e4016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:08.737 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.736+0000 7f23d6ffd700 1 -- 172.21.15.110:0/2544299233 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f23e0047550 con 0x7f23f00b4740 2021-03-25T14:16:08.889 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.888+0000 7f23f5640700 1 -- 172.21.15.110:0/2544299233 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f23f0066910 con 0x7f23f00b4740 2021-03-25T14:16:08.890 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.889+0000 7f23d6ffd700 1 -- 172.21.15.110:0/2544299233 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f23e004ab70 con 0x7f23f00b4740 2021-03-25T14:16:08.890 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:16:08.891 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.890+0000 7f23f5640700 1 -- 172.21.15.110:0/2544299233 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f23d005a0b0 msgr2=0x7f23d005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:08.892 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.890+0000 7f23f5640700 1 --2- 172.21.15.110:0/2544299233 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f23d005a0b0 0x7f23d005c570 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f23f00bb730 tx=0x7f23e4016000).stop 2021-03-25T14:16:08.892 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.890+0000 7f23f5640700 1 -- 172.21.15.110:0/2544299233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23f00b4740 msgr2=0x7f23f00ba5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:08.892 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.890+0000 7f23f5640700 1 --2- 172.21.15.110:0/2544299233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23f00b4740 0x7f23f00ba5e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f23e000db60 tx=0x7f23e0008040).stop 2021-03-25T14:16:08.892 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.890+0000 7f23f5640700 1 -- 172.21.15.110:0/2544299233 shutdown_connections 2021-03-25T14:16:08.892 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.890+0000 7f23f5640700 1 --2- 172.21.15.110:0/2544299233 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f23d005a0b0 0x7f23d005c570 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:08.892 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.890+0000 7f23f5640700 1 --2- 172.21.15.110:0/2544299233 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23f0149a00 0x7f23f0141ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:08.892 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.890+0000 7f23f5640700 1 --2- 172.21.15.110:0/2544299233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23f00b4740 0x7f23f00ba5e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:08.892 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.890+0000 7f23f5640700 1 --2- 172.21.15.110:0/2544299233 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23f00b8670 0x7f23f01415c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:08.892 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.890+0000 7f23f5640700 1 -- 172.21.15.110:0/2544299233 >> 172.21.15.110:0/2544299233 conn(0x7f23f00652a0 msgr2=0x7f23f00b7910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:08.892 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.890+0000 7f23f5640700 1 -- 172.21.15.110:0/2544299233 shutdown_connections 2021-03-25T14:16:08.892 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:08.890+0000 7f23f5640700 1 -- 172.21.15.110:0/2544299233 wait complete. 2021-03-25T14:16:08.903 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-03-25T14:16:09.018 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.011+0000 7fdea5d62700 1 Processor -- start 2021-03-25T14:16:09.019 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.011+0000 7fdea5d62700 1 -- start start 2021-03-25T14:16:09.019 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.012+0000 7fdea5d62700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdea00675d0 0x7fdea00b1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:09.019 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.012+0000 7fdea5d62700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdea00bc220 0x7fdea014cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:09.019 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.012+0000 7fdea5d62700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdea014d0a0 0x7fdea0148970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:09.019 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.012+0000 7fdea5d62700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdea00b1830 con 0x7fdea014d0a0 2021-03-25T14:16:09.019 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.012+0000 7fdea5d62700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdea00bafc0 con 0x7fdea00bc220 2021-03-25T14:16:09.019 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.012+0000 7fdea5d62700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea00baa80 con 0x7fdea00675d0 2021-03-25T14:16:09.019 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.012+0000 7fde9ffff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdea014d0a0 0x7fdea0148970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:09.019 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.012+0000 7fde9ffff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdea014d0a0 0x7fdea0148970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47442/0 (socket says 172.21.15.110:47442) 2021-03-25T14:16:09.019 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.012+0000 7fde9ffff700 1 -- 172.21.15.110:0/4135046560 learned_addr learned my addr 172.21.15.110:0/4135046560 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:09.019 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.012+0000 7fde9effd700 1 --2- 172.21.15.110:0/4135046560 >> v2:172.21.15.174:3300/0 conn(0x7fdea00bc220 0x7fdea014cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:09.020 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.012+0000 7fde9f7fe700 1 --2- 172.21.15.110:0/4135046560 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdea00675d0 0x7fdea00b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:09.020 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.012+0000 7fde9ffff700 1 -- 172.21.15.110:0/4135046560 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdea00675d0 msgr2=0x7fdea00b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:09.020 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.012+0000 7fde9ffff700 1 --2- 172.21.15.110:0/4135046560 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdea00675d0 0x7fdea00b1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:09.020 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.012+0000 7fde9ffff700 1 -- 172.21.15.110:0/4135046560 >> v2:172.21.15.174:3300/0 conn(0x7fdea00bc220 msgr2=0x7fdea014cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:09.020 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.012+0000 7fde9ffff700 1 --2- 172.21.15.110:0/4135046560 >> v2:172.21.15.174:3300/0 conn(0x7fdea00bc220 0x7fdea014cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:09.020 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.012+0000 7fde9ffff700 1 -- 172.21.15.110:0/4135046560 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea00bad20 con 0x7fdea014d0a0 2021-03-25T14:16:09.020 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.012+0000 7fde9f7fe700 1 --2- 172.21.15.110:0/4135046560 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdea00675d0 0x7fdea00b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:09.020 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.012+0000 7fde9ffff700 1 --2- 172.21.15.110:0/4135046560 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdea014d0a0 0x7fdea0148970 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fdea005d020 tx=0x7fde980092d0).ready entity=mon.0 client_cookie=6723953785a63a95 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:09.020 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.013+0000 7fde9e7fc700 1 -- 172.21.15.110:0/4135046560 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9800bc80 con 0x7fdea014d0a0 2021-03-25T14:16:09.020 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.013+0000 7fde9e7fc700 1 -- 172.21.15.110:0/4135046560 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9800bde0 con 0x7fdea014d0a0 2021-03-25T14:16:09.021 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.013+0000 7fde9e7fc700 1 -- 172.21.15.110:0/4135046560 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde98011610 con 0x7fdea014d0a0 2021-03-25T14:16:09.021 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.013+0000 7fdea5d62700 1 -- 172.21.15.110:0/4135046560 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdea014d0a0 msgr2=0x7fdea0148970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:09.021 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.013+0000 7fdea5d62700 1 --2- 172.21.15.110:0/4135046560 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdea014d0a0 0x7fdea0148970 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fdea005d020 tx=0x7fde980092d0).stop 2021-03-25T14:16:09.021 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.013+0000 7fdea5d62700 1 -- 172.21.15.110:0/4135046560 shutdown_connections 2021-03-25T14:16:09.021 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.013+0000 7fdea5d62700 1 --2- 172.21.15.110:0/4135046560 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdea014d0a0 0x7fdea0148970 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:09.021 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.013+0000 7fdea5d62700 1 --2- 172.21.15.110:0/4135046560 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdea00675d0 0x7fdea00b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:09.021 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.013+0000 7fdea5d62700 1 --2- 172.21.15.110:0/4135046560 >> v2:172.21.15.174:3300/0 conn(0x7fdea00bc220 0x7fdea014cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:09.021 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.013+0000 7fdea5d62700 1 -- 172.21.15.110:0/4135046560 >> 172.21.15.110:0/4135046560 conn(0x7fdea0064a10 msgr2=0x7fdea005c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:09.021 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.013+0000 7fdea5d62700 1 -- 172.21.15.110:0/4135046560 shutdown_connections 2021-03-25T14:16:09.021 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.013+0000 7fdea5d62700 1 -- 172.21.15.110:0/4135046560 wait complete. 2021-03-25T14:16:09.021 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.014+0000 7fdea5d62700 1 Processor -- start 2021-03-25T14:16:09.022 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.014+0000 7fdea5d62700 1 -- start start 2021-03-25T14:16:09.022 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.015+0000 7fdea5d62700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdea00675d0 0x7fdea00b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:09.022 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.015+0000 7fdea5d62700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdea00bc220 0x7fdea015c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:09.022 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.015+0000 7fdea5d62700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdea014d0a0 0x7fdea0158910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:09.022 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.015+0000 7fdea5d62700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea015cdb0 con 0x7fdea014d0a0 2021-03-25T14:16:09.022 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.015+0000 7fdea5d62700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea014c880 con 0x7fdea00bc220 2021-03-25T14:16:09.022 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.015+0000 7fdea5d62700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea014cb20 con 0x7fdea00675d0 2021-03-25T14:16:09.022 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.015+0000 7fde9ffff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdea014d0a0 0x7fdea0158910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:09.022 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.015+0000 7fde9ffff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdea014d0a0 0x7fdea0158910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47450/0 (socket says 172.21.15.110:47450) 2021-03-25T14:16:09.022 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.015+0000 7fde9ffff700 1 -- 172.21.15.110:0/2899929872 learned_addr learned my addr 172.21.15.110:0/2899929872 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:09.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.015+0000 7fde9f7fe700 1 --2- 172.21.15.110:0/2899929872 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdea00675d0 0x7fdea00b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:09.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.015+0000 7fde9effd700 1 --2- 172.21.15.110:0/2899929872 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdea00bc220 0x7fdea015c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:09.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.015+0000 7fde9ffff700 1 -- 172.21.15.110:0/2899929872 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdea00675d0 msgr2=0x7fdea00b25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:09.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.015+0000 7fde9ffff700 1 --2- 172.21.15.110:0/2899929872 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdea00675d0 0x7fdea00b25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:09.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.015+0000 7fde9ffff700 1 -- 172.21.15.110:0/2899929872 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdea00bc220 msgr2=0x7fdea015c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:09.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.015+0000 7fde9ffff700 1 --2- 172.21.15.110:0/2899929872 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdea00bc220 0x7fdea015c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:09.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.015+0000 7fde9ffff700 1 -- 172.21.15.110:0/2899929872 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea015bee0 con 0x7fdea014d0a0 2021-03-25T14:16:09.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.015+0000 7fde9ffff700 1 --2- 172.21.15.110:0/2899929872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdea014d0a0 0x7fdea0158910 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fde98009130 tx=0x7fde98017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:09.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.015+0000 7fde877fe700 1 -- 172.21.15.110:0/2899929872 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9801b620 con 0x7fdea014d0a0 2021-03-25T14:16:09.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.016+0000 7fde877fe700 1 -- 172.21.15.110:0/2899929872 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9801b780 con 0x7fdea014d0a0 2021-03-25T14:16:09.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.016+0000 7fdea5d62700 1 -- 172.21.15.110:0/2899929872 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdea015c180 con 0x7fdea014d0a0 2021-03-25T14:16:09.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.016+0000 7fde877fe700 1 -- 172.21.15.110:0/2899929872 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9801bb00 con 0x7fdea014d0a0 2021-03-25T14:16:09.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.016+0000 7fdea5d62700 1 -- 172.21.15.110:0/2899929872 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdea0158e00 con 0x7fdea014d0a0 2021-03-25T14:16:09.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.016+0000 7fdea5d62700 1 -- 172.21.15.110:0/2899929872 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdea0068850 con 0x7fdea014d0a0 2021-03-25T14:16:09.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.017+0000 7fde877fe700 1 -- 172.21.15.110:0/2899929872 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fde98023030 con 0x7fdea014d0a0 2021-03-25T14:16:09.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.017+0000 7fde877fe700 1 --2- 172.21.15.110:0/2899929872 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fde8005a0b0 0x7fde8005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:09.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.017+0000 7fde877fe700 1 -- 172.21.15.110:0/2899929872 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fde98074c10 con 0x7fdea014d0a0 2021-03-25T14:16:09.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.017+0000 7fde9f7fe700 1 --2- 172.21.15.110:0/2899929872 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fde8005a0b0 0x7fde8005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:09.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.017+0000 7fde9f7fe700 1 --2- 172.21.15.110:0/2899929872 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fde8005a0b0 0x7fde8005c570 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fde9000bab0 tx=0x7fde90008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:09.025 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.021+0000 7fde877fe700 1 -- 172.21.15.110:0/2899929872 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fde980488e0 con 0x7fdea014d0a0 2021-03-25T14:16:09.171 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.170+0000 7fdea5d62700 1 -- 172.21.15.110:0/2899929872 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fdea005d7b0 con 0x7fdea014d0a0 2021-03-25T14:16:09.171 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.170+0000 7fde877fe700 1 -- 172.21.15.110:0/2899929872 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+143 (secure 0 0 0) 0x7fde98021020 con 0x7fdea014d0a0 2021-03-25T14:16:09.172 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:16:09.172 INFO:teuthology.orchestra.run.smithi110.stdout:[ 2021-03-25T14:16:09.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:16:09.172 INFO:teuthology.orchestra.run.smithi110.stdout: "poolnum": 1, 2021-03-25T14:16:09.172 INFO:teuthology.orchestra.run.smithi110.stdout: "poolname": "device_health_metrics" 2021-03-25T14:16:09.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:16:09.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:16:09.173 INFO:teuthology.orchestra.run.smithi110.stdout: "poolnum": 2, 2021-03-25T14:16:09.173 INFO:teuthology.orchestra.run.smithi110.stdout: "poolname": "rbd" 2021-03-25T14:16:09.173 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:16:09.173 INFO:teuthology.orchestra.run.smithi110.stdout:] 2021-03-25T14:16:09.174 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.172+0000 7fdea5d62700 1 -- 172.21.15.110:0/2899929872 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fde8005a0b0 msgr2=0x7fde8005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:09.174 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.172+0000 7fdea5d62700 1 --2- 172.21.15.110:0/2899929872 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fde8005a0b0 0x7fde8005c570 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fde9000bab0 tx=0x7fde90008040).stop 2021-03-25T14:16:09.175 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.172+0000 7fdea5d62700 1 -- 172.21.15.110:0/2899929872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdea014d0a0 msgr2=0x7fdea0158910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:09.175 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.172+0000 7fdea5d62700 1 --2- 172.21.15.110:0/2899929872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdea014d0a0 0x7fdea0158910 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fde98009130 tx=0x7fde98017000).stop 2021-03-25T14:16:09.175 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.172+0000 7fdea5d62700 1 -- 172.21.15.110:0/2899929872 shutdown_connections 2021-03-25T14:16:09.175 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.172+0000 7fdea5d62700 1 --2- 172.21.15.110:0/2899929872 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fde8005a0b0 0x7fde8005c570 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:09.175 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.172+0000 7fdea5d62700 1 --2- 172.21.15.110:0/2899929872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdea014d0a0 0x7fdea0158910 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:09.175 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.172+0000 7fdea5d62700 1 --2- 172.21.15.110:0/2899929872 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdea00675d0 0x7fdea00b25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:09.175 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.172+0000 7fdea5d62700 1 --2- 172.21.15.110:0/2899929872 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdea00bc220 0x7fdea015c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:09.175 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.172+0000 7fdea5d62700 1 -- 172.21.15.110:0/2899929872 >> 172.21.15.110:0/2899929872 conn(0x7fdea0064a10 msgr2=0x7fdea0147b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:09.175 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.172+0000 7fdea5d62700 1 -- 172.21.15.110:0/2899929872 shutdown_connections 2021-03-25T14:16:09.175 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.172+0000 7fdea5d62700 1 -- 172.21.15.110:0/2899929872 wait complete. 2021-03-25T14:16:09.184 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-03-25T14:16:09.185 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-03-25T14:16:09.297 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.296+0000 7fdc6f979700 1 Processor -- start 2021-03-25T14:16:09.298 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.297+0000 7fdc6f979700 1 -- start start 2021-03-25T14:16:09.300 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.297+0000 7fdc6f979700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdc6814d850 0x7fdc680bc710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:09.300 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.297+0000 7fdc6f979700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc680691b0 con 0x7fdc6814d470 2021-03-25T14:16:09.301 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.297+0000 7fdc6f979700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc680bc2b0 con 0x7fdc6814cc90 2021-03-25T14:16:09.301 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.297+0000 7fdc6f979700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc68149dd0 con 0x7fdc6814d850 2021-03-25T14:16:09.301 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.298+0000 7fdc6df16700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdc6814d850 0x7fdc680bc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:09.301 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.298+0000 7fdc6d715700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fdc6814d470 0x7fdc681493c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:40390/0 (socket says 172.21.15.110:40390) 2021-03-25T14:16:09.301 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.298+0000 7fdc6d715700 1 -- 172.21.15.110:0/498351279 learned_addr learned my addr 172.21.15.110:0/498351279 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:09.301 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.298+0000 7fdc6df16700 1 -- 172.21.15.110:0/498351279 >> v1:172.21.15.174:6789/0 conn(0x7fdc6814cc90 legacy=0x7fdc680685d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:09.301 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.298+0000 7fdc6df16700 1 -- 172.21.15.110:0/498351279 >> v1:172.21.15.110:6789/0 conn(0x7fdc6814d470 legacy=0x7fdc681493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:09.301 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.298+0000 7fdc6df16700 1 -- 172.21.15.110:0/498351279 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6814a070 con 0x7fdc6814d850 2021-03-25T14:16:09.301 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.298+0000 7fdc57fff700 1 -- 172.21.15.110:0/498351279 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 221806890 0 0) 0x7fdc680691b0 con 0x7fdc6814d470 2021-03-25T14:16:09.302 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.298+0000 7fdc6df16700 1 --2- 172.21.15.110:0/498351279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc6814d850 0x7fdc680bc710 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fdc60009cc0 tx=0x7fdc60009220).ready entity=mon.0 client_cookie=de4001527f310dcf server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:09.302 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.298+0000 7fdc57fff700 1 -- 172.21.15.110:0/498351279 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6000bbf0 con 0x7fdc6814d850 2021-03-25T14:16:09.302 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.298+0000 7fdc57fff700 1 -- 172.21.15.110:0/498351279 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc6000bd50 con 0x7fdc6814d850 2021-03-25T14:16:09.302 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.298+0000 7fdc57fff700 1 -- 172.21.15.110:0/498351279 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc60011610 con 0x7fdc6814d850 2021-03-25T14:16:09.302 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.299+0000 7fdc6f979700 1 -- 172.21.15.110:0/498351279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc6814d850 msgr2=0x7fdc680bc710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:09.302 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.299+0000 7fdc6f979700 1 --2- 172.21.15.110:0/498351279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc6814d850 0x7fdc680bc710 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fdc60009cc0 tx=0x7fdc60009220).stop 2021-03-25T14:16:09.302 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.299+0000 7fdc6f979700 1 -- 172.21.15.110:0/498351279 shutdown_connections 2021-03-25T14:16:09.302 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.299+0000 7fdc6f979700 1 --2- 172.21.15.110:0/498351279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc6814d850 0x7fdc680bc710 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:09.302 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.299+0000 7fdc6f979700 1 -- 172.21.15.110:0/498351279 >> 172.21.15.110:0/498351279 conn(0x7fdc68060c40 msgr2=0x7fdc68061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:09.302 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.299+0000 7fdc6f979700 1 -- 172.21.15.110:0/498351279 shutdown_connections 2021-03-25T14:16:09.302 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.299+0000 7fdc6f979700 1 -- 172.21.15.110:0/498351279 wait complete. 2021-03-25T14:16:09.303 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.300+0000 7fdc6f979700 1 Processor -- start 2021-03-25T14:16:09.303 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.300+0000 7fdc6f979700 1 -- start start 2021-03-25T14:16:09.305 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.300+0000 7fdc6f979700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc6814cc90 0x7fdc680b8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:09.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.300+0000 7fdc6f979700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc6814d470 0x7fdc6815cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:09.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.301+0000 7fdc6f979700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc6814d850 0x7fdc680b8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:09.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.301+0000 7fdc6f979700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6815c570 con 0x7fdc6814d850 2021-03-25T14:16:09.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.301+0000 7fdc6f979700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc680ba250 con 0x7fdc6814cc90 2021-03-25T14:16:09.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.301+0000 7fdc6f979700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc680b8600 con 0x7fdc6814d470 2021-03-25T14:16:09.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.301+0000 7fdc6df16700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc6814d850 0x7fdc680b8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:09.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.301+0000 7fdc6df16700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc6814d850 0x7fdc680b8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47464/0 (socket says 172.21.15.110:47464) 2021-03-25T14:16:09.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.301+0000 7fdc6df16700 1 -- 172.21.15.110:0/2531987758 learned_addr learned my addr 172.21.15.110:0/2531987758 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:09.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.301+0000 7fdc6df16700 1 -- 172.21.15.110:0/2531987758 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc6814d470 msgr2=0x7fdc6815cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:09.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.301+0000 7fdc6d715700 1 --2- 172.21.15.110:0/2531987758 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc6814cc90 0x7fdc680b8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:09.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.301+0000 7fdc6cf14700 1 --2- 172.21.15.110:0/2531987758 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc6814d470 0x7fdc6815cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:09.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.301+0000 7fdc6df16700 1 --2- 172.21.15.110:0/2531987758 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc6814d470 0x7fdc6815cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:09.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.301+0000 7fdc6df16700 1 -- 172.21.15.110:0/2531987758 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc6814cc90 msgr2=0x7fdc680b8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:09.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.301+0000 7fdc6df16700 1 --2- 172.21.15.110:0/2531987758 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc6814cc90 0x7fdc680b8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:09.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.301+0000 7fdc6df16700 1 -- 172.21.15.110:0/2531987758 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6815d3d0 con 0x7fdc6814d850 2021-03-25T14:16:09.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.301+0000 7fdc6d715700 1 --2- 172.21.15.110:0/2531987758 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc6814cc90 0x7fdc680b8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:09.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.301+0000 7fdc6df16700 1 --2- 172.21.15.110:0/2531987758 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc6814d850 0x7fdc680b8e80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fdc6805d650 tx=0x7fdc60017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:09.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.301+0000 7fdc557fa700 1 -- 172.21.15.110:0/2531987758 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc60009e00 con 0x7fdc6814d850 2021-03-25T14:16:09.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.301+0000 7fdc557fa700 1 -- 172.21.15.110:0/2531987758 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc60010b50 con 0x7fdc6814d850 2021-03-25T14:16:09.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.301+0000 7fdc6f979700 1 -- 172.21.15.110:0/2531987758 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc680b8850 con 0x7fdc6814d850 2021-03-25T14:16:09.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.301+0000 7fdc557fa700 1 -- 172.21.15.110:0/2531987758 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6001b410 con 0x7fdc6814d850 2021-03-25T14:16:09.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.301+0000 7fdc6f979700 1 -- 172.21.15.110:0/2531987758 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc6815ca40 con 0x7fdc6814d850 2021-03-25T14:16:09.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.302+0000 7fdc6f979700 1 -- 172.21.15.110:0/2531987758 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc6814cad0 con 0x7fdc6814d850 2021-03-25T14:16:09.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.303+0000 7fdc557fa700 1 -- 172.21.15.110:0/2531987758 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fdc6002c070 con 0x7fdc6814d850 2021-03-25T14:16:09.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.303+0000 7fdc557fa700 1 --2- 172.21.15.110:0/2531987758 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fdc4805a0b0 0x7fdc4805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:09.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.303+0000 7fdc557fa700 1 -- 172.21.15.110:0/2531987758 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fdc60075e30 con 0x7fdc6814d850 2021-03-25T14:16:09.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.303+0000 7fdc6d715700 1 --2- 172.21.15.110:0/2531987758 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fdc4805a0b0 0x7fdc4805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:09.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.303+0000 7fdc6d715700 1 --2- 172.21.15.110:0/2531987758 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fdc4805a0b0 0x7fdc4805c570 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fdc64000c00 tx=0x7fdc64009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:09.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.307+0000 7fdc557fa700 1 -- 172.21.15.110:0/2531987758 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fdc60049b00 con 0x7fdc6814d850 2021-03-25T14:16:09.456 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.455+0000 7fdc6f979700 1 -- 172.21.15.110:0/2531987758 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fdc680b4f10 con 0x7fdc6814d850 2021-03-25T14:16:09.757 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.756+0000 7fdc557fa700 1 -- 172.21.15.110:0/2531987758 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v18) v1 ==== 133+0+0 (secure 0 0 0) 0x7fdc6004d120 con 0x7fdc6814d850 2021-03-25T14:16:09.759 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.758+0000 7fdc6f979700 1 -- 172.21.15.110:0/2531987758 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fdc4805a0b0 msgr2=0x7fdc4805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:09.759 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.758+0000 7fdc6f979700 1 --2- 172.21.15.110:0/2531987758 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fdc4805a0b0 0x7fdc4805c570 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fdc64000c00 tx=0x7fdc64009040).stop 2021-03-25T14:16:09.759 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.758+0000 7fdc6f979700 1 -- 172.21.15.110:0/2531987758 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc6814d850 msgr2=0x7fdc680b8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:09.759 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.758+0000 7fdc6f979700 1 --2- 172.21.15.110:0/2531987758 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc6814d850 0x7fdc680b8e80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fdc6805d650 tx=0x7fdc60017000).stop 2021-03-25T14:16:09.759 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.758+0000 7fdc6f979700 1 -- 172.21.15.110:0/2531987758 shutdown_connections 2021-03-25T14:16:09.759 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.758+0000 7fdc6f979700 1 --2- 172.21.15.110:0/2531987758 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fdc4805a0b0 0x7fdc4805c570 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:09.760 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.758+0000 7fdc6f979700 1 --2- 172.21.15.110:0/2531987758 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc6814cc90 0x7fdc680b8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:09.760 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.758+0000 7fdc6f979700 1 --2- 172.21.15.110:0/2531987758 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc6814d850 0x7fdc680b8e80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:09.760 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.758+0000 7fdc6f979700 1 --2- 172.21.15.110:0/2531987758 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc6814d470 0x7fdc6815cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:09.760 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.758+0000 7fdc6f979700 1 -- 172.21.15.110:0/2531987758 >> 172.21.15.110:0/2531987758 conn(0x7fdc68060c40 msgr2=0x7fdc680bec50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:09.760 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.758+0000 7fdc6f979700 1 -- 172.21.15.110:0/2531987758 shutdown_connections 2021-03-25T14:16:09.760 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.758+0000 7fdc6f979700 1 -- 172.21.15.110:0/2531987758 wait complete. 2021-03-25T14:16:09.761 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs_metadata' created 2021-03-25T14:16:09.773 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-03-25T14:16:09.886 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.885+0000 7f58cbe0f700 1 Processor -- start 2021-03-25T14:16:09.886 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.885+0000 7f58cbe0f700 1 -- start start 2021-03-25T14:16:09.893 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.886+0000 7f58cbe0f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58c4064be0 0x7f58c4149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:09.893 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.886+0000 7f58cbe0f700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58c414a720 con 0x7f58c414a2b0 2021-03-25T14:16:09.893 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.886+0000 7f58cbe0f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58c414cf60 con 0x7f58c4064800 2021-03-25T14:16:09.893 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.886+0000 7f58cbe0f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c414d200 con 0x7f58c4064be0 2021-03-25T14:16:09.893 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.886+0000 7f58ca3ac700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f58c414a2b0 0x7f58c4065620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:40406/0 (socket says 172.21.15.110:40406) 2021-03-25T14:16:09.893 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.886+0000 7f58ca3ac700 1 -- 172.21.15.110:0/1464511258 learned_addr learned my addr 172.21.15.110:0/1464511258 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:09.893 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.886+0000 7f58c93aa700 1 --2- 172.21.15.110:0/1464511258 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58c4064be0 0x7f58c4149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:09.893 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.886+0000 7f58c8ba9700 1 -- 172.21.15.110:0/1464511258 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 708285742 0 0) 0x7f58c414a720 con 0x7f58c414a2b0 2021-03-25T14:16:09.894 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.886+0000 7f58c8ba9700 1 -- 172.21.15.110:0/1464511258 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58ac003270 con 0x7f58c414a2b0 2021-03-25T14:16:09.894 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.886+0000 7f58c8ba9700 1 -- 172.21.15.110:0/1464511258 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 929029788 0 0) 0x7f58c414cf60 con 0x7f58c4064800 2021-03-25T14:16:09.894 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.886+0000 7f58c8ba9700 1 -- 172.21.15.110:0/1464511258 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58c414a720 con 0x7f58c4064800 2021-03-25T14:16:09.894 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.886+0000 7f58c8ba9700 1 -- 172.21.15.110:0/1464511258 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 207680637 0 0) 0x7f58ac003270 con 0x7f58c414a2b0 2021-03-25T14:16:09.894 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.886+0000 7f58c8ba9700 1 -- 172.21.15.110:0/1464511258 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58c4064be0 msgr2=0x7f58c4149dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:09.894 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.886+0000 7f58c8ba9700 1 --2- 172.21.15.110:0/1464511258 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58c4064be0 0x7f58c4149dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:09.894 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.886+0000 7f58c8ba9700 1 -- 172.21.15.110:0/1464511258 >> v1:172.21.15.174:6789/0 conn(0x7f58c4064800 legacy=0x7f58c4066c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:09.894 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.886+0000 7f58c8ba9700 1 -- 172.21.15.110:0/1464511258 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c414d4a0 con 0x7f58c414a2b0 2021-03-25T14:16:09.894 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.886+0000 7f58c8ba9700 1 -- 172.21.15.110:0/1464511258 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f58bc0018a0 con 0x7f58c414a2b0 2021-03-25T14:16:09.894 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.886+0000 7f58c8ba9700 1 -- 172.21.15.110:0/1464511258 >> v1:172.21.15.110:6789/0 conn(0x7f58c414a2b0 legacy=0x7f58c4065620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:09.894 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.886+0000 7f58c8ba9700 1 --2- 172.21.15.110:0/1464511258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58ac003920 0x7f58ac003d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:09.895 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.886+0000 7f58c8ba9700 1 --2- 172.21.15.110:0/1464511258 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58c4064be0 0x7f58ac004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:09.895 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.886+0000 7f58c8ba9700 1 --2- 172.21.15.110:0/1464511258 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58ac004a00 0x7f58ac004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:09.895 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.886+0000 7f58c8ba9700 1 -- 172.21.15.110:0/1464511258 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c414d200 con 0x7f58ac003920 2021-03-25T14:16:09.895 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.886+0000 7f58c8ba9700 1 -- 172.21.15.110:0/1464511258 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ac005370 con 0x7f58ac004a00 2021-03-25T14:16:09.895 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.886+0000 7f58c8ba9700 1 -- 172.21.15.110:0/1464511258 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58ac00b760 con 0x7f58c4064be0 2021-03-25T14:16:09.895 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.887+0000 7f58c9bab700 1 --2- 172.21.15.110:0/1464511258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58ac003920 0x7f58ac003d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:09.895 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.887+0000 7f58ca3ac700 1 --2- 172.21.15.110:0/1464511258 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58ac004a00 0x7f58ac004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:09.895 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.887+0000 7f58c93aa700 1 --2- 172.21.15.110:0/1464511258 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58c4064be0 0x7f58ac004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:09.895 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.887+0000 7f58c9bab700 1 -- 172.21.15.110:0/1464511258 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58c4064be0 msgr2=0x7f58ac004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:09.895 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.887+0000 7f58c9bab700 1 --2- 172.21.15.110:0/1464511258 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58c4064be0 0x7f58ac004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:09.895 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.887+0000 7f58c9bab700 1 -- 172.21.15.110:0/1464511258 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58ac004a00 msgr2=0x7f58ac004e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:09.895 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.887+0000 7f58c9bab700 1 --2- 172.21.15.110:0/1464511258 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58ac004a00 0x7f58ac004e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:09.895 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.887+0000 7f58c9bab700 1 -- 172.21.15.110:0/1464511258 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ac003270 con 0x7f58ac003920 2021-03-25T14:16:09.895 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.887+0000 7f58c9bab700 1 --2- 172.21.15.110:0/1464511258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58ac003920 0x7f58ac003d20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f58c0001ac0 tx=0x7f58c0007bc0).ready entity=mon.0 client_cookie=1e4d49f3cf2f9d44 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:09.896 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.887+0000 7f58c8ba9700 1 -- 172.21.15.110:0/1464511258 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c0007020 con 0x7f58ac003920 2021-03-25T14:16:09.896 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.887+0000 7f58c8ba9700 1 -- 172.21.15.110:0/1464511258 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c0007180 con 0x7f58ac003920 2021-03-25T14:16:09.896 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.887+0000 7f58c8ba9700 1 -- 172.21.15.110:0/1464511258 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c000c860 con 0x7f58ac003920 2021-03-25T14:16:09.896 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.888+0000 7f58cbe0f700 1 -- 172.21.15.110:0/1464511258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58ac003920 msgr2=0x7f58ac003d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:09.896 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.888+0000 7f58cbe0f700 1 --2- 172.21.15.110:0/1464511258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58ac003920 0x7f58ac003d20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f58c0001ac0 tx=0x7f58c0007bc0).stop 2021-03-25T14:16:09.896 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.888+0000 7f58ca3ac700 1 -- 172.21.15.110:0/1464511258 reap_dead start 2021-03-25T14:16:09.896 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.888+0000 7f58cbe0f700 1 -- 172.21.15.110:0/1464511258 shutdown_connections 2021-03-25T14:16:09.896 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.888+0000 7f58cbe0f700 1 -- 172.21.15.110:0/1464511258 >> 172.21.15.110:0/1464511258 conn(0x7f58c4060c40 msgr2=0x7f58c4061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:09.896 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.888+0000 7f58cbe0f700 1 -- 172.21.15.110:0/1464511258 shutdown_connections 2021-03-25T14:16:09.896 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.888+0000 7f58cbe0f700 1 -- 172.21.15.110:0/1464511258 wait complete. 2021-03-25T14:16:09.896 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.889+0000 7f58cbe0f700 1 Processor -- start 2021-03-25T14:16:09.897 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.889+0000 7f58cbe0f700 1 -- start start 2021-03-25T14:16:09.897 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.889+0000 7f58cbe0f700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58ac003920 0x7f58c40b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:09.897 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.889+0000 7f58cbe0f700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58c40a2f30 0x7f58c415ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:09.897 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.889+0000 7f58cbe0f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58c40a2900 0x7f58c40bbc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:09.897 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.889+0000 7f58cbe0f700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c40b3150 con 0x7f58ac003920 2021-03-25T14:16:09.897 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.889+0000 7f58cbe0f700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c40b41c0 con 0x7f58c40a2f30 2021-03-25T14:16:09.897 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.889+0000 7f58cbe0f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c40b4460 con 0x7f58c40a2900 2021-03-25T14:16:09.897 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.889+0000 7f58c9bab700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58ac003920 0x7f58c40b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:09.897 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.889+0000 7f58c9bab700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58ac003920 0x7f58c40b2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47478/0 (socket says 172.21.15.110:47478) 2021-03-25T14:16:09.897 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.889+0000 7f58c9bab700 1 -- 172.21.15.110:0/760874824 learned_addr learned my addr 172.21.15.110:0/760874824 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:09.897 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.890+0000 7f58c93aa700 1 --2- 172.21.15.110:0/760874824 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58c40a2f30 0x7f58c415ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:09.897 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.890+0000 7f58ca3ac700 1 --2- 172.21.15.110:0/760874824 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58c40a2900 0x7f58c40bbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:09.898 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.890+0000 7f58c9bab700 1 -- 172.21.15.110:0/760874824 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58c40a2900 msgr2=0x7f58c40bbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:09.898 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.890+0000 7f58c9bab700 1 --2- 172.21.15.110:0/760874824 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58c40a2900 0x7f58c40bbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:09.898 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.890+0000 7f58c9bab700 1 -- 172.21.15.110:0/760874824 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58c40a2f30 msgr2=0x7f58c415ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:09.898 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.890+0000 7f58c9bab700 1 --2- 172.21.15.110:0/760874824 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58c40a2f30 0x7f58c415ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:09.898 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.890+0000 7f58c9bab700 1 -- 172.21.15.110:0/760874824 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c415c320 con 0x7f58ac003920 2021-03-25T14:16:09.898 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.890+0000 7f58ca3ac700 1 --2- 172.21.15.110:0/760874824 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58c40a2900 0x7f58c40bbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:09.898 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.890+0000 7f58c9bab700 1 --2- 172.21.15.110:0/760874824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58ac003920 0x7f58c40b2c60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f58c000c3c0 tx=0x7f58c0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:09.898 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.890+0000 7f58b1ffb700 1 -- 172.21.15.110:0/760874824 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c00128f0 con 0x7f58ac003920 2021-03-25T14:16:09.898 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.890+0000 7f58b1ffb700 1 -- 172.21.15.110:0/760874824 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c0012a50 con 0x7f58ac003920 2021-03-25T14:16:09.898 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.890+0000 7f58b1ffb700 1 -- 172.21.15.110:0/760874824 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c0012df0 con 0x7f58ac003920 2021-03-25T14:16:09.898 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.890+0000 7f58cbe0f700 1 -- 172.21.15.110:0/760874824 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58c415c5c0 con 0x7f58ac003920 2021-03-25T14:16:09.898 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.890+0000 7f58cbe0f700 1 -- 172.21.15.110:0/760874824 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c40b3d90 con 0x7f58ac003920 2021-03-25T14:16:09.898 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.891+0000 7f58cbe0f700 1 -- 172.21.15.110:0/760874824 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58c40a2ce0 con 0x7f58ac003920 2021-03-25T14:16:09.899 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.892+0000 7f58b1ffb700 1 -- 172.21.15.110:0/760874824 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f58c0025030 con 0x7f58ac003920 2021-03-25T14:16:09.899 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.892+0000 7f58b1ffb700 1 --2- 172.21.15.110:0/760874824 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f58a405a0b0 0x7f58a405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:09.899 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.892+0000 7f58b1ffb700 1 -- 172.21.15.110:0/760874824 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f58c0002e40 con 0x7f58ac003920 2021-03-25T14:16:09.899 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.892+0000 7f58c93aa700 1 --2- 172.21.15.110:0/760874824 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f58a405a0b0 0x7f58a405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:09.899 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.892+0000 7f58c93aa700 1 --2- 172.21.15.110:0/760874824 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f58a405a0b0 0x7f58a405c570 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f58c4156a80 tx=0x7f58b4006e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:09.899 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:09.896+0000 7f58b1ffb700 1 -- 172.21.15.110:0/760874824 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f58c0079070 con 0x7f58ac003920 2021-03-25T14:16:10.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.048+0000 7f58cbe0f700 1 -- 172.21.15.110:0/760874824 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f58c40b4620 con 0x7f58ac003920 2021-03-25T14:16:10.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.761+0000 7f58b1ffb700 1 -- 172.21.15.110:0/760874824 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v19) v1 ==== 125+0+0 (secure 0 0 0) 0x7f58c0023030 con 0x7f58ac003920 2021-03-25T14:16:10.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.764+0000 7f58cbe0f700 1 -- 172.21.15.110:0/760874824 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f58a405a0b0 msgr2=0x7f58a405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:10.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.764+0000 7f58cbe0f700 1 --2- 172.21.15.110:0/760874824 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f58a405a0b0 0x7f58a405c570 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f58c4156a80 tx=0x7f58b4006e20).stop 2021-03-25T14:16:10.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.764+0000 7f58cbe0f700 1 -- 172.21.15.110:0/760874824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58ac003920 msgr2=0x7f58c40b2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:10.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.764+0000 7f58cbe0f700 1 --2- 172.21.15.110:0/760874824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58ac003920 0x7f58c40b2c60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f58c000c3c0 tx=0x7f58c0016000).stop 2021-03-25T14:16:10.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.764+0000 7f58cbe0f700 1 -- 172.21.15.110:0/760874824 shutdown_connections 2021-03-25T14:16:10.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.764+0000 7f58cbe0f700 1 --2- 172.21.15.110:0/760874824 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f58a405a0b0 0x7f58a405c570 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:10.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.764+0000 7f58cbe0f700 1 --2- 172.21.15.110:0/760874824 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58c40a2900 0x7f58c40bbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:10.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.764+0000 7f58cbe0f700 1 --2- 172.21.15.110:0/760874824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58ac003920 0x7f58c40b2c60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:10.766 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.764+0000 7f58cbe0f700 1 --2- 172.21.15.110:0/760874824 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58c40a2f30 0x7f58c415ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:10.766 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.764+0000 7f58cbe0f700 1 -- 172.21.15.110:0/760874824 >> 172.21.15.110:0/760874824 conn(0x7f58c4060c40 msgr2=0x7f58c40bcae0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:10.766 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.766+0000 7f58cbe0f700 1 -- 172.21.15.110:0/760874824 shutdown_connections 2021-03-25T14:16:10.767 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.766+0000 7f58cbe0f700 1 -- 172.21.15.110:0/760874824 wait complete. 2021-03-25T14:16:10.770 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs_data' created 2021-03-25T14:16:10.782 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2021-03-25T14:16:10.897 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.896+0000 7f703eaaa700 1 Processor -- start 2021-03-25T14:16:10.897 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.896+0000 7f703eaaa700 1 -- start start 2021-03-25T14:16:10.904 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.897+0000 7f703eaaa700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f703814d470 0x7f703814d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:10.904 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.897+0000 7f703eaaa700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70380685d0 0x7f7038068a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:10.904 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.897+0000 7f703eaaa700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70380691b0 con 0x7f703814cc90 2021-03-25T14:16:10.904 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.897+0000 7f703eaaa700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70380bc2b0 con 0x7f703814d470 2021-03-25T14:16:10.904 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.897+0000 7f703eaaa700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7038149dd0 con 0x7f70380685d0 2021-03-25T14:16:10.904 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.897+0000 7f703c846700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f703814d470 0x7f703814d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:10.904 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.897+0000 7f703c846700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f703814d470 0x7f703814d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47486/0 (socket says 172.21.15.110:47486) 2021-03-25T14:16:10.904 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.897+0000 7f703c846700 1 -- 172.21.15.110:0/4148883095 learned_addr learned my addr 172.21.15.110:0/4148883095 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:10.904 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.897+0000 7f703d047700 1 --2- 172.21.15.110:0/4148883095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70380685d0 0x7f7038068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:10.905 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.897+0000 7f703c846700 1 -- 172.21.15.110:0/4148883095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70380685d0 msgr2=0x7f7038068a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:10.905 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.897+0000 7f703c846700 1 --2- 172.21.15.110:0/4148883095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70380685d0 0x7f7038068a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:10.905 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.897+0000 7f703c846700 1 -- 172.21.15.110:0/4148883095 >> v1:172.21.15.174:6789/0 conn(0x7f703814cc90 legacy=0x7f70381493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:10.905 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.897+0000 7f703c846700 1 -- 172.21.15.110:0/4148883095 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f703814a070 con 0x7f703814d470 2021-03-25T14:16:10.905 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.897+0000 7f703d047700 1 --2- 172.21.15.110:0/4148883095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70380685d0 0x7f7038068a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:10.905 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.897+0000 7f703c846700 1 --2- 172.21.15.110:0/4148883095 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f703814d470 0x7f703814d850 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f702c00ba20 tx=0x7f702c006ee0).ready entity=mon.0 client_cookie=39960b9d6d51b265 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:10.905 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.897+0000 7f70377fe700 1 -- 172.21.15.110:0/4148883095 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c009890 con 0x7f703814d470 2021-03-25T14:16:10.905 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.897+0000 7f70377fe700 1 -- 172.21.15.110:0/4148883095 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702c0099f0 con 0x7f703814d470 2021-03-25T14:16:10.905 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.897+0000 7f70377fe700 1 -- 172.21.15.110:0/4148883095 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c009d70 con 0x7f703814d470 2021-03-25T14:16:10.905 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.898+0000 7f703eaaa700 1 -- 172.21.15.110:0/4148883095 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f703814d470 msgr2=0x7f703814d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:10.905 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.898+0000 7f703eaaa700 1 --2- 172.21.15.110:0/4148883095 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f703814d470 0x7f703814d850 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f702c00ba20 tx=0x7f702c006ee0).stop 2021-03-25T14:16:10.906 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.898+0000 7f703eaaa700 1 -- 172.21.15.110:0/4148883095 shutdown_connections 2021-03-25T14:16:10.906 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.898+0000 7f703eaaa700 1 --2- 172.21.15.110:0/4148883095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70380685d0 0x7f7038068a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:10.906 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.898+0000 7f703eaaa700 1 --2- 172.21.15.110:0/4148883095 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f703814d470 0x7f703814d850 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:10.906 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.898+0000 7f703eaaa700 1 -- 172.21.15.110:0/4148883095 >> 172.21.15.110:0/4148883095 conn(0x7f7038060c40 msgr2=0x7f7038061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:10.906 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.898+0000 7f703eaaa700 1 -- 172.21.15.110:0/4148883095 shutdown_connections 2021-03-25T14:16:10.906 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.898+0000 7f703eaaa700 1 -- 172.21.15.110:0/4148883095 wait complete. 2021-03-25T14:16:10.906 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.899+0000 7f703eaaa700 1 Processor -- start 2021-03-25T14:16:10.906 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.899+0000 7f703eaaa700 1 -- start start 2021-03-25T14:16:10.906 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.900+0000 7f703eaaa700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70380685d0 0x7f70380bae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:10.906 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.900+0000 7f703eaaa700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f703814cc90 0x7f70380a3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:10.906 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.900+0000 7f703eaaa700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f703814d470 0x7f70380a3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:10.906 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.900+0000 7f703eaaa700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70380a5be0 con 0x7f703814d470 2021-03-25T14:16:10.907 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.900+0000 7f703eaaa700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7038063730 con 0x7f70380685d0 2021-03-25T14:16:10.907 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.900+0000 7f703eaaa700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70380639d0 con 0x7f703814cc90 2021-03-25T14:16:10.907 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.900+0000 7f703d047700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f703814d470 0x7f70380a3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:10.907 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.900+0000 7f703d047700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f703814d470 0x7f70380a3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47494/0 (socket says 172.21.15.110:47494) 2021-03-25T14:16:10.907 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.900+0000 7f703d047700 1 -- 172.21.15.110:0/2888203651 learned_addr learned my addr 172.21.15.110:0/2888203651 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:10.907 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.900+0000 7f7037fff700 1 --2- 172.21.15.110:0/2888203651 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f703814cc90 0x7f70380a3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:10.907 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.900+0000 7f703c846700 1 --2- 172.21.15.110:0/2888203651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70380685d0 0x7f70380bae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:10.907 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.900+0000 7f703d047700 1 -- 172.21.15.110:0/2888203651 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f703814cc90 msgr2=0x7f70380a3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:10.907 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.900+0000 7f703d047700 1 --2- 172.21.15.110:0/2888203651 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f703814cc90 0x7f70380a3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:10.907 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.900+0000 7f703d047700 1 -- 172.21.15.110:0/2888203651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70380685d0 msgr2=0x7f70380bae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:10.907 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.900+0000 7f703d047700 1 --2- 172.21.15.110:0/2888203651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70380685d0 0x7f70380bae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:10.908 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.900+0000 7f703d047700 1 -- 172.21.15.110:0/2888203651 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7038064c60 con 0x7f703814d470 2021-03-25T14:16:10.908 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.900+0000 7f703d047700 1 --2- 172.21.15.110:0/2888203651 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f703814d470 0x7f70380a3510 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f703000cb20 tx=0x7f7030008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:10.908 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.901+0000 7f7034ff9700 1 -- 172.21.15.110:0/2888203651 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70300078b0 con 0x7f703814d470 2021-03-25T14:16:10.908 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.901+0000 7f7034ff9700 1 -- 172.21.15.110:0/2888203651 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7030007a10 con 0x7f703814d470 2021-03-25T14:16:10.908 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.901+0000 7f7034ff9700 1 -- 172.21.15.110:0/2888203651 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7030007d90 con 0x7f703814d470 2021-03-25T14:16:10.908 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.901+0000 7f703eaaa700 1 -- 172.21.15.110:0/2888203651 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7038064f00 con 0x7f703814d470 2021-03-25T14:16:10.908 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.901+0000 7f703eaaa700 1 -- 172.21.15.110:0/2888203651 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f703814c050 con 0x7f703814d470 2021-03-25T14:16:10.908 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.901+0000 7f703eaaa700 1 -- 172.21.15.110:0/2888203651 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f703805d7b0 con 0x7f703814d470 2021-03-25T14:16:10.908 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.902+0000 7f7034ff9700 1 -- 172.21.15.110:0/2888203651 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f7030011620 con 0x7f703814d470 2021-03-25T14:16:10.908 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.902+0000 7f7034ff9700 1 --2- 172.21.15.110:0/2888203651 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f701805a0b0 0x7f701805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:10.908 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.902+0000 7f7034ff9700 1 -- 172.21.15.110:0/2888203651 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f70300741b0 con 0x7f703814d470 2021-03-25T14:16:10.909 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.902+0000 7f703c846700 1 --2- 172.21.15.110:0/2888203651 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f701805a0b0 0x7f701805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:10.909 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.903+0000 7f703c846700 1 --2- 172.21.15.110:0/2888203651 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f701805a0b0 0x7f701805c570 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f702c006f20 tx=0x7f702c016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:10.909 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:10.906+0000 7f7034ff9700 1 -- 172.21.15.110:0/2888203651 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f7030047bc0 con 0x7f703814d470 2021-03-25T14:16:11.090 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.089+0000 7f703eaaa700 1 -- 172.21.15.110:0/2888203651 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7038065090 con 0x7f703814d470 2021-03-25T14:16:11.095 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.094+0000 7f7034ff9700 1 -- 172.21.15.110:0/2888203651 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v5) v1 ==== 172+0+0 (secure 0 0 0) 0x7f703004b1e0 con 0x7f703814d470 2021-03-25T14:16:11.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.096+0000 7f703eaaa700 1 -- 172.21.15.110:0/2888203651 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f701805a0b0 msgr2=0x7f701805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:11.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.096+0000 7f703eaaa700 1 --2- 172.21.15.110:0/2888203651 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f701805a0b0 0x7f701805c570 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f702c006f20 tx=0x7f702c016000).stop 2021-03-25T14:16:11.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.096+0000 7f703eaaa700 1 -- 172.21.15.110:0/2888203651 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f703814d470 msgr2=0x7f70380a3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:11.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.096+0000 7f703eaaa700 1 --2- 172.21.15.110:0/2888203651 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f703814d470 0x7f70380a3510 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f703000cb20 tx=0x7f7030008040).stop 2021-03-25T14:16:11.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.096+0000 7f703eaaa700 1 -- 172.21.15.110:0/2888203651 shutdown_connections 2021-03-25T14:16:11.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.096+0000 7f703eaaa700 1 --2- 172.21.15.110:0/2888203651 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f701805a0b0 0x7f701805c570 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:11.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.096+0000 7f703eaaa700 1 --2- 172.21.15.110:0/2888203651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70380685d0 0x7f70380bae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:11.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.096+0000 7f703eaaa700 1 --2- 172.21.15.110:0/2888203651 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f703814d470 0x7f70380a3510 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:11.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.096+0000 7f703eaaa700 1 --2- 172.21.15.110:0/2888203651 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f703814cc90 0x7f70380a3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:11.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.096+0000 7f703eaaa700 1 -- 172.21.15.110:0/2888203651 >> 172.21.15.110:0/2888203651 conn(0x7f7038060c40 msgr2=0x7f70380b64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:11.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.097+0000 7f703eaaa700 1 -- 172.21.15.110:0/2888203651 shutdown_connections 2021-03-25T14:16:11.100 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.099+0000 7f703eaaa700 1 -- 172.21.15.110:0/2888203651 wait complete. 2021-03-25T14:16:11.103 INFO:teuthology.orchestra.run.smithi110.stderr:new fs with metadata pool 3 and data pool 4 2021-03-25T14:16:11.117 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2021-03-25T14:16:11.117 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2021-03-25T14:16:11.231 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.231+0000 7f75aa325700 1 Processor -- start 2021-03-25T14:16:11.232 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.231+0000 7f75aa325700 1 -- start start 2021-03-25T14:16:11.234 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.231+0000 7f75aa325700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75a41493a0 0x7f75a40b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:11.234 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.231+0000 7f75aa325700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f75a4063510 0x7f75a4145c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:11.235 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.231+0000 7f75aa325700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75a40b13d0 con 0x7f75a4063090 2021-03-25T14:16:11.235 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.231+0000 7f75aa325700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75a40b7100 con 0x7f75a4063510 2021-03-25T14:16:11.235 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.231+0000 7f75aa325700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a40b73a0 con 0x7f75a41493a0 2021-03-25T14:16:11.235 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.231+0000 7f75a88c2700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f75a4063510 0x7f75a4145c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:11.235 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.231+0000 7f75a88c2700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f75a4063510 0x7f75a4145c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47502/0 (socket says 172.21.15.110:47502) 2021-03-25T14:16:11.235 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.231+0000 7f75a88c2700 1 -- 172.21.15.110:0/559952969 learned_addr learned my addr 172.21.15.110:0/559952969 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:11.235 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.232+0000 7f75a3fff700 1 --2- 172.21.15.110:0/559952969 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75a41493a0 0x7f75a40b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:11.235 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.232+0000 7f75a88c2700 1 -- 172.21.15.110:0/559952969 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75a41493a0 msgr2=0x7f75a40b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:11.235 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.232+0000 7f75a88c2700 1 --2- 172.21.15.110:0/559952969 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75a41493a0 0x7f75a40b1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:11.235 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.232+0000 7f75a88c2700 1 -- 172.21.15.110:0/559952969 >> v1:172.21.15.174:6789/0 conn(0x7f75a4063090 legacy=0x7f75a4149780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:11.235 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.232+0000 7f75a88c2700 1 -- 172.21.15.110:0/559952969 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a40b1660 con 0x7f75a4063510 2021-03-25T14:16:11.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.232+0000 7f75a88c2700 1 --2- 172.21.15.110:0/559952969 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75a4063510 0x7f75a4145c90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f759c009d90 tx=0x7f759c0092d0).ready entity=mon.0 client_cookie=8114000a8bcfb27b server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:11.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.232+0000 7f75a2ffd700 1 -- 172.21.15.110:0/559952969 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759c00bc40 con 0x7f75a4063510 2021-03-25T14:16:11.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.232+0000 7f75a2ffd700 1 -- 172.21.15.110:0/559952969 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f759c00bda0 con 0x7f75a4063510 2021-03-25T14:16:11.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.232+0000 7f75a2ffd700 1 -- 172.21.15.110:0/559952969 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759c011610 con 0x7f75a4063510 2021-03-25T14:16:11.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.232+0000 7f75aa325700 1 -- 172.21.15.110:0/559952969 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75a4063510 msgr2=0x7f75a4145c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:11.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.232+0000 7f75aa325700 1 --2- 172.21.15.110:0/559952969 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75a4063510 0x7f75a4145c90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f759c009d90 tx=0x7f759c0092d0).stop 2021-03-25T14:16:11.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.233+0000 7f75aa325700 1 -- 172.21.15.110:0/559952969 shutdown_connections 2021-03-25T14:16:11.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.233+0000 7f75aa325700 1 --2- 172.21.15.110:0/559952969 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75a4063510 0x7f75a4145c90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:11.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.233+0000 7f75aa325700 1 --2- 172.21.15.110:0/559952969 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75a41493a0 0x7f75a40b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:11.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.233+0000 7f75aa325700 1 -- 172.21.15.110:0/559952969 >> 172.21.15.110:0/559952969 conn(0x7f75a4061710 msgr2=0x7f75a40bbac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:11.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.233+0000 7f75aa325700 1 -- 172.21.15.110:0/559952969 shutdown_connections 2021-03-25T14:16:11.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.233+0000 7f75aa325700 1 -- 172.21.15.110:0/559952969 wait complete. 2021-03-25T14:16:11.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.234+0000 7f75aa325700 1 Processor -- start 2021-03-25T14:16:11.237 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.234+0000 7f75aa325700 1 -- start start 2021-03-25T14:16:11.240 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.234+0000 7f75aa325700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75a4063090 0x7f75a40a13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:11.240 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.234+0000 7f75aa325700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75a4063510 0x7f75a4142550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:11.240 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.234+0000 7f75aa325700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75a41493a0 0x7f75a4155b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:11.240 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.234+0000 7f75aa325700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a40a0d10 con 0x7f75a4063510 2021-03-25T14:16:11.240 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.234+0000 7f75aa325700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a40a18d0 con 0x7f75a41493a0 2021-03-25T14:16:11.240 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.234+0000 7f75aa325700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a40b2e10 con 0x7f75a4063090 2021-03-25T14:16:11.240 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.235+0000 7f75a37fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75a4063510 0x7f75a4142550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:11.240 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.235+0000 7f75a37fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75a4063510 0x7f75a4142550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47508/0 (socket says 172.21.15.110:47508) 2021-03-25T14:16:11.240 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.235+0000 7f75a37fe700 1 -- 172.21.15.110:0/1572905644 learned_addr learned my addr 172.21.15.110:0/1572905644 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:11.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.235+0000 7f75a3fff700 1 --2- 172.21.15.110:0/1572905644 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75a4063090 0x7f75a40a13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:11.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.235+0000 7f75a88c2700 1 --2- 172.21.15.110:0/1572905644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75a41493a0 0x7f75a4155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:11.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.235+0000 7f75a37fe700 1 -- 172.21.15.110:0/1572905644 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75a4063090 msgr2=0x7f75a40a13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:11.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.235+0000 7f75a37fe700 1 --2- 172.21.15.110:0/1572905644 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75a4063090 0x7f75a40a13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:11.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.235+0000 7f75a37fe700 1 -- 172.21.15.110:0/1572905644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75a41493a0 msgr2=0x7f75a4155b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:11.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.235+0000 7f75a37fe700 1 --2- 172.21.15.110:0/1572905644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75a41493a0 0x7f75a4155b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:11.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.235+0000 7f75a37fe700 1 -- 172.21.15.110:0/1572905644 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a40b30b0 con 0x7f75a4063510 2021-03-25T14:16:11.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.235+0000 7f75a88c2700 1 --2- 172.21.15.110:0/1572905644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75a41493a0 0x7f75a4155b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:11.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.235+0000 7f75a37fe700 1 --2- 172.21.15.110:0/1572905644 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75a4063510 0x7f75a4142550 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f759800ca70 tx=0x7f7598007ce0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:11.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.235+0000 7f758bfff700 1 -- 172.21.15.110:0/1572905644 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7598007020 con 0x7f75a4063510 2021-03-25T14:16:11.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.235+0000 7f758bfff700 1 -- 172.21.15.110:0/1572905644 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75980071a0 con 0x7f75a4063510 2021-03-25T14:16:11.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.235+0000 7f75aa325700 1 -- 172.21.15.110:0/1572905644 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75a40b3350 con 0x7f75a4063510 2021-03-25T14:16:11.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.235+0000 7f758bfff700 1 -- 172.21.15.110:0/1572905644 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7598002920 con 0x7f75a4063510 2021-03-25T14:16:11.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.235+0000 7f75aa325700 1 -- 172.21.15.110:0/1572905644 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a4142a40 con 0x7f75a4063510 2021-03-25T14:16:11.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.236+0000 7f75aa325700 1 -- 172.21.15.110:0/1572905644 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a40bc8a0 con 0x7f75a4063510 2021-03-25T14:16:11.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.236+0000 7f758bfff700 1 -- 172.21.15.110:0/1572905644 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f7598002c90 con 0x7f75a4063510 2021-03-25T14:16:11.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.237+0000 7f758bfff700 1 --2- 172.21.15.110:0/1572905644 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f758405a0b0 0x7f758405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:11.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.237+0000 7f758bfff700 1 -- 172.21.15.110:0/1572905644 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f75980760f0 con 0x7f75a4063510 2021-03-25T14:16:11.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.237+0000 7f75a3fff700 1 --2- 172.21.15.110:0/1572905644 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f758405a0b0 0x7f758405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:11.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.237+0000 7f75a3fff700 1 --2- 172.21.15.110:0/1572905644 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f758405a0b0 0x7f758405c570 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f759400d910 tx=0x7f7594008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:11.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.240+0000 7f758bfff700 1 -- 172.21.15.110:0/1572905644 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f7598049a90 con 0x7f75a4063510 2021-03-25T14:16:11.399 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:11.398+0000 7f75aa325700 1 -- 172.21.15.110:0/1572905644 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f75a40a1100 con 0x7f75a4063510 2021-03-25T14:16:11.735 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-03-25T14:16:11.738 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-03-25T14:16:12.103 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.103+0000 7f758bfff700 1 -- 172.21.15.110:0/1572905644 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 157+0+0 (secure 0 0 0) 0x7f7598015020 con 0x7f75a4063510 2021-03-25T14:16:12.106 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.104+0000 7f75aa325700 1 -- 172.21.15.110:0/1572905644 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f758405a0b0 msgr2=0x7f758405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:12.106 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.104+0000 7f75aa325700 1 --2- 172.21.15.110:0/1572905644 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f758405a0b0 0x7f758405c570 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f759400d910 tx=0x7f7594008040).stop 2021-03-25T14:16:12.106 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.104+0000 7f75aa325700 1 -- 172.21.15.110:0/1572905644 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75a4063510 msgr2=0x7f75a4142550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:12.106 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.104+0000 7f75aa325700 1 --2- 172.21.15.110:0/1572905644 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75a4063510 0x7f75a4142550 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f759800ca70 tx=0x7f7598007ce0).stop 2021-03-25T14:16:12.106 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.104+0000 7f75aa325700 1 -- 172.21.15.110:0/1572905644 shutdown_connections 2021-03-25T14:16:12.106 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.104+0000 7f75aa325700 1 --2- 172.21.15.110:0/1572905644 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f758405a0b0 0x7f758405c570 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:12.106 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.104+0000 7f75aa325700 1 --2- 172.21.15.110:0/1572905644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75a41493a0 0x7f75a4155b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:12.106 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.104+0000 7f75aa325700 1 --2- 172.21.15.110:0/1572905644 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75a4063090 0x7f75a40a13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:12.106 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.104+0000 7f75aa325700 1 --2- 172.21.15.110:0/1572905644 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75a4063510 0x7f75a4142550 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:12.106 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.104+0000 7f75aa325700 1 -- 172.21.15.110:0/1572905644 >> 172.21.15.110:0/1572905644 conn(0x7f75a4061710 msgr2=0x7f75a40ba670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:12.107 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.104+0000 7f75aa325700 1 -- 172.21.15.110:0/1572905644 shutdown_connections 2021-03-25T14:16:12.107 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.104+0000 7f75aa325700 1 -- 172.21.15.110:0/1572905644 wait complete. 2021-03-25T14:16:12.117 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec 8 erasure cephfs_data_ec 2021-03-25T14:16:12.232 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.231+0000 7febfce67700 1 Processor -- start 2021-03-25T14:16:12.232 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.231+0000 7febfce67700 1 -- start start 2021-03-25T14:16:12.235 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.232+0000 7febfce67700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7febf80bfd50 0x7febf80c0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:12.235 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.232+0000 7febfce67700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febf80bb060 con 0x7febf814aa20 2021-03-25T14:16:12.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.232+0000 7febfce67700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febf814ae80 con 0x7febf80672a0 2021-03-25T14:16:12.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.232+0000 7febfce67700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febf80bab20 con 0x7febf80bfd50 2021-03-25T14:16:12.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.232+0000 7febf77fe700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7febf80bfd50 0x7febf80c0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:12.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.232+0000 7febf77fe700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7febf80bfd50 0x7febf80c0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47514/0 (socket says 172.21.15.110:47514) 2021-03-25T14:16:12.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.232+0000 7febf6ffd700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7febf814aa20 0x7febf8149e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:40450/0 (socket says 172.21.15.110:40450) 2021-03-25T14:16:12.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.232+0000 7febf77fe700 1 -- 172.21.15.110:0/628519496 learned_addr learned my addr 172.21.15.110:0/628519496 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:12.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.232+0000 7febf77fe700 1 -- 172.21.15.110:0/628519496 >> v1:172.21.15.174:6789/0 conn(0x7febf80672a0 legacy=0x7febf81431e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:12.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.232+0000 7febf77fe700 1 -- 172.21.15.110:0/628519496 >> v1:172.21.15.110:6789/0 conn(0x7febf814aa20 legacy=0x7febf8149e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:12.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.232+0000 7febf67fc700 1 -- 172.21.15.110:0/628519496 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3162828410 0 0) 0x7febf80bb060 con 0x7febf814aa20 2021-03-25T14:16:12.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.232+0000 7febf77fe700 1 -- 172.21.15.110:0/628519496 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf80badc0 con 0x7febf80bfd50 2021-03-25T14:16:12.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.233+0000 7febf77fe700 1 --2- 172.21.15.110:0/628519496 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febf80bfd50 0x7febf80c0130 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7febe800ba20 tx=0x7febe8006ee0).ready entity=mon.0 client_cookie=df9fbc5f6194c7fa server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:12.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.233+0000 7febf67fc700 1 -- 172.21.15.110:0/628519496 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe80098d0 con 0x7febf80bfd50 2021-03-25T14:16:12.237 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.233+0000 7febf67fc700 1 -- 172.21.15.110:0/628519496 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe8009a30 con 0x7febf80bfd50 2021-03-25T14:16:12.237 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.233+0000 7febf67fc700 1 -- 172.21.15.110:0/628519496 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe8009db0 con 0x7febf80bfd50 2021-03-25T14:16:12.237 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.233+0000 7febfce67700 1 -- 172.21.15.110:0/628519496 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febf80bfd50 msgr2=0x7febf80c0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:12.237 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.233+0000 7febfce67700 1 --2- 172.21.15.110:0/628519496 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febf80bfd50 0x7febf80c0130 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7febe800ba20 tx=0x7febe8006ee0).stop 2021-03-25T14:16:12.237 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.233+0000 7febfce67700 1 -- 172.21.15.110:0/628519496 shutdown_connections 2021-03-25T14:16:12.237 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.233+0000 7febfce67700 1 --2- 172.21.15.110:0/628519496 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febf80bfd50 0x7febf80c0130 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:12.237 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.233+0000 7febfce67700 1 -- 172.21.15.110:0/628519496 >> 172.21.15.110:0/628519496 conn(0x7febf8066370 msgr2=0x7febf8066780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:12.237 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.233+0000 7febfce67700 1 -- 172.21.15.110:0/628519496 shutdown_connections 2021-03-25T14:16:12.237 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.233+0000 7febfce67700 1 -- 172.21.15.110:0/628519496 wait complete. 2021-03-25T14:16:12.237 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.234+0000 7febfce67700 1 Processor -- start 2021-03-25T14:16:12.237 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.235+0000 7febfce67700 1 -- start start 2021-03-25T14:16:12.240 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.235+0000 7febfce67700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7febf80672a0 0x7febf80b95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:12.240 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.235+0000 7febfce67700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febf80bfd50 0x7febf814bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:12.240 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.235+0000 7febfce67700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febf814aa20 0x7febf81455f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:12.240 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.235+0000 7febfce67700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf80b9c70 con 0x7febf80bfd50 2021-03-25T14:16:12.240 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.235+0000 7febfce67700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf80b33e0 con 0x7febf814aa20 2021-03-25T14:16:12.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.235+0000 7febfce67700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf80b3680 con 0x7febf80672a0 2021-03-25T14:16:12.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.235+0000 7febf6ffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febf80bfd50 0x7febf814bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:12.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.235+0000 7febf6ffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febf80bfd50 0x7febf814bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47522/0 (socket says 172.21.15.110:47522) 2021-03-25T14:16:12.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.235+0000 7febf6ffd700 1 -- 172.21.15.110:0/4277148858 learned_addr learned my addr 172.21.15.110:0/4277148858 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:12.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.235+0000 7febf77fe700 1 --2- 172.21.15.110:0/4277148858 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7febf80672a0 0x7febf80b95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:12.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.235+0000 7febf7fff700 1 --2- 172.21.15.110:0/4277148858 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febf814aa20 0x7febf81455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:12.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.236+0000 7febf6ffd700 1 -- 172.21.15.110:0/4277148858 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7febf80672a0 msgr2=0x7febf80b95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:12.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.236+0000 7febf6ffd700 1 --2- 172.21.15.110:0/4277148858 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7febf80672a0 0x7febf80b95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:12.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.236+0000 7febf6ffd700 1 -- 172.21.15.110:0/4277148858 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febf814aa20 msgr2=0x7febf81455f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:12.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.236+0000 7febf6ffd700 1 --2- 172.21.15.110:0/4277148858 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febf814aa20 0x7febf81455f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:12.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.236+0000 7febf6ffd700 1 -- 172.21.15.110:0/4277148858 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf80b3920 con 0x7febf80bfd50 2021-03-25T14:16:12.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.236+0000 7febf6ffd700 1 --2- 172.21.15.110:0/4277148858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febf80bfd50 0x7febf814bcf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7febec00c760 tx=0x7febec007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:12.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.236+0000 7febdf7fe700 1 -- 172.21.15.110:0/4277148858 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec0072e0 con 0x7febf80bfd50 2021-03-25T14:16:12.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.236+0000 7febdf7fe700 1 -- 172.21.15.110:0/4277148858 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febec007440 con 0x7febf80bfd50 2021-03-25T14:16:12.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.236+0000 7febdf7fe700 1 -- 172.21.15.110:0/4277148858 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec0057b0 con 0x7febf80bfd50 2021-03-25T14:16:12.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.236+0000 7febfce67700 1 -- 172.21.15.110:0/4277148858 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febf80b30d0 con 0x7febf80bfd50 2021-03-25T14:16:12.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.236+0000 7febfce67700 1 -- 172.21.15.110:0/4277148858 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febf814c1e0 con 0x7febf80bfd50 2021-03-25T14:16:12.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.237+0000 7febfce67700 1 -- 172.21.15.110:0/4277148858 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febf80b3ab0 con 0x7febf80bfd50 2021-03-25T14:16:12.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.237+0000 7febdf7fe700 1 -- 172.21.15.110:0/4277148858 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7febec010070 con 0x7febf80bfd50 2021-03-25T14:16:12.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.237+0000 7febdf7fe700 1 --2- 172.21.15.110:0/4277148858 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7febd805a0b0 0x7febd805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:12.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.237+0000 7febdf7fe700 1 -- 172.21.15.110:0/4277148858 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6332+0+0 (secure 0 0 0) 0x7febec0733f0 con 0x7febf80bfd50 2021-03-25T14:16:12.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.238+0000 7febf77fe700 1 --2- 172.21.15.110:0/4277148858 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7febd805a0b0 0x7febd805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:12.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.238+0000 7febf77fe700 1 --2- 172.21.15.110:0/4277148858 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7febd805a0b0 0x7febd805c570 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7febe8006f20 tx=0x7febe8016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:12.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.241+0000 7febdf7fe700 1 -- 172.21.15.110:0/4277148858 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7febec046c90 con 0x7febf80bfd50 2021-03-25T14:16:12.390 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:12.389+0000 7febfce67700 1 -- 172.21.15.110:0/4277148858 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec"} v 0) v1 -- 0x7febf8045ae0 con 0x7febf80bfd50 2021-03-25T14:16:13.151 INFO:tasks.ceph.mds.b.smithi174.stderr:2021-03-25T14:16:13.149+0000 7f5220b61700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2021-03-25T14:16:14.110 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.109+0000 7febdf7fe700 1 -- 172.21.15.110:0/4277148858 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec"}]=0 pool 'cephfs_data_ec' created v23) v1 ==== 197+0+0 (secure 0 0 0) 0x7febec04a2b0 con 0x7febf80bfd50 2021-03-25T14:16:14.113 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.112+0000 7febfce67700 1 -- 172.21.15.110:0/4277148858 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7febd805a0b0 msgr2=0x7febd805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:14.113 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.112+0000 7febfce67700 1 --2- 172.21.15.110:0/4277148858 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7febd805a0b0 0x7febd805c570 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7febe8006f20 tx=0x7febe8016000).stop 2021-03-25T14:16:14.113 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.112+0000 7febfce67700 1 -- 172.21.15.110:0/4277148858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febf80bfd50 msgr2=0x7febf814bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:14.113 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.112+0000 7febfce67700 1 --2- 172.21.15.110:0/4277148858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febf80bfd50 0x7febf814bcf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7febec00c760 tx=0x7febec007c60).stop 2021-03-25T14:16:14.114 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.113+0000 7febfce67700 1 -- 172.21.15.110:0/4277148858 shutdown_connections 2021-03-25T14:16:14.114 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.113+0000 7febfce67700 1 --2- 172.21.15.110:0/4277148858 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7febd805a0b0 0x7febd805c570 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0x7febe8006f20 tx=0x7febe8016000).stop 2021-03-25T14:16:14.114 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.113+0000 7febfce67700 1 --2- 172.21.15.110:0/4277148858 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febf814aa20 0x7febf81455f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:14.114 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.113+0000 7febfce67700 1 --2- 172.21.15.110:0/4277148858 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7febf80672a0 0x7febf80b95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:14.114 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.113+0000 7febfce67700 1 --2- 172.21.15.110:0/4277148858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febf80bfd50 0x7febf814bcf0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:14.114 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.113+0000 7febfce67700 1 -- 172.21.15.110:0/4277148858 >> 172.21.15.110:0/4277148858 conn(0x7febf8066370 msgr2=0x7febf814b040 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:14.115 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.114+0000 7febfce67700 1 -- 172.21.15.110:0/4277148858 shutdown_connections 2021-03-25T14:16:14.115 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.115+0000 7febfce67700 1 -- 172.21.15.110:0/4277148858 wait complete. 2021-03-25T14:16:14.117 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs_data_ec' created 2021-03-25T14:16:14.130 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2021-03-25T14:16:14.249 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.248+0000 7ff9818f0700 1 Processor -- start 2021-03-25T14:16:14.249 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.248+0000 7ff9818f0700 1 -- start start 2021-03-25T14:16:14.252 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.249+0000 7ff9818f0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff97c0b6e10 0x7ff97c0ba950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:14.252 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.249+0000 7ff9818f0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff97c067190 0x7ff97c0b73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:14.252 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.249+0000 7ff9818f0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff97c14a770 con 0x7ff97c066570 2021-03-25T14:16:14.252 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.249+0000 7ff9818f0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff97c14a2e0 con 0x7ff97c0b6e10 2021-03-25T14:16:14.252 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.249+0000 7ff9818f0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c068a70 con 0x7ff97c067190 2021-03-25T14:16:14.252 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.249+0000 7ff97a7fc700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff97c0b6e10 0x7ff97c0ba950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:14.252 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.249+0000 7ff97b7fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff97c067190 0x7ff97c0b73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:14.252 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.249+0000 7ff97affd700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7ff97c066570 0x7ff97c0b6700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.110:48130/0 (socket says 172.21.15.110:48130) 2021-03-25T14:16:14.253 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.249+0000 7ff97b7fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff97c067190 0x7ff97c0b73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.110:39928/0 (socket says 172.21.15.110:39928) 2021-03-25T14:16:14.253 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.249+0000 7ff97a7fc700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff97c0b6e10 0x7ff97c0ba950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.110:46178/0 (socket says 172.21.15.110:46178) 2021-03-25T14:16:14.253 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.249+0000 7ff97affd700 1 -- 172.21.15.110:0/789573375 learned_addr learned my addr 172.21.15.110:0/789573375 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:14.253 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.250+0000 7ff97a7fc700 1 -- 172.21.15.110:0/789573375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff97c067190 msgr2=0x7ff97c0b73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:14.253 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.250+0000 7ff97a7fc700 1 --2- 172.21.15.110:0/789573375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff97c067190 0x7ff97c0b73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:14.253 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.250+0000 7ff97a7fc700 1 -- 172.21.15.110:0/789573375 >> v1:172.21.15.174:6789/0 conn(0x7ff97c066570 legacy=0x7ff97c0b6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:14.253 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.250+0000 7ff979ffb700 1 -- 172.21.15.110:0/789573375 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2980755134 0 0) 0x7ff97c14a770 con 0x7ff97c066570 2021-03-25T14:16:14.253 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.250+0000 7ff97a7fc700 1 -- 172.21.15.110:0/789573375 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff97c067c90 con 0x7ff97c0b6e10 2021-03-25T14:16:14.253 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.250+0000 7ff97b7fe700 1 --2- 172.21.15.110:0/789573375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff97c067190 0x7ff97c0b73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:16:14.253 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.250+0000 7ff97a7fc700 1 --2- 172.21.15.110:0/789573375 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff97c0b6e10 0x7ff97c0ba950 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7ff97000b9c0 tx=0x7ff970006e20).ready entity=mon.1 client_cookie=98568f1ed444a3c4 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:14.253 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.250+0000 7ff979ffb700 1 -- 172.21.15.110:0/789573375 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9700097e0 con 0x7ff97c0b6e10 2021-03-25T14:16:14.253 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.250+0000 7ff979ffb700 1 -- 172.21.15.110:0/789573375 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff970009940 con 0x7ff97c0b6e10 2021-03-25T14:16:14.254 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.250+0000 7ff979ffb700 1 -- 172.21.15.110:0/789573375 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff970009cc0 con 0x7ff97c0b6e10 2021-03-25T14:16:14.254 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.250+0000 7ff9818f0700 1 -- 172.21.15.110:0/789573375 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff97c0b6e10 msgr2=0x7ff97c0ba950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:14.254 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.250+0000 7ff9818f0700 1 --2- 172.21.15.110:0/789573375 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff97c0b6e10 0x7ff97c0ba950 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7ff97000b9c0 tx=0x7ff970006e20).stop 2021-03-25T14:16:14.254 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.250+0000 7ff9818f0700 1 -- 172.21.15.110:0/789573375 shutdown_connections 2021-03-25T14:16:14.254 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.250+0000 7ff9818f0700 1 --2- 172.21.15.110:0/789573375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff97c067190 0x7ff97c0b73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:14.254 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.250+0000 7ff9818f0700 1 --2- 172.21.15.110:0/789573375 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff97c0b6e10 0x7ff97c0ba950 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:14.254 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.250+0000 7ff9818f0700 1 -- 172.21.15.110:0/789573375 >> 172.21.15.110:0/789573375 conn(0x7ff97c05c700 msgr2=0x7ff97c063090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:14.254 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.251+0000 7ff9818f0700 1 -- 172.21.15.110:0/789573375 shutdown_connections 2021-03-25T14:16:14.254 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.251+0000 7ff9818f0700 1 -- 172.21.15.110:0/789573375 wait complete. 2021-03-25T14:16:14.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.252+0000 7ff9818f0700 1 Processor -- start 2021-03-25T14:16:14.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.252+0000 7ff9818f0700 1 -- start start 2021-03-25T14:16:14.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.252+0000 7ff9818f0700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff97c066570 0x7ff97c14d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:14.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.252+0000 7ff9818f0700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff97c067190 0x7ff97c0b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:14.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.252+0000 7ff9818f0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff97c0b6e10 0x7ff97c148a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:14.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.252+0000 7ff9818f0700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c0b47a0 con 0x7ff97c066570 2021-03-25T14:16:14.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.252+0000 7ff9818f0700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c14d970 con 0x7ff97c067190 2021-03-25T14:16:14.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.252+0000 7ff9818f0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c0b4990 con 0x7ff97c0b6e10 2021-03-25T14:16:14.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.252+0000 7ff97affd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff97c066570 0x7ff97c14d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:14.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.253+0000 7ff97affd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff97c066570 0x7ff97c14d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47532/0 (socket says 172.21.15.110:47532) 2021-03-25T14:16:14.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.253+0000 7ff97affd700 1 -- 172.21.15.110:0/3560290531 learned_addr learned my addr 172.21.15.110:0/3560290531 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:14.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.253+0000 7ff97b7fe700 1 --2- 172.21.15.110:0/3560290531 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff97c0b6e10 0x7ff97c148a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:14.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.253+0000 7ff97a7fc700 1 --2- 172.21.15.110:0/3560290531 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff97c067190 0x7ff97c0b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:14.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.253+0000 7ff97affd700 1 -- 172.21.15.110:0/3560290531 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff97c0b6e10 msgr2=0x7ff97c148a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:14.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.253+0000 7ff97affd700 1 --2- 172.21.15.110:0/3560290531 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff97c0b6e10 0x7ff97c148a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:14.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.253+0000 7ff97affd700 1 -- 172.21.15.110:0/3560290531 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff97c067190 msgr2=0x7ff97c0b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:14.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.253+0000 7ff97affd700 1 --2- 172.21.15.110:0/3560290531 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff97c067190 0x7ff97c0b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:14.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.253+0000 7ff97affd700 1 -- 172.21.15.110:0/3560290531 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff97c0b4c30 con 0x7ff97c066570 2021-03-25T14:16:14.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.253+0000 7ff97affd700 1 --2- 172.21.15.110:0/3560290531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff97c066570 0x7ff97c14d480 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7ff96c00c790 tx=0x7ff96c007cc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:14.259 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.253+0000 7ff962ffd700 1 -- 172.21.15.110:0/3560290531 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96c0072e0 con 0x7ff97c066570 2021-03-25T14:16:14.259 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.253+0000 7ff962ffd700 1 -- 172.21.15.110:0/3560290531 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96c007440 con 0x7ff97c066570 2021-03-25T14:16:14.259 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.253+0000 7ff9818f0700 1 -- 172.21.15.110:0/3560290531 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff97c0b4ed0 con 0x7ff97c066570 2021-03-25T14:16:14.259 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.253+0000 7ff962ffd700 1 -- 172.21.15.110:0/3560290531 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96c005850 con 0x7ff97c066570 2021-03-25T14:16:14.259 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.253+0000 7ff9818f0700 1 -- 172.21.15.110:0/3560290531 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff97c14d1a0 con 0x7ff97c066570 2021-03-25T14:16:14.259 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.254+0000 7ff9818f0700 1 -- 172.21.15.110:0/3560290531 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff97c0b5330 con 0x7ff97c066570 2021-03-25T14:16:14.259 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.254+0000 7ff962ffd700 1 -- 172.21.15.110:0/3560290531 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7ff96c010070 con 0x7ff97c066570 2021-03-25T14:16:14.259 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.255+0000 7ff962ffd700 1 --2- 172.21.15.110:0/3560290531 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff95c05a0b0 0x7ff95c05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:14.259 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.255+0000 7ff962ffd700 1 -- 172.21.15.110:0/3560290531 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6793+0+0 (secure 0 0 0) 0x7ff96c073690 con 0x7ff97c066570 2021-03-25T14:16:14.259 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.255+0000 7ff97a7fc700 1 --2- 172.21.15.110:0/3560290531 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff95c05a0b0 0x7ff95c05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:14.259 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.255+0000 7ff97a7fc700 1 --2- 172.21.15.110:0/3560290531 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff95c05a0b0 0x7ff95c05c570 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7ff970007fd0 tx=0x7ff970016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:14.260 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.259+0000 7ff962ffd700 1 -- 172.21.15.110:0/3560290531 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7ff96c046d60 con 0x7ff97c066570 2021-03-25T14:16:14.410 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:14.409+0000 7ff9818f0700 1 -- 172.21.15.110:0/3560290531 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7ff97c05d7b0 con 0x7ff97c066570 2021-03-25T14:16:15.112 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.111+0000 7ff962ffd700 1 -- 172.21.15.110:0/3560290531 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff96c04a380 con 0x7ff97c066570 2021-03-25T14:16:15.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.117+0000 7ff9818f0700 1 -- 172.21.15.110:0/3560290531 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff95c05a0b0 msgr2=0x7ff95c05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:15.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.117+0000 7ff9818f0700 1 --2- 172.21.15.110:0/3560290531 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff95c05a0b0 0x7ff95c05c570 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7ff970007fd0 tx=0x7ff970016000).stop 2021-03-25T14:16:15.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.117+0000 7ff9818f0700 1 -- 172.21.15.110:0/3560290531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff97c066570 msgr2=0x7ff97c14d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:15.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.117+0000 7ff9818f0700 1 --2- 172.21.15.110:0/3560290531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff97c066570 0x7ff97c14d480 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7ff96c00c790 tx=0x7ff96c007cc0).stop 2021-03-25T14:16:15.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.118+0000 7ff9818f0700 1 -- 172.21.15.110:0/3560290531 shutdown_connections 2021-03-25T14:16:15.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.118+0000 7ff9818f0700 1 --2- 172.21.15.110:0/3560290531 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff95c05a0b0 0x7ff95c05c570 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:15.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.118+0000 7ff9818f0700 1 --2- 172.21.15.110:0/3560290531 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff97c0b6e10 0x7ff97c148a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:15.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.118+0000 7ff9818f0700 1 --2- 172.21.15.110:0/3560290531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff97c066570 0x7ff97c14d480 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:15.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.118+0000 7ff9818f0700 1 --2- 172.21.15.110:0/3560290531 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff97c067190 0x7ff97c0b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:15.120 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.118+0000 7ff9818f0700 1 -- 172.21.15.110:0/3560290531 >> 172.21.15.110:0/3560290531 conn(0x7ff97c05c700 msgr2=0x7ff97c149810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:15.120 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.118+0000 7ff9818f0700 1 -- 172.21.15.110:0/3560290531 shutdown_connections 2021-03-25T14:16:15.120 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.118+0000 7ff9818f0700 1 -- 172.21.15.110:0/3560290531 wait complete. 2021-03-25T14:16:15.120 INFO:teuthology.orchestra.run.smithi110.stderr:set pool 5 allow_ec_overwrites to true 2021-03-25T14:16:15.132 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2021-03-25T14:16:15.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.245+0000 7f2a757c7700 1 Processor -- start 2021-03-25T14:16:15.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.245+0000 7f2a757c7700 1 -- start start 2021-03-25T14:16:15.253 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.246+0000 7f2a757c7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2a700b0cc0 0x7f2a70145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:15.253 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.246+0000 7f2a757c7700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a70149c50 con 0x7f2a700648a0 2021-03-25T14:16:15.253 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.246+0000 7f2a757c7700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a701461b0 con 0x7f2a700b5d00 2021-03-25T14:16:15.253 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.246+0000 7f2a757c7700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a70067960 con 0x7f2a700b0cc0 2021-03-25T14:16:15.253 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.246+0000 7f2a6f7fe700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f2a700648a0 0x7f2a7009db40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:40476/0 (socket says 172.21.15.110:40476) 2021-03-25T14:16:15.254 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.246+0000 7f2a6f7fe700 1 -- 172.21.15.110:0/232676572 learned_addr learned my addr 172.21.15.110:0/232676572 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:15.254 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.246+0000 7f2a6dffb700 1 -- 172.21.15.110:0/232676572 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 568577626 0 0) 0x7f2a70149c50 con 0x7f2a700648a0 2021-03-25T14:16:15.254 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.246+0000 7f2a6effd700 1 --2- 172.21.15.110:0/232676572 >> v2:172.21.15.174:3300/0 conn(0x7f2a700b0cc0 0x7f2a70145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:15.254 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.246+0000 7f2a6dffb700 1 -- 172.21.15.110:0/232676572 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a5c003270 con 0x7f2a700648a0 2021-03-25T14:16:15.254 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.246+0000 7f2a6dffb700 1 -- 172.21.15.110:0/232676572 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2355514542 0 0) 0x7f2a5c003270 con 0x7f2a700648a0 2021-03-25T14:16:15.254 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.247+0000 7f2a6dffb700 1 -- 172.21.15.110:0/232676572 >> v2:172.21.15.174:3300/0 conn(0x7f2a700b0cc0 msgr2=0x7f2a70145cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:15.254 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.247+0000 7f2a6dffb700 1 --2- 172.21.15.110:0/232676572 >> v2:172.21.15.174:3300/0 conn(0x7f2a700b0cc0 0x7f2a70145cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:15.254 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.247+0000 7f2a6dffb700 1 -- 172.21.15.110:0/232676572 >> v1:172.21.15.174:6789/0 conn(0x7f2a700b5d00 legacy=0x7f2a70067250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:15.254 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.247+0000 7f2a6dffb700 1 -- 172.21.15.110:0/232676572 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a70149e80 con 0x7f2a700648a0 2021-03-25T14:16:15.254 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.247+0000 7f2a6dffb700 1 -- 172.21.15.110:0/232676572 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f2a680018a0 con 0x7f2a700648a0 2021-03-25T14:16:15.254 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.247+0000 7f2a6dffb700 1 -- 172.21.15.110:0/232676572 >> v1:172.21.15.110:6789/0 conn(0x7f2a700648a0 legacy=0x7f2a7009db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:15.254 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.247+0000 7f2a6dffb700 1 --2- 172.21.15.110:0/232676572 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a5c003760 0x7f2a5c003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:15.255 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.247+0000 7f2a6dffb700 1 --2- 172.21.15.110:0/232676572 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a5c004510 0x7f2a5c004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:15.255 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.247+0000 7f2a6dffb700 1 --2- 172.21.15.110:0/232676572 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a5c004e80 0x7f2a5c00b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:15.255 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.247+0000 7f2a6dffb700 1 -- 172.21.15.110:0/232676572 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a70067960 con 0x7f2a5c004510 2021-03-25T14:16:15.255 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.247+0000 7f2a6dffb700 1 -- 172.21.15.110:0/232676572 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c004290 con 0x7f2a5c003760 2021-03-25T14:16:15.255 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.247+0000 7f2a6dffb700 1 -- 172.21.15.110:0/232676572 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c00bc50 con 0x7f2a5c004e80 2021-03-25T14:16:15.255 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.247+0000 7f2a6e7fc700 1 --2- 172.21.15.110:0/232676572 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a5c004510 0x7f2a5c004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:15.255 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.247+0000 7f2a6effd700 1 --2- 172.21.15.110:0/232676572 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a5c003760 0x7f2a5c003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:15.255 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.247+0000 7f2a6f7fe700 1 --2- 172.21.15.110:0/232676572 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a5c004e80 0x7f2a5c00b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:15.255 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.247+0000 7f2a6e7fc700 1 -- 172.21.15.110:0/232676572 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a5c004e80 msgr2=0x7f2a5c00b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:15.255 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.247+0000 7f2a6e7fc700 1 --2- 172.21.15.110:0/232676572 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a5c004e80 0x7f2a5c00b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:15.255 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.247+0000 7f2a6e7fc700 1 -- 172.21.15.110:0/232676572 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a5c003760 msgr2=0x7f2a5c003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:15.255 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.247+0000 7f2a6e7fc700 1 --2- 172.21.15.110:0/232676572 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a5c003760 0x7f2a5c003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:15.256 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.247+0000 7f2a6e7fc700 1 -- 172.21.15.110:0/232676572 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a5c003270 con 0x7f2a5c004510 2021-03-25T14:16:15.256 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.247+0000 7f2a6f7fe700 1 --2- 172.21.15.110:0/232676572 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a5c004e80 0x7f2a5c00b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:15.256 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.247+0000 7f2a6f7fe700 1 -- 172.21.15.110:0/232676572 reap_dead start 2021-03-25T14:16:15.256 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.247+0000 7f2a6e7fc700 1 --2- 172.21.15.110:0/232676572 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a5c004510 0x7f2a5c004990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f2a64001960 tx=0x7f2a64007bc0).ready entity=mon.0 client_cookie=eed29e9b500f328f server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:15.256 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.247+0000 7f2a6dffb700 1 -- 172.21.15.110:0/232676572 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a64007020 con 0x7f2a5c004510 2021-03-25T14:16:15.256 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.247+0000 7f2a6dffb700 1 -- 172.21.15.110:0/232676572 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a64007180 con 0x7f2a5c004510 2021-03-25T14:16:15.256 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.247+0000 7f2a6dffb700 1 -- 172.21.15.110:0/232676572 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6400c860 con 0x7f2a5c004510 2021-03-25T14:16:15.256 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.248+0000 7f2a757c7700 1 -- 172.21.15.110:0/232676572 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a5c004510 msgr2=0x7f2a5c004990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:15.256 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.248+0000 7f2a757c7700 1 --2- 172.21.15.110:0/232676572 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a5c004510 0x7f2a5c004990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f2a64001960 tx=0x7f2a64007bc0).stop 2021-03-25T14:16:15.256 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.248+0000 7f2a757c7700 1 -- 172.21.15.110:0/232676572 shutdown_connections 2021-03-25T14:16:15.256 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.248+0000 7f2a757c7700 1 --2- 172.21.15.110:0/232676572 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a5c004510 0x7f2a5c004990 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:15.256 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.248+0000 7f2a757c7700 1 -- 172.21.15.110:0/232676572 >> 172.21.15.110:0/232676572 conn(0x7f2a700664e0 msgr2=0x7f2a700668f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:15.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.248+0000 7f2a757c7700 1 -- 172.21.15.110:0/232676572 shutdown_connections 2021-03-25T14:16:15.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.248+0000 7f2a757c7700 1 -- 172.21.15.110:0/232676572 wait complete. 2021-03-25T14:16:15.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.249+0000 7f2a757c7700 1 Processor -- start 2021-03-25T14:16:15.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.249+0000 7f2a757c7700 1 -- start start 2021-03-25T14:16:15.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.250+0000 7f2a757c7700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a5c004510 0x7f2a700b5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:15.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.250+0000 7f2a757c7700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a70158680 0x7f2a700b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:15.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.250+0000 7f2a757c7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a70145b90 0x7f2a701544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:15.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.250+0000 7f2a757c7700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a700b4f30 con 0x7f2a70158680 2021-03-25T14:16:15.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.250+0000 7f2a757c7700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a70157a40 con 0x7f2a5c004510 2021-03-25T14:16:15.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.250+0000 7f2a757c7700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a700b5a20 con 0x7f2a70145b90 2021-03-25T14:16:15.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.250+0000 7f2a6e7fc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a70158680 0x7f2a700b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:15.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.250+0000 7f2a6e7fc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a70158680 0x7f2a700b39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47552/0 (socket says 172.21.15.110:47552) 2021-03-25T14:16:15.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.250+0000 7f2a6e7fc700 1 -- 172.21.15.110:0/597795593 learned_addr learned my addr 172.21.15.110:0/597795593 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:15.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.250+0000 7f2a6effd700 1 --2- 172.21.15.110:0/597795593 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a5c004510 0x7f2a700b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:15.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.250+0000 7f2a6f7fe700 1 --2- 172.21.15.110:0/597795593 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a70145b90 0x7f2a701544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:15.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.250+0000 7f2a6e7fc700 1 -- 172.21.15.110:0/597795593 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a70145b90 msgr2=0x7f2a701544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:15.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.250+0000 7f2a6e7fc700 1 --2- 172.21.15.110:0/597795593 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a70145b90 0x7f2a701544f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:15.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.250+0000 7f2a6e7fc700 1 -- 172.21.15.110:0/597795593 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a5c004510 msgr2=0x7f2a700b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:15.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.250+0000 7f2a6e7fc700 1 --2- 172.21.15.110:0/597795593 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a5c004510 0x7f2a700b5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:15.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.250+0000 7f2a6e7fc700 1 -- 172.21.15.110:0/597795593 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a70157ca0 con 0x7f2a70158680 2021-03-25T14:16:15.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.250+0000 7f2a6effd700 1 --2- 172.21.15.110:0/597795593 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a5c004510 0x7f2a700b5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:15.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.250+0000 7f2a6f7fe700 1 --2- 172.21.15.110:0/597795593 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a70145b90 0x7f2a701544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:15.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.250+0000 7f2a6e7fc700 1 --2- 172.21.15.110:0/597795593 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a70158680 0x7f2a700b39b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f2a5c005450 tx=0x7f2a64015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:15.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.251+0000 7f2a56ffd700 1 -- 172.21.15.110:0/597795593 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a64013cc0 con 0x7f2a70158680 2021-03-25T14:16:15.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.251+0000 7f2a56ffd700 1 -- 172.21.15.110:0/597795593 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a64013e20 con 0x7f2a70158680 2021-03-25T14:16:15.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.251+0000 7f2a56ffd700 1 -- 172.21.15.110:0/597795593 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a640206b0 con 0x7f2a70158680 2021-03-25T14:16:15.259 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.251+0000 7f2a757c7700 1 -- 172.21.15.110:0/597795593 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a70157f40 con 0x7f2a70158680 2021-03-25T14:16:15.259 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.251+0000 7f2a757c7700 1 -- 172.21.15.110:0/597795593 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a7008fc30 con 0x7f2a70158680 2021-03-25T14:16:15.259 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.252+0000 7f2a757c7700 1 -- 172.21.15.110:0/597795593 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a7005d7b0 con 0x7f2a70158680 2021-03-25T14:16:15.259 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.252+0000 7f2a56ffd700 1 -- 172.21.15.110:0/597795593 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f2a64010030 con 0x7f2a70158680 2021-03-25T14:16:15.260 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.253+0000 7f2a56ffd700 1 --2- 172.21.15.110:0/597795593 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f2a5005e4c0 0x7f2a50060980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:15.260 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.253+0000 7f2a56ffd700 1 -- 172.21.15.110:0/597795593 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f2a64075640 con 0x7f2a70158680 2021-03-25T14:16:15.260 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.253+0000 7f2a6effd700 1 --2- 172.21.15.110:0/597795593 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f2a5005e4c0 0x7f2a50060980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:15.260 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.254+0000 7f2a6effd700 1 --2- 172.21.15.110:0/597795593 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f2a5005e4c0 0x7f2a50060980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f2a60006d30 tx=0x7f2a60008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:15.260 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.260+0000 7f2a56ffd700 1 -- 172.21.15.110:0/597795593 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f2a64048c90 con 0x7f2a70158680 2021-03-25T14:16:15.446 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.445+0000 7f2a757c7700 1 -- 172.21.15.110:0/597795593 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f2a700b7810 con 0x7f2a70158680 2021-03-25T14:16:15.450 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.449+0000 7f2a56ffd700 1 -- 172.21.15.110:0/597795593 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v8) v1 ==== 137+0+0 (secure 0 0 0) 0x7f2a64025020 con 0x7f2a70158680 2021-03-25T14:16:15.452 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.451+0000 7f2a757c7700 1 -- 172.21.15.110:0/597795593 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f2a5005e4c0 msgr2=0x7f2a50060980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:15.453 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.451+0000 7f2a757c7700 1 --2- 172.21.15.110:0/597795593 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f2a5005e4c0 0x7f2a50060980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f2a60006d30 tx=0x7f2a60008040).stop 2021-03-25T14:16:15.453 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.451+0000 7f2a757c7700 1 -- 172.21.15.110:0/597795593 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a70158680 msgr2=0x7f2a700b39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:15.453 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.451+0000 7f2a757c7700 1 --2- 172.21.15.110:0/597795593 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a70158680 0x7f2a700b39b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f2a5c005450 tx=0x7f2a64015000).stop 2021-03-25T14:16:15.453 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.451+0000 7f2a757c7700 1 -- 172.21.15.110:0/597795593 shutdown_connections 2021-03-25T14:16:15.453 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.451+0000 7f2a757c7700 1 --2- 172.21.15.110:0/597795593 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f2a5005e4c0 0x7f2a50060980 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:15.453 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.451+0000 7f2a757c7700 1 --2- 172.21.15.110:0/597795593 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a5c004510 0x7f2a700b5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:15.453 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.451+0000 7f2a757c7700 1 --2- 172.21.15.110:0/597795593 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a70145b90 0x7f2a701544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:15.453 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.451+0000 7f2a757c7700 1 --2- 172.21.15.110:0/597795593 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a70158680 0x7f2a700b39b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:15.453 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.451+0000 7f2a757c7700 1 -- 172.21.15.110:0/597795593 >> 172.21.15.110:0/597795593 conn(0x7f2a700664e0 msgr2=0x7f2a70146360 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:15.453 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.451+0000 7f2a757c7700 1 -- 172.21.15.110:0/597795593 shutdown_connections 2021-03-25T14:16:15.453 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.451+0000 7f2a757c7700 1 -- 172.21.15.110:0/597795593 wait complete. 2021-03-25T14:16:15.454 INFO:teuthology.orchestra.run.smithi110.stderr:added data pool 5 to fsmap 2021-03-25T14:16:15.463 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-03-25T14:16:15.573 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.571+0000 7f94285b6700 1 Processor -- start 2021-03-25T14:16:15.573 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.572+0000 7f94285b6700 1 -- start start 2021-03-25T14:16:15.581 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.572+0000 7f94285b6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f94200b1720 0x7f9420149cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:15.581 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.572+0000 7f94285b6700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9420067510 con 0x7f94200b1340 2021-03-25T14:16:15.581 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.572+0000 7f94285b6700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94200677b0 con 0x7f942014a1e0 2021-03-25T14:16:15.581 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.572+0000 7f94285b6700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9420067a50 con 0x7f94200b1720 2021-03-25T14:16:15.581 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.573+0000 7f9426352700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f94200b1340 0x7f9420066420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:40494/0 (socket says 172.21.15.110:40494) 2021-03-25T14:16:15.581 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.573+0000 7f9426352700 1 -- 172.21.15.110:0/2013904839 learned_addr learned my addr 172.21.15.110:0/2013904839 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:15.581 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.573+0000 7f9425b51700 1 --2- 172.21.15.110:0/2013904839 >> v2:172.21.15.174:3300/0 conn(0x7f94200b1720 0x7f9420149cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:15.581 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.573+0000 7f9425350700 1 -- 172.21.15.110:0/2013904839 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3954130618 0 0) 0x7f9420067510 con 0x7f94200b1340 2021-03-25T14:16:15.581 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.573+0000 7f9425350700 1 -- 172.21.15.110:0/2013904839 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9408003270 con 0x7f94200b1340 2021-03-25T14:16:15.581 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.573+0000 7f9425350700 1 -- 172.21.15.110:0/2013904839 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1430503570 0 0) 0x7f9408003270 con 0x7f94200b1340 2021-03-25T14:16:15.582 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.573+0000 7f9425350700 1 -- 172.21.15.110:0/2013904839 >> v2:172.21.15.174:3300/0 conn(0x7f94200b1720 msgr2=0x7f9420149cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:15.582 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.573+0000 7f9425350700 1 --2- 172.21.15.110:0/2013904839 >> v2:172.21.15.174:3300/0 conn(0x7f94200b1720 0x7f9420149cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:15.582 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.573+0000 7f9425350700 1 -- 172.21.15.110:0/2013904839 >> v1:172.21.15.174:6789/0 conn(0x7f942014a1e0 legacy=0x7f942014cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:15.582 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.573+0000 7f9425350700 1 -- 172.21.15.110:0/2013904839 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9420067cf0 con 0x7f94200b1340 2021-03-25T14:16:15.582 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.573+0000 7f9425350700 1 -- 172.21.15.110:0/2013904839 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f941c001520 con 0x7f94200b1340 2021-03-25T14:16:15.582 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.573+0000 7f9425350700 1 -- 172.21.15.110:0/2013904839 >> v1:172.21.15.110:6789/0 conn(0x7f94200b1340 legacy=0x7f9420066420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:15.582 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.573+0000 7f9425350700 1 --2- 172.21.15.110:0/2013904839 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9408003790 0x7f9408003bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:15.582 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.573+0000 7f9425350700 1 --2- 172.21.15.110:0/2013904839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9408004510 0x7f9408004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:15.582 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.573+0000 7f9425350700 1 --2- 172.21.15.110:0/2013904839 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9408004e80 0x7f940800b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:15.582 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.573+0000 7f9425350700 1 -- 172.21.15.110:0/2013904839 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9420067a50 con 0x7f9408004510 2021-03-25T14:16:15.582 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.573+0000 7f9425350700 1 -- 172.21.15.110:0/2013904839 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94080042c0 con 0x7f9408003790 2021-03-25T14:16:15.583 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.573+0000 7f9425350700 1 -- 172.21.15.110:0/2013904839 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f940800bc50 con 0x7f9408004e80 2021-03-25T14:16:15.583 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.573+0000 7f9425b51700 1 --2- 172.21.15.110:0/2013904839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9408004510 0x7f9408004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:15.583 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.573+0000 7f9426352700 1 --2- 172.21.15.110:0/2013904839 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9408003790 0x7f9408003bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:15.583 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.573+0000 7f9426b53700 1 --2- 172.21.15.110:0/2013904839 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9408004e80 0x7f940800b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:15.583 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.573+0000 7f9425b51700 1 -- 172.21.15.110:0/2013904839 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9408004e80 msgr2=0x7f940800b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:15.583 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.573+0000 7f9425b51700 1 --2- 172.21.15.110:0/2013904839 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9408004e80 0x7f940800b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:15.583 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.573+0000 7f9425b51700 1 -- 172.21.15.110:0/2013904839 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9408003790 msgr2=0x7f9408003bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:15.583 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.573+0000 7f9425b51700 1 --2- 172.21.15.110:0/2013904839 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9408003790 0x7f9408003bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:15.583 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.573+0000 7f9425b51700 1 -- 172.21.15.110:0/2013904839 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9408003270 con 0x7f9408004510 2021-03-25T14:16:15.583 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.573+0000 7f9426b53700 1 -- 172.21.15.110:0/2013904839 reap_dead start 2021-03-25T14:16:15.583 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.573+0000 7f9426352700 1 --2- 172.21.15.110:0/2013904839 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9408003790 0x7f9408003bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:15.583 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.574+0000 7f9425b51700 1 --2- 172.21.15.110:0/2013904839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9408004510 0x7f9408004990 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f941000bc60 tx=0x7f9410006e20).ready entity=mon.0 client_cookie=d8aa78a05d046ea1 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:15.583 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.574+0000 7f9425350700 1 -- 172.21.15.110:0/2013904839 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941000be70 con 0x7f9408004510 2021-03-25T14:16:15.584 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.574+0000 7f9425350700 1 -- 172.21.15.110:0/2013904839 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941000b310 con 0x7f9408004510 2021-03-25T14:16:15.584 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.574+0000 7f9425350700 1 -- 172.21.15.110:0/2013904839 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941000ee70 con 0x7f9408004510 2021-03-25T14:16:15.584 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.574+0000 7f94285b6700 1 -- 172.21.15.110:0/2013904839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9408004510 msgr2=0x7f9408004990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:15.584 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.574+0000 7f94285b6700 1 --2- 172.21.15.110:0/2013904839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9408004510 0x7f9408004990 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f941000bc60 tx=0x7f9410006e20).stop 2021-03-25T14:16:15.584 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.574+0000 7f94285b6700 1 -- 172.21.15.110:0/2013904839 shutdown_connections 2021-03-25T14:16:15.584 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.574+0000 7f94285b6700 1 --2- 172.21.15.110:0/2013904839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9408004510 0x7f9408004990 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:15.584 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.574+0000 7f94285b6700 1 -- 172.21.15.110:0/2013904839 >> 172.21.15.110:0/2013904839 conn(0x7f94200649a0 msgr2=0x7f942005c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:15.584 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.574+0000 7f94285b6700 1 -- 172.21.15.110:0/2013904839 shutdown_connections 2021-03-25T14:16:15.584 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.574+0000 7f94285b6700 1 -- 172.21.15.110:0/2013904839 wait complete. 2021-03-25T14:16:15.584 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.575+0000 7f94285b6700 1 Processor -- start 2021-03-25T14:16:15.584 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.575+0000 7f94285b6700 1 -- start start 2021-03-25T14:16:15.584 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.576+0000 7f94285b6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9408004510 0x7f94200b3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:15.585 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.576+0000 7f94285b6700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94201439a0 0x7f942014ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:15.585 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.576+0000 7f94285b6700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94201441f0 0x7f9420144650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:15.585 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.576+0000 7f94285b6700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94201463d0 con 0x7f94201441f0 2021-03-25T14:16:15.585 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.576+0000 7f94285b6700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9420158d60 con 0x7f94201439a0 2021-03-25T14:16:15.585 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.576+0000 7f94285b6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9420159e00 con 0x7f9408004510 2021-03-25T14:16:15.585 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.576+0000 7f9426b53700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94201441f0 0x7f9420144650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:15.585 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.576+0000 7f9426b53700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94201441f0 0x7f9420144650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47572/0 (socket says 172.21.15.110:47572) 2021-03-25T14:16:15.585 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.576+0000 7f9426b53700 1 -- 172.21.15.110:0/3121355170 learned_addr learned my addr 172.21.15.110:0/3121355170 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:15.585 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.576+0000 7f9426352700 1 --2- 172.21.15.110:0/3121355170 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9408004510 0x7f94200b3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:15.585 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.576+0000 7f9425b51700 1 --2- 172.21.15.110:0/3121355170 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94201439a0 0x7f942014ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:15.585 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.576+0000 7f9426b53700 1 -- 172.21.15.110:0/3121355170 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9408004510 msgr2=0x7f94200b3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:15.585 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.576+0000 7f9426b53700 1 --2- 172.21.15.110:0/3121355170 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9408004510 0x7f94200b3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:15.585 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.576+0000 7f9426b53700 1 -- 172.21.15.110:0/3121355170 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94201439a0 msgr2=0x7f942014ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:15.586 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.576+0000 7f9426b53700 1 --2- 172.21.15.110:0/3121355170 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94201439a0 0x7f942014ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:15.586 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.576+0000 7f9426b53700 1 -- 172.21.15.110:0/3121355170 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9420159b60 con 0x7f94201441f0 2021-03-25T14:16:15.586 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.576+0000 7f9426b53700 1 --2- 172.21.15.110:0/3121355170 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94201441f0 0x7f9420144650 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f9420067030 tx=0x7f9418009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:15.586 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.577+0000 7f940e7fc700 1 -- 172.21.15.110:0/3121355170 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9418003280 con 0x7f94201441f0 2021-03-25T14:16:15.586 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.577+0000 7f940e7fc700 1 -- 172.21.15.110:0/3121355170 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94180033e0 con 0x7f94201441f0 2021-03-25T14:16:15.586 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.577+0000 7f94285b6700 1 -- 172.21.15.110:0/3121355170 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9420146a50 con 0x7f94201441f0 2021-03-25T14:16:15.586 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.577+0000 7f940e7fc700 1 -- 172.21.15.110:0/3121355170 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9418001790 con 0x7f94201441f0 2021-03-25T14:16:15.586 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.577+0000 7f94285b6700 1 -- 172.21.15.110:0/3121355170 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f942014f020 con 0x7f94201441f0 2021-03-25T14:16:15.587 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.577+0000 7f94285b6700 1 -- 172.21.15.110:0/3121355170 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9420146be0 con 0x7f94201441f0 2021-03-25T14:16:15.587 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.578+0000 7f940e7fc700 1 -- 172.21.15.110:0/3121355170 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f9418001b00 con 0x7f94201441f0 2021-03-25T14:16:15.587 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.578+0000 7f940e7fc700 1 --2- 172.21.15.110:0/3121355170 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f940005a0b0 0x7f940005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:15.587 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.578+0000 7f940e7fc700 1 -- 172.21.15.110:0/3121355170 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f9418073950 con 0x7f94201441f0 2021-03-25T14:16:15.587 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.578+0000 7f9426352700 1 --2- 172.21.15.110:0/3121355170 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f940005a0b0 0x7f940005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:15.587 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.578+0000 7f9426352700 1 --2- 172.21.15.110:0/3121355170 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f940005a0b0 0x7f940005c570 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f941c0014b0 tx=0x7f9420067940).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:15.588 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.582+0000 7f940e7fc700 1 -- 172.21.15.110:0/3121355170 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f9418046620 con 0x7f94201441f0 2021-03-25T14:16:15.767 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.766+0000 7f94285b6700 1 -- 172.21.15.110:0/3121355170 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9420146e70 con 0x7f94201441f0 2021-03-25T14:16:15.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.767+0000 7f940e7fc700 1 -- 172.21.15.110:0/3121355170 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2846 (secure 0 0 0) 0x7f9418047000 con 0x7f94201441f0 2021-03-25T14:16:15.768 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:16:15.768 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1177985428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6833","nonce":1177985428},{"type":"v1","addr":"172.21.15.174:6835","nonce":1177985428}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.110:6836/3814723779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3814723779},{"type":"v1","addr":"172.21.15.110:6836","nonce":3814723779}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":4},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1613822797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1613822797},{"type":"v1","addr":"172.21.15.110:6837","nonce":1613822797}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-03-25T14:16:11.090720+0000","modified":"2021-03-25T14:16:15.446832+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"b","rank":0,"incarnation":5,"state":"up:active","state_seq":4,"addr":"172.21.15.174:6834/1564441351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1564441351},{"type":"v1","addr":"172.21.15.174:6834","nonce":1564441351}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2021-03-25T14:16:15.770 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.768+0000 7f94285b6700 1 -- 172.21.15.110:0/3121355170 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f940005a0b0 msgr2=0x7f940005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:15.770 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.768+0000 7f94285b6700 1 --2- 172.21.15.110:0/3121355170 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f940005a0b0 0x7f940005c570 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f941c0014b0 tx=0x7f9420067940).stop 2021-03-25T14:16:15.770 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.768+0000 7f94285b6700 1 -- 172.21.15.110:0/3121355170 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94201441f0 msgr2=0x7f9420144650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:15.770 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.768+0000 7f94285b6700 1 --2- 172.21.15.110:0/3121355170 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94201441f0 0x7f9420144650 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f9420067030 tx=0x7f9418009040).stop 2021-03-25T14:16:15.770 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.769+0000 7f94285b6700 1 -- 172.21.15.110:0/3121355170 shutdown_connections 2021-03-25T14:16:15.770 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.769+0000 7f94285b6700 1 --2- 172.21.15.110:0/3121355170 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f940005a0b0 0x7f940005c570 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:15.770 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.769+0000 7f94285b6700 1 --2- 172.21.15.110:0/3121355170 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94201441f0 0x7f9420144650 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:15.770 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.769+0000 7f94285b6700 1 --2- 172.21.15.110:0/3121355170 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9408004510 0x7f94200b3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:15.770 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.769+0000 7f94285b6700 1 --2- 172.21.15.110:0/3121355170 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94201439a0 0x7f942014ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:15.770 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.769+0000 7f94285b6700 1 -- 172.21.15.110:0/3121355170 >> 172.21.15.110:0/3121355170 conn(0x7f94200649a0 msgr2=0x7f9420142bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:15.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.769+0000 7f94285b6700 1 -- 172.21.15.110:0/3121355170 shutdown_connections 2021-03-25T14:16:15.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.769+0000 7f94285b6700 1 -- 172.21.15.110:0/3121355170 wait complete. 2021-03-25T14:16:15.771 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 8 2021-03-25T14:16:15.781 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:16:15.890 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.889+0000 7fd51db6d700 1 Processor -- start 2021-03-25T14:16:15.890 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.889+0000 7fd51db6d700 1 -- start start 2021-03-25T14:16:15.893 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.890+0000 7fd51db6d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd5180ba4f0 0x7fd518148fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:15.893 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.890+0000 7fd51db6d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd51814a050 0x7fd5180a3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:15.893 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.890+0000 7fd51db6d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5180ba950 con 0x7fd5180b99b0 2021-03-25T14:16:15.893 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.890+0000 7fd51db6d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5181494b0 con 0x7fd5180ba4f0 2021-03-25T14:16:15.893 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.890+0000 7fd51db6d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd51814a4e0 con 0x7fd51814a050 2021-03-25T14:16:15.893 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.890+0000 7fd516ffd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd5180ba4f0 0x7fd518148fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:15.893 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.890+0000 7fd517fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd51814a050 0x7fd5180a3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:15.894 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.890+0000 7fd516ffd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd5180ba4f0 0x7fd518148fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.110:46230/0 (socket says 172.21.15.110:46230) 2021-03-25T14:16:15.894 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.890+0000 7fd516ffd700 1 -- 172.21.15.110:0/1725651699 learned_addr learned my addr 172.21.15.110:0/1725651699 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:15.894 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.890+0000 7fd5177fe700 1 --1- 172.21.15.110:0/1725651699 >> v1:172.21.15.174:6789/0 conn(0x7fd5180b99b0 0x7fd5181488b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.110:48180/0 (socket says 172.21.15.110:48180) 2021-03-25T14:16:15.894 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.891+0000 7fd517fff700 1 -- 172.21.15.110:0/1725651699 >> v2:172.21.15.174:3300/0 conn(0x7fd5180ba4f0 msgr2=0x7fd518148fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:15.894 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.891+0000 7fd517fff700 1 --2- 172.21.15.110:0/1725651699 >> v2:172.21.15.174:3300/0 conn(0x7fd5180ba4f0 0x7fd518148fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:15.894 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.891+0000 7fd517fff700 1 -- 172.21.15.110:0/1725651699 >> v1:172.21.15.174:6789/0 conn(0x7fd5180b99b0 legacy=0x7fd5181488b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:15.894 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.891+0000 7fd517fff700 1 -- 172.21.15.110:0/1725651699 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5180babc0 con 0x7fd51814a050 2021-03-25T14:16:15.894 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.891+0000 7fd517fff700 1 --2- 172.21.15.110:0/1725651699 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd51814a050 0x7fd5180a3190 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fd510009cc0 tx=0x7fd510009220).ready entity=mon.2 client_cookie=dff3d8a8045e506b server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:15.894 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.891+0000 7fd5167fc700 1 -- 172.21.15.110:0/1725651699 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51000baa0 con 0x7fd51814a050 2021-03-25T14:16:15.894 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.891+0000 7fd5167fc700 1 -- 172.21.15.110:0/1725651699 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51000bc00 con 0x7fd51814a050 2021-03-25T14:16:15.894 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.891+0000 7fd5167fc700 1 -- 172.21.15.110:0/1725651699 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd510011400 con 0x7fd51814a050 2021-03-25T14:16:15.895 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.891+0000 7fd51db6d700 1 -- 172.21.15.110:0/1725651699 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd51814a050 msgr2=0x7fd5180a3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:15.895 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.891+0000 7fd51db6d700 1 --2- 172.21.15.110:0/1725651699 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd51814a050 0x7fd5180a3190 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fd510009cc0 tx=0x7fd510009220).stop 2021-03-25T14:16:15.895 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.891+0000 7fd51db6d700 1 -- 172.21.15.110:0/1725651699 shutdown_connections 2021-03-25T14:16:15.895 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.891+0000 7fd51db6d700 1 --2- 172.21.15.110:0/1725651699 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd51814a050 0x7fd5180a3190 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:15.895 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.891+0000 7fd51db6d700 1 --2- 172.21.15.110:0/1725651699 >> v2:172.21.15.174:3300/0 conn(0x7fd5180ba4f0 0x7fd518148fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:15.895 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.891+0000 7fd51db6d700 1 -- 172.21.15.110:0/1725651699 >> 172.21.15.110:0/1725651699 conn(0x7fd518060c40 msgr2=0x7fd518061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:15.895 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.892+0000 7fd51db6d700 1 -- 172.21.15.110:0/1725651699 shutdown_connections 2021-03-25T14:16:15.895 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.892+0000 7fd51db6d700 1 -- 172.21.15.110:0/1725651699 wait complete. 2021-03-25T14:16:15.898 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.893+0000 7fd51db6d700 1 Processor -- start 2021-03-25T14:16:15.898 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.893+0000 7fd51db6d700 1 -- start start 2021-03-25T14:16:15.898 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.893+0000 7fd51db6d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5180b99b0 0x7fd5180bdca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:15.898 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.893+0000 7fd51db6d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5180ba4f0 0x7fd5180b7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:15.898 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.893+0000 7fd51db6d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd51814a050 0x7fd5180b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:15.898 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.893+0000 7fd51db6d700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5180b7ef0 con 0x7fd5180b99b0 2021-03-25T14:16:15.898 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.893+0000 7fd51db6d700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd518064b70 con 0x7fd51814a050 2021-03-25T14:16:15.898 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.893+0000 7fd51db6d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd518064e10 con 0x7fd5180ba4f0 2021-03-25T14:16:15.899 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.893+0000 7fd5177fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5180b99b0 0x7fd5180bdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:15.899 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.894+0000 7fd5177fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5180b99b0 0x7fd5180bdca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47588/0 (socket says 172.21.15.110:47588) 2021-03-25T14:16:15.899 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.894+0000 7fd5177fe700 1 -- 172.21.15.110:0/2713766882 learned_addr learned my addr 172.21.15.110:0/2713766882 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:15.899 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.894+0000 7fd516ffd700 1 --2- 172.21.15.110:0/2713766882 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5180ba4f0 0x7fd5180b7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:15.899 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.894+0000 7fd517fff700 1 --2- 172.21.15.110:0/2713766882 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd51814a050 0x7fd5180b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:15.899 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.894+0000 7fd5177fe700 1 -- 172.21.15.110:0/2713766882 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5180ba4f0 msgr2=0x7fd5180b7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:15.899 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.894+0000 7fd5177fe700 1 --2- 172.21.15.110:0/2713766882 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5180ba4f0 0x7fd5180b7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:15.899 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.894+0000 7fd5177fe700 1 -- 172.21.15.110:0/2713766882 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd51814a050 msgr2=0x7fd5180b4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:15.899 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.894+0000 7fd5177fe700 1 --2- 172.21.15.110:0/2713766882 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd51814a050 0x7fd5180b4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:15.899 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.894+0000 7fd5177fe700 1 -- 172.21.15.110:0/2713766882 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5180650b0 con 0x7fd5180b99b0 2021-03-25T14:16:15.899 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.894+0000 7fd5177fe700 1 --2- 172.21.15.110:0/2713766882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5180b99b0 0x7fd5180bdca0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fd50800c6e0 tx=0x7fd508007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:15.899 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.894+0000 7fd4ff7fe700 1 -- 172.21.15.110:0/2713766882 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5080072e0 con 0x7fd5180b99b0 2021-03-25T14:16:15.900 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.894+0000 7fd4ff7fe700 1 -- 172.21.15.110:0/2713766882 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd508007440 con 0x7fd5180b99b0 2021-03-25T14:16:15.900 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.894+0000 7fd4ff7fe700 1 -- 172.21.15.110:0/2713766882 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5080057c0 con 0x7fd5180b99b0 2021-03-25T14:16:15.900 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.894+0000 7fd51db6d700 1 -- 172.21.15.110:0/2713766882 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd518065350 con 0x7fd5180b99b0 2021-03-25T14:16:15.900 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.894+0000 7fd51db6d700 1 -- 172.21.15.110:0/2713766882 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5180b7b80 con 0x7fd5180b99b0 2021-03-25T14:16:15.900 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.895+0000 7fd51db6d700 1 -- 172.21.15.110:0/2713766882 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd51805d7b0 con 0x7fd5180b99b0 2021-03-25T14:16:15.900 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.895+0000 7fd4ff7fe700 1 -- 172.21.15.110:0/2713766882 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fd508010070 con 0x7fd5180b99b0 2021-03-25T14:16:15.900 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.895+0000 7fd4ff7fe700 1 --2- 172.21.15.110:0/2713766882 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd4f805a0e0 0x7fd4f805c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:15.900 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.896+0000 7fd4ff7fe700 1 -- 172.21.15.110:0/2713766882 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fd5080735d0 con 0x7fd5180b99b0 2021-03-25T14:16:15.900 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.896+0000 7fd516ffd700 1 --2- 172.21.15.110:0/2713766882 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd4f805a0e0 0x7fd4f805c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:15.900 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.896+0000 7fd516ffd700 1 --2- 172.21.15.110:0/2713766882 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd4f805a0e0 0x7fd4f805c5a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fd5180be480 tx=0x7fd50c008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:15.901 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:15.899+0000 7fd4ff7fe700 1 -- 172.21.15.110:0/2713766882 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fd508046c80 con 0x7fd5180b99b0 2021-03-25T14:16:16.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.049+0000 7fd51db6d700 1 -- 172.21.15.110:0/2713766882 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5180a4000 con 0x7fd5180b99b0 2021-03-25T14:16:16.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.050+0000 7fd4ff7fe700 1 -- 172.21.15.110:0/2713766882 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18685 (secure 0 0 0) 0x7fd508018020 con 0x7fd5180b99b0 2021-03-25T14:16:16.051 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:16:16.051 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":25,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:16:15.446609+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-03-25T14:16:09.478442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-03-25T14:16:10.071152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2021-03-25T14:16:13.122119+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:16:16.052 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.051+0000 7fd51db6d700 1 -- 172.21.15.110:0/2713766882 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd4f805a0e0 msgr2=0x7fd4f805c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:16.052 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.051+0000 7fd51db6d700 1 --2- 172.21.15.110:0/2713766882 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd4f805a0e0 0x7fd4f805c5a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fd5180be480 tx=0x7fd50c008040).stop 2021-03-25T14:16:16.052 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.051+0000 7fd51db6d700 1 -- 172.21.15.110:0/2713766882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5180b99b0 msgr2=0x7fd5180bdca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:16.052 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.051+0000 7fd51db6d700 1 --2- 172.21.15.110:0/2713766882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5180b99b0 0x7fd5180bdca0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fd50800c6e0 tx=0x7fd508007c20).stop 2021-03-25T14:16:16.053 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.051+0000 7fd51db6d700 1 -- 172.21.15.110:0/2713766882 shutdown_connections 2021-03-25T14:16:16.053 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.051+0000 7fd51db6d700 1 --2- 172.21.15.110:0/2713766882 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd4f805a0e0 0x7fd4f805c5a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:16.053 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.051+0000 7fd51db6d700 1 --2- 172.21.15.110:0/2713766882 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd51814a050 0x7fd5180b4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:16.053 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.051+0000 7fd51db6d700 1 --2- 172.21.15.110:0/2713766882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5180b99b0 0x7fd5180bdca0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:16.053 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.051+0000 7fd51db6d700 1 --2- 172.21.15.110:0/2713766882 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5180ba4f0 0x7fd5180b7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:16.053 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.051+0000 7fd51db6d700 1 -- 172.21.15.110:0/2713766882 >> 172.21.15.110:0/2713766882 conn(0x7fd518060c40 msgr2=0x7fd518147b00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:16.053 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.051+0000 7fd51db6d700 1 -- 172.21.15.110:0/2713766882 shutdown_connections 2021-03-25T14:16:16.053 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.051+0000 7fd51db6d700 1 -- 172.21.15.110:0/2713766882 wait complete. 2021-03-25T14:16:16.065 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:16:16.176 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.175+0000 7fd000def700 1 Processor -- start 2021-03-25T14:16:16.176 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.175+0000 7fd000def700 1 -- start start 2021-03-25T14:16:16.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.176+0000 7fd000def700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcffc069050 0x7fcffc146650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:16.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.176+0000 7fd000def700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcffc063410 0x7fcffc0638a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:16.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.176+0000 7fd000def700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcffc067050 con 0x7fcffc0b0b60 2021-03-25T14:16:16.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.176+0000 7fd000def700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcffc0694b0 con 0x7fcffc069050 2021-03-25T14:16:16.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.176+0000 7fd000def700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc146b40 con 0x7fcffc063410 2021-03-25T14:16:16.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.176+0000 7fcffb7fe700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fcffc0b0b60 0x7fcffc068940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:40528/0 (socket says 172.21.15.110:40528) 2021-03-25T14:16:16.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.176+0000 7fcffb7fe700 1 -- 172.21.15.110:0/2235158564 learned_addr learned my addr 172.21.15.110:0/2235158564 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:16.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.176+0000 7fcffaffd700 1 --2- 172.21.15.110:0/2235158564 >> v2:172.21.15.174:3300/0 conn(0x7fcffc069050 0x7fcffc146650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:16.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.176+0000 7fcffbfff700 1 --2- 172.21.15.110:0/2235158564 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcffc063410 0x7fcffc0638a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:16.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.176+0000 7fcffa7fc700 1 -- 172.21.15.110:0/2235158564 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3232523205 0 0) 0x7fcffc067050 con 0x7fcffc0b0b60 2021-03-25T14:16:16.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.176+0000 7fcffa7fc700 1 -- 172.21.15.110:0/2235158564 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfe8003270 con 0x7fcffc0b0b60 2021-03-25T14:16:16.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.176+0000 7fcffa7fc700 1 -- 172.21.15.110:0/2235158564 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2061744337 0 0) 0x7fcfe8003270 con 0x7fcffc0b0b60 2021-03-25T14:16:16.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.176+0000 7fcffa7fc700 1 -- 172.21.15.110:0/2235158564 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcffc063410 msgr2=0x7fcffc0638a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:16.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.176+0000 7fcffa7fc700 1 --2- 172.21.15.110:0/2235158564 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcffc063410 0x7fcffc0638a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:16.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.176+0000 7fcffa7fc700 1 -- 172.21.15.110:0/2235158564 >> v2:172.21.15.174:3300/0 conn(0x7fcffc069050 msgr2=0x7fcffc146650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:16.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.176+0000 7fcffa7fc700 1 --2- 172.21.15.110:0/2235158564 >> v2:172.21.15.174:3300/0 conn(0x7fcffc069050 0x7fcffc146650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:16.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.176+0000 7fcffa7fc700 1 -- 172.21.15.110:0/2235158564 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcffc0b7490 con 0x7fcffc0b0b60 2021-03-25T14:16:16.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.176+0000 7fcffa7fc700 1 -- 172.21.15.110:0/2235158564 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7fcfec001520 con 0x7fcffc0b0b60 2021-03-25T14:16:16.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.176+0000 7fcffaffd700 1 --2- 172.21.15.110:0/2235158564 >> v2:172.21.15.174:3300/0 conn(0x7fcffc069050 0x7fcffc146650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:16:16.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.176+0000 7fcffa7fc700 1 -- 172.21.15.110:0/2235158564 >> v1:172.21.15.110:6789/0 conn(0x7fcffc0b0b60 legacy=0x7fcffc068940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:16.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.176+0000 7fcffa7fc700 1 --2- 172.21.15.110:0/2235158564 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfe8003760 0x7fcfe8003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:16.185 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.177+0000 7fcffa7fc700 1 --2- 172.21.15.110:0/2235158564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcfe8004510 0x7fcfe8004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:16.185 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.177+0000 7fcffa7fc700 1 --2- 172.21.15.110:0/2235158564 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcffc063410 0x7fcfe8004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:16.185 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.177+0000 7fcffa7fc700 1 -- 172.21.15.110:0/2235158564 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc0694b0 con 0x7fcfe8003760 2021-03-25T14:16:16.185 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.177+0000 7fcffa7fc700 1 -- 172.21.15.110:0/2235158564 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc146b40 con 0x7fcfe8004510 2021-03-25T14:16:16.185 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.177+0000 7fcffa7fc700 1 -- 172.21.15.110:0/2235158564 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe80042a0 con 0x7fcffc063410 2021-03-25T14:16:16.185 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.177+0000 7fcffb7fe700 1 --2- 172.21.15.110:0/2235158564 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfe8003760 0x7fcfe8003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:16.185 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.177+0000 7fcffaffd700 1 --2- 172.21.15.110:0/2235158564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcfe8004510 0x7fcfe8004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:16.185 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.177+0000 7fcffbfff700 1 --2- 172.21.15.110:0/2235158564 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcffc063410 0x7fcfe8004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:16.185 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.177+0000 7fcffb7fe700 1 -- 172.21.15.110:0/2235158564 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcffc063410 msgr2=0x7fcfe8004e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:16.185 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.177+0000 7fcffb7fe700 1 --2- 172.21.15.110:0/2235158564 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcffc063410 0x7fcfe8004e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:16.185 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.177+0000 7fcffb7fe700 1 -- 172.21.15.110:0/2235158564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcfe8004510 msgr2=0x7fcfe8004990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:16.185 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.177+0000 7fcffb7fe700 1 --2- 172.21.15.110:0/2235158564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcfe8004510 0x7fcfe8004990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:16.185 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.177+0000 7fcffb7fe700 1 -- 172.21.15.110:0/2235158564 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe8003270 con 0x7fcfe8003760 2021-03-25T14:16:16.186 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.177+0000 7fcffaffd700 1 --2- 172.21.15.110:0/2235158564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcfe8004510 0x7fcfe8004990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:16.186 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.177+0000 7fcffb7fe700 1 --2- 172.21.15.110:0/2235158564 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfe8003760 0x7fcfe8003b80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fcfec00c440 tx=0x7fcfec007830).ready entity=mon.0 client_cookie=315ae2c64651d6ce server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:16.186 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.177+0000 7fcffa7fc700 1 -- 172.21.15.110:0/2235158564 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec00ce20 con 0x7fcfe8003760 2021-03-25T14:16:16.186 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.177+0000 7fcffa7fc700 1 -- 172.21.15.110:0/2235158564 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfec0072e0 con 0x7fcfe8003760 2021-03-25T14:16:16.186 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.177+0000 7fcffa7fc700 1 -- 172.21.15.110:0/2235158564 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec005850 con 0x7fcfe8003760 2021-03-25T14:16:16.186 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.178+0000 7fd000def700 1 -- 172.21.15.110:0/2235158564 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfe8003760 msgr2=0x7fcfe8003b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:16.186 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.178+0000 7fd000def700 1 --2- 172.21.15.110:0/2235158564 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfe8003760 0x7fcfe8003b80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fcfec00c440 tx=0x7fcfec007830).stop 2021-03-25T14:16:16.186 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.178+0000 7fcffbfff700 1 -- 172.21.15.110:0/2235158564 reap_dead start 2021-03-25T14:16:16.186 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.178+0000 7fd000def700 1 -- 172.21.15.110:0/2235158564 shutdown_connections 2021-03-25T14:16:16.186 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.178+0000 7fd000def700 1 -- 172.21.15.110:0/2235158564 >> 172.21.15.110:0/2235158564 conn(0x7fcffc066350 msgr2=0x7fcffc066760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:16.186 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.178+0000 7fd000def700 1 -- 172.21.15.110:0/2235158564 shutdown_connections 2021-03-25T14:16:16.186 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.178+0000 7fd000def700 1 -- 172.21.15.110:0/2235158564 wait complete. 2021-03-25T14:16:16.186 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.179+0000 7fd000def700 1 Processor -- start 2021-03-25T14:16:16.187 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.179+0000 7fd000def700 1 -- start start 2021-03-25T14:16:16.187 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.179+0000 7fd000def700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfe8003760 0x7fcffc148310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:16.187 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.179+0000 7fd000def700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcffc0a0dd0 0x7fcffc0b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:16.187 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.180+0000 7fd000def700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcffc0a1390 0x7fcffc1441a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:16.187 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.180+0000 7fd000def700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc141a30 con 0x7fcffc0a1390 2021-03-25T14:16:16.187 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.180+0000 7fd000def700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc0b3eb0 con 0x7fcffc0a0dd0 2021-03-25T14:16:16.187 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.180+0000 7fd000def700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc1491d0 con 0x7fcfe8003760 2021-03-25T14:16:16.187 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.180+0000 7fcffbfff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcffc0a1390 0x7fcffc1441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:16.187 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.180+0000 7fcffbfff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcffc0a1390 0x7fcffc1441a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47608/0 (socket says 172.21.15.110:47608) 2021-03-25T14:16:16.187 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.180+0000 7fcffbfff700 1 -- 172.21.15.110:0/1281079777 learned_addr learned my addr 172.21.15.110:0/1281079777 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:16.187 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.180+0000 7fcffb7fe700 1 --2- 172.21.15.110:0/1281079777 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfe8003760 0x7fcffc148310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:16.187 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.180+0000 7fcffaffd700 1 --2- 172.21.15.110:0/1281079777 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcffc0a0dd0 0x7fcffc0b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:16.188 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.180+0000 7fcffbfff700 1 -- 172.21.15.110:0/1281079777 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfe8003760 msgr2=0x7fcffc148310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:16.188 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.180+0000 7fcffbfff700 1 --2- 172.21.15.110:0/1281079777 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfe8003760 0x7fcffc148310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:16.188 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.180+0000 7fcffbfff700 1 -- 172.21.15.110:0/1281079777 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcffc0a0dd0 msgr2=0x7fcffc0b57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:16.188 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.180+0000 7fcffbfff700 1 --2- 172.21.15.110:0/1281079777 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcffc0a0dd0 0x7fcffc0b57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:16.188 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.180+0000 7fcffbfff700 1 -- 172.21.15.110:0/1281079777 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcffc1489f0 con 0x7fcffc0a1390 2021-03-25T14:16:16.188 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.180+0000 7fcffaffd700 1 --2- 172.21.15.110:0/1281079777 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcffc0a0dd0 0x7fcffc0b57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:16.188 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.180+0000 7fcffbfff700 1 --2- 172.21.15.110:0/1281079777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcffc0a1390 0x7fcffc1441a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fcffc0bc870 tx=0x7fcff4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:16.188 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.180+0000 7fcfe37fe700 1 -- 172.21.15.110:0/1281079777 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff4015690 con 0x7fcffc0a1390 2021-03-25T14:16:16.188 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.180+0000 7fcfe37fe700 1 -- 172.21.15.110:0/1281079777 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff40157f0 con 0x7fcffc0a1390 2021-03-25T14:16:16.188 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.180+0000 7fd000def700 1 -- 172.21.15.110:0/1281079777 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcffc148c90 con 0x7fcffc0a1390 2021-03-25T14:16:16.188 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.180+0000 7fcfe37fe700 1 -- 172.21.15.110:0/1281079777 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff4015b90 con 0x7fcffc0a1390 2021-03-25T14:16:16.188 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.180+0000 7fd000def700 1 -- 172.21.15.110:0/1281079777 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcffc147bd0 con 0x7fcffc0a1390 2021-03-25T14:16:16.188 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.181+0000 7fd000def700 1 -- 172.21.15.110:0/1281079777 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcffc067700 con 0x7fcffc0a1390 2021-03-25T14:16:16.189 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.181+0000 7fcfe37fe700 1 -- 172.21.15.110:0/1281079777 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fcff4012040 con 0x7fcffc0a1390 2021-03-25T14:16:16.189 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.182+0000 7fcfe37fe700 1 --2- 172.21.15.110:0/1281079777 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fcfdc05a0b0 0x7fcfdc05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:16.189 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.182+0000 7fcfe37fe700 1 -- 172.21.15.110:0/1281079777 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fcff40743e0 con 0x7fcffc0a1390 2021-03-25T14:16:16.189 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.182+0000 7fcffb7fe700 1 --2- 172.21.15.110:0/1281079777 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fcfdc05a0b0 0x7fcfdc05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:16.189 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.182+0000 7fcffb7fe700 1 --2- 172.21.15.110:0/1281079777 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fcfdc05a0b0 0x7fcfdc05c570 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fcfec00c440 tx=0x7fcfec015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:16.189 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.185+0000 7fcfe37fe700 1 -- 172.21.15.110:0/1281079777 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fcff4047a90 con 0x7fcffc0a1390 2021-03-25T14:16:16.337 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.336+0000 7fd000def700 1 -- 172.21.15.110:0/1281079777 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcffc045ae0 con 0x7fcffc0a1390 2021-03-25T14:16:16.338 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.337+0000 7fcfe37fe700 1 -- 172.21.15.110:0/1281079777 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18685 (secure 0 0 0) 0x7fcff404b0b0 con 0x7fcffc0a1390 2021-03-25T14:16:16.339 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:16:16.339 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":25,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:16:15.446609+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-03-25T14:16:09.478442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-03-25T14:16:10.071152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2021-03-25T14:16:13.122119+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:16:16.340 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.339+0000 7fd000def700 1 -- 172.21.15.110:0/1281079777 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fcfdc05a0b0 msgr2=0x7fcfdc05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:16.340 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.339+0000 7fd000def700 1 --2- 172.21.15.110:0/1281079777 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fcfdc05a0b0 0x7fcfdc05c570 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fcfec00c440 tx=0x7fcfec015000).stop 2021-03-25T14:16:16.340 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.339+0000 7fd000def700 1 -- 172.21.15.110:0/1281079777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcffc0a1390 msgr2=0x7fcffc1441a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:16.341 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.339+0000 7fd000def700 1 --2- 172.21.15.110:0/1281079777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcffc0a1390 0x7fcffc1441a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fcffc0bc870 tx=0x7fcff4008040).stop 2021-03-25T14:16:16.341 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.339+0000 7fd000def700 1 -- 172.21.15.110:0/1281079777 shutdown_connections 2021-03-25T14:16:16.341 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.339+0000 7fd000def700 1 --2- 172.21.15.110:0/1281079777 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fcfdc05a0b0 0x7fcfdc05c570 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:16.341 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.339+0000 7fd000def700 1 --2- 172.21.15.110:0/1281079777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcffc0a1390 0x7fcffc1441a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:16.341 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.339+0000 7fd000def700 1 --2- 172.21.15.110:0/1281079777 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfe8003760 0x7fcffc148310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:16.341 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.339+0000 7fd000def700 1 --2- 172.21.15.110:0/1281079777 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcffc0a0dd0 0x7fcffc0b57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:16.341 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.339+0000 7fd000def700 1 -- 172.21.15.110:0/1281079777 >> 172.21.15.110:0/1281079777 conn(0x7fcffc066350 msgr2=0x7fcffc068710 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:16.341 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.339+0000 7fd000def700 1 -- 172.21.15.110:0/1281079777 shutdown_connections 2021-03-25T14:16:16.341 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.339+0000 7fd000def700 1 -- 172.21.15.110:0/1281079777 wait complete. 2021-03-25T14:16:16.371 DEBUG:teuthology.orchestra.run.smithi110:> ceph fs ls 2021-03-25T14:16:16.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.470+0000 7f6d9ccb9700 1 Processor -- start 2021-03-25T14:16:16.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.470+0000 7f6d9ccb9700 1 -- start start 2021-03-25T14:16:16.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.471+0000 7f6d9ccb9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6d98067790 0x7f6d9814b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:16.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.471+0000 7f6d9ccb9700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d9814cd00 con 0x7f6d98068d80 2021-03-25T14:16:16.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.471+0000 7f6d9ccb9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d9814dbb0 con 0x7f6d980673b0 2021-03-25T14:16:16.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.471+0000 7f6d9ccb9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d9814cf30 con 0x7f6d98067790 2021-03-25T14:16:16.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.471+0000 7f6d96d9d700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f6d98068d80 0x7f6d98149bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:40552/0 (socket says 172.21.15.110:40552) 2021-03-25T14:16:16.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.471+0000 7f6d96d9d700 1 -- 172.21.15.110:0/2906614262 learned_addr learned my addr 172.21.15.110:0/2906614262 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:16.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.471+0000 7f6d8ffff700 1 --2- 172.21.15.110:0/2906614262 >> v2:172.21.15.174:3300/0 conn(0x7f6d98067790 0x7f6d9814b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:16.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.471+0000 7f6d95d9b700 1 -- 172.21.15.110:0/2906614262 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1525787954 0 0) 0x7f6d9814cd00 con 0x7f6d98068d80 2021-03-25T14:16:16.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.471+0000 7f6d95d9b700 1 -- 172.21.15.110:0/2906614262 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d78003270 con 0x7f6d98068d80 2021-03-25T14:16:16.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.472+0000 7f6d95d9b700 1 -- 172.21.15.110:0/2906614262 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1100562277 0 0) 0x7f6d78003270 con 0x7f6d98068d80 2021-03-25T14:16:16.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.472+0000 7f6d95d9b700 1 -- 172.21.15.110:0/2906614262 >> v2:172.21.15.174:3300/0 conn(0x7f6d98067790 msgr2=0x7f6d9814b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:16.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.472+0000 7f6d95d9b700 1 --2- 172.21.15.110:0/2906614262 >> v2:172.21.15.174:3300/0 conn(0x7f6d98067790 0x7f6d9814b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:16.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.472+0000 7f6d95d9b700 1 -- 172.21.15.110:0/2906614262 >> v1:172.21.15.174:6789/0 conn(0x7f6d980673b0 legacy=0x7f6d9814ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:16.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.472+0000 7f6d95d9b700 1 -- 172.21.15.110:0/2906614262 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d9814d1d0 con 0x7f6d98068d80 2021-03-25T14:16:16.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.472+0000 7f6d95d9b700 1 -- 172.21.15.110:0/2906614262 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f6d900018a0 con 0x7f6d98068d80 2021-03-25T14:16:16.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.472+0000 7f6d95d9b700 1 -- 172.21.15.110:0/2906614262 >> v1:172.21.15.110:6789/0 conn(0x7f6d98068d80 legacy=0x7f6d98149bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:16.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.472+0000 7f6d95d9b700 1 --2- 172.21.15.110:0/2906614262 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d78003760 0x7f6d78003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:16.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.472+0000 7f6d95d9b700 1 --2- 172.21.15.110:0/2906614262 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6d78004510 0x7f6d78004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:16.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.472+0000 7f6d95d9b700 1 --2- 172.21.15.110:0/2906614262 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d78004e80 0x7f6d7800b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:16.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.472+0000 7f6d95d9b700 1 -- 172.21.15.110:0/2906614262 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9814cf30 con 0x7f6d78004e80 2021-03-25T14:16:16.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.472+0000 7f6d95d9b700 1 -- 172.21.15.110:0/2906614262 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d78005390 con 0x7f6d78003760 2021-03-25T14:16:16.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.472+0000 7f6d95d9b700 1 -- 172.21.15.110:0/2906614262 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d7800bc80 con 0x7f6d78004510 2021-03-25T14:16:16.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.472+0000 7f6d96d9d700 1 --2- 172.21.15.110:0/2906614262 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d78004e80 0x7f6d7800b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:16.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.472+0000 7f6d9659c700 1 --2- 172.21.15.110:0/2906614262 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d78003760 0x7f6d78003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:16.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.472+0000 7f6d8ffff700 1 --2- 172.21.15.110:0/2906614262 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6d78004510 0x7f6d78004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:16.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.472+0000 7f6d96d9d700 1 -- 172.21.15.110:0/2906614262 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6d78004510 msgr2=0x7f6d78004990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:16.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.472+0000 7f6d96d9d700 1 --2- 172.21.15.110:0/2906614262 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6d78004510 0x7f6d78004990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:16.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.472+0000 7f6d96d9d700 1 -- 172.21.15.110:0/2906614262 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d78003760 msgr2=0x7f6d78003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:16.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.472+0000 7f6d96d9d700 1 --2- 172.21.15.110:0/2906614262 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d78003760 0x7f6d78003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:16.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.472+0000 7f6d96d9d700 1 -- 172.21.15.110:0/2906614262 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d78003270 con 0x7f6d78004e80 2021-03-25T14:16:16.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.472+0000 7f6d8ffff700 1 --2- 172.21.15.110:0/2906614262 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6d78004510 0x7f6d78004990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:16.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.472+0000 7f6d96d9d700 1 -- 172.21.15.110:0/2906614262 reap_dead start 2021-03-25T14:16:16.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.472+0000 7f6d96d9d700 1 --2- 172.21.15.110:0/2906614262 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d78004e80 0x7f6d7800b760 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f6d9000c830 tx=0x7f6d90007b80).ready entity=mon.0 client_cookie=98e658f6121e017d server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:16.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.472+0000 7f6d95d9b700 1 -- 172.21.15.110:0/2906614262 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d90005bb0 con 0x7f6d78004e80 2021-03-25T14:16:16.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.472+0000 7f6d95d9b700 1 -- 172.21.15.110:0/2906614262 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d90005d10 con 0x7f6d78004e80 2021-03-25T14:16:16.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.472+0000 7f6d95d9b700 1 -- 172.21.15.110:0/2906614262 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d900072e0 con 0x7f6d78004e80 2021-03-25T14:16:16.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.473+0000 7f6d9ccb9700 1 -- 172.21.15.110:0/2906614262 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d78004e80 msgr2=0x7f6d7800b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:16.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.473+0000 7f6d9ccb9700 1 --2- 172.21.15.110:0/2906614262 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d78004e80 0x7f6d7800b760 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f6d9000c830 tx=0x7f6d90007b80).stop 2021-03-25T14:16:16.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.473+0000 7f6d9ccb9700 1 -- 172.21.15.110:0/2906614262 shutdown_connections 2021-03-25T14:16:16.488 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.473+0000 7f6d9ccb9700 1 --2- 172.21.15.110:0/2906614262 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d78004e80 0x7f6d7800b760 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:16.488 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.473+0000 7f6d9ccb9700 1 -- 172.21.15.110:0/2906614262 >> 172.21.15.110:0/2906614262 conn(0x7f6d98060de0 msgr2=0x7f6d980611f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:16.488 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.473+0000 7f6d9ccb9700 1 -- 172.21.15.110:0/2906614262 shutdown_connections 2021-03-25T14:16:16.488 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.473+0000 7f6d9ccb9700 1 -- 172.21.15.110:0/2906614262 wait complete. 2021-03-25T14:16:16.488 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.474+0000 7f6d9ccb9700 1 Processor -- start 2021-03-25T14:16:16.488 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.474+0000 7f6d9ccb9700 1 -- start start 2021-03-25T14:16:16.488 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.474+0000 7f6d9ccb9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6d78004e80 0x7f6d980b57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:16.488 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.475+0000 7f6d9ccb9700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d98159990 0x7f6d98146300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:16.488 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.475+0000 7f6d9ccb9700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d980ba7f0 0x7f6d980b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:16.488 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.475+0000 7f6d9ccb9700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d980b4860 con 0x7f6d98159990 2021-03-25T14:16:16.488 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.475+0000 7f6d9ccb9700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d980b4e10 con 0x7f6d980ba7f0 2021-03-25T14:16:16.488 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.475+0000 7f6d9ccb9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d980b50b0 con 0x7f6d78004e80 2021-03-25T14:16:16.489 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.475+0000 7f6d8ffff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d98159990 0x7f6d98146300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:16.489 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.475+0000 7f6d8ffff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d98159990 0x7f6d98146300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47626/0 (socket says 172.21.15.110:47626) 2021-03-25T14:16:16.489 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.475+0000 7f6d8ffff700 1 -- 172.21.15.110:0/2126544221 learned_addr learned my addr 172.21.15.110:0/2126544221 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:16.489 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.475+0000 7f6d9659c700 1 --2- 172.21.15.110:0/2126544221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6d78004e80 0x7f6d980b57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:16.489 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.475+0000 7f6d96d9d700 1 --2- 172.21.15.110:0/2126544221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d980ba7f0 0x7f6d980b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:16.489 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.475+0000 7f6d8ffff700 1 -- 172.21.15.110:0/2126544221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6d78004e80 msgr2=0x7f6d980b57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:16.489 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.475+0000 7f6d8ffff700 1 --2- 172.21.15.110:0/2126544221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6d78004e80 0x7f6d980b57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:16.489 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.475+0000 7f6d8ffff700 1 -- 172.21.15.110:0/2126544221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d980ba7f0 msgr2=0x7f6d980b3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:16.489 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.475+0000 7f6d8ffff700 1 --2- 172.21.15.110:0/2126544221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d980ba7f0 0x7f6d980b3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:16.489 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.475+0000 7f6d8ffff700 1 -- 172.21.15.110:0/2126544221 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d980b5350 con 0x7f6d98159990 2021-03-25T14:16:16.489 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.475+0000 7f6d96d9d700 1 --2- 172.21.15.110:0/2126544221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d980ba7f0 0x7f6d980b3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:16.489 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.475+0000 7f6d8ffff700 1 --2- 172.21.15.110:0/2126544221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d98159990 0x7f6d98146300 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f6d800109f0 tx=0x7f6d80008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:16.489 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.475+0000 7f6d8e7fc700 1 -- 172.21.15.110:0/2126544221 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d80010ee0 con 0x7f6d98159990 2021-03-25T14:16:16.490 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.475+0000 7f6d8e7fc700 1 -- 172.21.15.110:0/2126544221 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8000e960 con 0x7f6d98159990 2021-03-25T14:16:16.490 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.475+0000 7f6d9ccb9700 1 -- 172.21.15.110:0/2126544221 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d981467f0 con 0x7f6d98159990 2021-03-25T14:16:16.490 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.475+0000 7f6d8e7fc700 1 -- 172.21.15.110:0/2126544221 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8000ece0 con 0x7f6d98159990 2021-03-25T14:16:16.490 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.475+0000 7f6d9ccb9700 1 -- 172.21.15.110:0/2126544221 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d980bac50 con 0x7f6d98159990 2021-03-25T14:16:16.490 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.476+0000 7f6d9ccb9700 1 -- 172.21.15.110:0/2126544221 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d980baea0 con 0x7f6d98159990 2021-03-25T14:16:16.490 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.476+0000 7f6d8e7fc700 1 -- 172.21.15.110:0/2126544221 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f6d80014680 con 0x7f6d98159990 2021-03-25T14:16:16.490 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.477+0000 7f6d8e7fc700 1 --2- 172.21.15.110:0/2126544221 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6d7c05a0b0 0x7f6d7c05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:16.490 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.477+0000 7f6d8e7fc700 1 -- 172.21.15.110:0/2126544221 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f6d80074400 con 0x7f6d98159990 2021-03-25T14:16:16.490 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.477+0000 7f6d9659c700 1 --2- 172.21.15.110:0/2126544221 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6d7c05a0b0 0x7f6d7c05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:16.490 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.477+0000 7f6d9659c700 1 --2- 172.21.15.110:0/2126544221 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6d7c05a0b0 0x7f6d7c05c570 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f6d88007b90 tx=0x7f6d88007bc0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:16.490 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.481+0000 7f6d8e7fc700 1 -- 172.21.15.110:0/2126544221 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f6d980baea0 con 0x7f6d98159990 2021-03-25T14:16:16.670 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.669+0000 7f6d9ccb9700 1 -- 172.21.15.110:0/2126544221 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6d980b4c70 con 0x7f6d98159990 2021-03-25T14:16:16.670 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.669+0000 7f6d8e7fc700 1 -- 172.21.15.110:0/2126544221 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f6d980b4c70 con 0x7f6d98159990 2021-03-25T14:16:16.670 INFO:teuthology.orchestra.run.smithi110.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2021-03-25T14:16:16.672 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.670+0000 7f6d9ccb9700 1 -- 172.21.15.110:0/2126544221 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6d7c05a0b0 msgr2=0x7f6d7c05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:16.672 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.670+0000 7f6d9ccb9700 1 --2- 172.21.15.110:0/2126544221 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6d7c05a0b0 0x7f6d7c05c570 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f6d88007b90 tx=0x7f6d88007bc0).stop 2021-03-25T14:16:16.672 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.670+0000 7f6d9ccb9700 1 -- 172.21.15.110:0/2126544221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d98159990 msgr2=0x7f6d98146300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:16.672 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.670+0000 7f6d9ccb9700 1 --2- 172.21.15.110:0/2126544221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d98159990 0x7f6d98146300 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f6d800109f0 tx=0x7f6d80008040).stop 2021-03-25T14:16:16.672 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.670+0000 7f6d9ccb9700 1 -- 172.21.15.110:0/2126544221 shutdown_connections 2021-03-25T14:16:16.672 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.670+0000 7f6d9ccb9700 1 --2- 172.21.15.110:0/2126544221 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6d7c05a0b0 0x7f6d7c05c570 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:16.672 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.670+0000 7f6d9ccb9700 1 --2- 172.21.15.110:0/2126544221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d980ba7f0 0x7f6d980b3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:16.672 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.670+0000 7f6d9ccb9700 1 --2- 172.21.15.110:0/2126544221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6d78004e80 0x7f6d980b57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:16.673 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.670+0000 7f6d9ccb9700 1 --2- 172.21.15.110:0/2126544221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d98159990 0x7f6d98146300 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:16.673 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.670+0000 7f6d9ccb9700 1 -- 172.21.15.110:0/2126544221 >> 172.21.15.110:0/2126544221 conn(0x7f6d98060de0 msgr2=0x7f6d98145600 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:16.673 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.671+0000 7f6d9ccb9700 1 -- 172.21.15.110:0/2126544221 shutdown_connections 2021-03-25T14:16:16.673 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:16.671+0000 7f6d9ccb9700 1 -- 172.21.15.110:0/2126544221 wait complete. 2021-03-25T14:16:16.681 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2021-03-25T14:16:16.682 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2021-03-25T14:16:16.682 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi110.front.sepia.ceph.com 2021-03-25T14:16:16.682 INFO:tasks.cephfs.mount:self.client.name = client.admin 2021-03-25T14:16:16.682 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2021-03-25T14:16:16.682 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2021-03-25T14:16:16.682 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2021-03-25T14:16:16.682 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2021-03-25T14:16:16.682 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2021-03-25T14:16:16.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:16.683 DEBUG:teuthology.orchestra.run.smithi110:> ip addr 2021-03-25T14:16:16.698 INFO:teuthology.orchestra.run.smithi110.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2021-03-25T14:16:16.698 INFO:teuthology.orchestra.run.smithi110.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2021-03-25T14:16:16.698 INFO:teuthology.orchestra.run.smithi110.stdout: inet 127.0.0.1/8 scope host lo 2021-03-25T14:16:16.698 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:16:16.699 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 ::1/128 scope host 2021-03-25T14:16:16.699 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:16:16.699 INFO:teuthology.orchestra.run.smithi110.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-03-25T14:16:16.699 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:14 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:16:16.699 INFO:teuthology.orchestra.run.smithi110.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-03-25T14:16:16.700 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:15 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:16:16.700 INFO:teuthology.orchestra.run.smithi110.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-03-25T14:16:16.700 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:34 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:16:16.700 INFO:teuthology.orchestra.run.smithi110.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2021-03-25T14:16:16.700 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:35 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:16:16.700 INFO:teuthology.orchestra.run.smithi110.stdout: inet 172.21.15.110/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2021-03-25T14:16:16.701 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft 42625sec preferred_lft 42625sec 2021-03-25T14:16:16.701 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::ec4:7aff:fe8f:cc35/64 scope link 2021-03-25T14:16:16.701 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:16:16.702 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2021-03-25T14:16:16.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:16.702 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec sudo bash -c ' 2021-03-25T14:16:16.702 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2021-03-25T14:16:16.702 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link add name ceph-brx type bridge 2021-03-25T14:16:16.703 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip addr flush dev ceph-brx 2021-03-25T14:16:16.703 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set ceph-brx up 2021-03-25T14:16:16.703 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2021-03-25T14:16:16.703 DEBUG:teuthology.orchestra.run.smithi110:> ') 2021-03-25T14:16:16.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:16.852 DEBUG:teuthology.orchestra.run.smithi110:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2021-03-25T14:16:16.884 INFO:teuthology.orchestra.run.smithi110.stdout:1 2021-03-25T14:16:16.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:16.885 DEBUG:teuthology.orchestra.run.smithi110:> route 2021-03-25T14:16:16.959 INFO:teuthology.orchestra.run.smithi110.stdout:Kernel IP routing table 2021-03-25T14:16:16.959 INFO:teuthology.orchestra.run.smithi110.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2021-03-25T14:16:16.960 INFO:teuthology.orchestra.run.smithi110.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2021-03-25T14:16:16.960 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2021-03-25T14:16:16.960 INFO:teuthology.orchestra.run.smithi110.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2021-03-25T14:16:16.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:16.961 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec sudo bash -c ' 2021-03-25T14:16:16.961 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2021-03-25T14:16:16.961 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2021-03-25T14:16:16.961 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2021-03-25T14:16:16.962 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2021-03-25T14:16:16.962 DEBUG:teuthology.orchestra.run.smithi110:> ') 2021-03-25T14:16:17.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:17.164 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2021-03-25T14:16:17.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:17.179 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list-id 2021-03-25T14:16:17.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:17.233 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec sudo bash -c ' 2021-03-25T14:16:17.233 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2021-03-25T14:16:17.233 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2021-03-25T14:16:17.233 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2021-03-25T14:16:17.233 DEBUG:teuthology.orchestra.run.smithi110:> ') 2021-03-25T14:16:17.319 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2021-03-25T14:16:17.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:17.319 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec sudo bash -c ' 2021-03-25T14:16:17.319 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2021-03-25T14:16:17.319 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2021-03-25T14:16:17.320 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2021-03-25T14:16:17.320 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2021-03-25T14:16:17.320 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2021-03-25T14:16:17.320 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2021-03-25T14:16:17.320 DEBUG:teuthology.orchestra.run.smithi110:> ') 2021-03-25T14:16:17.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:17.504 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec sudo bash -c ' 2021-03-25T14:16:17.504 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2021-03-25T14:16:17.504 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set brx.0 up 2021-03-25T14:16:17.504 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set dev brx.0 master ceph-brx 2021-03-25T14:16:17.504 DEBUG:teuthology.orchestra.run.smithi110:> ') 2021-03-25T14:16:17.580 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2021-03-25T14:16:17.580 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-03-25T14:16:17.580 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.admin 2021-03-25T14:16:17.596 INFO:teuthology.orchestra.run.smithi110.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2021-03-25T14:16:17.596 DEBUG:teuthology.orchestra.run.smithi110:> sudo modprobe fuse 2021-03-25T14:16:17.699 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-03-25T14:16:17.699 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-03-25T14:16:17.724 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-03-25T14:16:17.724 DEBUG:teuthology.orchestra.run.smithi110:> ls /sys/fs/fuse/connections 2021-03-25T14:16:17.779 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-03-25T14:16:17.779 DEBUG:teuthology.orchestra.run.smithi110:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id admin --client_fs=cephfs /home/ubuntu/cephtest/mnt.admin 2021-03-25T14:16:17.821 DEBUG:teuthology.orchestra.run.smithi110:> sudo modprobe fuse 2021-03-25T14:16:17.845 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-03-25T14:16:17.845 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-03-25T14:16:17.910 INFO:teuthology.orchestra.run.smithi110.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2021-03-25T14:16:17.911 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-03-25T14:16:17.912 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-03-25T14:16:17.912 DEBUG:teuthology.orchestra.run.smithi110:> ls /sys/fs/fuse/connections 2021-03-25T14:16:17.912 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi110.stderr:2021-03-25T14:16:17.911+0000 7fc62cbc9200 -1 init, newargv = 0x55807fbaa900 newargc=15 2021-03-25T14:16:17.913 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi110.stderr:ceph-fuse[41854]: starting ceph client 2021-03-25T14:16:17.918 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi110.stderr:ceph-fuse[41854]: starting fuse 2021-03-25T14:16:17.931 INFO:teuthology.orchestra.run.smithi110.stdout:47 2021-03-25T14:16:17.932 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2021-03-25T14:16:17.932 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-03-25T14:16:17.932 DEBUG:teuthology.orchestra.run.smithi110:> import glob 2021-03-25T14:16:17.932 DEBUG:teuthology.orchestra.run.smithi110:> import re 2021-03-25T14:16:17.932 DEBUG:teuthology.orchestra.run.smithi110:> import os 2021-03-25T14:16:17.932 DEBUG:teuthology.orchestra.run.smithi110:> import subprocess 2021-03-25T14:16:17.932 DEBUG:teuthology.orchestra.run.smithi110:> 2021-03-25T14:16:17.932 DEBUG:teuthology.orchestra.run.smithi110:> def _find_admin_socket(client_name): 2021-03-25T14:16:17.933 DEBUG:teuthology.orchestra.run.smithi110:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2021-03-25T14:16:17.933 DEBUG:teuthology.orchestra.run.smithi110:> files = glob.glob(asok_path) 2021-03-25T14:16:17.933 DEBUG:teuthology.orchestra.run.smithi110:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2021-03-25T14:16:17.933 DEBUG:teuthology.orchestra.run.smithi110:> 2021-03-25T14:16:17.933 DEBUG:teuthology.orchestra.run.smithi110:> # Given a non-glob path, it better be there 2021-03-25T14:16:17.933 DEBUG:teuthology.orchestra.run.smithi110:> if "*" not in asok_path: 2021-03-25T14:16:17.933 DEBUG:teuthology.orchestra.run.smithi110:> assert(len(files) == 1) 2021-03-25T14:16:17.933 DEBUG:teuthology.orchestra.run.smithi110:> return files[0] 2021-03-25T14:16:17.933 DEBUG:teuthology.orchestra.run.smithi110:> 2021-03-25T14:16:17.933 DEBUG:teuthology.orchestra.run.smithi110:> for f in files: 2021-03-25T14:16:17.933 DEBUG:teuthology.orchestra.run.smithi110:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-03-25T14:16:17.933 DEBUG:teuthology.orchestra.run.smithi110:> if os.path.exists("/proc/{0}".format(pid)): 2021-03-25T14:16:17.934 DEBUG:teuthology.orchestra.run.smithi110:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2021-03-25T14:16:17.934 DEBUG:teuthology.orchestra.run.smithi110:> contents = proc_f.read() 2021-03-25T14:16:17.934 DEBUG:teuthology.orchestra.run.smithi110:> if mountpoint in contents: 2021-03-25T14:16:17.934 DEBUG:teuthology.orchestra.run.smithi110:> return f 2021-03-25T14:16:17.934 DEBUG:teuthology.orchestra.run.smithi110:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-03-25T14:16:17.934 DEBUG:teuthology.orchestra.run.smithi110:> 2021-03-25T14:16:17.934 DEBUG:teuthology.orchestra.run.smithi110:> print(_find_admin_socket("client.admin")) 2021-03-25T14:16:17.934 DEBUG:teuthology.orchestra.run.smithi110:> ' 2021-03-25T14:16:18.051 INFO:teuthology.orchestra.run.smithi110.stdout:/var/run/ceph/ceph-client.admin.41854.asok 2021-03-25T14:16:18.233 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.41854.asok 2021-03-25T14:16:18.234 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-03-25T14:16:18.234 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.41854.asok status 2021-03-25T14:16:18.380 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2021-03-25T14:16:18.380 INFO:teuthology.orchestra.run.smithi110.stdout: "metadata": { 2021-03-25T14:16:18.380 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph_sha1": "df88ec382221e0c1a0a6e66961f3fc1519f95986", 2021-03-25T14:16:18.380 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph_version": "ceph version 17.0.0-1676-gdf88ec38 (df88ec382221e0c1a0a6e66961f3fc1519f95986) quincy (dev)", 2021-03-25T14:16:18.380 INFO:teuthology.orchestra.run.smithi110.stdout: "entity_id": "admin", 2021-03-25T14:16:18.381 INFO:teuthology.orchestra.run.smithi110.stdout: "hostname": "smithi110", 2021-03-25T14:16:18.381 INFO:teuthology.orchestra.run.smithi110.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2021-03-25T14:16:18.381 INFO:teuthology.orchestra.run.smithi110.stdout: "pid": "41854", 2021-03-25T14:16:18.381 INFO:teuthology.orchestra.run.smithi110.stdout: "root": "/" 2021-03-25T14:16:18.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:16:18.381 INFO:teuthology.orchestra.run.smithi110.stdout: "dentry_count": 0, 2021-03-25T14:16:18.381 INFO:teuthology.orchestra.run.smithi110.stdout: "dentry_pinned_count": 0, 2021-03-25T14:16:18.381 INFO:teuthology.orchestra.run.smithi110.stdout: "id": 4428, 2021-03-25T14:16:18.381 INFO:teuthology.orchestra.run.smithi110.stdout: "inst": { 2021-03-25T14:16:18.381 INFO:teuthology.orchestra.run.smithi110.stdout: "name": { 2021-03-25T14:16:18.381 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "client", 2021-03-25T14:16:18.382 INFO:teuthology.orchestra.run.smithi110.stdout: "num": 4428 2021-03-25T14:16:18.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:16:18.382 INFO:teuthology.orchestra.run.smithi110.stdout: "addr": { 2021-03-25T14:16:18.382 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "v1", 2021-03-25T14:16:18.382 INFO:teuthology.orchestra.run.smithi110.stdout: "addr": "192.168.0.1:0", 2021-03-25T14:16:18.382 INFO:teuthology.orchestra.run.smithi110.stdout: "nonce": 1997125064 2021-03-25T14:16:18.382 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:16:18.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:16:18.382 INFO:teuthology.orchestra.run.smithi110.stdout: "addr": { 2021-03-25T14:16:18.382 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "v1", 2021-03-25T14:16:18.383 INFO:teuthology.orchestra.run.smithi110.stdout: "addr": "192.168.0.1:0", 2021-03-25T14:16:18.383 INFO:teuthology.orchestra.run.smithi110.stdout: "nonce": 1997125064 2021-03-25T14:16:18.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:16:18.383 INFO:teuthology.orchestra.run.smithi110.stdout: "inst_str": "client.4428 192.168.0.1:0/1997125064", 2021-03-25T14:16:18.383 INFO:teuthology.orchestra.run.smithi110.stdout: "addr_str": "192.168.0.1:0/1997125064", 2021-03-25T14:16:18.383 INFO:teuthology.orchestra.run.smithi110.stdout: "inode_count": 1, 2021-03-25T14:16:18.383 INFO:teuthology.orchestra.run.smithi110.stdout: "mds_epoch": 8, 2021-03-25T14:16:18.383 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_epoch": 25, 2021-03-25T14:16:18.383 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_epoch_barrier": 0, 2021-03-25T14:16:18.383 INFO:teuthology.orchestra.run.smithi110.stdout: "blocklisted": false, 2021-03-25T14:16:18.383 INFO:teuthology.orchestra.run.smithi110.stdout: "fs_name": "cephfs" 2021-03-25T14:16:18.384 INFO:teuthology.orchestra.run.smithi110.stdout:} 2021-03-25T14:16:18.389 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-03-25T14:16:18.390 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest/mnt.admin && exec sudo bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2021-03-25T14:16:18.430 INFO:teuthology.orchestra.run.smithi110.stdout:# file: . 2021-03-25T14:16:18.430 INFO:teuthology.orchestra.run.smithi110.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2021-03-25T14:16:18.430 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:16:18.432 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi110.front.sepia.ceph.com... 2021-03-25T14:16:18.432 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-03-25T14:16:18.432 DEBUG:teuthology.orchestra.run.smithi110:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2021-03-25T14:16:18.500 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi110.stderr:ceph-fuse[41854]: fuse finished with error 0 and tester_r 0 2021-03-25T14:16:18.502 INFO:teuthology.orchestra.run:waiting for 900 2021-03-25T14:16:24.603 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi110.front.sepia.ceph.com 2021-03-25T14:16:24.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:24.604 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2021-03-25T14:16:24.623 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:16:24.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.781+0000 7fa299524700 1 Processor -- start 2021-03-25T14:16:24.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.781+0000 7fa299524700 1 -- start start 2021-03-25T14:16:24.785 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.782+0000 7fa299524700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa294149080 0x7fa2940b1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:24.786 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.782+0000 7fa299524700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2940bafc0 con 0x7fa2940bc220 2021-03-25T14:16:24.786 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.782+0000 7fa299524700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2940baa80 con 0x7fa2940675d0 2021-03-25T14:16:24.786 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.782+0000 7fa299524700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2940b1830 con 0x7fa294149080 2021-03-25T14:16:24.786 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.782+0000 7fa2937fe700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa294149080 0x7fa2940b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:24.786 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.782+0000 7fa2927fc700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fa2940bc220 0x7fa294148970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:40584/0 (socket says 172.21.15.110:40584) 2021-03-25T14:16:24.786 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.782+0000 7fa2937fe700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa294149080 0x7fa2940b1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47650/0 (socket says 172.21.15.110:47650) 2021-03-25T14:16:24.786 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.782+0000 7fa2927fc700 1 -- 172.21.15.110:0/1324177311 learned_addr learned my addr 172.21.15.110:0/1324177311 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:24.786 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.782+0000 7fa2937fe700 1 -- 172.21.15.110:0/1324177311 >> v1:172.21.15.174:6789/0 conn(0x7fa2940675d0 legacy=0x7fa29414cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:24.786 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.782+0000 7fa2937fe700 1 -- 172.21.15.110:0/1324177311 >> v1:172.21.15.110:6789/0 conn(0x7fa2940bc220 legacy=0x7fa294148970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:24.786 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.782+0000 7fa291ffb700 1 -- 172.21.15.110:0/1324177311 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1374749507 0 0) 0x7fa2940bafc0 con 0x7fa2940bc220 2021-03-25T14:16:24.787 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.782+0000 7fa2937fe700 1 -- 172.21.15.110:0/1324177311 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2940bad20 con 0x7fa294149080 2021-03-25T14:16:24.787 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.782+0000 7fa2937fe700 1 --2- 172.21.15.110:0/1324177311 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa294149080 0x7fa2940b1340 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fa28c009cc0 tx=0x7fa28c009220).ready entity=mon.0 client_cookie=185c0714a23a25b6 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:24.787 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.783+0000 7fa291ffb700 1 -- 172.21.15.110:0/1324177311 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c00bc80 con 0x7fa294149080 2021-03-25T14:16:24.787 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.783+0000 7fa291ffb700 1 -- 172.21.15.110:0/1324177311 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28c00bde0 con 0x7fa294149080 2021-03-25T14:16:24.787 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.783+0000 7fa291ffb700 1 -- 172.21.15.110:0/1324177311 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c011610 con 0x7fa294149080 2021-03-25T14:16:24.787 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.783+0000 7fa299524700 1 -- 172.21.15.110:0/1324177311 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa294149080 msgr2=0x7fa2940b1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:24.787 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.783+0000 7fa299524700 1 --2- 172.21.15.110:0/1324177311 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa294149080 0x7fa2940b1340 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fa28c009cc0 tx=0x7fa28c009220).stop 2021-03-25T14:16:24.787 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.783+0000 7fa299524700 1 -- 172.21.15.110:0/1324177311 shutdown_connections 2021-03-25T14:16:24.787 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.783+0000 7fa299524700 1 --2- 172.21.15.110:0/1324177311 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa294149080 0x7fa2940b1340 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:24.787 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.783+0000 7fa299524700 1 -- 172.21.15.110:0/1324177311 >> 172.21.15.110:0/1324177311 conn(0x7fa294064a10 msgr2=0x7fa29405c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:24.787 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.783+0000 7fa299524700 1 -- 172.21.15.110:0/1324177311 shutdown_connections 2021-03-25T14:16:24.787 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.783+0000 7fa299524700 1 -- 172.21.15.110:0/1324177311 wait complete. 2021-03-25T14:16:24.791 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.784+0000 7fa299524700 1 Processor -- start 2021-03-25T14:16:24.791 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.784+0000 7fa299524700 1 -- start start 2021-03-25T14:16:24.791 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.785+0000 7fa299524700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2940675d0 0x7fa294145bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:24.791 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.785+0000 7fa299524700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2940bc220 0x7fa294159110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:24.791 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.785+0000 7fa299524700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa294149080 0x7fa294159600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:24.791 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.785+0000 7fa299524700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2940b9de0 con 0x7fa2940bc220 2021-03-25T14:16:24.792 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.785+0000 7fa299524700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29415c080 con 0x7fa294149080 2021-03-25T14:16:24.792 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.785+0000 7fa299524700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2940b1b30 con 0x7fa2940675d0 2021-03-25T14:16:24.792 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.785+0000 7fa2927fc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2940bc220 0x7fa294159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:24.792 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.785+0000 7fa2927fc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2940bc220 0x7fa294159110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47654/0 (socket says 172.21.15.110:47654) 2021-03-25T14:16:24.792 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.785+0000 7fa2927fc700 1 -- 172.21.15.110:0/976443099 learned_addr learned my addr 172.21.15.110:0/976443099 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:24.792 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.785+0000 7fa292ffd700 1 --2- 172.21.15.110:0/976443099 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2940675d0 0x7fa294145bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:24.792 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.785+0000 7fa2937fe700 1 --2- 172.21.15.110:0/976443099 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa294149080 0x7fa294159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:24.792 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.785+0000 7fa2927fc700 1 -- 172.21.15.110:0/976443099 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2940675d0 msgr2=0x7fa294145bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:24.792 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.785+0000 7fa2927fc700 1 --2- 172.21.15.110:0/976443099 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2940675d0 0x7fa294145bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:24.792 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.785+0000 7fa2927fc700 1 -- 172.21.15.110:0/976443099 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa294149080 msgr2=0x7fa294159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:24.792 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.785+0000 7fa2927fc700 1 --2- 172.21.15.110:0/976443099 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa294149080 0x7fa294159600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:24.792 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.785+0000 7fa2927fc700 1 -- 172.21.15.110:0/976443099 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2940ba010 con 0x7fa2940bc220 2021-03-25T14:16:24.793 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.785+0000 7fa292ffd700 1 --2- 172.21.15.110:0/976443099 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2940675d0 0x7fa294145bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:24.793 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.786+0000 7fa2927fc700 1 --2- 172.21.15.110:0/976443099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2940bc220 0x7fa294159110 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fa28800c6e0 tx=0x7fa288007a70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:24.793 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.786+0000 7fa27affd700 1 -- 172.21.15.110:0/976443099 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa288007320 con 0x7fa2940bc220 2021-03-25T14:16:24.793 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.786+0000 7fa27affd700 1 -- 172.21.15.110:0/976443099 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa288007480 con 0x7fa2940bc220 2021-03-25T14:16:24.793 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.786+0000 7fa27affd700 1 -- 172.21.15.110:0/976443099 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa288005830 con 0x7fa2940bc220 2021-03-25T14:16:24.793 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.786+0000 7fa299524700 1 -- 172.21.15.110:0/976443099 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2940ba2b0 con 0x7fa2940bc220 2021-03-25T14:16:24.793 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.786+0000 7fa299524700 1 -- 172.21.15.110:0/976443099 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2940b1dd0 con 0x7fa2940bc220 2021-03-25T14:16:24.793 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.787+0000 7fa299524700 1 -- 172.21.15.110:0/976443099 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2940ba440 con 0x7fa2940bc220 2021-03-25T14:16:24.793 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.787+0000 7fa27affd700 1 -- 172.21.15.110:0/976443099 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fa288010030 con 0x7fa2940bc220 2021-03-25T14:16:24.793 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.787+0000 7fa27affd700 1 --2- 172.21.15.110:0/976443099 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa27405a0b0 0x7fa27405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:24.793 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.787+0000 7fa27affd700 1 -- 172.21.15.110:0/976443099 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fa288073d90 con 0x7fa2940bc220 2021-03-25T14:16:24.793 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.787+0000 7fa292ffd700 1 --2- 172.21.15.110:0/976443099 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa27405a0b0 0x7fa27405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:24.794 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.788+0000 7fa292ffd700 1 --2- 172.21.15.110:0/976443099 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa27405a0b0 0x7fa27405c570 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fa284001530 tx=0x7fa284009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:24.794 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.791+0000 7fa27affd700 1 -- 172.21.15.110:0/976443099 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fa288047440 con 0x7fa2940bc220 2021-03-25T14:16:24.942 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.940+0000 7fa299524700 1 -- 172.21.15.110:0/976443099 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa29415c1f0 con 0x7fa2940bc220 2021-03-25T14:16:24.943 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.941+0000 7fa27affd700 1 -- 172.21.15.110:0/976443099 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18685 (secure 0 0 0) 0x7fa29415c1f0 con 0x7fa2940bc220 2021-03-25T14:16:24.943 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:16:24.943 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":25,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:16:15.446609+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-03-25T14:16:09.478442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-03-25T14:16:10.071152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2021-03-25T14:16:13.122119+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:16:24.945 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.943+0000 7fa299524700 1 -- 172.21.15.110:0/976443099 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa27405a0b0 msgr2=0x7fa27405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:24.945 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.943+0000 7fa299524700 1 --2- 172.21.15.110:0/976443099 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa27405a0b0 0x7fa27405c570 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fa284001530 tx=0x7fa284009040).stop 2021-03-25T14:16:24.945 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.943+0000 7fa299524700 1 -- 172.21.15.110:0/976443099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2940bc220 msgr2=0x7fa294159110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:24.945 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.943+0000 7fa299524700 1 --2- 172.21.15.110:0/976443099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2940bc220 0x7fa294159110 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fa28800c6e0 tx=0x7fa288007a70).stop 2021-03-25T14:16:24.945 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.943+0000 7fa299524700 1 -- 172.21.15.110:0/976443099 shutdown_connections 2021-03-25T14:16:24.945 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.943+0000 7fa299524700 1 --2- 172.21.15.110:0/976443099 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa27405a0b0 0x7fa27405c570 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:24.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.943+0000 7fa299524700 1 --2- 172.21.15.110:0/976443099 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa294149080 0x7fa294159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:24.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.943+0000 7fa299524700 1 --2- 172.21.15.110:0/976443099 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2940675d0 0x7fa294145bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:24.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.943+0000 7fa299524700 1 --2- 172.21.15.110:0/976443099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2940bc220 0x7fa294159110 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:24.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.943+0000 7fa299524700 1 -- 172.21.15.110:0/976443099 >> 172.21.15.110:0/976443099 conn(0x7fa294064a10 msgr2=0x7fa2940bf080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:24.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.943+0000 7fa299524700 1 -- 172.21.15.110:0/976443099 shutdown_connections 2021-03-25T14:16:24.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:24.943+0000 7fa299524700 1 -- 172.21.15.110:0/976443099 wait complete. 2021-03-25T14:16:24.957 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:16:25.066 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.065+0000 7f3acb4cb700 1 Processor -- start 2021-03-25T14:16:25.067 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.065+0000 7f3acb4cb700 1 -- start start 2021-03-25T14:16:25.070 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.066+0000 7f3acb4cb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3ac4068110 0x7f3ac40b8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:25.070 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.066+0000 7f3acb4cb700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3ac414ce70 0x7f3ac414d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:25.070 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.066+0000 7f3acb4cb700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ac40b73f0 con 0x7f3ac40b9640 2021-03-25T14:16:25.070 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.066+0000 7f3acb4cb700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ac4061650 con 0x7f3ac414ce70 2021-03-25T14:16:25.070 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.066+0000 7f3acb4cb700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ac40618f0 con 0x7f3ac4068110 2021-03-25T14:16:25.071 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.066+0000 7f3acacca700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3ac414ce70 0x7f3ac414d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:25.071 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.066+0000 7f3acacca700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3ac414ce70 0x7f3ac414d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47664/0 (socket says 172.21.15.110:47664) 2021-03-25T14:16:25.071 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.066+0000 7f3acacca700 1 -- 172.21.15.110:0/407449359 learned_addr learned my addr 172.21.15.110:0/407449359 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:25.071 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.066+0000 7f3ac9cc8700 1 --2- 172.21.15.110:0/407449359 >> v2:172.21.15.174:3300/0 conn(0x7f3ac4068110 0x7f3ac40b8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:25.071 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.066+0000 7f3acacca700 1 -- 172.21.15.110:0/407449359 >> v2:172.21.15.174:3300/0 conn(0x7f3ac4068110 msgr2=0x7f3ac40b8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:25.071 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.066+0000 7f3acacca700 1 --2- 172.21.15.110:0/407449359 >> v2:172.21.15.174:3300/0 conn(0x7f3ac4068110 0x7f3ac40b8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:25.071 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.066+0000 7f3acacca700 1 -- 172.21.15.110:0/407449359 >> v1:172.21.15.174:6789/0 conn(0x7f3ac40b9640 legacy=0x7f3ac4143140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:25.071 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.066+0000 7f3acacca700 1 -- 172.21.15.110:0/407449359 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac40b7620 con 0x7f3ac414ce70 2021-03-25T14:16:25.071 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.066+0000 7f3acacca700 1 --2- 172.21.15.110:0/407449359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ac414ce70 0x7f3ac414d2f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f3ac406aa90 tx=0x7f3abc0092d0).ready entity=mon.0 client_cookie=68b5cf5fcdad83c1 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:25.072 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.066+0000 7f3ac94c7700 1 -- 172.21.15.110:0/407449359 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3abc00bc40 con 0x7f3ac414ce70 2021-03-25T14:16:25.072 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.066+0000 7f3ac94c7700 1 -- 172.21.15.110:0/407449359 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3abc00bda0 con 0x7f3ac414ce70 2021-03-25T14:16:25.072 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.066+0000 7f3ac94c7700 1 -- 172.21.15.110:0/407449359 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3abc011610 con 0x7f3ac414ce70 2021-03-25T14:16:25.072 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.067+0000 7f3acb4cb700 1 -- 172.21.15.110:0/407449359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ac414ce70 msgr2=0x7f3ac414d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:25.072 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.067+0000 7f3acb4cb700 1 --2- 172.21.15.110:0/407449359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ac414ce70 0x7f3ac414d2f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f3ac406aa90 tx=0x7f3abc0092d0).stop 2021-03-25T14:16:25.072 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.067+0000 7f3acb4cb700 1 -- 172.21.15.110:0/407449359 shutdown_connections 2021-03-25T14:16:25.072 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.067+0000 7f3acb4cb700 1 --2- 172.21.15.110:0/407449359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ac414ce70 0x7f3ac414d2f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:25.072 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.067+0000 7f3acb4cb700 1 --2- 172.21.15.110:0/407449359 >> v2:172.21.15.174:3300/0 conn(0x7f3ac4068110 0x7f3ac40b8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:25.072 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.067+0000 7f3acb4cb700 1 -- 172.21.15.110:0/407449359 >> 172.21.15.110:0/407449359 conn(0x7f3ac4061d50 msgr2=0x7f3ac4062160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:25.072 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.067+0000 7f3acb4cb700 1 -- 172.21.15.110:0/407449359 shutdown_connections 2021-03-25T14:16:25.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.067+0000 7f3acb4cb700 1 -- 172.21.15.110:0/407449359 wait complete. 2021-03-25T14:16:25.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.068+0000 7f3acb4cb700 1 Processor -- start 2021-03-25T14:16:25.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.068+0000 7f3acb4cb700 1 -- start start 2021-03-25T14:16:25.076 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.069+0000 7f3acb4cb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ac4068110 0x7f3ac40bafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:25.076 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.069+0000 7f3acb4cb700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ac40b9640 0x7f3ac415c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:25.076 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.069+0000 7f3acb4cb700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ac414ce70 0x7f3ac415cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:25.076 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.069+0000 7f3acb4cb700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac4148b10 con 0x7f3ac414ce70 2021-03-25T14:16:25.076 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.069+0000 7f3acb4cb700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac415d250 con 0x7f3ac40b9640 2021-03-25T14:16:25.076 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.069+0000 7f3acb4cb700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac40b4360 con 0x7f3ac4068110 2021-03-25T14:16:25.077 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.069+0000 7f3acacca700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ac414ce70 0x7f3ac415cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:25.077 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.069+0000 7f3acacca700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ac414ce70 0x7f3ac415cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47670/0 (socket says 172.21.15.110:47670) 2021-03-25T14:16:25.077 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.069+0000 7f3acacca700 1 -- 172.21.15.110:0/3594777608 learned_addr learned my addr 172.21.15.110:0/3594777608 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:25.077 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.069+0000 7f3aca4c9700 1 --2- 172.21.15.110:0/3594777608 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ac4068110 0x7f3ac40bafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:25.077 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.069+0000 7f3ac9cc8700 1 --2- 172.21.15.110:0/3594777608 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ac40b9640 0x7f3ac415c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:25.077 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.069+0000 7f3acacca700 1 -- 172.21.15.110:0/3594777608 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ac4068110 msgr2=0x7f3ac40bafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:25.077 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.069+0000 7f3acacca700 1 --2- 172.21.15.110:0/3594777608 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ac4068110 0x7f3ac40bafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:25.077 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.069+0000 7f3acacca700 1 -- 172.21.15.110:0/3594777608 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ac40b9640 msgr2=0x7f3ac415c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:25.077 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.069+0000 7f3acacca700 1 --2- 172.21.15.110:0/3594777608 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ac40b9640 0x7f3ac415c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:25.077 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.069+0000 7f3acacca700 1 -- 172.21.15.110:0/3594777608 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac40b4600 con 0x7f3ac414ce70 2021-03-25T14:16:25.077 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.069+0000 7f3ac9cc8700 1 --2- 172.21.15.110:0/3594777608 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ac40b9640 0x7f3ac415c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:25.077 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.069+0000 7f3acacca700 1 --2- 172.21.15.110:0/3594777608 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ac414ce70 0x7f3ac415cd60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f3ac4061cb0 tx=0x7f3abc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:25.077 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.069+0000 7f3ab27fc700 1 -- 172.21.15.110:0/3594777608 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3abc009ea0 con 0x7f3ac414ce70 2021-03-25T14:16:25.078 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.069+0000 7f3ab27fc700 1 -- 172.21.15.110:0/3594777608 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3abc011e30 con 0x7f3ac414ce70 2021-03-25T14:16:25.078 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.069+0000 7f3acb4cb700 1 -- 172.21.15.110:0/3594777608 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ac40b48a0 con 0x7f3ac414ce70 2021-03-25T14:16:25.078 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.069+0000 7f3ab27fc700 1 -- 172.21.15.110:0/3594777608 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3abc010d40 con 0x7f3ac414ce70 2021-03-25T14:16:25.078 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.069+0000 7f3acb4cb700 1 -- 172.21.15.110:0/3594777608 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ac4148c80 con 0x7f3ac414ce70 2021-03-25T14:16:25.078 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.070+0000 7f3acb4cb700 1 -- 172.21.15.110:0/3594777608 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ac40b4c50 con 0x7f3ac414ce70 2021-03-25T14:16:25.078 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.070+0000 7f3ab27fc700 1 -- 172.21.15.110:0/3594777608 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f3abc023030 con 0x7f3ac414ce70 2021-03-25T14:16:25.078 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.071+0000 7f3ab27fc700 1 --2- 172.21.15.110:0/3594777608 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3aa405a0b0 0x7f3aa405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:25.078 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.071+0000 7f3ab27fc700 1 -- 172.21.15.110:0/3594777608 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f3abc0753b0 con 0x7f3ac414ce70 2021-03-25T14:16:25.078 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.071+0000 7f3aca4c9700 1 --2- 172.21.15.110:0/3594777608 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3aa405a0b0 0x7f3aa405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:25.078 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.071+0000 7f3aca4c9700 1 --2- 172.21.15.110:0/3594777608 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3aa405a0b0 0x7f3aa405c570 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f3ab4003730 tx=0x7f3ab4007ba0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:25.079 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.074+0000 7f3ab27fc700 1 -- 172.21.15.110:0/3594777608 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f3abc048aa0 con 0x7f3ac414ce70 2021-03-25T14:16:25.226 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.224+0000 7f3acb4cb700 1 -- 172.21.15.110:0/3594777608 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ac40b91b0 con 0x7f3ac414ce70 2021-03-25T14:16:25.228 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.225+0000 7f3ab27fc700 1 -- 172.21.15.110:0/3594777608 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18685 (secure 0 0 0) 0x7f3abc021020 con 0x7f3ac414ce70 2021-03-25T14:16:25.228 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:16:25.229 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":25,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:16:15.446609+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-03-25T14:16:09.478442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-03-25T14:16:10.071152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2021-03-25T14:16:13.122119+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:16:25.231 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.227+0000 7f3acb4cb700 1 -- 172.21.15.110:0/3594777608 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3aa405a0b0 msgr2=0x7f3aa405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:25.231 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.227+0000 7f3acb4cb700 1 --2- 172.21.15.110:0/3594777608 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3aa405a0b0 0x7f3aa405c570 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f3ab4003730 tx=0x7f3ab4007ba0).stop 2021-03-25T14:16:25.231 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.227+0000 7f3acb4cb700 1 -- 172.21.15.110:0/3594777608 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ac414ce70 msgr2=0x7f3ac415cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:25.231 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.227+0000 7f3acb4cb700 1 --2- 172.21.15.110:0/3594777608 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ac414ce70 0x7f3ac415cd60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f3ac4061cb0 tx=0x7f3abc017000).stop 2021-03-25T14:16:25.231 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.227+0000 7f3acb4cb700 1 -- 172.21.15.110:0/3594777608 shutdown_connections 2021-03-25T14:16:25.232 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.227+0000 7f3acb4cb700 1 --2- 172.21.15.110:0/3594777608 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3aa405a0b0 0x7f3aa405c570 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:25.232 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.227+0000 7f3acb4cb700 1 --2- 172.21.15.110:0/3594777608 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ac414ce70 0x7f3ac415cd60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:25.232 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.227+0000 7f3acb4cb700 1 --2- 172.21.15.110:0/3594777608 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ac4068110 0x7f3ac40bafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:25.232 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.227+0000 7f3acb4cb700 1 --2- 172.21.15.110:0/3594777608 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ac40b9640 0x7f3ac415c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:25.232 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.227+0000 7f3acb4cb700 1 -- 172.21.15.110:0/3594777608 >> 172.21.15.110:0/3594777608 conn(0x7f3ac4061d50 msgr2=0x7f3ac40ae710 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:25.233 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.227+0000 7f3acb4cb700 1 -- 172.21.15.110:0/3594777608 shutdown_connections 2021-03-25T14:16:25.233 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.227+0000 7f3acb4cb700 1 -- 172.21.15.110:0/3594777608 wait complete. 2021-03-25T14:16:25.241 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-03-25T14:16:25.356 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.351+0000 7fa39adb2700 1 Processor -- start 2021-03-25T14:16:25.356 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.351+0000 7fa39adb2700 1 -- start start 2021-03-25T14:16:25.356 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.352+0000 7fa39adb2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa39414cc90 0x7fa39414d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:25.356 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.352+0000 7fa39adb2700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa3940685d0 0x7fa394068a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:25.356 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.352+0000 7fa39adb2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3940691b0 con 0x7fa39414d470 2021-03-25T14:16:25.356 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.352+0000 7fa39adb2700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3940bc2b0 con 0x7fa3940685d0 2021-03-25T14:16:25.356 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.352+0000 7fa39adb2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa394149dd0 con 0x7fa39414cc90 2021-03-25T14:16:25.356 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.352+0000 7fa39934f700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa3940685d0 0x7fa394068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:25.356 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.352+0000 7fa39934f700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa3940685d0 0x7fa394068a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47678/0 (socket says 172.21.15.110:47678) 2021-03-25T14:16:25.357 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.352+0000 7fa39934f700 1 -- 172.21.15.110:0/3060481110 learned_addr learned my addr 172.21.15.110:0/3060481110 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:25.357 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.352+0000 7fa393fff700 1 --2- 172.21.15.110:0/3060481110 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa39414cc90 0x7fa39414d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:25.357 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.352+0000 7fa39934f700 1 -- 172.21.15.110:0/3060481110 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa39414cc90 msgr2=0x7fa39414d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:25.357 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.352+0000 7fa39934f700 1 --2- 172.21.15.110:0/3060481110 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa39414cc90 0x7fa39414d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:25.357 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.352+0000 7fa39934f700 1 -- 172.21.15.110:0/3060481110 >> v1:172.21.15.174:6789/0 conn(0x7fa39414d470 legacy=0x7fa3941493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:25.357 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.352+0000 7fa39934f700 1 -- 172.21.15.110:0/3060481110 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39414a070 con 0x7fa3940685d0 2021-03-25T14:16:25.357 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.353+0000 7fa39934f700 1 --2- 172.21.15.110:0/3060481110 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3940685d0 0x7fa394068a40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fa38c009d90 tx=0x7fa38c0092d0).ready entity=mon.0 client_cookie=6e95307e4ef610e server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:25.357 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.353+0000 7fa3937fe700 1 -- 172.21.15.110:0/3060481110 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c00bbf0 con 0x7fa3940685d0 2021-03-25T14:16:25.357 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.353+0000 7fa3937fe700 1 -- 172.21.15.110:0/3060481110 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa38c00bd50 con 0x7fa3940685d0 2021-03-25T14:16:25.357 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.353+0000 7fa3937fe700 1 -- 172.21.15.110:0/3060481110 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c011610 con 0x7fa3940685d0 2021-03-25T14:16:25.357 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.353+0000 7fa39adb2700 1 -- 172.21.15.110:0/3060481110 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3940685d0 msgr2=0x7fa394068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:25.357 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.353+0000 7fa39adb2700 1 --2- 172.21.15.110:0/3060481110 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3940685d0 0x7fa394068a40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fa38c009d90 tx=0x7fa38c0092d0).stop 2021-03-25T14:16:25.357 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.353+0000 7fa39adb2700 1 -- 172.21.15.110:0/3060481110 shutdown_connections 2021-03-25T14:16:25.358 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.353+0000 7fa39adb2700 1 --2- 172.21.15.110:0/3060481110 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3940685d0 0x7fa394068a40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:25.358 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.353+0000 7fa39adb2700 1 --2- 172.21.15.110:0/3060481110 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa39414cc90 0x7fa39414d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:25.358 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.353+0000 7fa39adb2700 1 -- 172.21.15.110:0/3060481110 >> 172.21.15.110:0/3060481110 conn(0x7fa394060c40 msgr2=0x7fa394061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:25.358 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.353+0000 7fa39adb2700 1 -- 172.21.15.110:0/3060481110 shutdown_connections 2021-03-25T14:16:25.358 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.353+0000 7fa39adb2700 1 -- 172.21.15.110:0/3060481110 wait complete. 2021-03-25T14:16:25.361 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.354+0000 7fa39adb2700 1 Processor -- start 2021-03-25T14:16:25.361 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.355+0000 7fa39adb2700 1 -- start start 2021-03-25T14:16:25.361 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.355+0000 7fa39adb2700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3940685d0 0x7fa3940bef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:25.361 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.355+0000 7fa39adb2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa39414cc90 0x7fa394158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:25.361 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.355+0000 7fa39adb2700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa39414d470 0x7fa394158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:25.361 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.355+0000 7fa39adb2700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3940a5c20 con 0x7fa39414d470 2021-03-25T14:16:25.361 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.355+0000 7fa39adb2700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3941442a0 con 0x7fa3940685d0 2021-03-25T14:16:25.361 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.355+0000 7fa39adb2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3940a30c0 con 0x7fa39414cc90 2021-03-25T14:16:25.361 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.355+0000 7fa39934f700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa39414d470 0x7fa394158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:25.361 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.355+0000 7fa39934f700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa39414d470 0x7fa394158e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47684/0 (socket says 172.21.15.110:47684) 2021-03-25T14:16:25.361 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.355+0000 7fa39934f700 1 -- 172.21.15.110:0/4040929408 learned_addr learned my addr 172.21.15.110:0/4040929408 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:25.362 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.355+0000 7fa398b4e700 1 --2- 172.21.15.110:0/4040929408 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3940685d0 0x7fa3940bef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:25.362 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.355+0000 7fa393fff700 1 --2- 172.21.15.110:0/4040929408 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa39414cc90 0x7fa394158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:25.362 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.356+0000 7fa39934f700 1 -- 172.21.15.110:0/4040929408 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa39414cc90 msgr2=0x7fa394158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:25.362 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.356+0000 7fa39934f700 1 --2- 172.21.15.110:0/4040929408 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa39414cc90 0x7fa394158920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:25.362 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.356+0000 7fa39934f700 1 -- 172.21.15.110:0/4040929408 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3940685d0 msgr2=0x7fa3940bef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:25.362 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.356+0000 7fa39934f700 1 --2- 172.21.15.110:0/4040929408 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3940685d0 0x7fa3940bef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:25.362 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.356+0000 7fa39934f700 1 -- 172.21.15.110:0/4040929408 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3940bf460 con 0x7fa39414d470 2021-03-25T14:16:25.362 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.356+0000 7fa39934f700 1 --2- 172.21.15.110:0/4040929408 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa39414d470 0x7fa394158e10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fa38c009310 tx=0x7fa38c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:25.362 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.356+0000 7fa390ff9700 1 -- 172.21.15.110:0/4040929408 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c011650 con 0x7fa39414d470 2021-03-25T14:16:25.362 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.356+0000 7fa390ff9700 1 -- 172.21.15.110:0/4040929408 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa38c00bec0 con 0x7fa39414d470 2021-03-25T14:16:25.362 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.356+0000 7fa39adb2700 1 -- 172.21.15.110:0/4040929408 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3940a5780 con 0x7fa39414d470 2021-03-25T14:16:25.362 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.356+0000 7fa390ff9700 1 -- 172.21.15.110:0/4040929408 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c010c90 con 0x7fa39414d470 2021-03-25T14:16:25.363 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.356+0000 7fa39adb2700 1 -- 172.21.15.110:0/4040929408 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3941462a0 con 0x7fa39414d470 2021-03-25T14:16:25.363 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.357+0000 7fa39adb2700 1 -- 172.21.15.110:0/4040929408 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa39405d7b0 con 0x7fa39414d470 2021-03-25T14:16:25.363 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.357+0000 7fa390ff9700 1 -- 172.21.15.110:0/4040929408 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fa38c00f070 con 0x7fa39414d470 2021-03-25T14:16:25.363 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.357+0000 7fa390ff9700 1 --2- 172.21.15.110:0/4040929408 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa37405a0b0 0x7fa37405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:25.363 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.358+0000 7fa390ff9700 1 -- 172.21.15.110:0/4040929408 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fa38c075880 con 0x7fa39414d470 2021-03-25T14:16:25.363 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.358+0000 7fa398b4e700 1 --2- 172.21.15.110:0/4040929408 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa37405a0b0 0x7fa37405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:25.363 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.358+0000 7fa398b4e700 1 --2- 172.21.15.110:0/4040929408 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa37405a0b0 0x7fa37405c570 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fa3880036e0 tx=0x7fa388007bc0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:25.363 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.361+0000 7fa390ff9700 1 -- 172.21.15.110:0/4040929408 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fa38c048f30 con 0x7fa39414d470 2021-03-25T14:16:25.551 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.549+0000 7fa39adb2700 1 -- 172.21.15.110:0/4040929408 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa394061c50 con 0x7fa39414d470 2021-03-25T14:16:25.753 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.751+0000 7fa390ff9700 1 -- 172.21.15.110:0/4040929408 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v9) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa38c04c550 con 0x7fa39414d470 2021-03-25T14:16:25.756 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.753+0000 7fa39adb2700 1 -- 172.21.15.110:0/4040929408 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa37405a0b0 msgr2=0x7fa37405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:25.756 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.753+0000 7fa39adb2700 1 --2- 172.21.15.110:0/4040929408 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa37405a0b0 0x7fa37405c570 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fa3880036e0 tx=0x7fa388007bc0).stop 2021-03-25T14:16:25.756 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.753+0000 7fa39adb2700 1 -- 172.21.15.110:0/4040929408 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa39414d470 msgr2=0x7fa394158e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:25.756 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.753+0000 7fa39adb2700 1 --2- 172.21.15.110:0/4040929408 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa39414d470 0x7fa394158e10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fa38c009310 tx=0x7fa38c017000).stop 2021-03-25T14:16:25.756 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.753+0000 7fa39adb2700 1 -- 172.21.15.110:0/4040929408 shutdown_connections 2021-03-25T14:16:25.757 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.753+0000 7fa39adb2700 1 --2- 172.21.15.110:0/4040929408 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa37405a0b0 0x7fa37405c570 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:25.757 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.753+0000 7fa39adb2700 1 --2- 172.21.15.110:0/4040929408 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3940685d0 0x7fa3940bef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:25.757 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.753+0000 7fa39adb2700 1 --2- 172.21.15.110:0/4040929408 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa39414d470 0x7fa394158e10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:25.757 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.753+0000 7fa39adb2700 1 --2- 172.21.15.110:0/4040929408 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa39414cc90 0x7fa394158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:25.757 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.753+0000 7fa39adb2700 1 -- 172.21.15.110:0/4040929408 >> 172.21.15.110:0/4040929408 conn(0x7fa394060c40 msgr2=0x7fa394147970 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:25.757 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.753+0000 7fa39adb2700 1 -- 172.21.15.110:0/4040929408 shutdown_connections 2021-03-25T14:16:25.757 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.753+0000 7fa39adb2700 1 -- 172.21.15.110:0/4040929408 wait complete. 2021-03-25T14:16:25.767 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-03-25T14:16:25.876 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.874+0000 7ff2fdad8700 1 Processor -- start 2021-03-25T14:16:25.877 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.875+0000 7ff2fdad8700 1 -- start start 2021-03-25T14:16:25.879 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.875+0000 7ff2fdad8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2f80b99b0 0x7ff2f80ba4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:25.880 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.875+0000 7ff2fdad8700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff2f814a050 0x7ff2f81488b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:25.880 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.875+0000 7ff2fdad8700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2f80babc0 con 0x7ff2f8148da0 2021-03-25T14:16:25.880 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.875+0000 7ff2fdad8700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2f80ba9e0 con 0x7ff2f814a050 2021-03-25T14:16:25.880 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.875+0000 7ff2fdad8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f80bae60 con 0x7ff2f80b99b0 2021-03-25T14:16:25.880 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.875+0000 7ff2f6ffd700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff2f814a050 0x7ff2f81488b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:25.880 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.875+0000 7ff2f7fff700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7ff2f8148da0 0x7ff2f80a3190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:40628/0 (socket says 172.21.15.110:40628) 2021-03-25T14:16:25.880 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.875+0000 7ff2f7fff700 1 -- 172.21.15.110:0/1723670353 learned_addr learned my addr 172.21.15.110:0/1723670353 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:25.880 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.876+0000 7ff2f77fe700 1 --2- 172.21.15.110:0/1723670353 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2f80b99b0 0x7ff2f80ba4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:25.880 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.876+0000 7ff2f6ffd700 1 -- 172.21.15.110:0/1723670353 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2f80b99b0 msgr2=0x7ff2f80ba4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:25.880 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.876+0000 7ff2f6ffd700 1 --2- 172.21.15.110:0/1723670353 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2f80b99b0 0x7ff2f80ba4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:25.880 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.876+0000 7ff2f6ffd700 1 -- 172.21.15.110:0/1723670353 >> v1:172.21.15.110:6789/0 conn(0x7ff2f8148da0 legacy=0x7ff2f80a3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:25.881 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.876+0000 7ff2f67fc700 1 -- 172.21.15.110:0/1723670353 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2765277906 0 0) 0x7ff2f80babc0 con 0x7ff2f8148da0 2021-03-25T14:16:25.881 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.876+0000 7ff2f6ffd700 1 -- 172.21.15.110:0/1723670353 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f80a2a50 con 0x7ff2f814a050 2021-03-25T14:16:25.881 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.876+0000 7ff2f77fe700 1 --2- 172.21.15.110:0/1723670353 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2f80b99b0 0x7ff2f80ba4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:25.881 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.876+0000 7ff2f6ffd700 1 --2- 172.21.15.110:0/1723670353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2f814a050 0x7ff2f81488b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7ff2ec00b9c0 tx=0x7ff2ec006e20).ready entity=mon.0 client_cookie=e62640fb1a52f7c4 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:25.881 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.876+0000 7ff2f67fc700 1 -- 172.21.15.110:0/1723670353 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec009870 con 0x7ff2f814a050 2021-03-25T14:16:25.881 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.876+0000 7ff2f67fc700 1 -- 172.21.15.110:0/1723670353 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ec0099d0 con 0x7ff2f814a050 2021-03-25T14:16:25.881 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.876+0000 7ff2f67fc700 1 -- 172.21.15.110:0/1723670353 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec009d50 con 0x7ff2f814a050 2021-03-25T14:16:25.881 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.876+0000 7ff2fdad8700 1 -- 172.21.15.110:0/1723670353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2f814a050 msgr2=0x7ff2f81488b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:25.881 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.876+0000 7ff2fdad8700 1 --2- 172.21.15.110:0/1723670353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2f814a050 0x7ff2f81488b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7ff2ec00b9c0 tx=0x7ff2ec006e20).stop 2021-03-25T14:16:25.881 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.876+0000 7ff2fdad8700 1 -- 172.21.15.110:0/1723670353 shutdown_connections 2021-03-25T14:16:25.881 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.876+0000 7ff2fdad8700 1 --2- 172.21.15.110:0/1723670353 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2f80b99b0 0x7ff2f80ba4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:25.881 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.876+0000 7ff2fdad8700 1 --2- 172.21.15.110:0/1723670353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2f814a050 0x7ff2f81488b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:25.881 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.877+0000 7ff2fdad8700 1 -- 172.21.15.110:0/1723670353 >> 172.21.15.110:0/1723670353 conn(0x7ff2f8060c40 msgr2=0x7ff2f8061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:25.881 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.877+0000 7ff2fdad8700 1 -- 172.21.15.110:0/1723670353 shutdown_connections 2021-03-25T14:16:25.882 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.877+0000 7ff2fdad8700 1 -- 172.21.15.110:0/1723670353 wait complete. 2021-03-25T14:16:25.882 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.878+0000 7ff2fdad8700 1 Processor -- start 2021-03-25T14:16:25.882 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.878+0000 7ff2fdad8700 1 -- start start 2021-03-25T14:16:25.884 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.878+0000 7ff2fdad8700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2f80b99b0 0x7ff2f80b7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:25.885 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.878+0000 7ff2fdad8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2f8148da0 0x7ff2f8064c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:25.885 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.878+0000 7ff2fdad8700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2f814a050 0x7ff2f8063250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:25.885 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.878+0000 7ff2fdad8700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f80b5bf0 con 0x7ff2f814a050 2021-03-25T14:16:25.885 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.878+0000 7ff2fdad8700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f80652c0 con 0x7ff2f80b99b0 2021-03-25T14:16:25.885 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.878+0000 7ff2fdad8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f8065560 con 0x7ff2f8148da0 2021-03-25T14:16:25.885 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.879+0000 7ff2f7fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2f814a050 0x7ff2f8063250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:25.885 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.879+0000 7ff2f7fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2f814a050 0x7ff2f8063250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47698/0 (socket says 172.21.15.110:47698) 2021-03-25T14:16:25.885 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.879+0000 7ff2f7fff700 1 -- 172.21.15.110:0/268291823 learned_addr learned my addr 172.21.15.110:0/268291823 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:25.885 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.879+0000 7ff2f6ffd700 1 --2- 172.21.15.110:0/268291823 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2f8148da0 0x7ff2f8064c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:25.885 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.879+0000 7ff2f77fe700 1 --2- 172.21.15.110:0/268291823 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2f80b99b0 0x7ff2f80b7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:25.885 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.879+0000 7ff2f7fff700 1 -- 172.21.15.110:0/268291823 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2f8148da0 msgr2=0x7ff2f8064c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:25.885 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.879+0000 7ff2f7fff700 1 --2- 172.21.15.110:0/268291823 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2f8148da0 0x7ff2f8064c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:25.886 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.879+0000 7ff2f7fff700 1 -- 172.21.15.110:0/268291823 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2f80b99b0 msgr2=0x7ff2f80b7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:25.886 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.879+0000 7ff2f7fff700 1 --2- 172.21.15.110:0/268291823 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2f80b99b0 0x7ff2f80b7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:25.886 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.879+0000 7ff2f7fff700 1 -- 172.21.15.110:0/268291823 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f80b7410 con 0x7ff2f814a050 2021-03-25T14:16:25.886 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.879+0000 7ff2f77fe700 1 --2- 172.21.15.110:0/268291823 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2f80b99b0 0x7ff2f80b7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:25.886 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.879+0000 7ff2f7fff700 1 --2- 172.21.15.110:0/268291823 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2f814a050 0x7ff2f8063250 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7ff2f0001560 tx=0x7ff2f0007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:25.886 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.879+0000 7ff2df7fe700 1 -- 172.21.15.110:0/268291823 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f0005bb0 con 0x7ff2f814a050 2021-03-25T14:16:25.886 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.879+0000 7ff2df7fe700 1 -- 172.21.15.110:0/268291823 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f0005d10 con 0x7ff2f814a050 2021-03-25T14:16:25.886 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.879+0000 7ff2fdad8700 1 -- 172.21.15.110:0/268291823 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f80b76b0 con 0x7ff2f814a050 2021-03-25T14:16:25.886 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.879+0000 7ff2df7fe700 1 -- 172.21.15.110:0/268291823 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f0007340 con 0x7ff2f814a050 2021-03-25T14:16:25.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.879+0000 7ff2fdad8700 1 -- 172.21.15.110:0/268291823 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f8065dd0 con 0x7ff2f814a050 2021-03-25T14:16:25.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.880+0000 7ff2fdad8700 1 -- 172.21.15.110:0/268291823 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2f80b7840 con 0x7ff2f814a050 2021-03-25T14:16:25.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.880+0000 7ff2df7fe700 1 -- 172.21.15.110:0/268291823 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7ff2f0010030 con 0x7ff2f814a050 2021-03-25T14:16:25.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.881+0000 7ff2df7fe700 1 --2- 172.21.15.110:0/268291823 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff2d805a0b0 0x7ff2d805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:25.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.881+0000 7ff2df7fe700 1 -- 172.21.15.110:0/268291823 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7ff2f0074140 con 0x7ff2f814a050 2021-03-25T14:16:25.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.881+0000 7ff2f77fe700 1 --2- 172.21.15.110:0/268291823 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff2d805a0b0 0x7ff2d805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:25.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.881+0000 7ff2f77fe700 1 --2- 172.21.15.110:0/268291823 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff2d805a0b0 0x7ff2d805c570 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7ff2e8006ba0 tx=0x7ff2e8008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:25.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:25.884+0000 7ff2df7fe700 1 -- 172.21.15.110:0/268291823 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7ff2f00477f0 con 0x7ff2f814a050 2021-03-25T14:16:26.070 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.068+0000 7ff2fdad8700 1 -- 172.21.15.110:0/268291823 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff2f80660b0 con 0x7ff2f814a050 2021-03-25T14:16:26.071 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.069+0000 7ff2df7fe700 1 -- 172.21.15.110:0/268291823 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+2846 (secure 0 0 0) 0x7ff2f004ae10 con 0x7ff2f814a050 2021-03-25T14:16:26.071 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:16:26.071 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1177985428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6833","nonce":1177985428},{"type":"v1","addr":"172.21.15.174:6835","nonce":1177985428}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.110:6836/3814723779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3814723779},{"type":"v1","addr":"172.21.15.110:6836","nonce":3814723779}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":4},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1613822797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1613822797},{"type":"v1","addr":"172.21.15.110:6837","nonce":1613822797}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-03-25T14:16:11.090720+0000","modified":"2021-03-25T14:16:25.750002+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"b","rank":0,"incarnation":5,"state":"up:active","state_seq":4,"addr":"172.21.15.174:6834/1564441351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1564441351},{"type":"v1","addr":"172.21.15.174:6834","nonce":1564441351}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-03-25T14:16:26.072 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.070+0000 7ff2fdad8700 1 -- 172.21.15.110:0/268291823 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff2d805a0b0 msgr2=0x7ff2d805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:26.072 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.070+0000 7ff2fdad8700 1 --2- 172.21.15.110:0/268291823 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff2d805a0b0 0x7ff2d805c570 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7ff2e8006ba0 tx=0x7ff2e8008040).stop 2021-03-25T14:16:26.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.070+0000 7ff2fdad8700 1 -- 172.21.15.110:0/268291823 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2f814a050 msgr2=0x7ff2f8063250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:26.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.070+0000 7ff2fdad8700 1 --2- 172.21.15.110:0/268291823 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2f814a050 0x7ff2f8063250 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7ff2f0001560 tx=0x7ff2f0007e10).stop 2021-03-25T14:16:26.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.070+0000 7ff2fdad8700 1 -- 172.21.15.110:0/268291823 shutdown_connections 2021-03-25T14:16:26.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.070+0000 7ff2fdad8700 1 --2- 172.21.15.110:0/268291823 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff2d805a0b0 0x7ff2d805c570 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:26.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.070+0000 7ff2fdad8700 1 --2- 172.21.15.110:0/268291823 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2f80b99b0 0x7ff2f80b7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:26.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.070+0000 7ff2fdad8700 1 --2- 172.21.15.110:0/268291823 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2f814a050 0x7ff2f8063250 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:26.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.070+0000 7ff2fdad8700 1 --2- 172.21.15.110:0/268291823 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2f8148da0 0x7ff2f8064c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:26.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.070+0000 7ff2fdad8700 1 -- 172.21.15.110:0/268291823 >> 172.21.15.110:0/268291823 conn(0x7ff2f8060c40 msgr2=0x7ff2f814cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:26.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.070+0000 7ff2fdad8700 1 -- 172.21.15.110:0/268291823 shutdown_connections 2021-03-25T14:16:26.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.070+0000 7ff2fdad8700 1 -- 172.21.15.110:0/268291823 wait complete. 2021-03-25T14:16:26.074 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 9 2021-03-25T14:16:26.084 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:16:26.194 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.192+0000 7f3080a2f700 1 Processor -- start 2021-03-25T14:16:26.194 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.192+0000 7f3080a2f700 1 -- start start 2021-03-25T14:16:26.196 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.193+0000 7f3080a2f700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f307c148fc0 0x7f307c14a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:26.196 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.193+0000 7f3080a2f700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f307c14a540 con 0x7f307c0b99b0 2021-03-25T14:16:26.196 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.193+0000 7f3080a2f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f307c0ba950 con 0x7f307c0ba4f0 2021-03-25T14:16:26.196 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.193+0000 7f3080a2f700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f307c149430 con 0x7f307c148fc0 2021-03-25T14:16:26.196 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.193+0000 7f307ad9d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f307c148fc0 0x7f307c14a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:26.196 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.193+0000 7f307ad9d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f307c148fc0 0x7f307c14a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47706/0 (socket says 172.21.15.110:47706) 2021-03-25T14:16:26.196 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.193+0000 7f307a59c700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f307c0b99b0 0x7f307c1488b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:40638/0 (socket says 172.21.15.110:40638) 2021-03-25T14:16:26.196 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.193+0000 7f307ad9d700 1 -- 172.21.15.110:0/1574597303 learned_addr learned my addr 172.21.15.110:0/1574597303 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:26.196 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.193+0000 7f307ad9d700 1 -- 172.21.15.110:0/1574597303 >> v1:172.21.15.174:6789/0 conn(0x7f307c0ba4f0 legacy=0x7f307c0a3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:26.197 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.193+0000 7f307ad9d700 1 -- 172.21.15.110:0/1574597303 >> v1:172.21.15.110:6789/0 conn(0x7f307c0b99b0 legacy=0x7f307c1488b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:26.197 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.193+0000 7f307ad9d700 1 -- 172.21.15.110:0/1574597303 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f307c0babc0 con 0x7f307c148fc0 2021-03-25T14:16:26.197 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.193+0000 7f307959a700 1 -- 172.21.15.110:0/1574597303 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3277785380 0 0) 0x7f307c14a540 con 0x7f307c0b99b0 2021-03-25T14:16:26.197 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.193+0000 7f307ad9d700 1 --2- 172.21.15.110:0/1574597303 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f307c148fc0 0x7f307c14a050 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f3074009d90 tx=0x7f30740092d0).ready entity=mon.0 client_cookie=584eb6ebce5d0566 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:26.197 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.193+0000 7f307959a700 1 -- 172.21.15.110:0/1574597303 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307400bc80 con 0x7f307c148fc0 2021-03-25T14:16:26.197 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.193+0000 7f307959a700 1 -- 172.21.15.110:0/1574597303 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f307400bde0 con 0x7f307c148fc0 2021-03-25T14:16:26.197 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.193+0000 7f307959a700 1 -- 172.21.15.110:0/1574597303 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3074011610 con 0x7f307c148fc0 2021-03-25T14:16:26.197 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.194+0000 7f3080a2f700 1 -- 172.21.15.110:0/1574597303 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f307c148fc0 msgr2=0x7f307c14a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:26.197 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.194+0000 7f3080a2f700 1 --2- 172.21.15.110:0/1574597303 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f307c148fc0 0x7f307c14a050 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f3074009d90 tx=0x7f30740092d0).stop 2021-03-25T14:16:26.197 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.194+0000 7f3080a2f700 1 -- 172.21.15.110:0/1574597303 shutdown_connections 2021-03-25T14:16:26.197 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.194+0000 7f3080a2f700 1 --2- 172.21.15.110:0/1574597303 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f307c148fc0 0x7f307c14a050 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:26.197 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.194+0000 7f3080a2f700 1 -- 172.21.15.110:0/1574597303 >> 172.21.15.110:0/1574597303 conn(0x7f307c060c40 msgr2=0x7f307c061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:26.197 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.194+0000 7f3080a2f700 1 -- 172.21.15.110:0/1574597303 shutdown_connections 2021-03-25T14:16:26.197 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.194+0000 7f3080a2f700 1 -- 172.21.15.110:0/1574597303 wait complete. 2021-03-25T14:16:26.200 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.195+0000 7f3080a2f700 1 Processor -- start 2021-03-25T14:16:26.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.195+0000 7f3080a2f700 1 -- start start 2021-03-25T14:16:26.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.196+0000 7f3080a2f700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f307c0b99b0 0x7f307c0b6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:26.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.196+0000 7f3080a2f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f307c0ba4f0 0x7f307c14ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:26.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.196+0000 7f3080a2f700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f307c148fc0 0x7f307c14eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:26.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.196+0000 7f3080a2f700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307c0b6d40 con 0x7f307c148fc0 2021-03-25T14:16:26.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.196+0000 7f3080a2f700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307c158b10 con 0x7f307c0b99b0 2021-03-25T14:16:26.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.196+0000 7f3080a2f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f307c158db0 con 0x7f307c0ba4f0 2021-03-25T14:16:26.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.196+0000 7f307ad9d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f307c148fc0 0x7f307c14eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:26.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.196+0000 7f307ad9d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f307c148fc0 0x7f307c14eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47712/0 (socket says 172.21.15.110:47712) 2021-03-25T14:16:26.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.196+0000 7f307ad9d700 1 -- 172.21.15.110:0/368310859 learned_addr learned my addr 172.21.15.110:0/368310859 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:26.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.196+0000 7f3079d9b700 1 --2- 172.21.15.110:0/368310859 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f307c0ba4f0 0x7f307c14ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:26.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.196+0000 7f307a59c700 1 --2- 172.21.15.110:0/368310859 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f307c0b99b0 0x7f307c0b6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:26.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.196+0000 7f307ad9d700 1 -- 172.21.15.110:0/368310859 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f307c0ba4f0 msgr2=0x7f307c14ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:26.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.196+0000 7f307ad9d700 1 --2- 172.21.15.110:0/368310859 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f307c0ba4f0 0x7f307c14ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:26.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.196+0000 7f307ad9d700 1 -- 172.21.15.110:0/368310859 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f307c0b99b0 msgr2=0x7f307c0b6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:26.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.196+0000 7f307ad9d700 1 --2- 172.21.15.110:0/368310859 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f307c0b99b0 0x7f307c0b6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:26.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.196+0000 7f307ad9d700 1 -- 172.21.15.110:0/368310859 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f307c159050 con 0x7f307c148fc0 2021-03-25T14:16:26.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.196+0000 7f3079d9b700 1 --2- 172.21.15.110:0/368310859 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f307c0ba4f0 0x7f307c14ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:26.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.196+0000 7f307a59c700 1 --2- 172.21.15.110:0/368310859 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f307c0b99b0 0x7f307c0b6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:26.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.196+0000 7f307ad9d700 1 --2- 172.21.15.110:0/368310859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f307c148fc0 0x7f307c14eeb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f307c05d2b0 tx=0x7f3074017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:26.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.196+0000 7f306a7fc700 1 -- 172.21.15.110:0/368310859 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307400bc80 con 0x7f307c148fc0 2021-03-25T14:16:26.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.196+0000 7f306a7fc700 1 -- 172.21.15.110:0/368310859 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3074011e30 con 0x7f307c148fc0 2021-03-25T14:16:26.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.196+0000 7f3080a2f700 1 -- 172.21.15.110:0/368310859 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f307c158830 con 0x7f307c148fc0 2021-03-25T14:16:26.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.196+0000 7f306a7fc700 1 -- 172.21.15.110:0/368310859 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3074010e10 con 0x7f307c148fc0 2021-03-25T14:16:26.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.196+0000 7f3080a2f700 1 -- 172.21.15.110:0/368310859 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f307c0b7970 con 0x7f307c148fc0 2021-03-25T14:16:26.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.197+0000 7f3080a2f700 1 -- 172.21.15.110:0/368310859 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f307c05d7b0 con 0x7f307c148fc0 2021-03-25T14:16:26.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.197+0000 7f306a7fc700 1 -- 172.21.15.110:0/368310859 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f307400f070 con 0x7f307c148fc0 2021-03-25T14:16:26.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.198+0000 7f306a7fc700 1 --2- 172.21.15.110:0/368310859 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f305805a0b0 0x7f305805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:26.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.198+0000 7f306a7fc700 1 -- 172.21.15.110:0/368310859 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f3074075f00 con 0x7f307c148fc0 2021-03-25T14:16:26.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.198+0000 7f307a59c700 1 --2- 172.21.15.110:0/368310859 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f305805a0b0 0x7f305805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:26.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.198+0000 7f307a59c700 1 --2- 172.21.15.110:0/368310859 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f305805a0b0 0x7f305805c570 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f307c14dab0 tx=0x7f3070009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:26.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.201+0000 7f306a7fc700 1 -- 172.21.15.110:0/368310859 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f30740495b0 con 0x7f307c148fc0 2021-03-25T14:16:26.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.352+0000 7f3080a2f700 1 -- 172.21.15.110:0/368310859 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f307c0a4000 con 0x7f307c148fc0 2021-03-25T14:16:26.355 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.352+0000 7f306a7fc700 1 -- 172.21.15.110:0/368310859 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18685 (secure 0 0 0) 0x7f307404cbd0 con 0x7f307c148fc0 2021-03-25T14:16:26.356 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:16:26.356 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":25,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:16:15.446609+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-03-25T14:16:09.478442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-03-25T14:16:10.071152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2021-03-25T14:16:13.122119+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:16:26.357 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.354+0000 7f3080a2f700 1 -- 172.21.15.110:0/368310859 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f305805a0b0 msgr2=0x7f305805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:26.357 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.354+0000 7f3080a2f700 1 --2- 172.21.15.110:0/368310859 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f305805a0b0 0x7f305805c570 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f307c14dab0 tx=0x7f3070009040).stop 2021-03-25T14:16:26.357 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.354+0000 7f3080a2f700 1 -- 172.21.15.110:0/368310859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f307c148fc0 msgr2=0x7f307c14eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:26.357 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.354+0000 7f3080a2f700 1 --2- 172.21.15.110:0/368310859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f307c148fc0 0x7f307c14eeb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f307c05d2b0 tx=0x7f3074017000).stop 2021-03-25T14:16:26.357 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.354+0000 7f3080a2f700 1 -- 172.21.15.110:0/368310859 shutdown_connections 2021-03-25T14:16:26.357 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.354+0000 7f3080a2f700 1 --2- 172.21.15.110:0/368310859 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f305805a0b0 0x7f305805c570 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:26.357 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.354+0000 7f3080a2f700 1 --2- 172.21.15.110:0/368310859 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f307c0b99b0 0x7f307c0b6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:26.357 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.354+0000 7f3080a2f700 1 --2- 172.21.15.110:0/368310859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f307c148fc0 0x7f307c14eeb0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:26.357 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.354+0000 7f3080a2f700 1 --2- 172.21.15.110:0/368310859 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f307c0ba4f0 0x7f307c14ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:26.358 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.354+0000 7f3080a2f700 1 -- 172.21.15.110:0/368310859 >> 172.21.15.110:0/368310859 conn(0x7f307c060c40 msgr2=0x7f307c148680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:26.358 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.354+0000 7f3080a2f700 1 -- 172.21.15.110:0/368310859 shutdown_connections 2021-03-25T14:16:26.358 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.354+0000 7f3080a2f700 1 -- 172.21.15.110:0/368310859 wait complete. 2021-03-25T14:16:26.368 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:16:26.369 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2021-03-25T14:16:26.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.476+0000 7f8685c34700 1 Processor -- start 2021-03-25T14:16:26.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.476+0000 7f8685c34700 1 -- start start 2021-03-25T14:16:26.481 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.477+0000 7f8685c34700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f86800b99b0 0x7f86800ba4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:26.481 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.477+0000 7f8685c34700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f868014a050 0x7f86801488b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:26.481 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.477+0000 7f8685c34700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86800babc0 con 0x7f8680148da0 2021-03-25T14:16:26.481 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.477+0000 7f8685c34700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86800ba9e0 con 0x7f86800b99b0 2021-03-25T14:16:26.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.477+0000 7f8685c34700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86800bae60 con 0x7f868014a050 2021-03-25T14:16:26.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.477+0000 7f867f7fe700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f86800b99b0 0x7f86800ba4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:26.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.477+0000 7f867ffff700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f8680148da0 0x7f86800a3190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:40654/0 (socket says 172.21.15.110:40654) 2021-03-25T14:16:26.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.477+0000 7f867ffff700 1 -- 172.21.15.110:0/1922130792 learned_addr learned my addr 172.21.15.110:0/1922130792 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:26.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.477+0000 7f867effd700 1 --2- 172.21.15.110:0/1922130792 >> v2:172.21.15.174:3300/0 conn(0x7f868014a050 0x7f86801488b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:26.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.477+0000 7f867f7fe700 1 -- 172.21.15.110:0/1922130792 >> v2:172.21.15.174:3300/0 conn(0x7f868014a050 msgr2=0x7f86801488b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:26.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.477+0000 7f867f7fe700 1 --2- 172.21.15.110:0/1922130792 >> v2:172.21.15.174:3300/0 conn(0x7f868014a050 0x7f86801488b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:26.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.477+0000 7f867f7fe700 1 -- 172.21.15.110:0/1922130792 >> v1:172.21.15.110:6789/0 conn(0x7f8680148da0 legacy=0x7f86800a3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:26.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.477+0000 7f867f7fe700 1 -- 172.21.15.110:0/1922130792 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86800a2a50 con 0x7f86800b99b0 2021-03-25T14:16:26.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.477+0000 7f867e7fc700 1 -- 172.21.15.110:0/1922130792 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1468870088 0 0) 0x7f86800babc0 con 0x7f8680148da0 2021-03-25T14:16:26.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.478+0000 7f867f7fe700 1 --2- 172.21.15.110:0/1922130792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86800b99b0 0x7f86800ba4f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f8680069e70 tx=0x7f8670006dc0).ready entity=mon.0 client_cookie=490d52b26f2c90a1 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:26.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.478+0000 7f867e7fc700 1 -- 172.21.15.110:0/1922130792 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8670006030 con 0x7f86800b99b0 2021-03-25T14:16:26.483 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.478+0000 7f867e7fc700 1 -- 172.21.15.110:0/1922130792 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8670006190 con 0x7f86800b99b0 2021-03-25T14:16:26.483 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.478+0000 7f867e7fc700 1 -- 172.21.15.110:0/1922130792 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8670006510 con 0x7f86800b99b0 2021-03-25T14:16:26.483 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.478+0000 7f8685c34700 1 -- 172.21.15.110:0/1922130792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86800b99b0 msgr2=0x7f86800ba4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:26.483 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.478+0000 7f8685c34700 1 --2- 172.21.15.110:0/1922130792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86800b99b0 0x7f86800ba4f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f8680069e70 tx=0x7f8670006dc0).stop 2021-03-25T14:16:26.483 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.478+0000 7f8685c34700 1 -- 172.21.15.110:0/1922130792 shutdown_connections 2021-03-25T14:16:26.483 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.478+0000 7f8685c34700 1 --2- 172.21.15.110:0/1922130792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86800b99b0 0x7f86800ba4f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:26.483 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.478+0000 7f8685c34700 1 --2- 172.21.15.110:0/1922130792 >> v2:172.21.15.174:3300/0 conn(0x7f868014a050 0x7f86801488b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:26.483 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.478+0000 7f8685c34700 1 -- 172.21.15.110:0/1922130792 >> 172.21.15.110:0/1922130792 conn(0x7f8680060c40 msgr2=0x7f8680061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:26.483 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.478+0000 7f8685c34700 1 -- 172.21.15.110:0/1922130792 shutdown_connections 2021-03-25T14:16:26.483 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.478+0000 7f8685c34700 1 -- 172.21.15.110:0/1922130792 wait complete. 2021-03-25T14:16:26.483 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.479+0000 7f8685c34700 1 Processor -- start 2021-03-25T14:16:26.483 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.479+0000 7f8685c34700 1 -- start start 2021-03-25T14:16:26.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.480+0000 7f8685c34700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f86800b99b0 0x7f8680144bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:26.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.480+0000 7f8685c34700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8680148da0 0x7f8680064cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:26.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.480+0000 7f8685c34700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f868014a050 0x7f86800651a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:26.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.480+0000 7f8685c34700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8680158e60 con 0x7f8680148da0 2021-03-25T14:16:26.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.480+0000 7f8685c34700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8680159100 con 0x7f868014a050 2021-03-25T14:16:26.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.480+0000 7f8685c34700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86801593a0 con 0x7f86800b99b0 2021-03-25T14:16:26.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.480+0000 7f867effd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8680148da0 0x7f8680064cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:26.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.480+0000 7f867effd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8680148da0 0x7f8680064cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47724/0 (socket says 172.21.15.110:47724) 2021-03-25T14:16:26.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.480+0000 7f867effd700 1 -- 172.21.15.110:0/264867273 learned_addr learned my addr 172.21.15.110:0/264867273 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:26.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.480+0000 7f867ffff700 1 --2- 172.21.15.110:0/264867273 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f868014a050 0x7f86800651a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:26.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.480+0000 7f867effd700 1 -- 172.21.15.110:0/264867273 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f86800b99b0 msgr2=0x7f8680144bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:26.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.480+0000 7f867f7fe700 1 --2- 172.21.15.110:0/264867273 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f86800b99b0 0x7f8680144bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:26.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.481+0000 7f867effd700 1 --2- 172.21.15.110:0/264867273 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f86800b99b0 0x7f8680144bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:26.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.481+0000 7f867effd700 1 -- 172.21.15.110:0/264867273 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f868014a050 msgr2=0x7f86800651a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:26.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.481+0000 7f867effd700 1 --2- 172.21.15.110:0/264867273 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f868014a050 0x7f86800651a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:26.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.481+0000 7f867effd700 1 -- 172.21.15.110:0/264867273 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8680159640 con 0x7f8680148da0 2021-03-25T14:16:26.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.481+0000 7f867ffff700 1 --2- 172.21.15.110:0/264867273 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f868014a050 0x7f86800651a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:26.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.481+0000 7f867effd700 1 --2- 172.21.15.110:0/264867273 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8680148da0 0x7f8680064cb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f867400bfd0 tx=0x7f8674008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:26.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.481+0000 7f86677fe700 1 -- 172.21.15.110:0/264867273 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867400de10 con 0x7f8680148da0 2021-03-25T14:16:26.488 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.481+0000 7f86677fe700 1 -- 172.21.15.110:0/264867273 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86740097c0 con 0x7f8680148da0 2021-03-25T14:16:26.488 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.481+0000 7f8685c34700 1 -- 172.21.15.110:0/264867273 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86801598e0 con 0x7f8680148da0 2021-03-25T14:16:26.488 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.481+0000 7f86677fe700 1 -- 172.21.15.110:0/264867273 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8674009b40 con 0x7f8680148da0 2021-03-25T14:16:26.488 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.481+0000 7f8685c34700 1 -- 172.21.15.110:0/264867273 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8680158a70 con 0x7f8680148da0 2021-03-25T14:16:26.488 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.482+0000 7f8685c34700 1 -- 172.21.15.110:0/264867273 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f868005d7b0 con 0x7f8680148da0 2021-03-25T14:16:26.488 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.482+0000 7f86677fe700 1 -- 172.21.15.110:0/264867273 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f8674013480 con 0x7f8680148da0 2021-03-25T14:16:26.488 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.482+0000 7f86677fe700 1 --2- 172.21.15.110:0/264867273 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f866005a0b0 0x7f866005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:26.488 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.482+0000 7f86677fe700 1 -- 172.21.15.110:0/264867273 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f8674074390 con 0x7f8680148da0 2021-03-25T14:16:26.488 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.483+0000 7f867f7fe700 1 --2- 172.21.15.110:0/264867273 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f866005a0b0 0x7f866005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:26.488 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.483+0000 7f867f7fe700 1 --2- 172.21.15.110:0/264867273 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f866005a0b0 0x7f866005c570 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f8670007fd0 tx=0x7f8670015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:26.489 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.486+0000 7f86677fe700 1 -- 172.21.15.110:0/264867273 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f86740479e0 con 0x7f8680148da0 2021-03-25T14:16:26.636 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.635+0000 7f8685c34700 1 -- 172.21.15.110:0/264867273 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86800a4000 con 0x7f8680148da0 2021-03-25T14:16:26.637 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.635+0000 7f86677fe700 1 -- 172.21.15.110:0/264867273 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18685 (secure 0 0 0) 0x7f867404b000 con 0x7f8680148da0 2021-03-25T14:16:26.638 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:16:26.638 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":25,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:16:15.446609+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-03-25T14:16:09.478442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-03-25T14:16:10.071152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2021-03-25T14:16:13.122119+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:16:26.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.637+0000 7f8685c34700 1 -- 172.21.15.110:0/264867273 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f866005a0b0 msgr2=0x7f866005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:26.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.637+0000 7f8685c34700 1 --2- 172.21.15.110:0/264867273 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f866005a0b0 0x7f866005c570 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f8670007fd0 tx=0x7f8670015000).stop 2021-03-25T14:16:26.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.637+0000 7f8685c34700 1 -- 172.21.15.110:0/264867273 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8680148da0 msgr2=0x7f8680064cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:26.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.637+0000 7f8685c34700 1 --2- 172.21.15.110:0/264867273 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8680148da0 0x7f8680064cb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f867400bfd0 tx=0x7f8674008040).stop 2021-03-25T14:16:26.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.637+0000 7f8685c34700 1 -- 172.21.15.110:0/264867273 shutdown_connections 2021-03-25T14:16:26.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.637+0000 7f8685c34700 1 --2- 172.21.15.110:0/264867273 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f866005a0b0 0x7f866005c570 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:26.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.637+0000 7f8685c34700 1 --2- 172.21.15.110:0/264867273 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f868014a050 0x7f86800651a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:26.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.637+0000 7f8685c34700 1 --2- 172.21.15.110:0/264867273 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f86800b99b0 0x7f8680144bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:26.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.637+0000 7f8685c34700 1 --2- 172.21.15.110:0/264867273 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8680148da0 0x7f8680064cb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:26.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.637+0000 7f8685c34700 1 -- 172.21.15.110:0/264867273 >> 172.21.15.110:0/264867273 conn(0x7f8680060c40 msgr2=0x7f86801473b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:26.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.637+0000 7f8685c34700 1 -- 172.21.15.110:0/264867273 shutdown_connections 2021-03-25T14:16:26.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.637+0000 7f8685c34700 1 -- 172.21.15.110:0/264867273 wait complete. 2021-03-25T14:16:26.651 INFO:tasks.ceph.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-03-25T14:15:59.047299+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-03-25T14:16:00.537926+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-03-25T14:16:09.478442+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-03-25T14:16:10.071152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2021-03-25T14:16:13.122119+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-03-25T14:16:26.651 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-03-25T14:16:26.764 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.762+0000 7febacd12700 1 Processor -- start 2021-03-25T14:16:26.764 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.762+0000 7febacd12700 1 -- start start 2021-03-25T14:16:26.770 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.763+0000 7febacd12700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feba8068f00 0x7feba8063e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:26.770 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.763+0000 7febacd12700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba805cdc0 con 0x7feba80bbb10 2021-03-25T14:16:26.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.763+0000 7febacd12700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba8064360 con 0x7feba8064570 2021-03-25T14:16:26.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.763+0000 7febacd12700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba81470b0 con 0x7feba8068f00 2021-03-25T14:16:26.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.763+0000 7feba77fe700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7feba80bbb10 0x7feba80678f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:40666/0 (socket says 172.21.15.110:40666) 2021-03-25T14:16:26.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.763+0000 7feba77fe700 1 -- 172.21.15.110:0/2824304011 learned_addr learned my addr 172.21.15.110:0/2824304011 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:26.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.763+0000 7feba67fc700 1 -- 172.21.15.110:0/2824304011 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2690736756 0 0) 0x7feba805cdc0 con 0x7feba80bbb10 2021-03-25T14:16:26.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.764+0000 7feba6ffd700 1 --2- 172.21.15.110:0/2824304011 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feba8068f00 0x7feba8063e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:26.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.764+0000 7feba67fc700 1 -- 172.21.15.110:0/2824304011 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb94003270 con 0x7feba80bbb10 2021-03-25T14:16:26.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.764+0000 7feba67fc700 1 -- 172.21.15.110:0/2824304011 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 428498795 0 0) 0x7feb94003270 con 0x7feba80bbb10 2021-03-25T14:16:26.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.764+0000 7feba67fc700 1 -- 172.21.15.110:0/2824304011 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feba8068f00 msgr2=0x7feba8063e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:26.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.764+0000 7feba67fc700 1 --2- 172.21.15.110:0/2824304011 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feba8068f00 0x7feba8063e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:26.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.764+0000 7feba67fc700 1 -- 172.21.15.110:0/2824304011 >> v1:172.21.15.174:6789/0 conn(0x7feba8064570 legacy=0x7feba8061c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:26.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.764+0000 7feba67fc700 1 -- 172.21.15.110:0/2824304011 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba814a3b0 con 0x7feba80bbb10 2021-03-25T14:16:26.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.764+0000 7feba67fc700 1 -- 172.21.15.110:0/2824304011 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7feb98001520 con 0x7feba80bbb10 2021-03-25T14:16:26.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.764+0000 7feba67fc700 1 -- 172.21.15.110:0/2824304011 >> v1:172.21.15.110:6789/0 conn(0x7feba80bbb10 legacy=0x7feba80678f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:26.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.764+0000 7feba67fc700 1 --2- 172.21.15.110:0/2824304011 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb94003790 0x7feb94003bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:26.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.764+0000 7feba67fc700 1 --2- 172.21.15.110:0/2824304011 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb94004510 0x7feb94004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:26.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.764+0000 7feba67fc700 1 --2- 172.21.15.110:0/2824304011 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feba8068f00 0x7feb94004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:26.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.764+0000 7feba67fc700 1 -- 172.21.15.110:0/2824304011 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba81470b0 con 0x7feb94004510 2021-03-25T14:16:26.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.764+0000 7feba67fc700 1 -- 172.21.15.110:0/2824304011 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb940053c0 con 0x7feb94003790 2021-03-25T14:16:26.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.764+0000 7feba67fc700 1 -- 172.21.15.110:0/2824304011 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb94004350 con 0x7feba8068f00 2021-03-25T14:16:26.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.764+0000 7feba6ffd700 1 --2- 172.21.15.110:0/2824304011 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb94004510 0x7feb94004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:26.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.764+0000 7feba77fe700 1 --2- 172.21.15.110:0/2824304011 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb94003790 0x7feb94003bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:26.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.764+0000 7feba7fff700 1 --2- 172.21.15.110:0/2824304011 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feba8068f00 0x7feb94004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:26.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.764+0000 7feba6ffd700 1 -- 172.21.15.110:0/2824304011 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feba8068f00 msgr2=0x7feb94004e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:26.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.764+0000 7feba6ffd700 1 --2- 172.21.15.110:0/2824304011 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feba8068f00 0x7feb94004e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:26.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.764+0000 7feba6ffd700 1 -- 172.21.15.110:0/2824304011 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb94003790 msgr2=0x7feb94003bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:26.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.764+0000 7feba6ffd700 1 --2- 172.21.15.110:0/2824304011 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb94003790 0x7feb94003bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:26.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.764+0000 7feba6ffd700 1 -- 172.21.15.110:0/2824304011 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb94003270 con 0x7feb94004510 2021-03-25T14:16:26.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.764+0000 7feba7fff700 1 --2- 172.21.15.110:0/2824304011 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feba8068f00 0x7feb94004e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:26.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.764+0000 7feba6ffd700 1 --2- 172.21.15.110:0/2824304011 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb94004510 0x7feb94004990 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7feb9c00bc30 tx=0x7feb9c006e20).ready entity=mon.0 client_cookie=1b0beeaeec96e8fb server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:26.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.765+0000 7feba67fc700 1 -- 172.21.15.110:0/2824304011 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c00b310 con 0x7feb94004510 2021-03-25T14:16:26.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.765+0000 7feba67fc700 1 -- 172.21.15.110:0/2824304011 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9c00ea00 con 0x7feb94004510 2021-03-25T14:16:26.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.765+0000 7feba67fc700 1 -- 172.21.15.110:0/2824304011 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c00ed80 con 0x7feb94004510 2021-03-25T14:16:26.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.765+0000 7febacd12700 1 -- 172.21.15.110:0/2824304011 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb94004510 msgr2=0x7feb94004990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:26.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.765+0000 7febacd12700 1 --2- 172.21.15.110:0/2824304011 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb94004510 0x7feb94004990 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7feb9c00bc30 tx=0x7feb9c006e20).stop 2021-03-25T14:16:26.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.765+0000 7feba7fff700 1 -- 172.21.15.110:0/2824304011 reap_dead start 2021-03-25T14:16:26.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.765+0000 7febacd12700 1 -- 172.21.15.110:0/2824304011 shutdown_connections 2021-03-25T14:16:26.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.765+0000 7febacd12700 1 -- 172.21.15.110:0/2824304011 >> 172.21.15.110:0/2824304011 conn(0x7feba80bccb0 msgr2=0x7feba80b8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:26.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.765+0000 7febacd12700 1 -- 172.21.15.110:0/2824304011 shutdown_connections 2021-03-25T14:16:26.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.765+0000 7febacd12700 1 -- 172.21.15.110:0/2824304011 wait complete. 2021-03-25T14:16:26.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.766+0000 7febacd12700 1 Processor -- start 2021-03-25T14:16:26.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.766+0000 7febacd12700 1 -- start start 2021-03-25T14:16:26.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.767+0000 7febacd12700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feba80b25a0 0x7feba815ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:26.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.767+0000 7febacd12700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feba8144000 0x7feba8144480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:26.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.767+0000 7febacd12700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feba80a0b90 0x7feba80a1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:26.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.767+0000 7febacd12700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba8144970 con 0x7feba80b25a0 2021-03-25T14:16:26.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.767+0000 7febacd12700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba815d300 con 0x7feba8144000 2021-03-25T14:16:26.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.767+0000 7febacd12700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba80b39d0 con 0x7feba80a0b90 2021-03-25T14:16:26.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.767+0000 7feba77fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feba80b25a0 0x7feba815ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:26.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.767+0000 7feba77fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feba80b25a0 0x7feba815ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47742/0 (socket says 172.21.15.110:47742) 2021-03-25T14:16:26.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.767+0000 7feba77fe700 1 -- 172.21.15.110:0/1400860390 learned_addr learned my addr 172.21.15.110:0/1400860390 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:26.775 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.767+0000 7feba6ffd700 1 --2- 172.21.15.110:0/1400860390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feba8144000 0x7feba8144480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:26.775 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.768+0000 7feba77fe700 1 -- 172.21.15.110:0/1400860390 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feba80a0b90 msgr2=0x7feba80a1010 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-25T14:16:26.775 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.768+0000 7feba77fe700 1 --2- 172.21.15.110:0/1400860390 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feba80a0b90 0x7feba80a1010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:16:26.775 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.768+0000 7feba77fe700 1 -- 172.21.15.110:0/1400860390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feba8144000 msgr2=0x7feba8144480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:26.775 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.768+0000 7feba77fe700 1 --2- 172.21.15.110:0/1400860390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feba8144000 0x7feba8144480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:26.775 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.768+0000 7feba77fe700 1 -- 172.21.15.110:0/1400860390 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba80b3c70 con 0x7feba80b25a0 2021-03-25T14:16:26.775 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.768+0000 7feba77fe700 1 --2- 172.21.15.110:0/1400860390 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feba80b25a0 0x7feba815ce10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7feb98004bf0 tx=0x7feb98007800).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:26.775 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.768+0000 7feb8f7fe700 1 -- 172.21.15.110:0/1400860390 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9800fa00 con 0x7feba80b25a0 2021-03-25T14:16:26.775 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.768+0000 7feb8f7fe700 1 -- 172.21.15.110:0/1400860390 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9800fb60 con 0x7feba80b25a0 2021-03-25T14:16:26.775 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.768+0000 7feb8f7fe700 1 -- 172.21.15.110:0/1400860390 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb98012350 con 0x7feba80b25a0 2021-03-25T14:16:26.775 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.768+0000 7febacd12700 1 -- 172.21.15.110:0/1400860390 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba80b3f10 con 0x7feba80b25a0 2021-03-25T14:16:26.775 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.768+0000 7febacd12700 1 -- 172.21.15.110:0/1400860390 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba80a06f0 con 0x7feba80b25a0 2021-03-25T14:16:26.776 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.769+0000 7febacd12700 1 -- 172.21.15.110:0/1400860390 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba80b6e10 con 0x7feba80b25a0 2021-03-25T14:16:26.776 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.769+0000 7feb8f7fe700 1 -- 172.21.15.110:0/1400860390 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7feb9801b030 con 0x7feba80b25a0 2021-03-25T14:16:26.776 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.770+0000 7feb8f7fe700 1 --2- 172.21.15.110:0/1400860390 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7feb8805a0b0 0x7feb8805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:26.777 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.770+0000 7feb8f7fe700 1 -- 172.21.15.110:0/1400860390 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7feb980739e0 con 0x7feba80b25a0 2021-03-25T14:16:26.777 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.770+0000 7feba6ffd700 1 --2- 172.21.15.110:0/1400860390 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7feb8805a0b0 0x7feb8805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:26.777 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.770+0000 7feba6ffd700 1 --2- 172.21.15.110:0/1400860390 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7feb8805a0b0 0x7feb8805c570 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7feba805fdb0 tx=0x7feb9c019000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:26.777 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.773+0000 7feb8f7fe700 1 -- 172.21.15.110:0/1400860390 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7feb98047090 con 0x7feba80b25a0 2021-03-25T14:16:26.924 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.922+0000 7febacd12700 1 -- 172.21.15.110:0/1400860390 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7feba8045ae0 con 0x7feba80b25a0 2021-03-25T14:16:26.925 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.923+0000 7feb8f7fe700 1 -- 172.21.15.110:0/1400860390 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7feb9804a6b0 con 0x7feba80b25a0 2021-03-25T14:16:26.925 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 1 2021-03-25T14:16:26.926 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.924+0000 7febacd12700 1 -- 172.21.15.110:0/1400860390 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7feb8805a0b0 msgr2=0x7feb8805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:26.927 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.924+0000 7febacd12700 1 --2- 172.21.15.110:0/1400860390 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7feb8805a0b0 0x7feb8805c570 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7feba805fdb0 tx=0x7feb9c019000).stop 2021-03-25T14:16:26.927 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.924+0000 7febacd12700 1 -- 172.21.15.110:0/1400860390 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feba80b25a0 msgr2=0x7feba815ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:26.927 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.924+0000 7febacd12700 1 --2- 172.21.15.110:0/1400860390 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feba80b25a0 0x7feba815ce10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7feb98004bf0 tx=0x7feb98007800).stop 2021-03-25T14:16:26.927 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.924+0000 7febacd12700 1 -- 172.21.15.110:0/1400860390 shutdown_connections 2021-03-25T14:16:26.927 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.924+0000 7febacd12700 1 --2- 172.21.15.110:0/1400860390 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7feb8805a0b0 0x7feb8805c570 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:26.927 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.924+0000 7febacd12700 1 --2- 172.21.15.110:0/1400860390 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feba80a0b90 0x7feba80a1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:16:26.927 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.924+0000 7febacd12700 1 --2- 172.21.15.110:0/1400860390 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feba80b25a0 0x7feba815ce10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:26.927 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.924+0000 7febacd12700 1 --2- 172.21.15.110:0/1400860390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feba8144000 0x7feba8144480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:26.927 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.924+0000 7febacd12700 1 -- 172.21.15.110:0/1400860390 >> 172.21.15.110:0/1400860390 conn(0x7feba80bccb0 msgr2=0x7feba80680a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:26.927 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.924+0000 7febacd12700 1 -- 172.21.15.110:0/1400860390 shutdown_connections 2021-03-25T14:16:26.927 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:26.924+0000 7febacd12700 1 -- 172.21.15.110:0/1400860390 wait complete. 2021-03-25T14:16:26.938 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-03-25T14:16:27.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.048+0000 7f3de67e4700 1 Processor -- start 2021-03-25T14:16:27.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.048+0000 7f3de67e4700 1 -- start start 2021-03-25T14:16:27.053 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.049+0000 7f3de67e4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3de014cc90 0x7f3de014d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:27.053 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.049+0000 7f3de67e4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3de00685d0 0x7f3de0068a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:27.053 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.049+0000 7f3de67e4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3de00691b0 con 0x7f3de014d470 2021-03-25T14:16:27.053 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.049+0000 7f3de67e4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3de00bc2b0 con 0x7f3de00685d0 2021-03-25T14:16:27.053 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.049+0000 7f3de67e4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de0149dd0 con 0x7f3de014cc90 2021-03-25T14:16:27.053 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.049+0000 7f3de4d81700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3de00685d0 0x7f3de0068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:27.053 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.049+0000 7f3ddf7fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3de014cc90 0x7f3de014d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:27.053 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.049+0000 7f3de4d81700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3de00685d0 0x7f3de0068a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.110:46402/0 (socket says 172.21.15.110:46402) 2021-03-25T14:16:27.053 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.049+0000 7f3ddf7fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3de014cc90 0x7f3de014d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.110:40154/0 (socket says 172.21.15.110:40154) 2021-03-25T14:16:27.053 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.049+0000 7f3de4d81700 1 -- 172.21.15.110:0/374623777 learned_addr learned my addr 172.21.15.110:0/374623777 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:27.053 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.049+0000 7f3ddffff700 1 --1- 172.21.15.110:0/374623777 >> v1:172.21.15.174:6789/0 conn(0x7f3de014d470 0x7f3de01493c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.110:48352/0 (socket says 172.21.15.110:48352) 2021-03-25T14:16:27.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.050+0000 7f3ddf7fe700 1 -- 172.21.15.110:0/374623777 >> v2:172.21.15.174:3300/0 conn(0x7f3de00685d0 msgr2=0x7f3de0068a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:27.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.050+0000 7f3ddf7fe700 1 --2- 172.21.15.110:0/374623777 >> v2:172.21.15.174:3300/0 conn(0x7f3de00685d0 0x7f3de0068a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:27.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.050+0000 7f3ddf7fe700 1 -- 172.21.15.110:0/374623777 >> v1:172.21.15.174:6789/0 conn(0x7f3de014d470 legacy=0x7f3de01493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:27.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.050+0000 7f3ddf7fe700 1 -- 172.21.15.110:0/374623777 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de014a070 con 0x7f3de014cc90 2021-03-25T14:16:27.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.050+0000 7f3de4d81700 1 --2- 172.21.15.110:0/374623777 >> v2:172.21.15.174:3300/0 conn(0x7f3de00685d0 0x7f3de0068a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:16:27.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.050+0000 7f3ddf7fe700 1 --2- 172.21.15.110:0/374623777 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3de014cc90 0x7f3de014d850 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f3dd400b9c0 tx=0x7f3dd4006e20).ready entity=mon.2 client_cookie=9f1bf7fc4dfe533d server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:27.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.050+0000 7f3ddeffd700 1 -- 172.21.15.110:0/374623777 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd40097e0 con 0x7f3de014cc90 2021-03-25T14:16:27.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.050+0000 7f3ddeffd700 1 -- 172.21.15.110:0/374623777 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd4009940 con 0x7f3de014cc90 2021-03-25T14:16:27.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.050+0000 7f3ddeffd700 1 -- 172.21.15.110:0/374623777 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd4009cc0 con 0x7f3de014cc90 2021-03-25T14:16:27.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.050+0000 7f3de67e4700 1 -- 172.21.15.110:0/374623777 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3de014cc90 msgr2=0x7f3de014d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:27.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.050+0000 7f3de67e4700 1 --2- 172.21.15.110:0/374623777 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3de014cc90 0x7f3de014d850 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f3dd400b9c0 tx=0x7f3dd4006e20).stop 2021-03-25T14:16:27.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.050+0000 7f3de67e4700 1 -- 172.21.15.110:0/374623777 shutdown_connections 2021-03-25T14:16:27.055 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.050+0000 7f3de67e4700 1 --2- 172.21.15.110:0/374623777 >> v2:172.21.15.174:3300/0 conn(0x7f3de00685d0 0x7f3de0068a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:27.055 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.050+0000 7f3de67e4700 1 --2- 172.21.15.110:0/374623777 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3de014cc90 0x7f3de014d850 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:27.055 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.050+0000 7f3de67e4700 1 -- 172.21.15.110:0/374623777 >> 172.21.15.110:0/374623777 conn(0x7f3de0060c40 msgr2=0x7f3de0061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:27.055 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.050+0000 7f3de67e4700 1 -- 172.21.15.110:0/374623777 shutdown_connections 2021-03-25T14:16:27.055 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.050+0000 7f3de67e4700 1 -- 172.21.15.110:0/374623777 wait complete. 2021-03-25T14:16:27.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.051+0000 7f3de67e4700 1 Processor -- start 2021-03-25T14:16:27.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.052+0000 7f3de67e4700 1 -- start start 2021-03-25T14:16:27.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.052+0000 7f3de67e4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3de00685d0 0x7f3de0146170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:27.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.052+0000 7f3de67e4700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3de014cc90 0x7f3de0144530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:27.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.052+0000 7f3de67e4700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3de014d470 0x7f3de01590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:27.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.052+0000 7f3de67e4700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de0158bf0 con 0x7f3de014cc90 2021-03-25T14:16:27.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.052+0000 7f3de67e4700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de00a34c0 con 0x7f3de014d470 2021-03-25T14:16:27.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.052+0000 7f3de67e4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de00b6140 con 0x7f3de00685d0 2021-03-25T14:16:27.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.052+0000 7f3ddf7fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3de014cc90 0x7f3de0144530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:27.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.052+0000 7f3ddffff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3de00685d0 0x7f3de0146170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:27.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.052+0000 7f3ddf7fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3de014cc90 0x7f3de0144530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47758/0 (socket says 172.21.15.110:47758) 2021-03-25T14:16:27.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.052+0000 7f3ddf7fe700 1 -- 172.21.15.110:0/452678042 learned_addr learned my addr 172.21.15.110:0/452678042 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:27.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.052+0000 7f3de4d81700 1 --2- 172.21.15.110:0/452678042 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3de014d470 0x7f3de01590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:27.059 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.053+0000 7f3ddffff700 1 -- 172.21.15.110:0/452678042 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3de014d470 msgr2=0x7f3de01590c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:27.059 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.053+0000 7f3ddffff700 1 --2- 172.21.15.110:0/452678042 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3de014d470 0x7f3de01590c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:27.059 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.053+0000 7f3ddffff700 1 -- 172.21.15.110:0/452678042 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3de014cc90 msgr2=0x7f3de0144530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:27.059 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.053+0000 7f3ddffff700 1 --2- 172.21.15.110:0/452678042 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3de014cc90 0x7f3de0144530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:27.059 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.053+0000 7f3ddffff700 1 -- 172.21.15.110:0/452678042 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de00b63e0 con 0x7f3de00685d0 2021-03-25T14:16:27.059 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.053+0000 7f3ddf7fe700 1 --2- 172.21.15.110:0/452678042 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3de014cc90 0x7f3de0144530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:16:27.059 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.053+0000 7f3de4d81700 1 --2- 172.21.15.110:0/452678042 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3de014d470 0x7f3de01590c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:16:27.059 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.053+0000 7f3ddffff700 1 --2- 172.21.15.110:0/452678042 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3de00685d0 0x7f3de0146170 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f3dd000c710 tx=0x7f3dd0007b70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:27.059 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.053+0000 7f3dc7fff700 1 -- 172.21.15.110:0/452678042 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd00072e0 con 0x7f3de00685d0 2021-03-25T14:16:27.059 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.053+0000 7f3dc7fff700 1 -- 172.21.15.110:0/452678042 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd0005560 con 0x7f3de00685d0 2021-03-25T14:16:27.059 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.053+0000 7f3de67e4700 1 -- 172.21.15.110:0/452678042 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3de00b6680 con 0x7f3de00685d0 2021-03-25T14:16:27.059 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.053+0000 7f3dc7fff700 1 -- 172.21.15.110:0/452678042 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd0005900 con 0x7f3de00685d0 2021-03-25T14:16:27.059 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.053+0000 7f3de67e4700 1 -- 172.21.15.110:0/452678042 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3de0144a20 con 0x7f3de00685d0 2021-03-25T14:16:27.060 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.054+0000 7f3de67e4700 1 -- 172.21.15.110:0/452678042 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3de014a250 con 0x7f3de00685d0 2021-03-25T14:16:27.060 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.054+0000 7f3dc7fff700 1 -- 172.21.15.110:0/452678042 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f3dd0010070 con 0x7f3de00685d0 2021-03-25T14:16:27.060 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.055+0000 7f3dc7fff700 1 --2- 172.21.15.110:0/452678042 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3dc005a0b0 0x7f3dc005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:27.060 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.055+0000 7f3dc7fff700 1 -- 172.21.15.110:0/452678042 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f3dd00735d0 con 0x7f3de00685d0 2021-03-25T14:16:27.060 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.055+0000 7f3ddf7fe700 1 --2- 172.21.15.110:0/452678042 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3dc005a0b0 0x7f3dc005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:27.060 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.055+0000 7f3ddf7fe700 1 --2- 172.21.15.110:0/452678042 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3dc005a0b0 0x7f3dc005c570 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f3de014bcd0 tx=0x7f3dd4016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:27.061 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.059+0000 7f3dc7fff700 1 -- 172.21.15.110:0/452678042 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f3dd0046d00 con 0x7f3de00685d0 2021-03-25T14:16:27.213 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.211+0000 7f3de67e4700 1 -- 172.21.15.110:0/452678042 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3de005d7b0 con 0x7f3de00685d0 2021-03-25T14:16:27.213 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.212+0000 7f3dc7fff700 1 -- 172.21.15.110:0/452678042 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3dd004a320 con 0x7f3de00685d0 2021-03-25T14:16:27.213 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:16:27.215 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.213+0000 7f3de67e4700 1 -- 172.21.15.110:0/452678042 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3dc005a0b0 msgr2=0x7f3dc005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:27.215 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.213+0000 7f3de67e4700 1 --2- 172.21.15.110:0/452678042 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3dc005a0b0 0x7f3dc005c570 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f3de014bcd0 tx=0x7f3dd4016000).stop 2021-03-25T14:16:27.216 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.213+0000 7f3de67e4700 1 -- 172.21.15.110:0/452678042 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3de00685d0 msgr2=0x7f3de0146170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:27.216 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.213+0000 7f3de67e4700 1 --2- 172.21.15.110:0/452678042 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3de00685d0 0x7f3de0146170 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f3dd000c710 tx=0x7f3dd0007b70).stop 2021-03-25T14:16:27.216 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.213+0000 7f3de67e4700 1 -- 172.21.15.110:0/452678042 shutdown_connections 2021-03-25T14:16:27.216 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.213+0000 7f3de67e4700 1 --2- 172.21.15.110:0/452678042 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3dc005a0b0 0x7f3dc005c570 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:27.216 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.213+0000 7f3de67e4700 1 --2- 172.21.15.110:0/452678042 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3de014d470 0x7f3de01590c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:27.216 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.213+0000 7f3de67e4700 1 --2- 172.21.15.110:0/452678042 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3de00685d0 0x7f3de0146170 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:27.216 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.213+0000 7f3de67e4700 1 --2- 172.21.15.110:0/452678042 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3de014cc90 0x7f3de0144530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:27.216 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.213+0000 7f3de67e4700 1 -- 172.21.15.110:0/452678042 >> 172.21.15.110:0/452678042 conn(0x7f3de0060c40 msgr2=0x7f3de00bf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:27.216 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.213+0000 7f3de67e4700 1 -- 172.21.15.110:0/452678042 shutdown_connections 2021-03-25T14:16:27.216 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.213+0000 7f3de67e4700 1 -- 172.21.15.110:0/452678042 wait complete. 2021-03-25T14:16:27.227 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-03-25T14:16:27.339 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.337+0000 7fc615d58700 1 Processor -- start 2021-03-25T14:16:27.339 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.337+0000 7fc615d58700 1 -- start start 2021-03-25T14:16:27.347 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.338+0000 7fc615d58700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc61014cc90 0x7fc61014d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:27.347 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.338+0000 7fc615d58700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6100691b0 con 0x7fc6100685d0 2021-03-25T14:16:27.347 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.338+0000 7fc615d58700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6100bc2b0 con 0x7fc61014d470 2021-03-25T14:16:27.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.338+0000 7fc615d58700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc610149dd0 con 0x7fc61014cc90 2021-03-25T14:16:27.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.338+0000 7fc60ffff700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fc6100685d0 0x7fc6100bc710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:40702/0 (socket says 172.21.15.110:40702) 2021-03-25T14:16:27.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.338+0000 7fc60ffff700 1 -- 172.21.15.110:0/2747243729 learned_addr learned my addr 172.21.15.110:0/2747243729 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:27.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.338+0000 7fc60effd700 1 --2- 172.21.15.110:0/2747243729 >> v2:172.21.15.174:3300/0 conn(0x7fc61014cc90 0x7fc61014d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:27.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.338+0000 7fc60e7fc700 1 -- 172.21.15.110:0/2747243729 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2862076135 0 0) 0x7fc6100691b0 con 0x7fc6100685d0 2021-03-25T14:16:27.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.338+0000 7fc60e7fc700 1 -- 172.21.15.110:0/2747243729 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5fc003270 con 0x7fc6100685d0 2021-03-25T14:16:27.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.339+0000 7fc60e7fc700 1 -- 172.21.15.110:0/2747243729 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1738429912 0 0) 0x7fc5fc003270 con 0x7fc6100685d0 2021-03-25T14:16:27.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.339+0000 7fc60e7fc700 1 -- 172.21.15.110:0/2747243729 >> v2:172.21.15.174:3300/0 conn(0x7fc61014cc90 msgr2=0x7fc61014d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:27.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.339+0000 7fc60e7fc700 1 --2- 172.21.15.110:0/2747243729 >> v2:172.21.15.174:3300/0 conn(0x7fc61014cc90 0x7fc61014d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:27.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.339+0000 7fc60e7fc700 1 -- 172.21.15.110:0/2747243729 >> v1:172.21.15.174:6789/0 conn(0x7fc61014d470 legacy=0x7fc6101493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:27.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.339+0000 7fc60e7fc700 1 -- 172.21.15.110:0/2747243729 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61014a070 con 0x7fc6100685d0 2021-03-25T14:16:27.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.339+0000 7fc60e7fc700 1 -- 172.21.15.110:0/2747243729 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7fc6080018a0 con 0x7fc6100685d0 2021-03-25T14:16:27.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.339+0000 7fc60e7fc700 1 -- 172.21.15.110:0/2747243729 >> v1:172.21.15.110:6789/0 conn(0x7fc6100685d0 legacy=0x7fc6100bc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:27.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.339+0000 7fc60e7fc700 1 --2- 172.21.15.110:0/2747243729 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc5fc003760 0x7fc5fc003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:27.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.339+0000 7fc60e7fc700 1 --2- 172.21.15.110:0/2747243729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc5fc004510 0x7fc5fc004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:27.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.339+0000 7fc60e7fc700 1 --2- 172.21.15.110:0/2747243729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5fc004e80 0x7fc5fc00b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:27.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.339+0000 7fc60e7fc700 1 -- 172.21.15.110:0/2747243729 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc610149dd0 con 0x7fc5fc004e80 2021-03-25T14:16:27.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.339+0000 7fc60e7fc700 1 -- 172.21.15.110:0/2747243729 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc004200 con 0x7fc5fc004510 2021-03-25T14:16:27.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.339+0000 7fc60e7fc700 1 -- 172.21.15.110:0/2747243729 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc00bc50 con 0x7fc5fc003760 2021-03-25T14:16:27.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.339+0000 7fc60ffff700 1 --2- 172.21.15.110:0/2747243729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5fc004e80 0x7fc5fc00b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:27.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.339+0000 7fc60effd700 1 --2- 172.21.15.110:0/2747243729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc5fc004510 0x7fc5fc004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:27.350 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.339+0000 7fc60f7fe700 1 --2- 172.21.15.110:0/2747243729 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc5fc003760 0x7fc5fc003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:27.350 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.339+0000 7fc60ffff700 1 -- 172.21.15.110:0/2747243729 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc5fc003760 msgr2=0x7fc5fc003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:27.350 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.339+0000 7fc60ffff700 1 --2- 172.21.15.110:0/2747243729 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc5fc003760 0x7fc5fc003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:27.350 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.339+0000 7fc60ffff700 1 -- 172.21.15.110:0/2747243729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc5fc004510 msgr2=0x7fc5fc004990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:27.350 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.339+0000 7fc60ffff700 1 --2- 172.21.15.110:0/2747243729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc5fc004510 0x7fc5fc004990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:27.350 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.339+0000 7fc60ffff700 1 -- 172.21.15.110:0/2747243729 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5fc003270 con 0x7fc5fc004e80 2021-03-25T14:16:27.350 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.339+0000 7fc60effd700 1 --2- 172.21.15.110:0/2747243729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc5fc004510 0x7fc5fc004990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:16:27.350 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.339+0000 7fc60ffff700 1 -- 172.21.15.110:0/2747243729 reap_dead start 2021-03-25T14:16:27.350 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.339+0000 7fc60ffff700 1 --2- 172.21.15.110:0/2747243729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5fc004e80 0x7fc5fc00b760 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fc60800c840 tx=0x7fc61014a200).ready entity=mon.0 client_cookie=62c7ca14ca2a94fe server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:27.350 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.339+0000 7fc60e7fc700 1 -- 172.21.15.110:0/2747243729 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc608005bb0 con 0x7fc5fc004e80 2021-03-25T14:16:27.350 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.339+0000 7fc60e7fc700 1 -- 172.21.15.110:0/2747243729 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc608005d10 con 0x7fc5fc004e80 2021-03-25T14:16:27.351 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.339+0000 7fc60e7fc700 1 -- 172.21.15.110:0/2747243729 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc608007320 con 0x7fc5fc004e80 2021-03-25T14:16:27.351 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.340+0000 7fc615d58700 1 -- 172.21.15.110:0/2747243729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5fc004e80 msgr2=0x7fc5fc00b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:27.351 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.340+0000 7fc615d58700 1 --2- 172.21.15.110:0/2747243729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5fc004e80 0x7fc5fc00b760 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fc60800c840 tx=0x7fc61014a200).stop 2021-03-25T14:16:27.351 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.340+0000 7fc615d58700 1 -- 172.21.15.110:0/2747243729 shutdown_connections 2021-03-25T14:16:27.351 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.340+0000 7fc615d58700 1 --2- 172.21.15.110:0/2747243729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5fc004e80 0x7fc5fc00b760 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:27.351 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.340+0000 7fc615d58700 1 -- 172.21.15.110:0/2747243729 >> 172.21.15.110:0/2747243729 conn(0x7fc610060c40 msgr2=0x7fc610061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:27.351 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.340+0000 7fc615d58700 1 -- 172.21.15.110:0/2747243729 shutdown_connections 2021-03-25T14:16:27.351 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.340+0000 7fc615d58700 1 -- 172.21.15.110:0/2747243729 wait complete. 2021-03-25T14:16:27.351 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.341+0000 7fc615d58700 1 Processor -- start 2021-03-25T14:16:27.351 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.341+0000 7fc615d58700 1 -- start start 2021-03-25T14:16:27.351 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.342+0000 7fc615d58700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc5fc004e80 0x7fc6100c0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:27.351 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.342+0000 7fc615d58700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6100a5c70 0x7fc6101468c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:27.351 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.342+0000 7fc615d58700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6100a4790 0x7fc610146db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:27.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.342+0000 7fc615d58700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6100c0dc0 con 0x7fc6100a4790 2021-03-25T14:16:27.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.342+0000 7fc615d58700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61015cd90 con 0x7fc6100a5c70 2021-03-25T14:16:27.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.342+0000 7fc615d58700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6100bdde0 con 0x7fc5fc004e80 2021-03-25T14:16:27.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.342+0000 7fc60ffff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6100a4790 0x7fc610146db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:27.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.342+0000 7fc60ffff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6100a4790 0x7fc610146db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47778/0 (socket says 172.21.15.110:47778) 2021-03-25T14:16:27.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.342+0000 7fc60ffff700 1 -- 172.21.15.110:0/3576096544 learned_addr learned my addr 172.21.15.110:0/3576096544 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:27.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.342+0000 7fc60ffff700 1 -- 172.21.15.110:0/3576096544 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc5fc004e80 msgr2=0x7fc6100c0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:27.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.342+0000 7fc60f7fe700 1 --2- 172.21.15.110:0/3576096544 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc5fc004e80 0x7fc6100c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:27.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.342+0000 7fc60effd700 1 --2- 172.21.15.110:0/3576096544 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6100a5c70 0x7fc6101468c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:27.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.342+0000 7fc60ffff700 1 --2- 172.21.15.110:0/3576096544 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc5fc004e80 0x7fc6100c0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:27.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.342+0000 7fc60ffff700 1 -- 172.21.15.110:0/3576096544 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6100a5c70 msgr2=0x7fc6101468c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:27.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.342+0000 7fc60ffff700 1 --2- 172.21.15.110:0/3576096544 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6100a5c70 0x7fc6101468c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:27.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.342+0000 7fc60ffff700 1 -- 172.21.15.110:0/3576096544 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc610158830 con 0x7fc6100a4790 2021-03-25T14:16:27.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.342+0000 7fc60effd700 1 --2- 172.21.15.110:0/3576096544 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6100a5c70 0x7fc6101468c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:27.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.342+0000 7fc60ffff700 1 --2- 172.21.15.110:0/3576096544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6100a4790 0x7fc610146db0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fc608007c70 tx=0x7fc608015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:27.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.342+0000 7fc5f77fe700 1 -- 172.21.15.110:0/3576096544 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6080078a0 con 0x7fc6100a4790 2021-03-25T14:16:27.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.342+0000 7fc5f77fe700 1 -- 172.21.15.110:0/3576096544 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc608001010 con 0x7fc6100a4790 2021-03-25T14:16:27.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.343+0000 7fc615d58700 1 -- 172.21.15.110:0/3576096544 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc61015caf0 con 0x7fc6100a4790 2021-03-25T14:16:27.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.343+0000 7fc5f77fe700 1 -- 172.21.15.110:0/3576096544 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc608004ac0 con 0x7fc6100a4790 2021-03-25T14:16:27.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.343+0000 7fc615d58700 1 -- 172.21.15.110:0/3576096544 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6100a52d0 con 0x7fc6100a4790 2021-03-25T14:16:27.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.344+0000 7fc615d58700 1 -- 172.21.15.110:0/3576096544 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6100a54d0 con 0x7fc6100a4790 2021-03-25T14:16:27.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.344+0000 7fc5f77fe700 1 -- 172.21.15.110:0/3576096544 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fc608027070 con 0x7fc6100a4790 2021-03-25T14:16:27.354 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.344+0000 7fc5f77fe700 1 --2- 172.21.15.110:0/3576096544 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc5f005a0b0 0x7fc5f005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:27.354 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.344+0000 7fc5f77fe700 1 -- 172.21.15.110:0/3576096544 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fc608074f00 con 0x7fc6100a4790 2021-03-25T14:16:27.354 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.344+0000 7fc60f7fe700 1 --2- 172.21.15.110:0/3576096544 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc5f005a0b0 0x7fc5f005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:27.354 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.344+0000 7fc60f7fe700 1 --2- 172.21.15.110:0/3576096544 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc5f005a0b0 0x7fc5f005c570 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fc600000c00 tx=0x7fc600009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:27.354 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.348+0000 7fc5f77fe700 1 -- 172.21.15.110:0/3576096544 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fc608048660 con 0x7fc6100a4790 2021-03-25T14:16:27.502 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.500+0000 7fc615d58700 1 -- 172.21.15.110:0/3576096544 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc61005d7b0 con 0x7fc6100a4790 2021-03-25T14:16:27.503 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.501+0000 7fc5f77fe700 1 -- 172.21.15.110:0/3576096544 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7fc60804bc80 con 0x7fc6100a4790 2021-03-25T14:16:27.503 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:16:27.504 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.502+0000 7fc615d58700 1 -- 172.21.15.110:0/3576096544 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc5f005a0b0 msgr2=0x7fc5f005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:27.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.502+0000 7fc615d58700 1 --2- 172.21.15.110:0/3576096544 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc5f005a0b0 0x7fc5f005c570 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fc600000c00 tx=0x7fc600009040).stop 2021-03-25T14:16:27.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.502+0000 7fc615d58700 1 -- 172.21.15.110:0/3576096544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6100a4790 msgr2=0x7fc610146db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:27.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.502+0000 7fc615d58700 1 --2- 172.21.15.110:0/3576096544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6100a4790 0x7fc610146db0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fc608007c70 tx=0x7fc608015000).stop 2021-03-25T14:16:27.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.502+0000 7fc615d58700 1 -- 172.21.15.110:0/3576096544 shutdown_connections 2021-03-25T14:16:27.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.502+0000 7fc615d58700 1 --2- 172.21.15.110:0/3576096544 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc5f005a0b0 0x7fc5f005c570 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:27.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.502+0000 7fc615d58700 1 --2- 172.21.15.110:0/3576096544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6100a4790 0x7fc610146db0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:27.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.502+0000 7fc615d58700 1 --2- 172.21.15.110:0/3576096544 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc5fc004e80 0x7fc6100c0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:27.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.502+0000 7fc615d58700 1 --2- 172.21.15.110:0/3576096544 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6100a5c70 0x7fc6101468c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:27.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.502+0000 7fc615d58700 1 -- 172.21.15.110:0/3576096544 >> 172.21.15.110:0/3576096544 conn(0x7fc610060c40 msgr2=0x7fc61014aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:27.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.502+0000 7fc615d58700 1 -- 172.21.15.110:0/3576096544 shutdown_connections 2021-03-25T14:16:27.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.502+0000 7fc615d58700 1 -- 172.21.15.110:0/3576096544 wait complete. 2021-03-25T14:16:27.516 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-03-25T14:16:27.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.627+0000 7f09fb11b700 1 Processor -- start 2021-03-25T14:16:27.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.627+0000 7f09fb11b700 1 -- start start 2021-03-25T14:16:27.632 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.628+0000 7f09fb11b700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f09f40bcb10 0x7f09f40bcef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:27.632 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.628+0000 7f09fb11b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f09f414a140 0x7f09f4131ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:27.632 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.628+0000 7f09fb11b700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f4068b60 con 0x7f09f40671d0 2021-03-25T14:16:27.632 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.628+0000 7f09fb11b700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f414a550 con 0x7f09f40bcb10 2021-03-25T14:16:27.632 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.628+0000 7f09fb11b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f40a2ad0 con 0x7f09f414a140 2021-03-25T14:16:27.632 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.628+0000 7f09fa119700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f09f40bcb10 0x7f09f40bcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:27.632 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.628+0000 7f09f9918700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f09f40671d0 0x7f09f41317c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:40720/0 (socket says 172.21.15.110:40720) 2021-03-25T14:16:27.632 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.628+0000 7f09f9918700 1 -- 172.21.15.110:0/159941737 learned_addr learned my addr 172.21.15.110:0/159941737 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:27.632 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.628+0000 7f09fa91a700 1 --2- 172.21.15.110:0/159941737 >> v2:172.21.15.174:3300/0 conn(0x7f09f414a140 0x7f09f4131ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:27.632 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.628+0000 7f09fa119700 1 -- 172.21.15.110:0/159941737 >> v2:172.21.15.174:3300/0 conn(0x7f09f414a140 msgr2=0x7f09f4131ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:27.632 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.628+0000 7f09fa119700 1 --2- 172.21.15.110:0/159941737 >> v2:172.21.15.174:3300/0 conn(0x7f09f414a140 0x7f09f4131ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:27.633 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.628+0000 7f09fa119700 1 -- 172.21.15.110:0/159941737 >> v1:172.21.15.110:6789/0 conn(0x7f09f40671d0 legacy=0x7f09f41317c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:27.633 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.628+0000 7f09fa119700 1 -- 172.21.15.110:0/159941737 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f40bd4f0 con 0x7f09f40bcb10 2021-03-25T14:16:27.633 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.628+0000 7f09f9117700 1 -- 172.21.15.110:0/159941737 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2185091404 0 0) 0x7f09f4068b60 con 0x7f09f40671d0 2021-03-25T14:16:27.633 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.628+0000 7f09fa119700 1 --2- 172.21.15.110:0/159941737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09f40bcb10 0x7f09f40bcef0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f09f4067660 tx=0x7f09e4006e20).ready entity=mon.0 client_cookie=503de704df1daf5a server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:27.633 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.628+0000 7f09f9117700 1 -- 172.21.15.110:0/159941737 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e4009870 con 0x7f09f40bcb10 2021-03-25T14:16:27.633 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.628+0000 7f09f9117700 1 -- 172.21.15.110:0/159941737 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e40099d0 con 0x7f09f40bcb10 2021-03-25T14:16:27.633 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.628+0000 7f09f9117700 1 -- 172.21.15.110:0/159941737 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e4009d50 con 0x7f09f40bcb10 2021-03-25T14:16:27.633 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.629+0000 7f09fb11b700 1 -- 172.21.15.110:0/159941737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09f40bcb10 msgr2=0x7f09f40bcef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:27.633 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.629+0000 7f09fb11b700 1 --2- 172.21.15.110:0/159941737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09f40bcb10 0x7f09f40bcef0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f09f4067660 tx=0x7f09e4006e20).stop 2021-03-25T14:16:27.633 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.629+0000 7f09fb11b700 1 -- 172.21.15.110:0/159941737 shutdown_connections 2021-03-25T14:16:27.633 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.629+0000 7f09fb11b700 1 --2- 172.21.15.110:0/159941737 >> v2:172.21.15.174:3300/0 conn(0x7f09f414a140 0x7f09f4131ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:27.633 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.629+0000 7f09fb11b700 1 --2- 172.21.15.110:0/159941737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09f40bcb10 0x7f09f40bcef0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:27.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.629+0000 7f09fb11b700 1 -- 172.21.15.110:0/159941737 >> 172.21.15.110:0/159941737 conn(0x7f09f4064860 msgr2=0x7f09f40664d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:27.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.629+0000 7f09fb11b700 1 -- 172.21.15.110:0/159941737 shutdown_connections 2021-03-25T14:16:27.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.629+0000 7f09fb11b700 1 -- 172.21.15.110:0/159941737 wait complete. 2021-03-25T14:16:27.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.630+0000 7f09fb11b700 1 Processor -- start 2021-03-25T14:16:27.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.630+0000 7f09fb11b700 1 -- start start 2021-03-25T14:16:27.638 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.631+0000 7f09fb11b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09f40671d0 0x7f09f40b62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:27.638 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.631+0000 7f09fb11b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f09f40bcb10 0x7f09f41597b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:27.638 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.631+0000 7f09fb11b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09f414a140 0x7f09f40a2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:27.638 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.631+0000 7f09fb11b700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f4159ca0 con 0x7f09f414a140 2021-03-25T14:16:27.638 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.631+0000 7f09fb11b700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f40b6960 con 0x7f09f40bcb10 2021-03-25T14:16:27.638 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.631+0000 7f09fb11b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f40b6c00 con 0x7f09f40671d0 2021-03-25T14:16:27.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.631+0000 7f09fa91a700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09f414a140 0x7f09f40a2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:27.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.631+0000 7f09fa91a700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09f414a140 0x7f09f40a2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47794/0 (socket says 172.21.15.110:47794) 2021-03-25T14:16:27.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.631+0000 7f09fa91a700 1 -- 172.21.15.110:0/4118595254 learned_addr learned my addr 172.21.15.110:0/4118595254 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:27.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.631+0000 7f09fa119700 1 --2- 172.21.15.110:0/4118595254 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09f40671d0 0x7f09f40b62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:27.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.631+0000 7f09f9918700 1 --2- 172.21.15.110:0/4118595254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f09f40bcb10 0x7f09f41597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:27.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.631+0000 7f09fa91a700 1 -- 172.21.15.110:0/4118595254 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09f40671d0 msgr2=0x7f09f40b62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:27.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.631+0000 7f09fa91a700 1 --2- 172.21.15.110:0/4118595254 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09f40671d0 0x7f09f40b62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:27.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.631+0000 7f09fa91a700 1 -- 172.21.15.110:0/4118595254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f09f40bcb10 msgr2=0x7f09f41597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:27.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.631+0000 7f09fa91a700 1 --2- 172.21.15.110:0/4118595254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f09f40bcb10 0x7f09f41597b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:27.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.631+0000 7f09fa91a700 1 -- 172.21.15.110:0/4118595254 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f414b420 con 0x7f09f414a140 2021-03-25T14:16:27.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.631+0000 7f09fa119700 1 --2- 172.21.15.110:0/4118595254 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09f40671d0 0x7f09f40b62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:27.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.631+0000 7f09fa91a700 1 --2- 172.21.15.110:0/4118595254 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09f414a140 0x7f09f40a2f10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f09ec00cb20 tx=0x7f09ec008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:27.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.631+0000 7f09e27fc700 1 -- 172.21.15.110:0/4118595254 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ec007940 con 0x7f09f414a140 2021-03-25T14:16:27.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.631+0000 7f09e27fc700 1 -- 172.21.15.110:0/4118595254 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09ec007aa0 con 0x7f09f414a140 2021-03-25T14:16:27.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.631+0000 7f09fb11b700 1 -- 172.21.15.110:0/4118595254 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f414b6c0 con 0x7f09f414a140 2021-03-25T14:16:27.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.631+0000 7f09e27fc700 1 -- 172.21.15.110:0/4118595254 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ec007e40 con 0x7f09f414a140 2021-03-25T14:16:27.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.631+0000 7f09fb11b700 1 -- 172.21.15.110:0/4118595254 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f412f6b0 con 0x7f09f414a140 2021-03-25T14:16:27.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.632+0000 7f09fb11b700 1 -- 172.21.15.110:0/4118595254 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f414b850 con 0x7f09f414a140 2021-03-25T14:16:27.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.632+0000 7f09e27fc700 1 -- 172.21.15.110:0/4118595254 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f09ec011620 con 0x7f09f414a140 2021-03-25T14:16:27.641 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.633+0000 7f09e27fc700 1 --2- 172.21.15.110:0/4118595254 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f09d405a0b0 0x7f09d405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:27.641 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.633+0000 7f09e27fc700 1 -- 172.21.15.110:0/4118595254 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f09ec0745b0 con 0x7f09f414a140 2021-03-25T14:16:27.641 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.633+0000 7f09fa119700 1 --2- 172.21.15.110:0/4118595254 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f09d405a0b0 0x7f09d405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:27.641 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.633+0000 7f09fa119700 1 --2- 172.21.15.110:0/4118595254 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f09d405a0b0 0x7f09d405c570 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f09e4006e60 tx=0x7f09e4016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:27.641 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.637+0000 7f09e27fc700 1 -- 172.21.15.110:0/4118595254 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f09ec047c60 con 0x7f09f414a140 2021-03-25T14:16:27.789 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.787+0000 7f09fb11b700 1 -- 172.21.15.110:0/4118595254 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f09f4045ae0 con 0x7f09f414a140 2021-03-25T14:16:27.789 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.787+0000 7f09e27fc700 1 -- 172.21.15.110:0/4118595254 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7f09ec04b280 con 0x7f09f414a140 2021-03-25T14:16:27.789 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:16:27.791 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.789+0000 7f09fb11b700 1 -- 172.21.15.110:0/4118595254 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f09d405a0b0 msgr2=0x7f09d405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:27.791 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.789+0000 7f09fb11b700 1 --2- 172.21.15.110:0/4118595254 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f09d405a0b0 0x7f09d405c570 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f09e4006e60 tx=0x7f09e4016000).stop 2021-03-25T14:16:27.791 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.789+0000 7f09fb11b700 1 -- 172.21.15.110:0/4118595254 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09f414a140 msgr2=0x7f09f40a2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:27.791 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.789+0000 7f09fb11b700 1 --2- 172.21.15.110:0/4118595254 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09f414a140 0x7f09f40a2f10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f09ec00cb20 tx=0x7f09ec008040).stop 2021-03-25T14:16:27.791 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.789+0000 7f09fb11b700 1 -- 172.21.15.110:0/4118595254 shutdown_connections 2021-03-25T14:16:27.791 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.789+0000 7f09fb11b700 1 --2- 172.21.15.110:0/4118595254 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f09d405a0b0 0x7f09d405c570 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:27.791 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.789+0000 7f09fb11b700 1 --2- 172.21.15.110:0/4118595254 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09f414a140 0x7f09f40a2f10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:27.791 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.789+0000 7f09fb11b700 1 --2- 172.21.15.110:0/4118595254 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09f40671d0 0x7f09f40b62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:27.792 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.789+0000 7f09fb11b700 1 --2- 172.21.15.110:0/4118595254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f09f40bcb10 0x7f09f41597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:27.792 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.789+0000 7f09fb11b700 1 -- 172.21.15.110:0/4118595254 >> 172.21.15.110:0/4118595254 conn(0x7f09f4064860 msgr2=0x7f09f4148910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:27.792 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.789+0000 7f09fb11b700 1 -- 172.21.15.110:0/4118595254 shutdown_connections 2021-03-25T14:16:27.792 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.789+0000 7f09fb11b700 1 -- 172.21.15.110:0/4118595254 wait complete. 2021-03-25T14:16:27.802 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2021-03-25T14:16:27.914 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.912+0000 7fe6d6a6a700 1 Processor -- start 2021-03-25T14:16:27.914 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.912+0000 7fe6d6a6a700 1 -- start start 2021-03-25T14:16:27.917 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.913+0000 7fe6d6a6a700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe6d00be3a0 0x7fe6d00b4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:27.917 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.913+0000 7fe6d6a6a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe6d0149340 0x7fe6d00b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:27.917 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.913+0000 7fe6d6a6a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6d00b4c20 con 0x7fe6d00b47a0 2021-03-25T14:16:27.917 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.913+0000 7fe6d6a6a700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6d0149960 con 0x7fe6d00be3a0 2021-03-25T14:16:27.917 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.913+0000 7fe6d6a6a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d0149c00 con 0x7fe6d0149340 2021-03-25T14:16:27.917 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.913+0000 7fe6d4806700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe6d00be3a0 0x7fe6d00b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:27.917 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.913+0000 7fe6d4806700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe6d00be3a0 0x7fe6d00b4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47798/0 (socket says 172.21.15.110:47798) 2021-03-25T14:16:27.918 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.913+0000 7fe6d4806700 1 -- 172.21.15.110:0/3169827763 learned_addr learned my addr 172.21.15.110:0/3169827763 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:27.918 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.913+0000 7fe6d5007700 1 --2- 172.21.15.110:0/3169827763 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe6d0149340 0x7fe6d00b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:27.918 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.913+0000 7fe6d4806700 1 -- 172.21.15.110:0/3169827763 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe6d0149340 msgr2=0x7fe6d00b8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:27.918 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.913+0000 7fe6d4806700 1 --2- 172.21.15.110:0/3169827763 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe6d0149340 0x7fe6d00b8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:27.918 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.913+0000 7fe6d4806700 1 -- 172.21.15.110:0/3169827763 >> v1:172.21.15.174:6789/0 conn(0x7fe6d00b47a0 legacy=0x7fe6d0148c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:27.918 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.913+0000 7fe6d4806700 1 -- 172.21.15.110:0/3169827763 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d0149ea0 con 0x7fe6d00be3a0 2021-03-25T14:16:27.918 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.913+0000 7fe6d5007700 1 --2- 172.21.15.110:0/3169827763 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe6d0149340 0x7fe6d00b8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:27.918 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.913+0000 7fe6d4806700 1 --2- 172.21.15.110:0/3169827763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6d00be3a0 0x7fe6d00b4100 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fe6c400ba20 tx=0x7fe6c4006ee0).ready entity=mon.0 client_cookie=b4e5be515acf7ece server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:27.918 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.913+0000 7fe6cf7fe700 1 -- 172.21.15.110:0/3169827763 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c4009840 con 0x7fe6d00be3a0 2021-03-25T14:16:27.918 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.913+0000 7fe6cf7fe700 1 -- 172.21.15.110:0/3169827763 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c40099a0 con 0x7fe6d00be3a0 2021-03-25T14:16:27.918 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.913+0000 7fe6cf7fe700 1 -- 172.21.15.110:0/3169827763 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c4009d20 con 0x7fe6d00be3a0 2021-03-25T14:16:27.919 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.914+0000 7fe6d6a6a700 1 -- 172.21.15.110:0/3169827763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6d00be3a0 msgr2=0x7fe6d00b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:27.919 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.914+0000 7fe6d6a6a700 1 --2- 172.21.15.110:0/3169827763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6d00be3a0 0x7fe6d00b4100 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fe6c400ba20 tx=0x7fe6c4006ee0).stop 2021-03-25T14:16:27.919 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.914+0000 7fe6d6a6a700 1 -- 172.21.15.110:0/3169827763 shutdown_connections 2021-03-25T14:16:27.919 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.914+0000 7fe6d6a6a700 1 --2- 172.21.15.110:0/3169827763 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe6d0149340 0x7fe6d00b8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:27.919 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.914+0000 7fe6d6a6a700 1 --2- 172.21.15.110:0/3169827763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6d00be3a0 0x7fe6d00b4100 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:27.919 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.914+0000 7fe6d6a6a700 1 -- 172.21.15.110:0/3169827763 >> 172.21.15.110:0/3169827763 conn(0x7fe6d00686f0 msgr2=0x7fe6d0068b00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:27.919 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.914+0000 7fe6d6a6a700 1 -- 172.21.15.110:0/3169827763 shutdown_connections 2021-03-25T14:16:27.919 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.914+0000 7fe6d6a6a700 1 -- 172.21.15.110:0/3169827763 wait complete. 2021-03-25T14:16:27.919 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.915+0000 7fe6d6a6a700 1 Processor -- start 2021-03-25T14:16:27.919 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.915+0000 7fe6d6a6a700 1 -- start start 2021-03-25T14:16:27.922 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.916+0000 7fe6d6a6a700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe6d00b47a0 0x7fe6d00b5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:27.922 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.916+0000 7fe6d6a6a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe6d00be3a0 0x7fe6d00a20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:27.922 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.916+0000 7fe6d6a6a700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6d0149340 0x7fe6d00a25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:27.922 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.916+0000 7fe6d6a6a700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d0159a50 con 0x7fe6d0149340 2021-03-25T14:16:27.922 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.916+0000 7fe6d6a6a700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d014ab30 con 0x7fe6d00b47a0 2021-03-25T14:16:27.922 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.916+0000 7fe6d6a6a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d00a02f0 con 0x7fe6d00be3a0 2021-03-25T14:16:27.922 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.916+0000 7fe6d5007700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6d0149340 0x7fe6d00a25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:27.923 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.916+0000 7fe6d5007700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6d0149340 0x7fe6d00a25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47808/0 (socket says 172.21.15.110:47808) 2021-03-25T14:16:27.923 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.916+0000 7fe6d5007700 1 -- 172.21.15.110:0/1831197709 learned_addr learned my addr 172.21.15.110:0/1831197709 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:27.923 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.916+0000 7fe6cffff700 1 --2- 172.21.15.110:0/1831197709 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe6d00be3a0 0x7fe6d00a20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:27.923 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.916+0000 7fe6d4806700 1 --2- 172.21.15.110:0/1831197709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe6d00b47a0 0x7fe6d00b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:27.923 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.916+0000 7fe6d5007700 1 -- 172.21.15.110:0/1831197709 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe6d00be3a0 msgr2=0x7fe6d00a20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:27.923 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.916+0000 7fe6d5007700 1 --2- 172.21.15.110:0/1831197709 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe6d00be3a0 0x7fe6d00a20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:27.923 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.916+0000 7fe6d5007700 1 -- 172.21.15.110:0/1831197709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe6d00b47a0 msgr2=0x7fe6d00b5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:27.923 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.916+0000 7fe6d5007700 1 --2- 172.21.15.110:0/1831197709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe6d00b47a0 0x7fe6d00b5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:27.923 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.916+0000 7fe6d5007700 1 -- 172.21.15.110:0/1831197709 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d00a0590 con 0x7fe6d0149340 2021-03-25T14:16:27.923 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.916+0000 7fe6d5007700 1 --2- 172.21.15.110:0/1831197709 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6d0149340 0x7fe6d00a25a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fe6c800ebc0 tx=0x7fe6c8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:27.924 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.916+0000 7fe6ccff9700 1 -- 172.21.15.110:0/1831197709 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c800c5e0 con 0x7fe6d0149340 2021-03-25T14:16:27.924 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.916+0000 7fe6ccff9700 1 -- 172.21.15.110:0/1831197709 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c800c740 con 0x7fe6d0149340 2021-03-25T14:16:27.924 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.916+0000 7fe6d6a6a700 1 -- 172.21.15.110:0/1831197709 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6d00a0830 con 0x7fe6d0149340 2021-03-25T14:16:27.924 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.916+0000 7fe6ccff9700 1 -- 172.21.15.110:0/1831197709 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c800cae0 con 0x7fe6d0149340 2021-03-25T14:16:27.924 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.916+0000 7fe6d6a6a700 1 -- 172.21.15.110:0/1831197709 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6d00a2a90 con 0x7fe6d0149340 2021-03-25T14:16:27.924 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.917+0000 7fe6d6a6a700 1 -- 172.21.15.110:0/1831197709 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6d005d7b0 con 0x7fe6d0149340 2021-03-25T14:16:27.924 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.918+0000 7fe6ccff9700 1 -- 172.21.15.110:0/1831197709 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fe6c801d460 con 0x7fe6d0149340 2021-03-25T14:16:27.924 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.918+0000 7fe6ccff9700 1 --2- 172.21.15.110:0/1831197709 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe6b005a0b0 0x7fe6b005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:27.925 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.918+0000 7fe6ccff9700 1 -- 172.21.15.110:0/1831197709 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fe6c8073f10 con 0x7fe6d0149340 2021-03-25T14:16:27.925 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.918+0000 7fe6d4806700 1 --2- 172.21.15.110:0/1831197709 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe6b005a0b0 0x7fe6b005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:27.925 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.918+0000 7fe6d4806700 1 --2- 172.21.15.110:0/1831197709 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe6b005a0b0 0x7fe6b005c570 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fe6c4006f20 tx=0x7fe6c4016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:27.925 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:27.922+0000 7fe6ccff9700 1 -- 172.21.15.110:0/1831197709 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fe6c8047560 con 0x7fe6d0149340 2021-03-25T14:16:28.072 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.070+0000 7fe6d6a6a700 1 -- 172.21.15.110:0/1831197709 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe6d0061c50 con 0x7fe6d0149340 2021-03-25T14:16:28.072 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.070+0000 7fe6ccff9700 1 -- 172.21.15.110:0/1831197709 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+10 (secure 0 0 0) 0x7fe6c804ab80 con 0x7fe6d0149340 2021-03-25T14:16:28.073 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:16:28.074 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.071+0000 7fe6d6a6a700 1 -- 172.21.15.110:0/1831197709 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe6b005a0b0 msgr2=0x7fe6b005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:28.074 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.071+0000 7fe6d6a6a700 1 --2- 172.21.15.110:0/1831197709 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe6b005a0b0 0x7fe6b005c570 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fe6c4006f20 tx=0x7fe6c4016000).stop 2021-03-25T14:16:28.074 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.071+0000 7fe6d6a6a700 1 -- 172.21.15.110:0/1831197709 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6d0149340 msgr2=0x7fe6d00a25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:28.074 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.071+0000 7fe6d6a6a700 1 --2- 172.21.15.110:0/1831197709 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6d0149340 0x7fe6d00a25a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fe6c800ebc0 tx=0x7fe6c8008040).stop 2021-03-25T14:16:28.074 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.071+0000 7fe6d6a6a700 1 -- 172.21.15.110:0/1831197709 shutdown_connections 2021-03-25T14:16:28.074 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.071+0000 7fe6d6a6a700 1 --2- 172.21.15.110:0/1831197709 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe6b005a0b0 0x7fe6b005c570 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:28.074 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.071+0000 7fe6d6a6a700 1 --2- 172.21.15.110:0/1831197709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe6d00b47a0 0x7fe6d00b5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:28.075 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.071+0000 7fe6d6a6a700 1 --2- 172.21.15.110:0/1831197709 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6d0149340 0x7fe6d00a25a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:28.075 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.071+0000 7fe6d6a6a700 1 --2- 172.21.15.110:0/1831197709 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe6d00be3a0 0x7fe6d00a20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:28.075 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.071+0000 7fe6d6a6a700 1 -- 172.21.15.110:0/1831197709 >> 172.21.15.110:0/1831197709 conn(0x7fe6d00686f0 msgr2=0x7fe6d00b9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:28.075 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.072+0000 7fe6d6a6a700 1 -- 172.21.15.110:0/1831197709 shutdown_connections 2021-03-25T14:16:28.075 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.072+0000 7fe6d6a6a700 1 -- 172.21.15.110:0/1831197709 wait complete. 2021-03-25T14:16:28.085 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2021-03-25T14:16:28.085 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2021-03-25T14:16:28.085 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2021-03-25T14:16:28.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.193+0000 7fd45089b700 1 Processor -- start 2021-03-25T14:16:28.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.193+0000 7fd45089b700 1 -- start start 2021-03-25T14:16:28.200 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.193+0000 7fd45089b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd44c0bc220 0x7fd44c0b1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:28.200 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.193+0000 7fd45089b700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd44c148970 0x7fd44c148e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:28.200 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.193+0000 7fd45089b700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd44c0bafc0 con 0x7fd44c0675d0 2021-03-25T14:16:28.200 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.193+0000 7fd45089b700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd44c0b1830 con 0x7fd44c148970 2021-03-25T14:16:28.200 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.193+0000 7fd45089b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c0baa80 con 0x7fd44c0bc220 2021-03-25T14:16:28.200 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.194+0000 7fd44ad9d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd44c148970 0x7fd44c148e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:28.200 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.194+0000 7fd44a59c700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fd44c0675d0 0x7fd44c14cbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:40748/0 (socket says 172.21.15.110:40748) 2021-03-25T14:16:28.200 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.194+0000 7fd44a59c700 1 -- 172.21.15.110:0/1223737340 learned_addr learned my addr 172.21.15.110:0/1223737340 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:28.200 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.194+0000 7fd443fff700 1 --2- 172.21.15.110:0/1223737340 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd44c0bc220 0x7fd44c0b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:28.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.194+0000 7fd449d9b700 1 -- 172.21.15.110:0/1223737340 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3441203980 0 0) 0x7fd44c0bafc0 con 0x7fd44c0675d0 2021-03-25T14:16:28.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.194+0000 7fd449d9b700 1 -- 172.21.15.110:0/1223737340 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd42c003270 con 0x7fd44c0675d0 2021-03-25T14:16:28.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.194+0000 7fd44ad9d700 1 -- 172.21.15.110:0/1223737340 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd44c0bc220 msgr2=0x7fd44c0b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:28.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.194+0000 7fd44ad9d700 1 --2- 172.21.15.110:0/1223737340 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd44c0bc220 0x7fd44c0b1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:28.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.194+0000 7fd44ad9d700 1 -- 172.21.15.110:0/1223737340 >> v1:172.21.15.110:6789/0 conn(0x7fd44c0675d0 legacy=0x7fd44c14cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:28.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.194+0000 7fd44ad9d700 1 -- 172.21.15.110:0/1223737340 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd44c0bad20 con 0x7fd44c148970 2021-03-25T14:16:28.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.194+0000 7fd44ad9d700 1 --2- 172.21.15.110:0/1223737340 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd44c148970 0x7fd44c148e00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fd444009cc0 tx=0x7fd444009220).ready entity=mon.0 client_cookie=753bbe3a759eace8 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:28.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.194+0000 7fd449d9b700 1 -- 172.21.15.110:0/1223737340 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44400b9f0 con 0x7fd44c148970 2021-03-25T14:16:28.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.194+0000 7fd449d9b700 1 -- 172.21.15.110:0/1223737340 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44400bb50 con 0x7fd44c148970 2021-03-25T14:16:28.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.194+0000 7fd449d9b700 1 -- 172.21.15.110:0/1223737340 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd444011400 con 0x7fd44c148970 2021-03-25T14:16:28.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.195+0000 7fd45089b700 1 -- 172.21.15.110:0/1223737340 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd44c148970 msgr2=0x7fd44c148e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:28.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.195+0000 7fd45089b700 1 --2- 172.21.15.110:0/1223737340 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd44c148970 0x7fd44c148e00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fd444009cc0 tx=0x7fd444009220).stop 2021-03-25T14:16:28.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.195+0000 7fd45089b700 1 -- 172.21.15.110:0/1223737340 shutdown_connections 2021-03-25T14:16:28.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.195+0000 7fd45089b700 1 --2- 172.21.15.110:0/1223737340 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd44c148970 0x7fd44c148e00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:28.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.195+0000 7fd45089b700 1 --2- 172.21.15.110:0/1223737340 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd44c0bc220 0x7fd44c0b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:28.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.195+0000 7fd45089b700 1 -- 172.21.15.110:0/1223737340 >> 172.21.15.110:0/1223737340 conn(0x7fd44c064a10 msgr2=0x7fd44c05c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:28.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.195+0000 7fd45089b700 1 -- 172.21.15.110:0/1223737340 shutdown_connections 2021-03-25T14:16:28.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.195+0000 7fd45089b700 1 -- 172.21.15.110:0/1223737340 wait complete. 2021-03-25T14:16:28.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.196+0000 7fd45089b700 1 Processor -- start 2021-03-25T14:16:28.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.196+0000 7fd45089b700 1 -- start start 2021-03-25T14:16:28.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.196+0000 7fd45089b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd44c0675d0 0x7fd44c0b1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:28.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.196+0000 7fd45089b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd44c0bc220 0x7fd44c14a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:28.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.196+0000 7fd45089b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd44c148970 0x7fd44c15c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:28.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.196+0000 7fd45089b700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c0bde60 con 0x7fd44c0bc220 2021-03-25T14:16:28.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.196+0000 7fd45089b700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c0be100 con 0x7fd44c0675d0 2021-03-25T14:16:28.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.196+0000 7fd45089b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c0be3a0 con 0x7fd44c148970 2021-03-25T14:16:28.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.196+0000 7fd443fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd44c0bc220 0x7fd44c14a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:28.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.196+0000 7fd443fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd44c0bc220 0x7fd44c14a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47820/0 (socket says 172.21.15.110:47820) 2021-03-25T14:16:28.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.196+0000 7fd443fff700 1 -- 172.21.15.110:0/681155191 learned_addr learned my addr 172.21.15.110:0/681155191 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:28.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.197+0000 7fd44a59c700 1 --2- 172.21.15.110:0/681155191 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd44c0675d0 0x7fd44c0b1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:28.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.197+0000 7fd44ad9d700 1 --2- 172.21.15.110:0/681155191 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd44c148970 0x7fd44c15c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:28.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.197+0000 7fd443fff700 1 -- 172.21.15.110:0/681155191 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd44c148970 msgr2=0x7fd44c15c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:28.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.197+0000 7fd443fff700 1 --2- 172.21.15.110:0/681155191 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd44c148970 0x7fd44c15c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:28.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.197+0000 7fd443fff700 1 -- 172.21.15.110:0/681155191 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd44c0675d0 msgr2=0x7fd44c0b1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:28.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.197+0000 7fd443fff700 1 --2- 172.21.15.110:0/681155191 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd44c0675d0 0x7fd44c0b1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:28.204 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.197+0000 7fd443fff700 1 -- 172.21.15.110:0/681155191 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd44c0be640 con 0x7fd44c0bc220 2021-03-25T14:16:28.204 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.197+0000 7fd443fff700 1 --2- 172.21.15.110:0/681155191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd44c0bc220 0x7fd44c14a7c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fd43400ebd0 tx=0x7fd434006e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:28.204 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.197+0000 7fd4427fc700 1 -- 172.21.15.110:0/681155191 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43400ca60 con 0x7fd44c0bc220 2021-03-25T14:16:28.204 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.197+0000 7fd4427fc700 1 -- 172.21.15.110:0/681155191 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43400cbc0 con 0x7fd44c0bc220 2021-03-25T14:16:28.204 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.197+0000 7fd45089b700 1 -- 172.21.15.110:0/681155191 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd44c0be8e0 con 0x7fd44c0bc220 2021-03-25T14:16:28.204 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.197+0000 7fd4427fc700 1 -- 172.21.15.110:0/681155191 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4340123f0 con 0x7fd44c0bc220 2021-03-25T14:16:28.204 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.197+0000 7fd45089b700 1 -- 172.21.15.110:0/681155191 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd44c14acb0 con 0x7fd44c0bc220 2021-03-25T14:16:28.204 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.198+0000 7fd45089b700 1 -- 172.21.15.110:0/681155191 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd44c068850 con 0x7fd44c0bc220 2021-03-25T14:16:28.204 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.198+0000 7fd4427fc700 1 -- 172.21.15.110:0/681155191 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fd4340127a0 con 0x7fd44c0bc220 2021-03-25T14:16:28.205 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.199+0000 7fd4427fc700 1 --2- 172.21.15.110:0/681155191 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd43005a0b0 0x7fd43005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:28.205 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.199+0000 7fd4427fc700 1 -- 172.21.15.110:0/681155191 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fd4340744a0 con 0x7fd44c0bc220 2021-03-25T14:16:28.206 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.199+0000 7fd44a59c700 1 --2- 172.21.15.110:0/681155191 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd43005a0b0 0x7fd43005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:28.206 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.199+0000 7fd44a59c700 1 --2- 172.21.15.110:0/681155191 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd43005a0b0 0x7fd43005c570 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fd44c0bcce0 tx=0x7fd43c009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:28.206 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.202+0000 7fd4427fc700 1 -- 172.21.15.110:0/681155191 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fd434047b50 con 0x7fd44c0bc220 2021-03-25T14:16:28.390 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.388+0000 7fd45089b700 1 -- 172.21.15.110:0/681155191 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fd44c05d7b0 con 0x7fd44c0bc220 2021-03-25T14:16:28.392 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.391+0000 7fd4427fc700 1 -- 172.21.15.110:0/681155191 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+140009 (secure 0 0 0) 0x7fd43404b170 con 0x7fd44c0bc220 2021-03-25T14:16:28.395 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:16:28.396 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.393+0000 7fd45089b700 1 -- 172.21.15.110:0/681155191 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd43005a0b0 msgr2=0x7fd43005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:28.396 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.393+0000 7fd45089b700 1 --2- 172.21.15.110:0/681155191 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd43005a0b0 0x7fd43005c570 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fd44c0bcce0 tx=0x7fd43c009040).stop 2021-03-25T14:16:28.397 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.393+0000 7fd45089b700 1 -- 172.21.15.110:0/681155191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd44c0bc220 msgr2=0x7fd44c14a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:28.397 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.393+0000 7fd45089b700 1 --2- 172.21.15.110:0/681155191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd44c0bc220 0x7fd44c14a7c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fd43400ebd0 tx=0x7fd434006e20).stop 2021-03-25T14:16:28.397 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.393+0000 7fd45089b700 1 -- 172.21.15.110:0/681155191 shutdown_connections 2021-03-25T14:16:28.397 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.393+0000 7fd45089b700 1 --2- 172.21.15.110:0/681155191 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd43005a0b0 0x7fd43005c570 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:28.397 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.393+0000 7fd45089b700 1 --2- 172.21.15.110:0/681155191 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd44c0675d0 0x7fd44c0b1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:28.397 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.393+0000 7fd45089b700 1 --2- 172.21.15.110:0/681155191 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd44c148970 0x7fd44c15c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:28.397 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.393+0000 7fd45089b700 1 --2- 172.21.15.110:0/681155191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd44c0bc220 0x7fd44c14a7c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:28.397 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.393+0000 7fd45089b700 1 -- 172.21.15.110:0/681155191 >> 172.21.15.110:0/681155191 conn(0x7fd44c064a10 msgr2=0x7fd44c14d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:28.397 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.393+0000 7fd45089b700 1 -- 172.21.15.110:0/681155191 shutdown_connections 2021-03-25T14:16:28.397 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.393+0000 7fd45089b700 1 -- 172.21.15.110:0/681155191 wait complete. 2021-03-25T14:16:28.406 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":4,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":36740},{"type":"v1","addr":"172.21.15.110:6833","nonce":36740}]},"active_addr":"172.21.15.110:6833/36740","active_change":"2021-03-25T14:15:53.893305+0000","active_mgr_features":4540138303579357183,"available":true,"standbys":[{"gid":4109,"name":"x","mgr_features":4540138303579357183,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"haproxy","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"haproxy","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":3666482598}]},{"addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":2848372087}]}]}} 2021-03-25T14:16:28.411 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2021-03-25T14:16:28.411 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2021-03-25T14:16:28.411 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:16:28.520 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.518+0000 7f83cf9b1700 1 Processor -- start 2021-03-25T14:16:28.521 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.519+0000 7f83cf9b1700 1 -- start start 2021-03-25T14:16:28.527 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.519+0000 7f83cf9b1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83c80b1340 0x7f83c80b1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:28.527 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.519+0000 7f83cf9b1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f83c8066420 0x7f83c80668a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:28.527 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.519+0000 7f83cf9b1700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83c8067510 con 0x7f83c8149cf0 2021-03-25T14:16:28.527 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.519+0000 7f83cf9b1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83c80677b0 con 0x7f83c8066420 2021-03-25T14:16:28.527 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.519+0000 7f83cf9b1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c8067a50 con 0x7f83c80b1340 2021-03-25T14:16:28.527 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.519+0000 7f83cdf4e700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f83c8149cf0 0x7f83c814cee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:40766/0 (socket says 172.21.15.110:40766) 2021-03-25T14:16:28.527 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.519+0000 7f83cdf4e700 1 -- 172.21.15.110:0/1225204878 learned_addr learned my addr 172.21.15.110:0/1225204878 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:28.527 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.520+0000 7f83cd74d700 1 --2- 172.21.15.110:0/1225204878 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83c80b1340 0x7f83c80b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:28.527 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.520+0000 7f83ccf4c700 1 --2- 172.21.15.110:0/1225204878 >> v2:172.21.15.174:3300/0 conn(0x7f83c8066420 0x7f83c80668a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:28.527 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.520+0000 7f83b7fff700 1 -- 172.21.15.110:0/1225204878 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4864405 0 0) 0x7f83c8067510 con 0x7f83c8149cf0 2021-03-25T14:16:28.528 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.520+0000 7f83b7fff700 1 -- 172.21.15.110:0/1225204878 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83b0003270 con 0x7f83c8149cf0 2021-03-25T14:16:28.528 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.520+0000 7f83b7fff700 1 -- 172.21.15.110:0/1225204878 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2371833093 0 0) 0x7f83b0003270 con 0x7f83c8149cf0 2021-03-25T14:16:28.528 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.520+0000 7f83b7fff700 1 -- 172.21.15.110:0/1225204878 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83c80b1340 msgr2=0x7f83c80b1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:28.528 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.520+0000 7f83b7fff700 1 --2- 172.21.15.110:0/1225204878 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83c80b1340 0x7f83c80b1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:28.528 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.520+0000 7f83b7fff700 1 -- 172.21.15.110:0/1225204878 >> v2:172.21.15.174:3300/0 conn(0x7f83c8066420 msgr2=0x7f83c80668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:28.528 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.520+0000 7f83b7fff700 1 --2- 172.21.15.110:0/1225204878 >> v2:172.21.15.174:3300/0 conn(0x7f83c8066420 0x7f83c80668a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:28.528 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.520+0000 7f83b7fff700 1 -- 172.21.15.110:0/1225204878 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c8067cf0 con 0x7f83c8149cf0 2021-03-25T14:16:28.528 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.520+0000 7f83b7fff700 1 -- 172.21.15.110:0/1225204878 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f83c00018a0 con 0x7f83c8149cf0 2021-03-25T14:16:28.528 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.520+0000 7f83b7fff700 1 -- 172.21.15.110:0/1225204878 >> v1:172.21.15.110:6789/0 conn(0x7f83c8149cf0 legacy=0x7f83c814cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:28.528 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.520+0000 7f83b7fff700 1 --2- 172.21.15.110:0/1225204878 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83b0003760 0x7f83b0003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:28.528 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.520+0000 7f83b7fff700 1 --2- 172.21.15.110:0/1225204878 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83b0004510 0x7f83b0004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:28.528 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.520+0000 7f83b7fff700 1 --2- 172.21.15.110:0/1225204878 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83c80b1340 0x7f83b0004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:28.529 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.520+0000 7f83b7fff700 1 -- 172.21.15.110:0/1225204878 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c80677b0 con 0x7f83b0004510 2021-03-25T14:16:28.529 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.520+0000 7f83b7fff700 1 -- 172.21.15.110:0/1225204878 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c8067a50 con 0x7f83b0003760 2021-03-25T14:16:28.529 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.520+0000 7f83b7fff700 1 -- 172.21.15.110:0/1225204878 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b00042a0 con 0x7f83c80b1340 2021-03-25T14:16:28.529 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.520+0000 7f83ccf4c700 1 --2- 172.21.15.110:0/1225204878 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83b0004510 0x7f83b0004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:28.529 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.520+0000 7f83cd74d700 1 --2- 172.21.15.110:0/1225204878 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83b0003760 0x7f83b0003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:28.529 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.520+0000 7f83cdf4e700 1 --2- 172.21.15.110:0/1225204878 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83c80b1340 0x7f83b0004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:28.529 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.520+0000 7f83ccf4c700 1 -- 172.21.15.110:0/1225204878 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83c80b1340 msgr2=0x7f83b0004e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:28.529 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.520+0000 7f83ccf4c700 1 --2- 172.21.15.110:0/1225204878 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83c80b1340 0x7f83b0004e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:28.529 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.520+0000 7f83ccf4c700 1 -- 172.21.15.110:0/1225204878 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83b0003760 msgr2=0x7f83b0003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:28.529 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.520+0000 7f83ccf4c700 1 --2- 172.21.15.110:0/1225204878 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83b0003760 0x7f83b0003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:28.529 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.520+0000 7f83ccf4c700 1 -- 172.21.15.110:0/1225204878 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b0003270 con 0x7f83b0004510 2021-03-25T14:16:28.529 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.521+0000 7f83ccf4c700 1 --2- 172.21.15.110:0/1225204878 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83b0004510 0x7f83b0004990 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f83b800bc30 tx=0x7f83b8006e20).ready entity=mon.0 client_cookie=85eb8d9f3f91a1df server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:28.529 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.521+0000 7f83b7fff700 1 -- 172.21.15.110:0/1225204878 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b800b310 con 0x7f83b0004510 2021-03-25T14:16:28.530 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.521+0000 7f83b7fff700 1 -- 172.21.15.110:0/1225204878 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b800e9a0 con 0x7f83b0004510 2021-03-25T14:16:28.530 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.521+0000 7f83b7fff700 1 -- 172.21.15.110:0/1225204878 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b800ed20 con 0x7f83b0004510 2021-03-25T14:16:28.530 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.521+0000 7f83cf9b1700 1 -- 172.21.15.110:0/1225204878 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83b0004510 msgr2=0x7f83b0004990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:28.530 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.521+0000 7f83cf9b1700 1 --2- 172.21.15.110:0/1225204878 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83b0004510 0x7f83b0004990 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f83b800bc30 tx=0x7f83b8006e20).stop 2021-03-25T14:16:28.530 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.521+0000 7f83cdf4e700 1 -- 172.21.15.110:0/1225204878 reap_dead start 2021-03-25T14:16:28.530 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.521+0000 7f83cf9b1700 1 -- 172.21.15.110:0/1225204878 shutdown_connections 2021-03-25T14:16:28.530 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.521+0000 7f83cf9b1700 1 -- 172.21.15.110:0/1225204878 >> 172.21.15.110:0/1225204878 conn(0x7f83c80649a0 msgr2=0x7f83c805c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:28.530 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.521+0000 7f83cf9b1700 1 -- 172.21.15.110:0/1225204878 shutdown_connections 2021-03-25T14:16:28.530 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.521+0000 7f83cf9b1700 1 -- 172.21.15.110:0/1225204878 wait complete. 2021-03-25T14:16:28.530 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.522+0000 7f83cf9b1700 1 Processor -- start 2021-03-25T14:16:28.530 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.522+0000 7f83cf9b1700 1 -- start start 2021-03-25T14:16:28.530 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.523+0000 7f83cf9b1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83b0004510 0x7f83c81403c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:28.531 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.523+0000 7f83cf9b1700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83c81408b0 0x7f83c81457a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:28.531 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.523+0000 7f83cf9b1700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83c8145c90 0x7f83c815c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:28.531 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.523+0000 7f83cf9b1700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c80b60d0 con 0x7f83c8145c90 2021-03-25T14:16:28.531 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.523+0000 7f83cf9b1700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c8146f80 con 0x7f83c81408b0 2021-03-25T14:16:28.531 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.523+0000 7f83cf9b1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c80b6ca0 con 0x7f83b0004510 2021-03-25T14:16:28.531 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.523+0000 7f83cdf4e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83c8145c90 0x7f83c815c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:28.531 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.523+0000 7f83cdf4e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83c8145c90 0x7f83c815c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47842/0 (socket says 172.21.15.110:47842) 2021-03-25T14:16:28.531 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.523+0000 7f83cdf4e700 1 -- 172.21.15.110:0/2329817330 learned_addr learned my addr 172.21.15.110:0/2329817330 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:28.531 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.523+0000 7f83cd74d700 1 --2- 172.21.15.110:0/2329817330 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83b0004510 0x7f83c81403c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:28.531 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.523+0000 7f83ccf4c700 1 --2- 172.21.15.110:0/2329817330 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83c81408b0 0x7f83c81457a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:28.531 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.524+0000 7f83cdf4e700 1 -- 172.21.15.110:0/2329817330 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83b0004510 msgr2=0x7f83c81403c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:28.531 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.524+0000 7f83cdf4e700 1 --2- 172.21.15.110:0/2329817330 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83b0004510 0x7f83c81403c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:28.532 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.524+0000 7f83cdf4e700 1 -- 172.21.15.110:0/2329817330 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83c81408b0 msgr2=0x7f83c81457a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:28.532 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.524+0000 7f83cdf4e700 1 --2- 172.21.15.110:0/2329817330 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83c81408b0 0x7f83c81457a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:28.532 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.524+0000 7f83cdf4e700 1 -- 172.21.15.110:0/2329817330 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c80b4b30 con 0x7f83c8145c90 2021-03-25T14:16:28.532 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.524+0000 7f83cdf4e700 1 --2- 172.21.15.110:0/2329817330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83c8145c90 0x7f83c815c360 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f83c80b2f80 tx=0x7f83c80b2c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:28.532 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.524+0000 7f83b57fa700 1 -- 172.21.15.110:0/2329817330 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c000fb20 con 0x7f83c8145c90 2021-03-25T14:16:28.532 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.524+0000 7f83b57fa700 1 -- 172.21.15.110:0/2329817330 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c000fc80 con 0x7f83c8145c90 2021-03-25T14:16:28.532 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.524+0000 7f83cf9b1700 1 -- 172.21.15.110:0/2329817330 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c80b62c0 con 0x7f83c8145c90 2021-03-25T14:16:28.532 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.524+0000 7f83b57fa700 1 -- 172.21.15.110:0/2329817330 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c0015410 con 0x7f83c8145c90 2021-03-25T14:16:28.532 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.524+0000 7f83cf9b1700 1 -- 172.21.15.110:0/2329817330 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c80b6800 con 0x7f83c8145c90 2021-03-25T14:16:28.532 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.525+0000 7f83cf9b1700 1 -- 172.21.15.110:0/2329817330 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c814c9a0 con 0x7f83c8145c90 2021-03-25T14:16:28.532 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.525+0000 7f83b57fa700 1 -- 172.21.15.110:0/2329817330 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f83c0015780 con 0x7f83c8145c90 2021-03-25T14:16:28.533 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.526+0000 7f83b57fa700 1 --2- 172.21.15.110:0/2329817330 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f83a805a0b0 0x7f83a805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:28.533 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.526+0000 7f83b57fa700 1 -- 172.21.15.110:0/2329817330 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f83c0074140 con 0x7f83c8145c90 2021-03-25T14:16:28.533 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.526+0000 7f83cd74d700 1 --2- 172.21.15.110:0/2329817330 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f83a805a0b0 0x7f83a805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:28.533 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.526+0000 7f83cd74d700 1 --2- 172.21.15.110:0/2329817330 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f83a805a0b0 0x7f83a805c570 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f83c400bcc0 tx=0x7f83c4006e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:28.534 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.529+0000 7f83b57fa700 1 -- 172.21.15.110:0/2329817330 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f83c00477f0 con 0x7f83c8145c90 2021-03-25T14:16:28.681 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.679+0000 7f83cf9b1700 1 -- 172.21.15.110:0/2329817330 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83c8067ed0 con 0x7f83c8145c90 2021-03-25T14:16:28.681 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.680+0000 7f83b57fa700 1 -- 172.21.15.110:0/2329817330 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18685 (secure 0 0 0) 0x7f83c004ae10 con 0x7f83c8145c90 2021-03-25T14:16:28.682 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:16:28.682 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":25,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:16:15.446609+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-03-25T14:16:09.478442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-03-25T14:16:10.071152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2021-03-25T14:16:13.122119+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:16:28.684 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.681+0000 7f83cf9b1700 1 -- 172.21.15.110:0/2329817330 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f83a805a0b0 msgr2=0x7f83a805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:28.684 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.681+0000 7f83cf9b1700 1 --2- 172.21.15.110:0/2329817330 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f83a805a0b0 0x7f83a805c570 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f83c400bcc0 tx=0x7f83c4006e20).stop 2021-03-25T14:16:28.684 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.681+0000 7f83cf9b1700 1 -- 172.21.15.110:0/2329817330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83c8145c90 msgr2=0x7f83c815c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:28.684 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.681+0000 7f83cf9b1700 1 --2- 172.21.15.110:0/2329817330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83c8145c90 0x7f83c815c360 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f83c80b2f80 tx=0x7f83c80b2c00).stop 2021-03-25T14:16:28.684 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.681+0000 7f83cf9b1700 1 -- 172.21.15.110:0/2329817330 shutdown_connections 2021-03-25T14:16:28.684 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.681+0000 7f83cf9b1700 1 --2- 172.21.15.110:0/2329817330 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f83a805a0b0 0x7f83a805c570 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:28.684 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.681+0000 7f83cf9b1700 1 --2- 172.21.15.110:0/2329817330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83c8145c90 0x7f83c815c360 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:28.684 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.681+0000 7f83cf9b1700 1 --2- 172.21.15.110:0/2329817330 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83b0004510 0x7f83c81403c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:28.684 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.681+0000 7f83cf9b1700 1 --2- 172.21.15.110:0/2329817330 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83c81408b0 0x7f83c81457a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:28.684 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.681+0000 7f83cf9b1700 1 -- 172.21.15.110:0/2329817330 >> 172.21.15.110:0/2329817330 conn(0x7f83c80649a0 msgr2=0x7f83c80bced0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:28.684 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.681+0000 7f83cf9b1700 1 -- 172.21.15.110:0/2329817330 shutdown_connections 2021-03-25T14:16:28.685 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.681+0000 7f83cf9b1700 1 -- 172.21.15.110:0/2329817330 wait complete. 2021-03-25T14:16:28.695 INFO:tasks.ceph.ceph_manager.ceph:all up! 2021-03-25T14:16:28.695 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:16:28.806 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.804+0000 7f855b498700 1 Processor -- start 2021-03-25T14:16:28.807 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.805+0000 7f855b498700 1 -- start start 2021-03-25T14:16:28.818 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.805+0000 7f855b498700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f85540bcd90 0x7f855414d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:28.819 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.805+0000 7f855b498700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85540b9140 con 0x7f85540b1340 2021-03-25T14:16:28.819 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.805+0000 7f855b498700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85540b93e0 con 0x7f85540b7620 2021-03-25T14:16:28.819 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.805+0000 7f855b498700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85540692a0 con 0x7f85540bcd90 2021-03-25T14:16:28.819 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.805+0000 7f8558a33700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f85540b1340 0x7f8554060c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:40782/0 (socket says 172.21.15.110:40782) 2021-03-25T14:16:28.819 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.805+0000 7f8558a33700 1 -- 172.21.15.110:0/402553884 learned_addr learned my addr 172.21.15.110:0/402553884 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:28.819 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.806+0000 7f8559234700 1 --2- 172.21.15.110:0/402553884 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f85540bcd90 0x7f855414d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:28.819 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.806+0000 7f8547fff700 1 -- 172.21.15.110:0/402553884 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494249919 0 0) 0x7f85540b9140 con 0x7f85540b1340 2021-03-25T14:16:28.819 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.806+0000 7f8547fff700 1 -- 172.21.15.110:0/402553884 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f853c003270 con 0x7f85540b1340 2021-03-25T14:16:28.819 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.806+0000 7f8547fff700 1 -- 172.21.15.110:0/402553884 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4009820857 0 0) 0x7f853c003270 con 0x7f85540b1340 2021-03-25T14:16:28.819 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.806+0000 7f8547fff700 1 -- 172.21.15.110:0/402553884 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f85540bcd90 msgr2=0x7f855414d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:28.820 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.806+0000 7f8547fff700 1 --2- 172.21.15.110:0/402553884 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f85540bcd90 0x7f855414d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:28.820 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.806+0000 7f8547fff700 1 -- 172.21.15.110:0/402553884 >> v1:172.21.15.174:6789/0 conn(0x7f85540b7620 legacy=0x7f8554148ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:28.820 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.806+0000 7f8547fff700 1 -- 172.21.15.110:0/402553884 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f855414cda0 con 0x7f85540b1340 2021-03-25T14:16:28.820 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.806+0000 7f8547fff700 1 -- 172.21.15.110:0/402553884 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f8548001520 con 0x7f85540b1340 2021-03-25T14:16:28.820 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.806+0000 7f8547fff700 1 -- 172.21.15.110:0/402553884 >> v1:172.21.15.110:6789/0 conn(0x7f85540b1340 legacy=0x7f8554060c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:28.820 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.806+0000 7f8547fff700 1 --2- 172.21.15.110:0/402553884 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f85540bcd90 0x7f853c003790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:28.820 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.806+0000 7f8547fff700 1 --2- 172.21.15.110:0/402553884 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f853c003c80 0x7f853c004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:28.820 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.806+0000 7f8547fff700 1 --2- 172.21.15.110:0/402553884 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f853c004a00 0x7f853c004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:28.820 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.806+0000 7f8547fff700 1 -- 172.21.15.110:0/402553884 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85540692a0 con 0x7f853c003c80 2021-03-25T14:16:28.820 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.806+0000 7f8547fff700 1 -- 172.21.15.110:0/402553884 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853c0041a0 con 0x7f853c004a00 2021-03-25T14:16:28.821 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.806+0000 7f8547fff700 1 -- 172.21.15.110:0/402553884 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f853c004360 con 0x7f85540bcd90 2021-03-25T14:16:28.821 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.806+0000 7f8558a33700 1 --2- 172.21.15.110:0/402553884 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f853c003c80 0x7f853c004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:28.821 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.806+0000 7f8559234700 1 --2- 172.21.15.110:0/402553884 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f85540bcd90 0x7f853c003790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:28.821 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.806+0000 7f8559a35700 1 --2- 172.21.15.110:0/402553884 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f853c004a00 0x7f853c004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:28.821 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.806+0000 7f8558a33700 1 -- 172.21.15.110:0/402553884 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f85540bcd90 msgr2=0x7f853c003790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:28.821 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.806+0000 7f8558a33700 1 --2- 172.21.15.110:0/402553884 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f85540bcd90 0x7f853c003790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:28.821 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.806+0000 7f8558a33700 1 -- 172.21.15.110:0/402553884 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f853c004a00 msgr2=0x7f853c004e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:28.821 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.806+0000 7f8558a33700 1 --2- 172.21.15.110:0/402553884 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f853c004a00 0x7f853c004e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:28.822 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.806+0000 7f8558a33700 1 -- 172.21.15.110:0/402553884 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853c003270 con 0x7f853c003c80 2021-03-25T14:16:28.822 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.806+0000 7f8559a35700 1 --2- 172.21.15.110:0/402553884 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f853c004a00 0x7f853c004e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:28.822 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.807+0000 7f8558a33700 1 --2- 172.21.15.110:0/402553884 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f853c003c80 0x7f853c004510 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f854800c410 tx=0x7f85540b8ca0).ready entity=mon.0 client_cookie=ae305fac1af36b95 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:28.822 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.807+0000 7f8547fff700 1 -- 172.21.15.110:0/402553884 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85480070d0 con 0x7f853c003c80 2021-03-25T14:16:28.822 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.807+0000 7f8547fff700 1 -- 172.21.15.110:0/402553884 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8548007230 con 0x7f853c003c80 2021-03-25T14:16:28.822 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.807+0000 7f8547fff700 1 -- 172.21.15.110:0/402553884 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8548005620 con 0x7f853c003c80 2021-03-25T14:16:28.822 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.807+0000 7f855b498700 1 -- 172.21.15.110:0/402553884 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f853c003c80 msgr2=0x7f853c004510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:28.822 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.807+0000 7f855b498700 1 --2- 172.21.15.110:0/402553884 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f853c003c80 0x7f853c004510 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f854800c410 tx=0x7f85540b8ca0).stop 2021-03-25T14:16:28.822 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.807+0000 7f8559a35700 1 -- 172.21.15.110:0/402553884 reap_dead start 2021-03-25T14:16:28.822 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.807+0000 7f855b498700 1 -- 172.21.15.110:0/402553884 shutdown_connections 2021-03-25T14:16:28.822 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.807+0000 7f855b498700 1 -- 172.21.15.110:0/402553884 >> 172.21.15.110:0/402553884 conn(0x7f8554063720 msgr2=0x7f8554063b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:28.823 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.807+0000 7f855b498700 1 -- 172.21.15.110:0/402553884 shutdown_connections 2021-03-25T14:16:28.823 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.807+0000 7f855b498700 1 -- 172.21.15.110:0/402553884 wait complete. 2021-03-25T14:16:28.823 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.808+0000 7f855b498700 1 Processor -- start 2021-03-25T14:16:28.823 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.808+0000 7f855b498700 1 -- start start 2021-03-25T14:16:28.823 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.809+0000 7f855b498700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f853c003c80 0x7f855415cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:28.823 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.809+0000 7f855b498700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85540b4380 0x7f8554149de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:28.823 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.809+0000 7f855b498700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8554116060 0x7f8554158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:28.823 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.809+0000 7f855b498700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85541168c0 con 0x7f8554116060 2021-03-25T14:16:28.823 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.809+0000 7f855b498700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8554116b60 con 0x7f85540b4380 2021-03-25T14:16:28.823 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.809+0000 7f855b498700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f855415c320 con 0x7f853c003c80 2021-03-25T14:16:28.824 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.809+0000 7f8559a35700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8554116060 0x7f8554158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:28.824 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.809+0000 7f8559a35700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8554116060 0x7f8554158cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47862/0 (socket says 172.21.15.110:47862) 2021-03-25T14:16:28.824 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.809+0000 7f8559a35700 1 -- 172.21.15.110:0/3526613807 learned_addr learned my addr 172.21.15.110:0/3526613807 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:28.824 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.809+0000 7f8559234700 1 --2- 172.21.15.110:0/3526613807 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f853c003c80 0x7f855415cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:28.824 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.809+0000 7f8558a33700 1 --2- 172.21.15.110:0/3526613807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85540b4380 0x7f8554149de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:28.824 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.810+0000 7f8559a35700 1 -- 172.21.15.110:0/3526613807 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f853c003c80 msgr2=0x7f855415cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:28.824 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.810+0000 7f8559a35700 1 --2- 172.21.15.110:0/3526613807 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f853c003c80 0x7f855415cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:28.824 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.810+0000 7f8559a35700 1 -- 172.21.15.110:0/3526613807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85540b4380 msgr2=0x7f8554149de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:28.824 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.810+0000 7f8559a35700 1 --2- 172.21.15.110:0/3526613807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85540b4380 0x7f8554149de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:28.824 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.810+0000 7f8559a35700 1 -- 172.21.15.110:0/3526613807 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f855415c5c0 con 0x7f8554116060 2021-03-25T14:16:28.825 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.810+0000 7f8559a35700 1 --2- 172.21.15.110:0/3526613807 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8554116060 0x7f8554158cb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f854c007d00 tx=0x7f854c009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:28.825 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.810+0000 7f85457fa700 1 -- 172.21.15.110:0/3526613807 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c00ee90 con 0x7f8554116060 2021-03-25T14:16:28.825 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.810+0000 7f85457fa700 1 -- 172.21.15.110:0/3526613807 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854c0068a0 con 0x7f8554116060 2021-03-25T14:16:28.825 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.810+0000 7f855b498700 1 -- 172.21.15.110:0/3526613807 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f855415c860 con 0x7f8554116060 2021-03-25T14:16:28.825 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.810+0000 7f85457fa700 1 -- 172.21.15.110:0/3526613807 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c006c60 con 0x7f8554116060 2021-03-25T14:16:28.825 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.810+0000 7f855b498700 1 -- 172.21.15.110:0/3526613807 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85541164e0 con 0x7f8554116060 2021-03-25T14:16:28.825 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.811+0000 7f855b498700 1 -- 172.21.15.110:0/3526613807 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f855405d7b0 con 0x7f8554116060 2021-03-25T14:16:28.825 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.811+0000 7f85457fa700 1 -- 172.21.15.110:0/3526613807 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f854c007230 con 0x7f8554116060 2021-03-25T14:16:28.825 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.811+0000 7f85457fa700 1 --2- 172.21.15.110:0/3526613807 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f853405a0b0 0x7f853405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:28.825 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.811+0000 7f85457fa700 1 -- 172.21.15.110:0/3526613807 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f854c073dc0 con 0x7f8554116060 2021-03-25T14:16:28.825 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.812+0000 7f8559234700 1 --2- 172.21.15.110:0/3526613807 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f853405a0b0 0x7f853405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:28.825 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.812+0000 7f8559234700 1 --2- 172.21.15.110:0/3526613807 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f853405a0b0 0x7f853405c570 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f855000bcc0 tx=0x7f8550006e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:28.826 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.815+0000 7f85457fa700 1 -- 172.21.15.110:0/3526613807 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f854c046620 con 0x7f8554116060 2021-03-25T14:16:28.969 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.967+0000 7f855b498700 1 -- 172.21.15.110:0/3526613807 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85540b3a20 con 0x7f8554116060 2021-03-25T14:16:28.970 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.968+0000 7f85457fa700 1 -- 172.21.15.110:0/3526613807 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18685 (secure 0 0 0) 0x7f854c026910 con 0x7f8554116060 2021-03-25T14:16:28.970 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:16:28.971 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":25,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:16:15.446609+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-03-25T14:16:09.478442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-03-25T14:16:10.071152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2021-03-25T14:16:13.122119+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:16:28.972 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.970+0000 7f855b498700 1 -- 172.21.15.110:0/3526613807 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f853405a0b0 msgr2=0x7f853405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:28.972 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.970+0000 7f855b498700 1 --2- 172.21.15.110:0/3526613807 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f853405a0b0 0x7f853405c570 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f855000bcc0 tx=0x7f8550006e20).stop 2021-03-25T14:16:28.973 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.970+0000 7f855b498700 1 -- 172.21.15.110:0/3526613807 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8554116060 msgr2=0x7f8554158cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:28.973 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.970+0000 7f855b498700 1 --2- 172.21.15.110:0/3526613807 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8554116060 0x7f8554158cb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f854c007d00 tx=0x7f854c009040).stop 2021-03-25T14:16:28.973 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.970+0000 7f855b498700 1 -- 172.21.15.110:0/3526613807 shutdown_connections 2021-03-25T14:16:28.973 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.970+0000 7f855b498700 1 --2- 172.21.15.110:0/3526613807 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f853405a0b0 0x7f853405c570 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:28.973 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.970+0000 7f855b498700 1 --2- 172.21.15.110:0/3526613807 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8554116060 0x7f8554158cb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:28.973 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.970+0000 7f855b498700 1 --2- 172.21.15.110:0/3526613807 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f853c003c80 0x7f855415cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:28.973 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.970+0000 7f855b498700 1 --2- 172.21.15.110:0/3526613807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85540b4380 0x7f8554149de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:28.973 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.970+0000 7f855b498700 1 -- 172.21.15.110:0/3526613807 >> 172.21.15.110:0/3526613807 conn(0x7f8554063720 msgr2=0x7f855414ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:28.973 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.970+0000 7f855b498700 1 -- 172.21.15.110:0/3526613807 shutdown_connections 2021-03-25T14:16:28.973 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:28.970+0000 7f855b498700 1 -- 172.21.15.110:0/3526613807 wait complete. 2021-03-25T14:16:28.984 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2021-03-25T14:16:29.094 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.092+0000 7fbd867e1700 1 Processor -- start 2021-03-25T14:16:29.095 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.092+0000 7fbd867e1700 1 -- start start 2021-03-25T14:16:29.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.093+0000 7fbd867e1700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbd800b6750 0x7fbd800bc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.093+0000 7fbd867e1700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd800bacd0 con 0x7fbd800b62c0 2021-03-25T14:16:29.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.093+0000 7fbd867e1700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd800baf70 con 0x7fbd80149c40 2021-03-25T14:16:29.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.093+0000 7fbd867e1700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd801472c0 con 0x7fbd800b6750 2021-03-25T14:16:29.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.093+0000 7fbd84d7e700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbd800b6750 0x7fbd800bc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.093+0000 7fbd7f7fe700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fbd800b62c0 0x7fbd800bbe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:40802/0 (socket says 172.21.15.110:40802) 2021-03-25T14:16:29.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.093+0000 7fbd7f7fe700 1 -- 172.21.15.110:0/1577238567 learned_addr learned my addr 172.21.15.110:0/1577238567 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:29.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.094+0000 7fbd84d7e700 1 -- 172.21.15.110:0/1577238567 >> v1:172.21.15.174:6789/0 conn(0x7fbd80149c40 legacy=0x7fbd8014a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.094+0000 7fbd84d7e700 1 -- 172.21.15.110:0/1577238567 >> v1:172.21.15.110:6789/0 conn(0x7fbd800b62c0 legacy=0x7fbd800bbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.094+0000 7fbd7effd700 1 -- 172.21.15.110:0/1577238567 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4008499834 0 0) 0x7fbd800bacd0 con 0x7fbd800b62c0 2021-03-25T14:16:29.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.094+0000 7fbd84d7e700 1 -- 172.21.15.110:0/1577238567 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd800bb210 con 0x7fbd800b6750 2021-03-25T14:16:29.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.094+0000 7fbd84d7e700 1 --2- 172.21.15.110:0/1577238567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd800b6750 0x7fbd800bc520 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fbd80147400 tx=0x7fbd78009220).ready entity=mon.0 client_cookie=fffb07cd7392429c server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:29.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.094+0000 7fbd7effd700 1 -- 172.21.15.110:0/1577238567 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd78009ea0 con 0x7fbd800b6750 2021-03-25T14:16:29.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.094+0000 7fbd7effd700 1 -- 172.21.15.110:0/1577238567 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd7800bbf0 con 0x7fbd800b6750 2021-03-25T14:16:29.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.094+0000 7fbd7effd700 1 -- 172.21.15.110:0/1577238567 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd78011400 con 0x7fbd800b6750 2021-03-25T14:16:29.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.094+0000 7fbd867e1700 1 -- 172.21.15.110:0/1577238567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd800b6750 msgr2=0x7fbd800bc520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.094+0000 7fbd867e1700 1 --2- 172.21.15.110:0/1577238567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd800b6750 0x7fbd800bc520 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fbd80147400 tx=0x7fbd78009220).stop 2021-03-25T14:16:29.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.094+0000 7fbd867e1700 1 -- 172.21.15.110:0/1577238567 shutdown_connections 2021-03-25T14:16:29.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.094+0000 7fbd867e1700 1 --2- 172.21.15.110:0/1577238567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd800b6750 0x7fbd800bc520 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:29.099 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.094+0000 7fbd867e1700 1 -- 172.21.15.110:0/1577238567 >> 172.21.15.110:0/1577238567 conn(0x7fbd80060c40 msgr2=0x7fbd80061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:29.099 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.094+0000 7fbd867e1700 1 -- 172.21.15.110:0/1577238567 shutdown_connections 2021-03-25T14:16:29.099 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.094+0000 7fbd867e1700 1 -- 172.21.15.110:0/1577238567 wait complete. 2021-03-25T14:16:29.099 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.095+0000 7fbd867e1700 1 Processor -- start 2021-03-25T14:16:29.099 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.096+0000 7fbd867e1700 1 -- start start 2021-03-25T14:16:29.102 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.096+0000 7fbd867e1700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd800b62c0 0x7fbd80142cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.102 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.096+0000 7fbd867e1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd800b6750 0x7fbd801431c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.102 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.096+0000 7fbd867e1700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd80149c40 0x7fbd800b86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.102 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.096+0000 7fbd867e1700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd801436b0 con 0x7fbd800b62c0 2021-03-25T14:16:29.103 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.096+0000 7fbd867e1700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd800a5cd0 con 0x7fbd80149c40 2021-03-25T14:16:29.103 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.096+0000 7fbd867e1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd800a3250 con 0x7fbd800b6750 2021-03-25T14:16:29.103 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.096+0000 7fbd7ffff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd800b62c0 0x7fbd80142cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.103 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.096+0000 7fbd7ffff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd800b62c0 0x7fbd80142cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47872/0 (socket says 172.21.15.110:47872) 2021-03-25T14:16:29.103 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.096+0000 7fbd7ffff700 1 -- 172.21.15.110:0/707921287 learned_addr learned my addr 172.21.15.110:0/707921287 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:29.103 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.096+0000 7fbd7f7fe700 1 --2- 172.21.15.110:0/707921287 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd800b6750 0x7fbd801431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.103 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.096+0000 7fbd84d7e700 1 --2- 172.21.15.110:0/707921287 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd80149c40 0x7fbd800b86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.103 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.097+0000 7fbd7ffff700 1 -- 172.21.15.110:0/707921287 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd800b6750 msgr2=0x7fbd801431c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.103 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.097+0000 7fbd7ffff700 1 --2- 172.21.15.110:0/707921287 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd800b6750 0x7fbd801431c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:29.103 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.097+0000 7fbd7ffff700 1 -- 172.21.15.110:0/707921287 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd80149c40 msgr2=0x7fbd800b86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.103 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.097+0000 7fbd7ffff700 1 --2- 172.21.15.110:0/707921287 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd80149c40 0x7fbd800b86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:29.103 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.097+0000 7fbd7ffff700 1 -- 172.21.15.110:0/707921287 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd80159ab0 con 0x7fbd800b62c0 2021-03-25T14:16:29.104 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.097+0000 7fbd7ffff700 1 --2- 172.21.15.110:0/707921287 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd800b62c0 0x7fbd80142cd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fbd7000c710 tx=0x7fbd70007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:29.104 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.097+0000 7fbd67fff700 1 -- 172.21.15.110:0/707921287 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd70007020 con 0x7fbd800b62c0 2021-03-25T14:16:29.104 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.097+0000 7fbd67fff700 1 -- 172.21.15.110:0/707921287 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd70007180 con 0x7fbd800b62c0 2021-03-25T14:16:29.104 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.097+0000 7fbd867e1700 1 -- 172.21.15.110:0/707921287 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd80159d50 con 0x7fbd800b62c0 2021-03-25T14:16:29.104 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.097+0000 7fbd67fff700 1 -- 172.21.15.110:0/707921287 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd70006520 con 0x7fbd800b62c0 2021-03-25T14:16:29.104 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.097+0000 7fbd867e1700 1 -- 172.21.15.110:0/707921287 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd800b9400 con 0x7fbd800b62c0 2021-03-25T14:16:29.104 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.098+0000 7fbd867e1700 1 -- 172.21.15.110:0/707921287 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbd8005d7b0 con 0x7fbd800b62c0 2021-03-25T14:16:29.104 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.098+0000 7fbd67fff700 1 -- 172.21.15.110:0/707921287 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fbd7001a060 con 0x7fbd800b62c0 2021-03-25T14:16:29.104 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.098+0000 7fbd67fff700 1 --2- 172.21.15.110:0/707921287 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fbd6005a0b0 0x7fbd6005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.104 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.099+0000 7fbd67fff700 1 -- 172.21.15.110:0/707921287 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fbd70073790 con 0x7fbd800b62c0 2021-03-25T14:16:29.104 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.099+0000 7fbd7f7fe700 1 --2- 172.21.15.110:0/707921287 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fbd6005a0b0 0x7fbd6005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.104 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.099+0000 7fbd67fff700 1 --2- 172.21.15.110:0/707921287 >> [v2:172.21.15.110:6800/36956,v1:172.21.15.110:6801/36956] conn(0x7fbd600621c0 0x7fbd60064660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.104 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.099+0000 7fbd67fff700 1 -- 172.21.15.110:0/707921287 --> [v2:172.21.15.110:6800/36956,v1:172.21.15.110:6801/36956] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbd60064ce0 con 0x7fbd600621c0 2021-03-25T14:16:29.104 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.099+0000 7fbd67fff700 1 -- 172.21.15.110:0/707921287 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd70078220 con 0x7fbd800b62c0 2021-03-25T14:16:29.105 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.099+0000 7fbd84d7e700 1 --2- 172.21.15.110:0/707921287 >> [v2:172.21.15.110:6800/36956,v1:172.21.15.110:6801/36956] conn(0x7fbd600621c0 0x7fbd60064660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.105 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.099+0000 7fbd7f7fe700 1 --2- 172.21.15.110:0/707921287 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fbd6005a0b0 0x7fbd6005c570 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fbd74007fd0 tx=0x7fbd74007a10).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:29.105 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.099+0000 7fbd84d7e700 1 --2- 172.21.15.110:0/707921287 >> [v2:172.21.15.110:6800/36956,v1:172.21.15.110:6801/36956] conn(0x7fbd600621c0 0x7fbd60064660 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:29.105 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.100+0000 7fbd67fff700 1 -- 172.21.15.110:0/707921287 <== osd.0 v2:172.21.15.110:6800/36956 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fbd60064ce0 con 0x7fbd600621c0 2021-03-25T14:16:29.115 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.114+0000 7fbd867e1700 1 -- 172.21.15.110:0/707921287 --> [v2:172.21.15.110:6800/36956,v1:172.21.15.110:6801/36956] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbd800a5ef0 con 0x7fbd600621c0 2021-03-25T14:16:29.116 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.114+0000 7fbd67fff700 1 -- 172.21.15.110:0/707921287 <== osd.0 v2:172.21.15.110:6800/36956 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbd800a5ef0 con 0x7fbd600621c0 2021-03-25T14:16:29.117 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.115+0000 7fbd867e1700 1 -- 172.21.15.110:0/707921287 >> [v2:172.21.15.110:6800/36956,v1:172.21.15.110:6801/36956] conn(0x7fbd600621c0 msgr2=0x7fbd60064660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.117 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.115+0000 7fbd867e1700 1 --2- 172.21.15.110:0/707921287 >> [v2:172.21.15.110:6800/36956,v1:172.21.15.110:6801/36956] conn(0x7fbd600621c0 0x7fbd60064660 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:29.117 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.115+0000 7fbd867e1700 1 -- 172.21.15.110:0/707921287 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fbd6005a0b0 msgr2=0x7fbd6005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.117 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.115+0000 7fbd867e1700 1 --2- 172.21.15.110:0/707921287 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fbd6005a0b0 0x7fbd6005c570 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fbd74007fd0 tx=0x7fbd74007a10).stop 2021-03-25T14:16:29.117 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.115+0000 7fbd867e1700 1 -- 172.21.15.110:0/707921287 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd800b62c0 msgr2=0x7fbd80142cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.117 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.115+0000 7fbd867e1700 1 --2- 172.21.15.110:0/707921287 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd800b62c0 0x7fbd80142cd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fbd7000c710 tx=0x7fbd70007c80).stop 2021-03-25T14:16:29.117 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.115+0000 7fbd84d7e700 1 -- 172.21.15.110:0/707921287 reap_dead start 2021-03-25T14:16:29.117 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.115+0000 7fbd867e1700 1 -- 172.21.15.110:0/707921287 shutdown_connections 2021-03-25T14:16:29.118 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.115+0000 7fbd867e1700 1 -- 172.21.15.110:0/707921287 >> 172.21.15.110:0/707921287 conn(0x7fbd80060c40 msgr2=0x7fbd800689c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:29.118 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.115+0000 7fbd867e1700 1 -- 172.21.15.110:0/707921287 shutdown_connections 2021-03-25T14:16:29.118 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.115+0000 7fbd867e1700 1 -- 172.21.15.110:0/707921287 wait complete. 2021-03-25T14:16:29.127 INFO:teuthology.orchestra.run.smithi110.stdout:55834574857 2021-03-25T14:16:29.128 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2021-03-25T14:16:29.238 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.236+0000 7fd8ec40e700 1 Processor -- start 2021-03-25T14:16:29.238 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.236+0000 7fd8ec40e700 1 -- start start 2021-03-25T14:16:29.240 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.237+0000 7fd8ec40e700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd8e40b6410 0x7fd8e40ba870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.240 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.237+0000 7fd8ec40e700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8e40bb2d0 con 0x7fd8e40bad60 2021-03-25T14:16:29.240 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.237+0000 7fd8ec40e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8e40bb570 con 0x7fd8e40b67f0 2021-03-25T14:16:29.240 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.237+0000 7fd8ec40e700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8e40bb810 con 0x7fd8e40b6410 2021-03-25T14:16:29.240 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.237+0000 7fd8ea1aa700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd8e40b6410 0x7fd8e40ba870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.240 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.237+0000 7fd8ea9ab700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fd8e40bad60 0x7fd8e40bc950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:40820/0 (socket says 172.21.15.110:40820) 2021-03-25T14:16:29.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.237+0000 7fd8ea9ab700 1 -- 172.21.15.110:0/352215964 learned_addr learned my addr 172.21.15.110:0/352215964 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:29.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.237+0000 7fd8ea1aa700 1 -- 172.21.15.110:0/352215964 >> v1:172.21.15.174:6789/0 conn(0x7fd8e40b67f0 legacy=0x7fd8e4149ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:29.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.237+0000 7fd8ea1aa700 1 -- 172.21.15.110:0/352215964 >> v1:172.21.15.110:6789/0 conn(0x7fd8e40bad60 legacy=0x7fd8e40bc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.237+0000 7fd8e91a8700 1 -- 172.21.15.110:0/352215964 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2081275252 0 0) 0x7fd8e40bb2d0 con 0x7fd8e40bad60 2021-03-25T14:16:29.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.237+0000 7fd8ea1aa700 1 -- 172.21.15.110:0/352215964 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e40bc210 con 0x7fd8e40b6410 2021-03-25T14:16:29.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.238+0000 7fd8ea1aa700 1 --2- 172.21.15.110:0/352215964 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8e40b6410 0x7fd8e40ba870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fd8e000b9c0 tx=0x7fd8e0006e20).ready entity=mon.0 client_cookie=d12d6c01b56963fc server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:29.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.238+0000 7fd8e91a8700 1 -- 172.21.15.110:0/352215964 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e0009830 con 0x7fd8e40b6410 2021-03-25T14:16:29.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.238+0000 7fd8e91a8700 1 -- 172.21.15.110:0/352215964 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e0009990 con 0x7fd8e40b6410 2021-03-25T14:16:29.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.238+0000 7fd8e91a8700 1 -- 172.21.15.110:0/352215964 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e0009d10 con 0x7fd8e40b6410 2021-03-25T14:16:29.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.238+0000 7fd8ec40e700 1 -- 172.21.15.110:0/352215964 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8e40b6410 msgr2=0x7fd8e40ba870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.238+0000 7fd8ec40e700 1 --2- 172.21.15.110:0/352215964 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8e40b6410 0x7fd8e40ba870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fd8e000b9c0 tx=0x7fd8e0006e20).stop 2021-03-25T14:16:29.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.238+0000 7fd8ec40e700 1 -- 172.21.15.110:0/352215964 shutdown_connections 2021-03-25T14:16:29.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.238+0000 7fd8ec40e700 1 --2- 172.21.15.110:0/352215964 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8e40b6410 0x7fd8e40ba870 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:29.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.238+0000 7fd8ec40e700 1 -- 172.21.15.110:0/352215964 >> 172.21.15.110:0/352215964 conn(0x7fd8e4060c40 msgr2=0x7fd8e4061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:29.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.238+0000 7fd8ec40e700 1 -- 172.21.15.110:0/352215964 shutdown_connections 2021-03-25T14:16:29.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.238+0000 7fd8ec40e700 1 -- 172.21.15.110:0/352215964 wait complete. 2021-03-25T14:16:29.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.239+0000 7fd8ec40e700 1 Processor -- start 2021-03-25T14:16:29.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.239+0000 7fd8ec40e700 1 -- start start 2021-03-25T14:16:29.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.240+0000 7fd8ec40e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8e40b6410 0x7fd8e4148090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.240+0000 7fd8ec40e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd8e40b67f0 0x7fd8e4158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.240+0000 7fd8ec40e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8e40bad60 0x7fd8e41590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.240+0000 7fd8ec40e700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e414bc30 con 0x7fd8e40bad60 2021-03-25T14:16:29.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.240+0000 7fd8ec40e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e414db30 con 0x7fd8e40b6410 2021-03-25T14:16:29.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.240+0000 7fd8ec40e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e40a3e80 con 0x7fd8e40b67f0 2021-03-25T14:16:29.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.240+0000 7fd8ea9ab700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8e40bad60 0x7fd8e41590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.240+0000 7fd8ea9ab700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8e40bad60 0x7fd8e41590b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47892/0 (socket says 172.21.15.110:47892) 2021-03-25T14:16:29.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.240+0000 7fd8ea9ab700 1 -- 172.21.15.110:0/439909670 learned_addr learned my addr 172.21.15.110:0/439909670 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:29.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.240+0000 7fd8ea1aa700 1 --2- 172.21.15.110:0/439909670 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8e40b6410 0x7fd8e4148090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.247 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.240+0000 7fd8e99a9700 1 --2- 172.21.15.110:0/439909670 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd8e40b67f0 0x7fd8e4158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.247 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.240+0000 7fd8ea9ab700 1 -- 172.21.15.110:0/439909670 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd8e40b67f0 msgr2=0x7fd8e4158bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.247 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.240+0000 7fd8ea9ab700 1 --2- 172.21.15.110:0/439909670 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd8e40b67f0 0x7fd8e4158bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:29.247 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.240+0000 7fd8ea9ab700 1 -- 172.21.15.110:0/439909670 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8e40b6410 msgr2=0x7fd8e4148090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.247 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.240+0000 7fd8ea9ab700 1 --2- 172.21.15.110:0/439909670 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8e40b6410 0x7fd8e4148090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:29.247 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.240+0000 7fd8ea9ab700 1 -- 172.21.15.110:0/439909670 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e414ac60 con 0x7fd8e40bad60 2021-03-25T14:16:29.248 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.240+0000 7fd8ea1aa700 1 --2- 172.21.15.110:0/439909670 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8e40b6410 0x7fd8e4148090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:29.248 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.240+0000 7fd8ea9ab700 1 --2- 172.21.15.110:0/439909670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8e40bad60 0x7fd8e41590b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fd8dc00cab0 tx=0x7fd8dc007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:29.248 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.241+0000 7fd8d27fc700 1 -- 172.21.15.110:0/439909670 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc005c80 con 0x7fd8e40bad60 2021-03-25T14:16:29.248 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.241+0000 7fd8d27fc700 1 -- 172.21.15.110:0/439909670 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8dc005de0 con 0x7fd8e40bad60 2021-03-25T14:16:29.248 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.241+0000 7fd8d27fc700 1 -- 172.21.15.110:0/439909670 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc007360 con 0x7fd8e40bad60 2021-03-25T14:16:29.248 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.241+0000 7fd8ec40e700 1 -- 172.21.15.110:0/439909670 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8e414af00 con 0x7fd8e40bad60 2021-03-25T14:16:29.248 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.241+0000 7fd8ec40e700 1 -- 172.21.15.110:0/439909670 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8e40a4580 con 0x7fd8e40bad60 2021-03-25T14:16:29.248 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.241+0000 7fd8ec40e700 1 -- 172.21.15.110:0/439909670 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd8e405d7b0 con 0x7fd8e40bad60 2021-03-25T14:16:29.248 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.242+0000 7fd8d27fc700 1 -- 172.21.15.110:0/439909670 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fd8dc010030 con 0x7fd8e40bad60 2021-03-25T14:16:29.248 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.242+0000 7fd8d27fc700 1 --2- 172.21.15.110:0/439909670 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd8c405a0b0 0x7fd8c405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.248 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.242+0000 7fd8d27fc700 1 -- 172.21.15.110:0/439909670 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fd8dc0740f0 con 0x7fd8e40bad60 2021-03-25T14:16:29.248 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.242+0000 7fd8ea1aa700 1 --2- 172.21.15.110:0/439909670 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd8c405a0b0 0x7fd8c405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.249 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.242+0000 7fd8d27fc700 1 --2- 172.21.15.110:0/439909670 >> [v2:172.21.15.110:6808/36957,v1:172.21.15.110:6809/36957] conn(0x7fd8c40621c0 0x7fd8c4064660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.249 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.242+0000 7fd8d27fc700 1 -- 172.21.15.110:0/439909670 --> [v2:172.21.15.110:6808/36957,v1:172.21.15.110:6809/36957] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd8c4064ce0 con 0x7fd8c40621c0 2021-03-25T14:16:29.249 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.242+0000 7fd8d27fc700 1 -- 172.21.15.110:0/439909670 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd8dc076760 con 0x7fd8e40bad60 2021-03-25T14:16:29.249 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.242+0000 7fd8e99a9700 1 --2- 172.21.15.110:0/439909670 >> [v2:172.21.15.110:6808/36957,v1:172.21.15.110:6809/36957] conn(0x7fd8c40621c0 0x7fd8c4064660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.249 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.242+0000 7fd8ea1aa700 1 --2- 172.21.15.110:0/439909670 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd8c405a0b0 0x7fd8c405c570 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fd8e0006e60 tx=0x7fd8e0016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:29.249 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.243+0000 7fd8e99a9700 1 --2- 172.21.15.110:0/439909670 >> [v2:172.21.15.110:6808/36957,v1:172.21.15.110:6809/36957] conn(0x7fd8c40621c0 0x7fd8c4064660 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:29.249 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.244+0000 7fd8d27fc700 1 -- 172.21.15.110:0/439909670 <== osd.1 v2:172.21.15.110:6808/36957 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fd8c4064ce0 con 0x7fd8c40621c0 2021-03-25T14:16:29.259 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.258+0000 7fd8ec40e700 1 -- 172.21.15.110:0/439909670 --> [v2:172.21.15.110:6808/36957,v1:172.21.15.110:6809/36957] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd8e40a4250 con 0x7fd8c40621c0 2021-03-25T14:16:29.260 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.258+0000 7fd8d27fc700 1 -- 172.21.15.110:0/439909670 <== osd.1 v2:172.21.15.110:6808/36957 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd8e40a4250 con 0x7fd8c40621c0 2021-03-25T14:16:29.261 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.258+0000 7fd8ec40e700 1 -- 172.21.15.110:0/439909670 >> [v2:172.21.15.110:6808/36957,v1:172.21.15.110:6809/36957] conn(0x7fd8c40621c0 msgr2=0x7fd8c4064660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.261 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.259+0000 7fd8ec40e700 1 --2- 172.21.15.110:0/439909670 >> [v2:172.21.15.110:6808/36957,v1:172.21.15.110:6809/36957] conn(0x7fd8c40621c0 0x7fd8c4064660 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:29.261 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.259+0000 7fd8ec40e700 1 -- 172.21.15.110:0/439909670 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd8c405a0b0 msgr2=0x7fd8c405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.261 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.259+0000 7fd8ec40e700 1 --2- 172.21.15.110:0/439909670 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd8c405a0b0 0x7fd8c405c570 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fd8e0006e60 tx=0x7fd8e0016000).stop 2021-03-25T14:16:29.261 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.259+0000 7fd8ec40e700 1 -- 172.21.15.110:0/439909670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8e40bad60 msgr2=0x7fd8e41590b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.262 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.259+0000 7fd8ec40e700 1 --2- 172.21.15.110:0/439909670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8e40bad60 0x7fd8e41590b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fd8dc00cab0 tx=0x7fd8dc007db0).stop 2021-03-25T14:16:29.262 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.259+0000 7fd8ea9ab700 1 -- 172.21.15.110:0/439909670 reap_dead start 2021-03-25T14:16:29.262 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.259+0000 7fd8ec40e700 1 -- 172.21.15.110:0/439909670 shutdown_connections 2021-03-25T14:16:29.262 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.259+0000 7fd8ec40e700 1 -- 172.21.15.110:0/439909670 >> 172.21.15.110:0/439909670 conn(0x7fd8e4060c40 msgr2=0x7fd8e40a2100 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:29.262 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.259+0000 7fd8ec40e700 1 -- 172.21.15.110:0/439909670 shutdown_connections 2021-03-25T14:16:29.262 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.259+0000 7fd8ec40e700 1 -- 172.21.15.110:0/439909670 wait complete. 2021-03-25T14:16:29.271 INFO:teuthology.orchestra.run.smithi110.stdout:55834574855 2021-03-25T14:16:29.272 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2021-03-25T14:16:29.392 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.380+0000 7f8334c70700 1 Processor -- start 2021-03-25T14:16:29.392 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.380+0000 7f8334c70700 1 -- start start 2021-03-25T14:16:29.392 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.381+0000 7f8334c70700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f83300b6410 0x7f83300ba870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.392 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.381+0000 7f8334c70700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83300b67f0 0x7f8330149ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.392 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.381+0000 7f8334c70700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83300bb2d0 con 0x7f83300bad60 2021-03-25T14:16:29.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.381+0000 7f8334c70700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83300bb570 con 0x7f83300b6410 2021-03-25T14:16:29.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.381+0000 7f8334c70700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83300bb810 con 0x7f83300b67f0 2021-03-25T14:16:29.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.381+0000 7f832e59c700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f83300b6410 0x7f83300ba870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.381+0000 7f832e59c700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f83300b6410 0x7f83300ba870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47898/0 (socket says 172.21.15.110:47898) 2021-03-25T14:16:29.394 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.381+0000 7f832e59c700 1 -- 172.21.15.110:0/2233041119 learned_addr learned my addr 172.21.15.110:0/2233041119 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:29.394 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.381+0000 7f8327fff700 1 --2- 172.21.15.110:0/2233041119 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83300b67f0 0x7f8330149ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.394 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.381+0000 7f832e59c700 1 -- 172.21.15.110:0/2233041119 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83300b67f0 msgr2=0x7f8330149ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:29.394 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.381+0000 7f832e59c700 1 --2- 172.21.15.110:0/2233041119 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83300b67f0 0x7f8330149ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:29.394 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.381+0000 7f832e59c700 1 -- 172.21.15.110:0/2233041119 >> v1:172.21.15.174:6789/0 conn(0x7f83300bad60 legacy=0x7f83300bc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:29.394 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.382+0000 7f832e59c700 1 -- 172.21.15.110:0/2233041119 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83300bc210 con 0x7f83300b6410 2021-03-25T14:16:29.394 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.382+0000 7f832e59c700 1 --2- 172.21.15.110:0/2233041119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83300b6410 0x7f83300ba870 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f832000ba20 tx=0x7f8320006ee0).ready entity=mon.0 client_cookie=fa7438385e60fcdf server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:29.394 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.382+0000 7f832dd9b700 1 -- 172.21.15.110:0/2233041119 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8320009890 con 0x7f83300b6410 2021-03-25T14:16:29.394 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.382+0000 7f832dd9b700 1 -- 172.21.15.110:0/2233041119 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83200099f0 con 0x7f83300b6410 2021-03-25T14:16:29.394 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.382+0000 7f832dd9b700 1 -- 172.21.15.110:0/2233041119 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8320009d70 con 0x7f83300b6410 2021-03-25T14:16:29.395 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.382+0000 7f8334c70700 1 -- 172.21.15.110:0/2233041119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83300b6410 msgr2=0x7f83300ba870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.395 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.382+0000 7f8334c70700 1 --2- 172.21.15.110:0/2233041119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83300b6410 0x7f83300ba870 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f832000ba20 tx=0x7f8320006ee0).stop 2021-03-25T14:16:29.395 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.382+0000 7f8334c70700 1 -- 172.21.15.110:0/2233041119 shutdown_connections 2021-03-25T14:16:29.395 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.382+0000 7f8334c70700 1 --2- 172.21.15.110:0/2233041119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83300b6410 0x7f83300ba870 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:29.395 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.382+0000 7f8334c70700 1 --2- 172.21.15.110:0/2233041119 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83300b67f0 0x7f8330149ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:29.395 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.382+0000 7f8334c70700 1 -- 172.21.15.110:0/2233041119 >> 172.21.15.110:0/2233041119 conn(0x7f8330060c40 msgr2=0x7f8330061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:29.395 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.382+0000 7f8334c70700 1 -- 172.21.15.110:0/2233041119 shutdown_connections 2021-03-25T14:16:29.395 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.382+0000 7f8334c70700 1 -- 172.21.15.110:0/2233041119 wait complete. 2021-03-25T14:16:29.395 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.383+0000 7f8334c70700 1 Processor -- start 2021-03-25T14:16:29.395 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.383+0000 7f8334c70700 1 -- start start 2021-03-25T14:16:29.395 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.384+0000 7f8334c70700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83300b6410 0x7f83300b9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.395 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.384+0000 7f8334c70700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83300b67f0 0x7f83300a34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.395 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.384+0000 7f8334c70700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83300bad60 0x7f83300a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.396 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.384+0000 7f8334c70700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83300a4eb0 con 0x7f83300b6410 2021-03-25T14:16:29.396 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.384+0000 7f8334c70700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83300a5150 con 0x7f83300bad60 2021-03-25T14:16:29.396 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.384+0000 7f8334c70700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83300a53f0 con 0x7f83300b67f0 2021-03-25T14:16:29.396 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.384+0000 7f832e59c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83300b6410 0x7f83300b9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.396 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.384+0000 7f832e59c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83300b6410 0x7f83300b9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47904/0 (socket says 172.21.15.110:47904) 2021-03-25T14:16:29.396 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.384+0000 7f832e59c700 1 -- 172.21.15.110:0/3523374958 learned_addr learned my addr 172.21.15.110:0/3523374958 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:29.396 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.384+0000 7f8327fff700 1 --2- 172.21.15.110:0/3523374958 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83300b67f0 0x7f83300a34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.396 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.384+0000 7f832ed9d700 1 --2- 172.21.15.110:0/3523374958 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83300bad60 0x7f83300a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.396 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.384+0000 7f832e59c700 1 -- 172.21.15.110:0/3523374958 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83300b67f0 msgr2=0x7f83300a34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.396 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.384+0000 7f832e59c700 1 --2- 172.21.15.110:0/3523374958 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83300b67f0 0x7f83300a34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:29.396 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.384+0000 7f832e59c700 1 -- 172.21.15.110:0/3523374958 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83300bad60 msgr2=0x7f83300a39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.396 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.384+0000 7f832e59c700 1 --2- 172.21.15.110:0/3523374958 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83300bad60 0x7f83300a39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:29.396 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.384+0000 7f832e59c700 1 -- 172.21.15.110:0/3523374958 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83300a3040 con 0x7f83300b6410 2021-03-25T14:16:29.397 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.384+0000 7f832e59c700 1 --2- 172.21.15.110:0/3523374958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83300b6410 0x7f83300b9c30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f8330065fa0 tx=0x7f8320016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:29.397 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.385+0000 7f83267fc700 1 -- 172.21.15.110:0/3523374958 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8320011e30 con 0x7f83300b6410 2021-03-25T14:16:29.397 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.385+0000 7f83267fc700 1 -- 172.21.15.110:0/3523374958 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f832001c420 con 0x7f83300b6410 2021-03-25T14:16:29.397 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.385+0000 7f8334c70700 1 -- 172.21.15.110:0/3523374958 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83300ba120 con 0x7f83300b6410 2021-03-25T14:16:29.397 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.385+0000 7f83267fc700 1 -- 172.21.15.110:0/3523374958 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832001c7a0 con 0x7f83300b6410 2021-03-25T14:16:29.397 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.385+0000 7f8334c70700 1 -- 172.21.15.110:0/3523374958 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83300a2470 con 0x7f83300b6410 2021-03-25T14:16:29.397 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.386+0000 7f8334c70700 1 -- 172.21.15.110:0/3523374958 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f83300641e0 con 0x7f83300b6410 2021-03-25T14:16:29.397 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.386+0000 7f83267fc700 1 -- 172.21.15.110:0/3523374958 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f832000f070 con 0x7f83300b6410 2021-03-25T14:16:29.397 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.386+0000 7f83267fc700 1 --2- 172.21.15.110:0/3523374958 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f831405a0b0 0x7f831405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.397 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.386+0000 7f83267fc700 1 -- 172.21.15.110:0/3523374958 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f83200757e0 con 0x7f83300b6410 2021-03-25T14:16:29.397 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.386+0000 7f8327fff700 1 --2- 172.21.15.110:0/3523374958 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f831405a0b0 0x7f831405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.397 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.386+0000 7f83267fc700 1 --2- 172.21.15.110:0/3523374958 >> [v2:172.21.15.110:6816/36986,v1:172.21.15.110:6817/36986] conn(0x7f83140621c0 0x7f8314064660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.398 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.386+0000 7f83267fc700 1 -- 172.21.15.110:0/3523374958 --> [v2:172.21.15.110:6816/36986,v1:172.21.15.110:6817/36986] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8314064ce0 con 0x7f83140621c0 2021-03-25T14:16:29.398 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.386+0000 7f83267fc700 1 -- 172.21.15.110:0/3523374958 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f832007a220 con 0x7f83300b6410 2021-03-25T14:16:29.398 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.386+0000 7f832ed9d700 1 --2- 172.21.15.110:0/3523374958 >> [v2:172.21.15.110:6816/36986,v1:172.21.15.110:6817/36986] conn(0x7f83140621c0 0x7f8314064660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.398 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.387+0000 7f8327fff700 1 --2- 172.21.15.110:0/3523374958 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f831405a0b0 0x7f831405c570 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f8318006fd0 tx=0x7f8318008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:29.398 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.387+0000 7f832ed9d700 1 --2- 172.21.15.110:0/3523374958 >> [v2:172.21.15.110:6816/36986,v1:172.21.15.110:6817/36986] conn(0x7f83140621c0 0x7f8314064660 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:29.399 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.387+0000 7f83267fc700 1 -- 172.21.15.110:0/3523374958 <== osd.2 v2:172.21.15.110:6816/36986 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f8314064ce0 con 0x7f83140621c0 2021-03-25T14:16:29.403 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.402+0000 7f8334c70700 1 -- 172.21.15.110:0/3523374958 --> [v2:172.21.15.110:6816/36986,v1:172.21.15.110:6817/36986] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f83300a55b0 con 0x7f83140621c0 2021-03-25T14:16:29.404 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.402+0000 7f83267fc700 1 -- 172.21.15.110:0/3523374958 <== osd.2 v2:172.21.15.110:6816/36986 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f83300a55b0 con 0x7f83140621c0 2021-03-25T14:16:29.405 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.402+0000 7f8334c70700 1 -- 172.21.15.110:0/3523374958 >> [v2:172.21.15.110:6816/36986,v1:172.21.15.110:6817/36986] conn(0x7f83140621c0 msgr2=0x7f8314064660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.405 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.402+0000 7f8334c70700 1 --2- 172.21.15.110:0/3523374958 >> [v2:172.21.15.110:6816/36986,v1:172.21.15.110:6817/36986] conn(0x7f83140621c0 0x7f8314064660 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:29.405 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.402+0000 7f8334c70700 1 -- 172.21.15.110:0/3523374958 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f831405a0b0 msgr2=0x7f831405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.405 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.402+0000 7f8334c70700 1 --2- 172.21.15.110:0/3523374958 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f831405a0b0 0x7f831405c570 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f8318006fd0 tx=0x7f8318008040).stop 2021-03-25T14:16:29.405 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.402+0000 7f8334c70700 1 -- 172.21.15.110:0/3523374958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83300b6410 msgr2=0x7f83300b9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.405 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.402+0000 7f8334c70700 1 --2- 172.21.15.110:0/3523374958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83300b6410 0x7f83300b9c30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f8330065fa0 tx=0x7f8320016000).stop 2021-03-25T14:16:29.405 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.402+0000 7f832ed9d700 1 -- 172.21.15.110:0/3523374958 reap_dead start 2021-03-25T14:16:29.406 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.402+0000 7f8334c70700 1 -- 172.21.15.110:0/3523374958 shutdown_connections 2021-03-25T14:16:29.406 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.402+0000 7f8334c70700 1 -- 172.21.15.110:0/3523374958 >> 172.21.15.110:0/3523374958 conn(0x7f8330060c40 msgr2=0x7f83301430f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:29.406 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.402+0000 7f8334c70700 1 -- 172.21.15.110:0/3523374958 shutdown_connections 2021-03-25T14:16:29.406 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.402+0000 7f8334c70700 1 -- 172.21.15.110:0/3523374958 wait complete. 2021-03-25T14:16:29.415 INFO:teuthology.orchestra.run.smithi110.stdout:55834574856 2021-03-25T14:16:29.415 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2021-03-25T14:16:29.526 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.524+0000 7f1fd02c3700 1 Processor -- start 2021-03-25T14:16:29.526 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.524+0000 7f1fd02c3700 1 -- start start 2021-03-25T14:16:29.541 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.524+0000 7f1fd02c3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1fc8149c40 0x7f1fc814a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.541 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.525+0000 7f1fd02c3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1fc80bbe10 0x7f1fc80bc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.541 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.525+0000 7f1fd02c3700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fc80bacd0 con 0x7f1fc814a510 2021-03-25T14:16:29.541 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.525+0000 7f1fd02c3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fc81472c0 con 0x7f1fc8149c40 2021-03-25T14:16:29.542 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.525+0000 7f1fd02c3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc80baf70 con 0x7f1fc80bbe10 2021-03-25T14:16:29.542 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.525+0000 7f1fcd85e700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f1fc814a510 0x7f1fc80b62c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:40850/0 (socket says 172.21.15.110:40850) 2021-03-25T14:16:29.542 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.525+0000 7f1fcd85e700 1 -- 172.21.15.110:0/2535218799 learned_addr learned my addr 172.21.15.110:0/2535218799 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:29.542 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.525+0000 7f1fce05f700 1 --2- 172.21.15.110:0/2535218799 >> v2:172.21.15.174:3300/0 conn(0x7f1fc8149c40 0x7f1fc814a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.542 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.525+0000 7f1fce860700 1 --2- 172.21.15.110:0/2535218799 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1fc80bbe10 0x7f1fc80bc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.542 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.525+0000 7f1fcd05d700 1 -- 172.21.15.110:0/2535218799 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 500822056 0 0) 0x7f1fc80bacd0 con 0x7f1fc814a510 2021-03-25T14:16:29.543 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.525+0000 7f1fcd05d700 1 -- 172.21.15.110:0/2535218799 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fb0003270 con 0x7f1fc814a510 2021-03-25T14:16:29.543 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.525+0000 7f1fcd05d700 1 -- 172.21.15.110:0/2535218799 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1285405416 0 0) 0x7f1fb0003270 con 0x7f1fc814a510 2021-03-25T14:16:29.543 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.525+0000 7f1fcd05d700 1 -- 172.21.15.110:0/2535218799 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1fc80bbe10 msgr2=0x7f1fc80bc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:29.543 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.525+0000 7f1fcd05d700 1 --2- 172.21.15.110:0/2535218799 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1fc80bbe10 0x7f1fc80bc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:29.543 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.525+0000 7f1fcd05d700 1 -- 172.21.15.110:0/2535218799 >> v2:172.21.15.174:3300/0 conn(0x7f1fc8149c40 msgr2=0x7f1fc814a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:29.543 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.525+0000 7f1fcd05d700 1 --2- 172.21.15.110:0/2535218799 >> v2:172.21.15.174:3300/0 conn(0x7f1fc8149c40 0x7f1fc814a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:29.543 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.525+0000 7f1fcd05d700 1 -- 172.21.15.110:0/2535218799 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc80bb210 con 0x7f1fc814a510 2021-03-25T14:16:29.544 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.525+0000 7f1fcd05d700 1 -- 172.21.15.110:0/2535218799 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f1fb8001520 con 0x7f1fc814a510 2021-03-25T14:16:29.544 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.525+0000 7f1fcd05d700 1 -- 172.21.15.110:0/2535218799 >> v1:172.21.15.110:6789/0 conn(0x7f1fc814a510 legacy=0x7f1fc80b62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.544 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.525+0000 7f1fcd05d700 1 --2- 172.21.15.110:0/2535218799 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1fc80bbe10 0x7f1fb0003760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.544 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.525+0000 7f1fcd05d700 1 --2- 172.21.15.110:0/2535218799 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fb0003c70 0x7f1fb0004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.544 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.525+0000 7f1fcd05d700 1 --2- 172.21.15.110:0/2535218799 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fb0004a00 0x7f1fb0004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.544 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.525+0000 7f1fcd05d700 1 -- 172.21.15.110:0/2535218799 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc81472c0 con 0x7f1fb0004a00 2021-03-25T14:16:29.544 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.525+0000 7f1fcd05d700 1 -- 172.21.15.110:0/2535218799 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc80baf70 con 0x7f1fb0003c70 2021-03-25T14:16:29.544 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.525+0000 7f1fcd05d700 1 -- 172.21.15.110:0/2535218799 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb0004230 con 0x7f1fc80bbe10 2021-03-25T14:16:29.545 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.526+0000 7f1fce860700 1 --2- 172.21.15.110:0/2535218799 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fb0004a00 0x7f1fb0004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.545 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.526+0000 7f1fce05f700 1 --2- 172.21.15.110:0/2535218799 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1fc80bbe10 0x7f1fb0003760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.545 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.526+0000 7f1fcd85e700 1 --2- 172.21.15.110:0/2535218799 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fb0003c70 0x7f1fb0004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.545 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.526+0000 7f1fce860700 1 -- 172.21.15.110:0/2535218799 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1fc80bbe10 msgr2=0x7f1fb0003760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:29.545 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.526+0000 7f1fce860700 1 --2- 172.21.15.110:0/2535218799 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1fc80bbe10 0x7f1fb0003760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:29.545 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.526+0000 7f1fce860700 1 -- 172.21.15.110:0/2535218799 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fb0003c70 msgr2=0x7f1fb0004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:29.545 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.526+0000 7f1fce860700 1 --2- 172.21.15.110:0/2535218799 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fb0003c70 0x7f1fb0004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:29.545 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.526+0000 7f1fce860700 1 -- 172.21.15.110:0/2535218799 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb0003270 con 0x7f1fb0004a00 2021-03-25T14:16:29.546 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.526+0000 7f1fce860700 1 --2- 172.21.15.110:0/2535218799 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fb0004a00 0x7f1fb0004e80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f1fc0009ed0 tx=0x7f1fc0009220).ready entity=mon.0 client_cookie=ee9cabbf2530291a server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:29.546 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.526+0000 7f1fcd05d700 1 -- 172.21.15.110:0/2535218799 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc00095f0 con 0x7f1fb0004a00 2021-03-25T14:16:29.546 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.526+0000 7f1fcd05d700 1 -- 172.21.15.110:0/2535218799 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc000ec20 con 0x7f1fb0004a00 2021-03-25T14:16:29.546 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.526+0000 7f1fcd05d700 1 -- 172.21.15.110:0/2535218799 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc00123f0 con 0x7f1fb0004a00 2021-03-25T14:16:29.546 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.526+0000 7f1fd02c3700 1 -- 172.21.15.110:0/2535218799 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fb0004a00 msgr2=0x7f1fb0004e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.546 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.526+0000 7f1fd02c3700 1 --2- 172.21.15.110:0/2535218799 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fb0004a00 0x7f1fb0004e80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f1fc0009ed0 tx=0x7f1fc0009220).stop 2021-03-25T14:16:29.547 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.526+0000 7f1fce860700 1 -- 172.21.15.110:0/2535218799 reap_dead start 2021-03-25T14:16:29.547 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.527+0000 7f1fd02c3700 1 -- 172.21.15.110:0/2535218799 shutdown_connections 2021-03-25T14:16:29.547 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.527+0000 7f1fd02c3700 1 -- 172.21.15.110:0/2535218799 >> 172.21.15.110:0/2535218799 conn(0x7f1fc8060c40 msgr2=0x7f1fc8061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:29.547 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.527+0000 7f1fd02c3700 1 -- 172.21.15.110:0/2535218799 shutdown_connections 2021-03-25T14:16:29.547 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.527+0000 7f1fd02c3700 1 -- 172.21.15.110:0/2535218799 wait complete. 2021-03-25T14:16:29.547 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.528+0000 7f1fd02c3700 1 Processor -- start 2021-03-25T14:16:29.547 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.528+0000 7f1fd02c3700 1 -- start start 2021-03-25T14:16:29.547 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.528+0000 7f1fd02c3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1fb0004a00 0x7f1fc815cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.547 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.528+0000 7f1fd02c3700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fc80a5930 0x7f1fc814b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.547 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.528+0000 7f1fd02c3700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fc814d300 0x7f1fc814d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.547 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.528+0000 7f1fd02c3700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc813fe60 con 0x7f1fc80a5930 2021-03-25T14:16:29.547 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.528+0000 7f1fd02c3700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc814dc70 con 0x7f1fc814d300 2021-03-25T14:16:29.547 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.528+0000 7f1fd02c3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc80a2fd0 con 0x7f1fb0004a00 2021-03-25T14:16:29.548 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.528+0000 7f1fcd85e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fc80a5930 0x7f1fc814b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.548 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.528+0000 7f1fcd85e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fc80a5930 0x7f1fc814b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47930/0 (socket says 172.21.15.110:47930) 2021-03-25T14:16:29.548 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.528+0000 7f1fcd85e700 1 -- 172.21.15.110:0/1531355658 learned_addr learned my addr 172.21.15.110:0/1531355658 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:29.548 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.528+0000 7f1fce860700 1 --2- 172.21.15.110:0/1531355658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fc814d300 0x7f1fc814d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.548 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.528+0000 7f1fce05f700 1 --2- 172.21.15.110:0/1531355658 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1fb0004a00 0x7f1fc815cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.548 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.529+0000 7f1fcd85e700 1 -- 172.21.15.110:0/1531355658 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1fb0004a00 msgr2=0x7f1fc815cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.548 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.529+0000 7f1fcd85e700 1 --2- 172.21.15.110:0/1531355658 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1fb0004a00 0x7f1fc815cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:29.548 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.529+0000 7f1fcd85e700 1 -- 172.21.15.110:0/1531355658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fc814d300 msgr2=0x7f1fc814d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.548 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.529+0000 7f1fcd85e700 1 --2- 172.21.15.110:0/1531355658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fc814d300 0x7f1fc814d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:29.548 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.529+0000 7f1fcd85e700 1 -- 172.21.15.110:0/1531355658 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc815d0f0 con 0x7f1fc80a5930 2021-03-25T14:16:29.548 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.529+0000 7f1fcd85e700 1 --2- 172.21.15.110:0/1531355658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fc80a5930 0x7f1fc814b2b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f1fb80078a0 tx=0x7f1fc80b61a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:29.548 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.529+0000 7f1fb67fc700 1 -- 172.21.15.110:0/1531355658 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb800f8d0 con 0x7f1fc80a5930 2021-03-25T14:16:29.548 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.529+0000 7f1fb67fc700 1 -- 172.21.15.110:0/1531355658 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb800fa30 con 0x7f1fc80a5930 2021-03-25T14:16:29.549 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.529+0000 7f1fd02c3700 1 -- 172.21.15.110:0/1531355658 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fc80a3230 con 0x7f1fc80a5930 2021-03-25T14:16:29.549 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.529+0000 7f1fb67fc700 1 -- 172.21.15.110:0/1531355658 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb800fdd0 con 0x7f1fc80a5930 2021-03-25T14:16:29.549 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.529+0000 7f1fd02c3700 1 -- 172.21.15.110:0/1531355658 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fc80a3770 con 0x7f1fc80a5930 2021-03-25T14:16:29.549 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.530+0000 7f1fd02c3700 1 -- 172.21.15.110:0/1531355658 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1fc805d7b0 con 0x7f1fc80a5930 2021-03-25T14:16:29.549 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.530+0000 7f1fb67fc700 1 -- 172.21.15.110:0/1531355658 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f1fb801b030 con 0x7f1fc80a5930 2021-03-25T14:16:29.549 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.530+0000 7f1fb67fc700 1 --2- 172.21.15.110:0/1531355658 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f1fa805a0b0 0x7f1fa805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.549 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.530+0000 7f1fb67fc700 1 -- 172.21.15.110:0/1531355658 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f1fb8073680 con 0x7f1fc80a5930 2021-03-25T14:16:29.549 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.530+0000 7f1fce05f700 1 --2- 172.21.15.110:0/1531355658 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f1fa805a0b0 0x7f1fa805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.549 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.531+0000 7f1fb67fc700 1 --2- 172.21.15.110:0/1531355658 >> [v2:172.21.15.110:6824/36988,v1:172.21.15.110:6825/36988] conn(0x7f1fa80621c0 0x7f1fa8064660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.549 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.531+0000 7f1fb67fc700 1 -- 172.21.15.110:0/1531355658 --> [v2:172.21.15.110:6824/36988,v1:172.21.15.110:6825/36988] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1fa8064ce0 con 0x7f1fa80621c0 2021-03-25T14:16:29.549 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.531+0000 7f1fb67fc700 1 -- 172.21.15.110:0/1531355658 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1fb8075cf0 con 0x7f1fc80a5930 2021-03-25T14:16:29.549 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.531+0000 7f1fce860700 1 --2- 172.21.15.110:0/1531355658 >> [v2:172.21.15.110:6824/36988,v1:172.21.15.110:6825/36988] conn(0x7f1fa80621c0 0x7f1fa8064660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.550 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.531+0000 7f1fce05f700 1 --2- 172.21.15.110:0/1531355658 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f1fa805a0b0 0x7f1fa805c570 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f1fc4006890 tx=0x7f1fc4006e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:29.550 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.531+0000 7f1fce860700 1 --2- 172.21.15.110:0/1531355658 >> [v2:172.21.15.110:6824/36988,v1:172.21.15.110:6825/36988] conn(0x7f1fa80621c0 0x7f1fa8064660 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:29.550 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.532+0000 7f1fb67fc700 1 -- 172.21.15.110:0/1531355658 <== osd.3 v2:172.21.15.110:6824/36988 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f1fa8064ce0 con 0x7f1fa80621c0 2021-03-25T14:16:29.550 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.546+0000 7f1fd02c3700 1 -- 172.21.15.110:0/1531355658 --> [v2:172.21.15.110:6824/36988,v1:172.21.15.110:6825/36988] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1fc814bdd0 con 0x7f1fa80621c0 2021-03-25T14:16:29.550 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.546+0000 7f1fb67fc700 1 -- 172.21.15.110:0/1531355658 <== osd.3 v2:172.21.15.110:6824/36988 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1fc814bdd0 con 0x7f1fa80621c0 2021-03-25T14:16:29.552 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.546+0000 7f1fd02c3700 1 -- 172.21.15.110:0/1531355658 >> [v2:172.21.15.110:6824/36988,v1:172.21.15.110:6825/36988] conn(0x7f1fa80621c0 msgr2=0x7f1fa8064660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.552 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.546+0000 7f1fd02c3700 1 --2- 172.21.15.110:0/1531355658 >> [v2:172.21.15.110:6824/36988,v1:172.21.15.110:6825/36988] conn(0x7f1fa80621c0 0x7f1fa8064660 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:29.552 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.546+0000 7f1fd02c3700 1 -- 172.21.15.110:0/1531355658 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f1fa805a0b0 msgr2=0x7f1fa805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.552 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.546+0000 7f1fd02c3700 1 --2- 172.21.15.110:0/1531355658 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f1fa805a0b0 0x7f1fa805c570 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f1fc4006890 tx=0x7f1fc4006e20).stop 2021-03-25T14:16:29.552 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.546+0000 7f1fd02c3700 1 -- 172.21.15.110:0/1531355658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fc80a5930 msgr2=0x7f1fc814b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.552 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.546+0000 7f1fd02c3700 1 --2- 172.21.15.110:0/1531355658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fc80a5930 0x7f1fc814b2b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f1fb80078a0 tx=0x7f1fc80b61a0).stop 2021-03-25T14:16:29.552 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.546+0000 7f1fce860700 1 -- 172.21.15.110:0/1531355658 reap_dead start 2021-03-25T14:16:29.552 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.546+0000 7f1fd02c3700 1 -- 172.21.15.110:0/1531355658 shutdown_connections 2021-03-25T14:16:29.552 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.546+0000 7f1fd02c3700 1 -- 172.21.15.110:0/1531355658 >> 172.21.15.110:0/1531355658 conn(0x7f1fc8060c40 msgr2=0x7f1fc8068b50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:29.553 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.547+0000 7f1fd02c3700 1 -- 172.21.15.110:0/1531355658 shutdown_connections 2021-03-25T14:16:29.553 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.547+0000 7f1fd02c3700 1 -- 172.21.15.110:0/1531355658 wait complete. 2021-03-25T14:16:29.559 INFO:teuthology.orchestra.run.smithi110.stdout:55834574855 2021-03-25T14:16:29.559 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2021-03-25T14:16:29.670 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.668+0000 7f2e1c224700 1 Processor -- start 2021-03-25T14:16:29.670 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.668+0000 7f2e1c224700 1 -- start start 2021-03-25T14:16:29.673 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.669+0000 7f2e1c224700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2e14149c40 0x7f2e1414a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.674 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.669+0000 7f2e1c224700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2e1414a510 0x7f2e140b62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.674 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.669+0000 7f2e1c224700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e140bacd0 con 0x7f2e140b67b0 2021-03-25T14:16:29.674 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.669+0000 7f2e1c224700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e141472c0 con 0x7f2e14149c40 2021-03-25T14:16:29.674 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.669+0000 7f2e1c224700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e140baf70 con 0x7f2e1414a510 2021-03-25T14:16:29.674 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.669+0000 7f2e19fc0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2e14149c40 0x7f2e1414a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.674 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.669+0000 7f2e197bf700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2e1414a510 0x7f2e140b62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.674 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.669+0000 7f2e1a7c1700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f2e140b67b0 0x7f2e140bbe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.110:48540/0 (socket says 172.21.15.110:48540) 2021-03-25T14:16:29.674 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.670+0000 7f2e1a7c1700 1 -- 172.21.15.110:0/251914312 learned_addr learned my addr 172.21.15.110:0/251914312 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:29.674 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.670+0000 7f2e19fc0700 1 -- 172.21.15.110:0/251914312 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2e1414a510 msgr2=0x7f2e140b62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:29.675 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.670+0000 7f2e19fc0700 1 --2- 172.21.15.110:0/251914312 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2e1414a510 0x7f2e140b62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:29.675 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.670+0000 7f2e19fc0700 1 -- 172.21.15.110:0/251914312 >> v1:172.21.15.174:6789/0 conn(0x7f2e140b67b0 legacy=0x7f2e140bbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.675 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.670+0000 7f2e18fbe700 1 -- 172.21.15.110:0/251914312 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3552454183 0 0) 0x7f2e140bacd0 con 0x7f2e140b67b0 2021-03-25T14:16:29.675 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.670+0000 7f2e19fc0700 1 -- 172.21.15.110:0/251914312 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e140bb210 con 0x7f2e14149c40 2021-03-25T14:16:29.675 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.670+0000 7f2e197bf700 1 --2- 172.21.15.110:0/251914312 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2e1414a510 0x7f2e140b62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:16:29.675 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.670+0000 7f2e19fc0700 1 --2- 172.21.15.110:0/251914312 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e14149c40 0x7f2e1414a020 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f2e1000b9c0 tx=0x7f2e10006e20).ready entity=mon.1 client_cookie=79381491bcbe6cca server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:29.675 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.670+0000 7f2e18fbe700 1 -- 172.21.15.110:0/251914312 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e100097e0 con 0x7f2e14149c40 2021-03-25T14:16:29.675 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.670+0000 7f2e18fbe700 1 -- 172.21.15.110:0/251914312 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e10009940 con 0x7f2e14149c40 2021-03-25T14:16:29.675 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.670+0000 7f2e18fbe700 1 -- 172.21.15.110:0/251914312 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e10009cc0 con 0x7f2e14149c40 2021-03-25T14:16:29.675 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.671+0000 7f2e1c224700 1 -- 172.21.15.110:0/251914312 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e14149c40 msgr2=0x7f2e1414a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.675 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.671+0000 7f2e1c224700 1 --2- 172.21.15.110:0/251914312 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e14149c40 0x7f2e1414a020 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f2e1000b9c0 tx=0x7f2e10006e20).stop 2021-03-25T14:16:29.675 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.671+0000 7f2e1c224700 1 -- 172.21.15.110:0/251914312 shutdown_connections 2021-03-25T14:16:29.675 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.671+0000 7f2e1c224700 1 --2- 172.21.15.110:0/251914312 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e14149c40 0x7f2e1414a020 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:29.676 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.671+0000 7f2e1c224700 1 --2- 172.21.15.110:0/251914312 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2e1414a510 0x7f2e140b62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:29.676 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.671+0000 7f2e1c224700 1 -- 172.21.15.110:0/251914312 >> 172.21.15.110:0/251914312 conn(0x7f2e14060c40 msgr2=0x7f2e14061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:29.676 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.671+0000 7f2e1c224700 1 -- 172.21.15.110:0/251914312 shutdown_connections 2021-03-25T14:16:29.676 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.671+0000 7f2e1c224700 1 -- 172.21.15.110:0/251914312 wait complete. 2021-03-25T14:16:29.676 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.672+0000 7f2e1c224700 1 Processor -- start 2021-03-25T14:16:29.676 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.672+0000 7f2e1c224700 1 -- start start 2021-03-25T14:16:29.679 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.672+0000 7f2e1c224700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e140b67b0 0x7f2e140b8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.679 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.672+0000 7f2e1c224700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e14149c40 0x7f2e140bebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.679 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.672+0000 7f2e1c224700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2e1414a510 0x7f2e140bf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.680 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.672+0000 7f2e1c224700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1415c840 con 0x7f2e14149c40 2021-03-25T14:16:29.680 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.672+0000 7f2e1c224700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1415cae0 con 0x7f2e140b67b0 2021-03-25T14:16:29.680 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.672+0000 7f2e1c224700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1415cd80 con 0x7f2e1414a510 2021-03-25T14:16:29.680 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.673+0000 7f2e197bf700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e14149c40 0x7f2e140bebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.680 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.673+0000 7f2e197bf700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e14149c40 0x7f2e140bebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47944/0 (socket says 172.21.15.110:47944) 2021-03-25T14:16:29.680 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.673+0000 7f2e197bf700 1 -- 172.21.15.110:0/753054223 learned_addr learned my addr 172.21.15.110:0/753054223 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:29.680 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.673+0000 7f2e19fc0700 1 --2- 172.21.15.110:0/753054223 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e140b67b0 0x7f2e140b8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.680 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.673+0000 7f2e1a7c1700 1 --2- 172.21.15.110:0/753054223 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2e1414a510 0x7f2e140bf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.680 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.673+0000 7f2e197bf700 1 -- 172.21.15.110:0/753054223 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2e1414a510 msgr2=0x7f2e140bf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.680 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.673+0000 7f2e197bf700 1 --2- 172.21.15.110:0/753054223 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2e1414a510 0x7f2e140bf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:29.680 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.673+0000 7f2e197bf700 1 -- 172.21.15.110:0/753054223 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e140b67b0 msgr2=0x7f2e140b8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.680 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.673+0000 7f2e197bf700 1 --2- 172.21.15.110:0/753054223 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e140b67b0 0x7f2e140b8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:29.681 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.673+0000 7f2e197bf700 1 -- 172.21.15.110:0/753054223 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e1415d020 con 0x7f2e14149c40 2021-03-25T14:16:29.681 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.673+0000 7f2e197bf700 1 --2- 172.21.15.110:0/753054223 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e14149c40 0x7f2e140bebb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f2e0400ed10 tx=0x7f2e04006e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:29.681 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.673+0000 7f2e01ffb700 1 -- 172.21.15.110:0/753054223 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0400cc70 con 0x7f2e14149c40 2021-03-25T14:16:29.681 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.673+0000 7f2e01ffb700 1 -- 172.21.15.110:0/753054223 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0400cdd0 con 0x7f2e14149c40 2021-03-25T14:16:29.681 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.673+0000 7f2e1c224700 1 -- 172.21.15.110:0/753054223 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e14144300 con 0x7f2e14149c40 2021-03-25T14:16:29.681 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.673+0000 7f2e01ffb700 1 -- 172.21.15.110:0/753054223 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e04012600 con 0x7f2e14149c40 2021-03-25T14:16:29.681 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.673+0000 7f2e1c224700 1 -- 172.21.15.110:0/753054223 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e1415c3a0 con 0x7f2e14149c40 2021-03-25T14:16:29.681 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.674+0000 7f2e1c224700 1 -- 172.21.15.110:0/753054223 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2e1415c620 con 0x7f2e14149c40 2021-03-25T14:16:29.681 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.675+0000 7f2e01ffb700 1 -- 172.21.15.110:0/753054223 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f2e04012970 con 0x7f2e14149c40 2021-03-25T14:16:29.681 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.675+0000 7f2e01ffb700 1 --2- 172.21.15.110:0/753054223 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f2df405a0b0 0x7f2df405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.681 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.675+0000 7f2e01ffb700 1 -- 172.21.15.110:0/753054223 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f2e04075100 con 0x7f2e14149c40 2021-03-25T14:16:29.682 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.675+0000 7f2e19fc0700 1 --2- 172.21.15.110:0/753054223 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f2df405a0b0 0x7f2df405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.682 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.675+0000 7f2e01ffb700 1 --2- 172.21.15.110:0/753054223 >> [v2:172.21.15.174:6801/37282,v1:172.21.15.174:6803/37282] conn(0x7f2df40621c0 0x7f2df4064660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.682 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.675+0000 7f2e01ffb700 1 -- 172.21.15.110:0/753054223 --> [v2:172.21.15.174:6801/37282,v1:172.21.15.174:6803/37282] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2df4064ce0 con 0x7f2df40621c0 2021-03-25T14:16:29.682 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.675+0000 7f2e01ffb700 1 -- 172.21.15.110:0/753054223 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e04075500 con 0x7f2e14149c40 2021-03-25T14:16:29.682 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.675+0000 7f2e19fc0700 1 --2- 172.21.15.110:0/753054223 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f2df405a0b0 0x7f2df405c570 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f2e10007fd0 tx=0x7f2e10016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:29.682 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.675+0000 7f2e1a7c1700 1 --2- 172.21.15.110:0/753054223 >> [v2:172.21.15.174:6801/37282,v1:172.21.15.174:6803/37282] conn(0x7f2df40621c0 0x7f2df4064660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.682 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.676+0000 7f2e1a7c1700 1 --2- 172.21.15.110:0/753054223 >> [v2:172.21.15.174:6801/37282,v1:172.21.15.174:6803/37282] conn(0x7f2df40621c0 0x7f2df4064660 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:29.682 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.677+0000 7f2e01ffb700 1 -- 172.21.15.110:0/753054223 <== osd.4 v2:172.21.15.174:6801/37282 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f2df4064ce0 con 0x7f2df40621c0 2021-03-25T14:16:29.692 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.691+0000 7f2e1c224700 1 -- 172.21.15.110:0/753054223 --> [v2:172.21.15.174:6801/37282,v1:172.21.15.174:6803/37282] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2e140bf5c0 con 0x7f2df40621c0 2021-03-25T14:16:29.693 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.691+0000 7f2e01ffb700 1 -- 172.21.15.110:0/753054223 <== osd.4 v2:172.21.15.174:6801/37282 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2e140bf5c0 con 0x7f2df40621c0 2021-03-25T14:16:29.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.692+0000 7f2e1c224700 1 -- 172.21.15.110:0/753054223 >> [v2:172.21.15.174:6801/37282,v1:172.21.15.174:6803/37282] conn(0x7f2df40621c0 msgr2=0x7f2df4064660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.692+0000 7f2e1c224700 1 --2- 172.21.15.110:0/753054223 >> [v2:172.21.15.174:6801/37282,v1:172.21.15.174:6803/37282] conn(0x7f2df40621c0 0x7f2df4064660 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:29.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.692+0000 7f2e1c224700 1 -- 172.21.15.110:0/753054223 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f2df405a0b0 msgr2=0x7f2df405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.692+0000 7f2e1c224700 1 --2- 172.21.15.110:0/753054223 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f2df405a0b0 0x7f2df405c570 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f2e10007fd0 tx=0x7f2e10016000).stop 2021-03-25T14:16:29.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.692+0000 7f2e1c224700 1 -- 172.21.15.110:0/753054223 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e14149c40 msgr2=0x7f2e140bebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.696 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.692+0000 7f2e1c224700 1 --2- 172.21.15.110:0/753054223 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e14149c40 0x7f2e140bebb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f2e0400ed10 tx=0x7f2e04006e20).stop 2021-03-25T14:16:29.696 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.692+0000 7f2e1a7c1700 1 -- 172.21.15.110:0/753054223 reap_dead start 2021-03-25T14:16:29.696 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.692+0000 7f2e1c224700 1 -- 172.21.15.110:0/753054223 shutdown_connections 2021-03-25T14:16:29.696 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.692+0000 7f2e1c224700 1 -- 172.21.15.110:0/753054223 >> 172.21.15.110:0/753054223 conn(0x7f2e14060c40 msgr2=0x7f2e14068a50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:29.696 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.692+0000 7f2e1c224700 1 -- 172.21.15.110:0/753054223 shutdown_connections 2021-03-25T14:16:29.696 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.692+0000 7f2e1c224700 1 -- 172.21.15.110:0/753054223 wait complete. 2021-03-25T14:16:29.705 INFO:teuthology.orchestra.run.smithi110.stdout:55834574856 2021-03-25T14:16:29.705 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2021-03-25T14:16:29.816 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.814+0000 7f56eea2b700 1 Processor -- start 2021-03-25T14:16:29.816 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.815+0000 7f56eea2b700 1 -- start start 2021-03-25T14:16:29.829 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.815+0000 7f56eea2b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f56e80bfdc0 0x7f56e80c01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.829 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.815+0000 7f56eea2b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56e80bc480 0x7f56e81498a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.829 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.815+0000 7f56eea2b700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56e814cf80 con 0x7f56e80b6580 2021-03-25T14:16:29.829 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.815+0000 7f56eea2b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56e814d220 con 0x7f56e80bfdc0 2021-03-25T14:16:29.829 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.815+0000 7f56eea2b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e814d4c0 con 0x7f56e80bc480 2021-03-25T14:16:29.830 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.815+0000 7f56ed228700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f56e80b6580 0x7f56e80bbd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:40892/0 (socket says 172.21.15.110:40892) 2021-03-25T14:16:29.830 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.815+0000 7f56ed228700 1 -- 172.21.15.110:0/2643128020 learned_addr learned my addr 172.21.15.110:0/2643128020 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:29.830 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.816+0000 7f56eda29700 1 --2- 172.21.15.110:0/2643128020 >> v2:172.21.15.174:3300/0 conn(0x7f56e80bfdc0 0x7f56e80c01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.830 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.816+0000 7f56ee22a700 1 --2- 172.21.15.110:0/2643128020 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56e80bc480 0x7f56e81498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.830 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.816+0000 7f56eca27700 1 -- 172.21.15.110:0/2643128020 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1917916502 0 0) 0x7f56e814cf80 con 0x7f56e80b6580 2021-03-25T14:16:29.831 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.816+0000 7f56eca27700 1 -- 172.21.15.110:0/2643128020 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56d0003270 con 0x7f56e80b6580 2021-03-25T14:16:29.831 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.816+0000 7f56eca27700 1 -- 172.21.15.110:0/2643128020 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3274154069 0 0) 0x7f56d0003270 con 0x7f56e80b6580 2021-03-25T14:16:29.831 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.816+0000 7f56eca27700 1 -- 172.21.15.110:0/2643128020 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56e80bc480 msgr2=0x7f56e81498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:29.831 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.816+0000 7f56eca27700 1 --2- 172.21.15.110:0/2643128020 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56e80bc480 0x7f56e81498a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:29.831 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.816+0000 7f56eca27700 1 -- 172.21.15.110:0/2643128020 >> v2:172.21.15.174:3300/0 conn(0x7f56e80bfdc0 msgr2=0x7f56e80c01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:29.832 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.816+0000 7f56eca27700 1 --2- 172.21.15.110:0/2643128020 >> v2:172.21.15.174:3300/0 conn(0x7f56e80bfdc0 0x7f56e80c01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:29.832 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.816+0000 7f56eca27700 1 -- 172.21.15.110:0/2643128020 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e814d760 con 0x7f56e80b6580 2021-03-25T14:16:29.832 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.816+0000 7f56eca27700 1 -- 172.21.15.110:0/2643128020 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f56d8001520 con 0x7f56e80b6580 2021-03-25T14:16:29.832 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.816+0000 7f56eca27700 1 -- 172.21.15.110:0/2643128020 >> v1:172.21.15.110:6789/0 conn(0x7f56e80b6580 legacy=0x7f56e80bbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.832 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.816+0000 7f56eca27700 1 --2- 172.21.15.110:0/2643128020 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56d0003760 0x7f56d0003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.833 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.816+0000 7f56eca27700 1 --2- 172.21.15.110:0/2643128020 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56e80bc480 0x7f56d0004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.833 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.816+0000 7f56eca27700 1 --2- 172.21.15.110:0/2643128020 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56d0004a00 0x7f56d0004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.833 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.816+0000 7f56eca27700 1 -- 172.21.15.110:0/2643128020 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e814d220 con 0x7f56d0004a00 2021-03-25T14:16:29.833 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.816+0000 7f56eca27700 1 -- 172.21.15.110:0/2643128020 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e814d4c0 con 0x7f56d0003760 2021-03-25T14:16:29.833 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.816+0000 7f56eca27700 1 -- 172.21.15.110:0/2643128020 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d0004200 con 0x7f56e80bc480 2021-03-25T14:16:29.834 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.816+0000 7f56ee22a700 1 --2- 172.21.15.110:0/2643128020 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56d0004a00 0x7f56d0004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.834 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.816+0000 7f56eda29700 1 --2- 172.21.15.110:0/2643128020 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56d0003760 0x7f56d0003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.834 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.816+0000 7f56ed228700 1 --2- 172.21.15.110:0/2643128020 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56e80bc480 0x7f56d0004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.835 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.816+0000 7f56ee22a700 1 -- 172.21.15.110:0/2643128020 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56e80bc480 msgr2=0x7f56d0004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:29.835 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.816+0000 7f56ee22a700 1 --2- 172.21.15.110:0/2643128020 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56e80bc480 0x7f56d0004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:29.835 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.816+0000 7f56ee22a700 1 -- 172.21.15.110:0/2643128020 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56d0003760 msgr2=0x7f56d0003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:29.835 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.816+0000 7f56ee22a700 1 --2- 172.21.15.110:0/2643128020 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56d0003760 0x7f56d0003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:29.835 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.816+0000 7f56ee22a700 1 -- 172.21.15.110:0/2643128020 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d0003270 con 0x7f56d0004a00 2021-03-25T14:16:29.835 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.817+0000 7f56ee22a700 1 --2- 172.21.15.110:0/2643128020 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56d0004a00 0x7f56d0004e80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f56e0009ed0 tx=0x7f56e0009220).ready entity=mon.0 client_cookie=870161efbb8633c1 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:29.836 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.817+0000 7f56eca27700 1 -- 172.21.15.110:0/2643128020 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e00095f0 con 0x7f56d0004a00 2021-03-25T14:16:29.836 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.817+0000 7f56eca27700 1 -- 172.21.15.110:0/2643128020 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e000ec80 con 0x7f56d0004a00 2021-03-25T14:16:29.836 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.817+0000 7f56eca27700 1 -- 172.21.15.110:0/2643128020 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e00123f0 con 0x7f56d0004a00 2021-03-25T14:16:29.836 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.817+0000 7f56eea2b700 1 -- 172.21.15.110:0/2643128020 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56d0004a00 msgr2=0x7f56d0004e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.836 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.817+0000 7f56eea2b700 1 --2- 172.21.15.110:0/2643128020 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56d0004a00 0x7f56d0004e80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f56e0009ed0 tx=0x7f56e0009220).stop 2021-03-25T14:16:29.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.817+0000 7f56ee22a700 1 -- 172.21.15.110:0/2643128020 reap_dead start 2021-03-25T14:16:29.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.817+0000 7f56eea2b700 1 -- 172.21.15.110:0/2643128020 shutdown_connections 2021-03-25T14:16:29.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.817+0000 7f56eea2b700 1 -- 172.21.15.110:0/2643128020 >> 172.21.15.110:0/2643128020 conn(0x7f56e80663c0 msgr2=0x7f56e80667d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:29.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.817+0000 7f56eea2b700 1 -- 172.21.15.110:0/2643128020 shutdown_connections 2021-03-25T14:16:29.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.817+0000 7f56eea2b700 1 -- 172.21.15.110:0/2643128020 wait complete. 2021-03-25T14:16:29.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.818+0000 7f56eea2b700 1 Processor -- start 2021-03-25T14:16:29.838 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.818+0000 7f56eea2b700 1 -- start start 2021-03-25T14:16:29.838 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.819+0000 7f56eea2b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56e80b8c90 0x7f56e80b7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.838 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.819+0000 7f56eea2b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56e8155c80 0x7f56e8156100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.838 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.819+0000 7f56eea2b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56e8158ae0 0x7f56e8158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.838 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.819+0000 7f56eea2b700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e81565f0 con 0x7f56e8155c80 2021-03-25T14:16:29.839 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.819+0000 7f56eea2b700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e80b8440 con 0x7f56e80b8c90 2021-03-25T14:16:29.839 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.819+0000 7f56eea2b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e80b7530 con 0x7f56e8158ae0 2021-03-25T14:16:29.839 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.819+0000 7f56ed228700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56e8155c80 0x7f56e8156100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.839 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.819+0000 7f56ed228700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56e8155c80 0x7f56e8156100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47966/0 (socket says 172.21.15.110:47966) 2021-03-25T14:16:29.839 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.819+0000 7f56ed228700 1 -- 172.21.15.110:0/456480677 learned_addr learned my addr 172.21.15.110:0/456480677 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:29.839 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.819+0000 7f56eda29700 1 --2- 172.21.15.110:0/456480677 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56e80b8c90 0x7f56e80b7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.840 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.819+0000 7f56ee22a700 1 --2- 172.21.15.110:0/456480677 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56e8158ae0 0x7f56e8158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.840 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.819+0000 7f56ed228700 1 -- 172.21.15.110:0/456480677 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56e8158ae0 msgr2=0x7f56e8158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.840 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.819+0000 7f56ed228700 1 --2- 172.21.15.110:0/456480677 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56e8158ae0 0x7f56e8158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:29.840 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.819+0000 7f56ed228700 1 -- 172.21.15.110:0/456480677 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56e80b8c90 msgr2=0x7f56e80b7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.840 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.819+0000 7f56ed228700 1 --2- 172.21.15.110:0/456480677 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56e80b8c90 0x7f56e80b7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:29.840 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.819+0000 7f56ed228700 1 -- 172.21.15.110:0/456480677 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e80b8660 con 0x7f56e8155c80 2021-03-25T14:16:29.840 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.820+0000 7f56ed228700 1 --2- 172.21.15.110:0/456480677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56e8155c80 0x7f56e8156100 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f56d8004c20 tx=0x7f56e8149630).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:29.840 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.820+0000 7f56d5ffb700 1 -- 172.21.15.110:0/456480677 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d800f960 con 0x7f56e8155c80 2021-03-25T14:16:29.840 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.820+0000 7f56d5ffb700 1 -- 172.21.15.110:0/456480677 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d800fac0 con 0x7f56e8155c80 2021-03-25T14:16:29.840 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.820+0000 7f56eea2b700 1 -- 172.21.15.110:0/456480677 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e80b6b50 con 0x7f56e8155c80 2021-03-25T14:16:29.841 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.820+0000 7f56d5ffb700 1 -- 172.21.15.110:0/456480677 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d800fe60 con 0x7f56e8155c80 2021-03-25T14:16:29.841 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.820+0000 7f56eea2b700 1 -- 172.21.15.110:0/456480677 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e80b7090 con 0x7f56e8155c80 2021-03-25T14:16:29.841 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.821+0000 7f56eea2b700 1 -- 172.21.15.110:0/456480677 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f56e8045ae0 con 0x7f56e8155c80 2021-03-25T14:16:29.841 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.821+0000 7f56d5ffb700 1 -- 172.21.15.110:0/456480677 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f56d8015620 con 0x7f56e8155c80 2021-03-25T14:16:29.841 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.821+0000 7f56d5ffb700 1 --2- 172.21.15.110:0/456480677 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f56c805a0e0 0x7f56c805c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.842 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.821+0000 7f56d5ffb700 1 -- 172.21.15.110:0/456480677 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f56d80742d0 con 0x7f56e8155c80 2021-03-25T14:16:29.842 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.821+0000 7f56eda29700 1 --2- 172.21.15.110:0/456480677 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f56c805a0e0 0x7f56c805c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.842 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.821+0000 7f56d5ffb700 1 --2- 172.21.15.110:0/456480677 >> [v2:172.21.15.174:6800/37283,v1:172.21.15.174:6802/37283] conn(0x7f56c80621f0 0x7f56c8064690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.842 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.821+0000 7f56d5ffb700 1 -- 172.21.15.110:0/456480677 --> [v2:172.21.15.174:6800/37283,v1:172.21.15.174:6802/37283] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f56c8064d10 con 0x7f56c80621f0 2021-03-25T14:16:29.842 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.821+0000 7f56d5ffb700 1 -- 172.21.15.110:0/456480677 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f56d8076940 con 0x7f56e8155c80 2021-03-25T14:16:29.842 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.822+0000 7f56eda29700 1 --2- 172.21.15.110:0/456480677 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f56c805a0e0 0x7f56c805c5a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f56e4006890 tx=0x7f56e4006e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:29.843 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.822+0000 7f56ee22a700 1 --2- 172.21.15.110:0/456480677 >> [v2:172.21.15.174:6800/37283,v1:172.21.15.174:6802/37283] conn(0x7f56c80621f0 0x7f56c8064690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.843 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.822+0000 7f56ee22a700 1 --2- 172.21.15.110:0/456480677 >> [v2:172.21.15.174:6800/37283,v1:172.21.15.174:6802/37283] conn(0x7f56c80621f0 0x7f56c8064690 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:29.843 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.823+0000 7f56d5ffb700 1 -- 172.21.15.110:0/456480677 <== osd.5 v2:172.21.15.174:6800/37283 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f56c8064d10 con 0x7f56c80621f0 2021-03-25T14:16:29.844 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.837+0000 7f56eea2b700 1 -- 172.21.15.110:0/456480677 --> [v2:172.21.15.174:6800/37283,v1:172.21.15.174:6802/37283] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f56e80b7290 con 0x7f56c80621f0 2021-03-25T14:16:29.844 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.838+0000 7f56d5ffb700 1 -- 172.21.15.110:0/456480677 <== osd.5 v2:172.21.15.174:6800/37283 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f56e00095f0 con 0x7f56c80621f0 2021-03-25T14:16:29.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.838+0000 7f56eea2b700 1 -- 172.21.15.110:0/456480677 >> [v2:172.21.15.174:6800/37283,v1:172.21.15.174:6802/37283] conn(0x7f56c80621f0 msgr2=0x7f56c8064690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.838+0000 7f56eea2b700 1 --2- 172.21.15.110:0/456480677 >> [v2:172.21.15.174:6800/37283,v1:172.21.15.174:6802/37283] conn(0x7f56c80621f0 0x7f56c8064690 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:29.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.838+0000 7f56eea2b700 1 -- 172.21.15.110:0/456480677 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f56c805a0e0 msgr2=0x7f56c805c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.838+0000 7f56eea2b700 1 --2- 172.21.15.110:0/456480677 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f56c805a0e0 0x7f56c805c5a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f56e4006890 tx=0x7f56e4006e20).stop 2021-03-25T14:16:29.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.838+0000 7f56eea2b700 1 -- 172.21.15.110:0/456480677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56e8155c80 msgr2=0x7f56e8156100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.838+0000 7f56eea2b700 1 --2- 172.21.15.110:0/456480677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56e8155c80 0x7f56e8156100 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f56d8004c20 tx=0x7f56e8149630).stop 2021-03-25T14:16:29.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.838+0000 7f56ee22a700 1 -- 172.21.15.110:0/456480677 reap_dead start 2021-03-25T14:16:29.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.838+0000 7f56eea2b700 1 -- 172.21.15.110:0/456480677 shutdown_connections 2021-03-25T14:16:29.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.838+0000 7f56eea2b700 1 -- 172.21.15.110:0/456480677 >> 172.21.15.110:0/456480677 conn(0x7f56e80663c0 msgr2=0x7f56e8143520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:29.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.838+0000 7f56eea2b700 1 -- 172.21.15.110:0/456480677 shutdown_connections 2021-03-25T14:16:29.849 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.838+0000 7f56eea2b700 1 -- 172.21.15.110:0/456480677 wait complete. 2021-03-25T14:16:29.851 INFO:teuthology.orchestra.run.smithi110.stdout:55834574855 2021-03-25T14:16:29.851 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2021-03-25T14:16:29.968 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.960+0000 7f17d0822700 1 Processor -- start 2021-03-25T14:16:29.969 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.960+0000 7f17d0822700 1 -- start start 2021-03-25T14:16:29.969 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.961+0000 7f17d0822700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f17cc064280 0x7f17cc064660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.969 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.961+0000 7f17d0822700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f17cc0b7800 0x7f17cc147060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.969 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.961+0000 7f17d0822700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17cc0b0b30 con 0x7f17cc0b8030 2021-03-25T14:16:29.969 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.961+0000 7f17d0822700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17cc147550 con 0x7f17cc064280 2021-03-25T14:16:29.970 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.961+0000 7f17d0822700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17cc0b0dd0 con 0x7f17cc0b7800 2021-03-25T14:16:29.970 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.961+0000 7f17ca59c700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f17cc064280 0x7f17cc064660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.970 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.961+0000 7f17ca59c700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f17cc064280 0x7f17cc064660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47974/0 (socket says 172.21.15.110:47974) 2021-03-25T14:16:29.970 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.961+0000 7f17ca59c700 1 -- 172.21.15.110:0/578365252 learned_addr learned my addr 172.21.15.110:0/578365252 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:29.970 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.961+0000 7f17c9d9b700 1 --2- 172.21.15.110:0/578365252 >> v2:172.21.15.174:3300/0 conn(0x7f17cc0b7800 0x7f17cc147060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.970 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.961+0000 7f17ca59c700 1 -- 172.21.15.110:0/578365252 >> v2:172.21.15.174:3300/0 conn(0x7f17cc0b7800 msgr2=0x7f17cc147060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:29.971 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.961+0000 7f17ca59c700 1 --2- 172.21.15.110:0/578365252 >> v2:172.21.15.174:3300/0 conn(0x7f17cc0b7800 0x7f17cc147060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:29.971 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.961+0000 7f17ca59c700 1 -- 172.21.15.110:0/578365252 >> v1:172.21.15.174:6789/0 conn(0x7f17cc0b8030 legacy=0x7f17cc0b84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.971 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.961+0000 7f17ca59c700 1 -- 172.21.15.110:0/578365252 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17cc0b1070 con 0x7f17cc064280 2021-03-25T14:16:29.971 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.962+0000 7f17ca59c700 1 --2- 172.21.15.110:0/578365252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17cc064280 0x7f17cc064660 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f17cc0658c0 tx=0x7f17bc006ee0).ready entity=mon.0 client_cookie=849ab6317ff6525f server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:29.971 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.962+0000 7f17c959a700 1 -- 172.21.15.110:0/578365252 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc0098d0 con 0x7f17cc064280 2021-03-25T14:16:29.972 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.962+0000 7f17c959a700 1 -- 172.21.15.110:0/578365252 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17bc009a30 con 0x7f17cc064280 2021-03-25T14:16:29.972 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.962+0000 7f17c959a700 1 -- 172.21.15.110:0/578365252 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc009db0 con 0x7f17cc064280 2021-03-25T14:16:29.972 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.962+0000 7f17d0822700 1 -- 172.21.15.110:0/578365252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17cc064280 msgr2=0x7f17cc064660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.972 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.962+0000 7f17d0822700 1 --2- 172.21.15.110:0/578365252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17cc064280 0x7f17cc064660 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f17cc0658c0 tx=0x7f17bc006ee0).stop 2021-03-25T14:16:29.972 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.962+0000 7f17d0822700 1 -- 172.21.15.110:0/578365252 shutdown_connections 2021-03-25T14:16:29.973 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.962+0000 7f17d0822700 1 --2- 172.21.15.110:0/578365252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17cc064280 0x7f17cc064660 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:29.973 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.962+0000 7f17d0822700 1 --2- 172.21.15.110:0/578365252 >> v2:172.21.15.174:3300/0 conn(0x7f17cc0b7800 0x7f17cc147060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:29.973 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.962+0000 7f17d0822700 1 -- 172.21.15.110:0/578365252 >> 172.21.15.110:0/578365252 conn(0x7f17cc0663f0 msgr2=0x7f17cc066800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:29.973 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.962+0000 7f17d0822700 1 -- 172.21.15.110:0/578365252 shutdown_connections 2021-03-25T14:16:29.973 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.962+0000 7f17d0822700 1 -- 172.21.15.110:0/578365252 wait complete. 2021-03-25T14:16:29.973 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.963+0000 7f17d0822700 1 Processor -- start 2021-03-25T14:16:29.974 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.963+0000 7f17d0822700 1 -- start start 2021-03-25T14:16:29.974 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.964+0000 7f17d0822700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17cc064280 0x7f17cc0b5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.974 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.964+0000 7f17d0822700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17cc0b7800 0x7f17cc0b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.974 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.964+0000 7f17d0822700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17cc0b8030 0x7f17cc0b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.974 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.964+0000 7f17d0822700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc09fb20 con 0x7f17cc0b8030 2021-03-25T14:16:29.975 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.964+0000 7f17d0822700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc09fdc0 con 0x7f17cc0b7800 2021-03-25T14:16:29.975 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.964+0000 7f17d0822700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc0a0060 con 0x7f17cc064280 2021-03-25T14:16:29.975 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.964+0000 7f17cad9d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17cc0b8030 0x7f17cc0b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.975 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.964+0000 7f17cad9d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17cc0b8030 0x7f17cc0b34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47980/0 (socket says 172.21.15.110:47980) 2021-03-25T14:16:29.975 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.964+0000 7f17cad9d700 1 -- 172.21.15.110:0/3781723853 learned_addr learned my addr 172.21.15.110:0/3781723853 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:29.975 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.964+0000 7f17c9d9b700 1 --2- 172.21.15.110:0/3781723853 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17cc0b7800 0x7f17cc0b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.976 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.964+0000 7f17ca59c700 1 --2- 172.21.15.110:0/3781723853 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17cc064280 0x7f17cc0b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.976 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.964+0000 7f17cad9d700 1 -- 172.21.15.110:0/3781723853 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17cc064280 msgr2=0x7f17cc0b5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.976 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.964+0000 7f17cad9d700 1 --2- 172.21.15.110:0/3781723853 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17cc064280 0x7f17cc0b5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:29.976 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.964+0000 7f17cad9d700 1 -- 172.21.15.110:0/3781723853 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17cc0b7800 msgr2=0x7f17cc0b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.976 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.964+0000 7f17cad9d700 1 --2- 172.21.15.110:0/3781723853 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17cc0b7800 0x7f17cc0b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:29.977 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.964+0000 7f17cad9d700 1 -- 172.21.15.110:0/3781723853 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17cc0a0300 con 0x7f17cc0b8030 2021-03-25T14:16:29.977 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.964+0000 7f17cad9d700 1 --2- 172.21.15.110:0/3781723853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17cc0b8030 0x7f17cc0b34c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f17c400ca90 tx=0x7f17c4007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:29.977 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.965+0000 7f17ba7fc700 1 -- 172.21.15.110:0/3781723853 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c400a7f0 con 0x7f17cc0b8030 2021-03-25T14:16:29.977 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.965+0000 7f17ba7fc700 1 -- 172.21.15.110:0/3781723853 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c400a950 con 0x7f17cc0b8030 2021-03-25T14:16:29.977 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.965+0000 7f17ba7fc700 1 -- 172.21.15.110:0/3781723853 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c400acd0 con 0x7f17cc0b8030 2021-03-25T14:16:29.977 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.965+0000 7f17d0822700 1 -- 172.21.15.110:0/3781723853 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17cc0a05a0 con 0x7f17cc0b8030 2021-03-25T14:16:29.978 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.965+0000 7f17d0822700 1 -- 172.21.15.110:0/3781723853 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17cc0b5690 con 0x7f17cc0b8030 2021-03-25T14:16:29.978 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.965+0000 7f17d0822700 1 -- 172.21.15.110:0/3781723853 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f17cc05d7b0 con 0x7f17cc0b8030 2021-03-25T14:16:29.978 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.966+0000 7f17ba7fc700 1 -- 172.21.15.110:0/3781723853 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f17c4019030 con 0x7f17cc0b8030 2021-03-25T14:16:29.978 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.966+0000 7f17ba7fc700 1 --2- 172.21.15.110:0/3781723853 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f17a805a0b0 0x7f17a805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.978 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.966+0000 7f17ba7fc700 1 -- 172.21.15.110:0/3781723853 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f17c40738c0 con 0x7f17cc0b8030 2021-03-25T14:16:29.979 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.966+0000 7f17ca59c700 1 --2- 172.21.15.110:0/3781723853 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f17a805a0b0 0x7f17a805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.979 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.966+0000 7f17ba7fc700 1 --2- 172.21.15.110:0/3781723853 >> [v2:172.21.15.174:6824/37327,v1:172.21.15.174:6825/37327] conn(0x7f17a80621c0 0x7f17a8064660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:29.979 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.966+0000 7f17ba7fc700 1 -- 172.21.15.110:0/3781723853 --> [v2:172.21.15.174:6824/37327,v1:172.21.15.174:6825/37327] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f17a8064ce0 con 0x7f17a80621c0 2021-03-25T14:16:29.979 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.966+0000 7f17ba7fc700 1 -- 172.21.15.110:0/3781723853 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17c4078220 con 0x7f17cc0b8030 2021-03-25T14:16:29.979 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.967+0000 7f17c9d9b700 1 --2- 172.21.15.110:0/3781723853 >> [v2:172.21.15.174:6824/37327,v1:172.21.15.174:6825/37327] conn(0x7f17a80621c0 0x7f17a8064660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:29.979 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.967+0000 7f17ca59c700 1 --2- 172.21.15.110:0/3781723853 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f17a805a0b0 0x7f17a805c570 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f17bc006f20 tx=0x7f17bc016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:29.981 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.967+0000 7f17c9d9b700 1 --2- 172.21.15.110:0/3781723853 >> [v2:172.21.15.174:6824/37327,v1:172.21.15.174:6825/37327] conn(0x7f17a80621c0 0x7f17a8064660 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:29.981 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.968+0000 7f17ba7fc700 1 -- 172.21.15.110:0/3781723853 <== osd.6 v2:172.21.15.174:6824/37327 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f17a8064ce0 con 0x7f17a80621c0 2021-03-25T14:16:29.983 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.982+0000 7f17d0822700 1 -- 172.21.15.110:0/3781723853 --> [v2:172.21.15.174:6824/37327,v1:172.21.15.174:6825/37327] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f17cc068710 con 0x7f17a80621c0 2021-03-25T14:16:29.984 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.982+0000 7f17ba7fc700 1 -- 172.21.15.110:0/3781723853 <== osd.6 v2:172.21.15.174:6824/37327 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f17cc068710 con 0x7f17a80621c0 2021-03-25T14:16:29.986 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.983+0000 7f17d0822700 1 -- 172.21.15.110:0/3781723853 >> [v2:172.21.15.174:6824/37327,v1:172.21.15.174:6825/37327] conn(0x7f17a80621c0 msgr2=0x7f17a8064660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.986 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.983+0000 7f17d0822700 1 --2- 172.21.15.110:0/3781723853 >> [v2:172.21.15.174:6824/37327,v1:172.21.15.174:6825/37327] conn(0x7f17a80621c0 0x7f17a8064660 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:29.986 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.983+0000 7f17d0822700 1 -- 172.21.15.110:0/3781723853 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f17a805a0b0 msgr2=0x7f17a805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.987 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.983+0000 7f17d0822700 1 --2- 172.21.15.110:0/3781723853 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f17a805a0b0 0x7f17a805c570 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f17bc006f20 tx=0x7f17bc016000).stop 2021-03-25T14:16:29.987 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.983+0000 7f17d0822700 1 -- 172.21.15.110:0/3781723853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17cc0b8030 msgr2=0x7f17cc0b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:29.987 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.983+0000 7f17d0822700 1 --2- 172.21.15.110:0/3781723853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17cc0b8030 0x7f17cc0b34c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f17c400ca90 tx=0x7f17c4007f70).stop 2021-03-25T14:16:29.987 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.983+0000 7f17cad9d700 1 -- 172.21.15.110:0/3781723853 reap_dead start 2021-03-25T14:16:29.987 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.983+0000 7f17d0822700 1 -- 172.21.15.110:0/3781723853 shutdown_connections 2021-03-25T14:16:29.987 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.983+0000 7f17d0822700 1 -- 172.21.15.110:0/3781723853 >> 172.21.15.110:0/3781723853 conn(0x7f17cc0663f0 msgr2=0x7f17cc143e30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:29.987 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.983+0000 7f17d0822700 1 -- 172.21.15.110:0/3781723853 shutdown_connections 2021-03-25T14:16:29.987 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:29.983+0000 7f17d0822700 1 -- 172.21.15.110:0/3781723853 wait complete. 2021-03-25T14:16:29.996 INFO:teuthology.orchestra.run.smithi110.stdout:55834574855 2021-03-25T14:16:29.997 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2021-03-25T14:16:30.111 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.106+0000 7f8b296a2700 1 Processor -- start 2021-03-25T14:16:30.112 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.106+0000 7f8b296a2700 1 -- start start 2021-03-25T14:16:30.112 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.107+0000 7f8b296a2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8b24149c40 0x7f8b2414a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:30.112 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.107+0000 7f8b296a2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b240bbe10 0x7f8b240bc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:30.112 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.107+0000 7f8b296a2700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b240bacd0 con 0x7f8b2414a510 2021-03-25T14:16:30.112 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.107+0000 7f8b296a2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b241472c0 con 0x7f8b24149c40 2021-03-25T14:16:30.112 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.107+0000 7f8b296a2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b240baf70 con 0x7f8b240bbe10 2021-03-25T14:16:30.112 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.107+0000 7f8b1bfff700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f8b2414a510 0x7f8b240b62c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:40924/0 (socket says 172.21.15.110:40924) 2021-03-25T14:16:30.112 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.107+0000 7f8b1bfff700 1 -- 172.21.15.110:0/339508561 learned_addr learned my addr 172.21.15.110:0/339508561 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:30.112 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.107+0000 7f8b22ffd700 1 --2- 172.21.15.110:0/339508561 >> v2:172.21.15.174:3300/0 conn(0x7f8b24149c40 0x7f8b2414a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:30.112 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.107+0000 7f8b237fe700 1 --2- 172.21.15.110:0/339508561 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b240bbe10 0x7f8b240bc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:30.113 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.107+0000 7f8b227fc700 1 -- 172.21.15.110:0/339508561 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 156843944 0 0) 0x7f8b240bacd0 con 0x7f8b2414a510 2021-03-25T14:16:30.113 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.107+0000 7f8b227fc700 1 -- 172.21.15.110:0/339508561 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b04003270 con 0x7f8b2414a510 2021-03-25T14:16:30.113 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.108+0000 7f8b237fe700 1 -- 172.21.15.110:0/339508561 >> v2:172.21.15.174:3300/0 conn(0x7f8b24149c40 msgr2=0x7f8b2414a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:30.113 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.108+0000 7f8b237fe700 1 --2- 172.21.15.110:0/339508561 >> v2:172.21.15.174:3300/0 conn(0x7f8b24149c40 0x7f8b2414a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:30.113 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.108+0000 7f8b237fe700 1 -- 172.21.15.110:0/339508561 >> v1:172.21.15.110:6789/0 conn(0x7f8b2414a510 legacy=0x7f8b240b62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:30.113 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.108+0000 7f8b227fc700 1 -- 172.21.15.110:0/339508561 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1961835114 0 0) 0x7f8b04003270 con 0x7f8b2414a510 2021-03-25T14:16:30.113 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.108+0000 7f8b237fe700 1 -- 172.21.15.110:0/339508561 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b240bb210 con 0x7f8b240bbe10 2021-03-25T14:16:30.113 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.108+0000 7f8b22ffd700 1 --2- 172.21.15.110:0/339508561 >> v2:172.21.15.174:3300/0 conn(0x7f8b24149c40 0x7f8b2414a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:16:30.113 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.108+0000 7f8b237fe700 1 --2- 172.21.15.110:0/339508561 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b240bbe10 0x7f8b240bc270 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f8b1c009cc0 tx=0x7f8b1c009220).ready entity=mon.2 client_cookie=9e381345ee14d212 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:30.113 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.108+0000 7f8b227fc700 1 -- 172.21.15.110:0/339508561 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c001520 con 0x7f8b240bbe10 2021-03-25T14:16:30.113 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.108+0000 7f8b227fc700 1 -- 172.21.15.110:0/339508561 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1c00b650 con 0x7f8b240bbe10 2021-03-25T14:16:30.114 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.108+0000 7f8b227fc700 1 -- 172.21.15.110:0/339508561 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c00b9f0 con 0x7f8b240bbe10 2021-03-25T14:16:30.114 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.108+0000 7f8b296a2700 1 -- 172.21.15.110:0/339508561 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b240bbe10 msgr2=0x7f8b240bc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:30.114 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.108+0000 7f8b296a2700 1 --2- 172.21.15.110:0/339508561 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b240bbe10 0x7f8b240bc270 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f8b1c009cc0 tx=0x7f8b1c009220).stop 2021-03-25T14:16:30.114 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.109+0000 7f8b296a2700 1 -- 172.21.15.110:0/339508561 shutdown_connections 2021-03-25T14:16:30.114 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.109+0000 7f8b296a2700 1 --2- 172.21.15.110:0/339508561 >> v2:172.21.15.174:3300/0 conn(0x7f8b24149c40 0x7f8b2414a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:30.114 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.109+0000 7f8b296a2700 1 --2- 172.21.15.110:0/339508561 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b240bbe10 0x7f8b240bc270 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:30.114 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.109+0000 7f8b296a2700 1 -- 172.21.15.110:0/339508561 >> 172.21.15.110:0/339508561 conn(0x7f8b24060c40 msgr2=0x7f8b24061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:30.114 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.109+0000 7f8b296a2700 1 -- 172.21.15.110:0/339508561 shutdown_connections 2021-03-25T14:16:30.114 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.109+0000 7f8b296a2700 1 -- 172.21.15.110:0/339508561 wait complete. 2021-03-25T14:16:30.114 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.110+0000 7f8b296a2700 1 Processor -- start 2021-03-25T14:16:30.114 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.110+0000 7f8b296a2700 1 -- start start 2021-03-25T14:16:30.118 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.110+0000 7f8b296a2700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b240bbe10 0x7f8b24144920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:30.118 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.110+0000 7f8b296a2700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b24149c40 0x7f8b2415c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:30.118 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.110+0000 7f8b296a2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b2414a510 0x7f8b2415cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:30.118 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.110+0000 7f8b296a2700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2414d9a0 con 0x7f8b240bbe10 2021-03-25T14:16:30.118 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.110+0000 7f8b296a2700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b24159130 con 0x7f8b24149c40 2021-03-25T14:16:30.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.110+0000 7f8b296a2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b241593d0 con 0x7f8b2414a510 2021-03-25T14:16:30.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.110+0000 7f8b22ffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b240bbe10 0x7f8b24144920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:30.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.110+0000 7f8b22ffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b240bbe10 0x7f8b24144920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47992/0 (socket says 172.21.15.110:47992) 2021-03-25T14:16:30.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.110+0000 7f8b22ffd700 1 -- 172.21.15.110:0/1846166399 learned_addr learned my addr 172.21.15.110:0/1846166399 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:30.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.110+0000 7f8b237fe700 1 --2- 172.21.15.110:0/1846166399 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b2414a510 0x7f8b2415cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:30.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.110+0000 7f8b1bfff700 1 --2- 172.21.15.110:0/1846166399 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b24149c40 0x7f8b2415c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:30.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.111+0000 7f8b22ffd700 1 -- 172.21.15.110:0/1846166399 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b2414a510 msgr2=0x7f8b2415cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:30.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.111+0000 7f8b22ffd700 1 --2- 172.21.15.110:0/1846166399 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b2414a510 0x7f8b2415cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:30.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.111+0000 7f8b22ffd700 1 -- 172.21.15.110:0/1846166399 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b24149c40 msgr2=0x7f8b2415c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:30.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.111+0000 7f8b22ffd700 1 --2- 172.21.15.110:0/1846166399 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b24149c40 0x7f8b2415c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:30.120 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.111+0000 7f8b22ffd700 1 -- 172.21.15.110:0/1846166399 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b24159670 con 0x7f8b240bbe10 2021-03-25T14:16:30.120 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.111+0000 7f8b22ffd700 1 --2- 172.21.15.110:0/1846166399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b240bbe10 0x7f8b24144920 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f8b1400ef20 tx=0x7f8b14006e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:30.120 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.111+0000 7f8b1affd700 1 -- 172.21.15.110:0/1846166399 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1400cb30 con 0x7f8b240bbe10 2021-03-25T14:16:30.120 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.111+0000 7f8b1affd700 1 -- 172.21.15.110:0/1846166399 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1400cc90 con 0x7f8b240bbe10 2021-03-25T14:16:30.120 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.111+0000 7f8b296a2700 1 -- 172.21.15.110:0/1846166399 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b24159910 con 0x7f8b240bbe10 2021-03-25T14:16:30.120 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.111+0000 7f8b1affd700 1 -- 172.21.15.110:0/1846166399 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b140123f0 con 0x7f8b240bbe10 2021-03-25T14:16:30.120 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.111+0000 7f8b296a2700 1 -- 172.21.15.110:0/1846166399 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b24144e10 con 0x7f8b240bbe10 2021-03-25T14:16:30.120 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.112+0000 7f8b296a2700 1 -- 172.21.15.110:0/1846166399 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8b2405d7b0 con 0x7f8b240bbe10 2021-03-25T14:16:30.120 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.112+0000 7f8b1affd700 1 -- 172.21.15.110:0/1846166399 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f8b14012760 con 0x7f8b240bbe10 2021-03-25T14:16:30.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.112+0000 7f8b1affd700 1 --2- 172.21.15.110:0/1846166399 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f8b0805a0b0 0x7f8b0805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:30.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.112+0000 7f8b1affd700 1 -- 172.21.15.110:0/1846166399 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f8b14074560 con 0x7f8b240bbe10 2021-03-25T14:16:30.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.112+0000 7f8b1bfff700 1 --2- 172.21.15.110:0/1846166399 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f8b0805a0b0 0x7f8b0805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:30.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.112+0000 7f8b1affd700 1 --2- 172.21.15.110:0/1846166399 >> [v2:172.21.15.174:6816/37284,v1:172.21.15.174:6817/37284] conn(0x7f8b080621c0 0x7f8b08064660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:30.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.112+0000 7f8b1affd700 1 -- 172.21.15.110:0/1846166399 --> [v2:172.21.15.174:6816/37284,v1:172.21.15.174:6817/37284] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8b08064ce0 con 0x7f8b080621c0 2021-03-25T14:16:30.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.112+0000 7f8b1affd700 1 -- 172.21.15.110:0/1846166399 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b14076bd0 con 0x7f8b240bbe10 2021-03-25T14:16:30.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.113+0000 7f8b1bfff700 1 --2- 172.21.15.110:0/1846166399 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f8b0805a0b0 0x7f8b0805c570 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f8b240c0f20 tx=0x7f8b0c001e70).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:30.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.113+0000 7f8b237fe700 1 --2- 172.21.15.110:0/1846166399 >> [v2:172.21.15.174:6816/37284,v1:172.21.15.174:6817/37284] conn(0x7f8b080621c0 0x7f8b08064660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:30.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.113+0000 7f8b237fe700 1 --2- 172.21.15.110:0/1846166399 >> [v2:172.21.15.174:6816/37284,v1:172.21.15.174:6817/37284] conn(0x7f8b080621c0 0x7f8b08064660 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:30.122 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.114+0000 7f8b1affd700 1 -- 172.21.15.110:0/1846166399 <== osd.7 v2:172.21.15.174:6816/37284 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f8b08064ce0 con 0x7f8b080621c0 2021-03-25T14:16:30.129 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.128+0000 7f8b296a2700 1 -- 172.21.15.110:0/1846166399 --> [v2:172.21.15.174:6816/37284,v1:172.21.15.174:6817/37284] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8b2414d6e0 con 0x7f8b080621c0 2021-03-25T14:16:30.130 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.128+0000 7f8b1affd700 1 -- 172.21.15.110:0/1846166399 <== osd.7 v2:172.21.15.174:6816/37284 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8b2414d6e0 con 0x7f8b080621c0 2021-03-25T14:16:30.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.129+0000 7f8b296a2700 1 -- 172.21.15.110:0/1846166399 >> [v2:172.21.15.174:6816/37284,v1:172.21.15.174:6817/37284] conn(0x7f8b080621c0 msgr2=0x7f8b08064660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:30.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.129+0000 7f8b296a2700 1 --2- 172.21.15.110:0/1846166399 >> [v2:172.21.15.174:6816/37284,v1:172.21.15.174:6817/37284] conn(0x7f8b080621c0 0x7f8b08064660 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:30.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.129+0000 7f8b296a2700 1 -- 172.21.15.110:0/1846166399 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f8b0805a0b0 msgr2=0x7f8b0805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:30.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.129+0000 7f8b296a2700 1 --2- 172.21.15.110:0/1846166399 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f8b0805a0b0 0x7f8b0805c570 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f8b240c0f20 tx=0x7f8b0c001e70).stop 2021-03-25T14:16:30.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.129+0000 7f8b296a2700 1 -- 172.21.15.110:0/1846166399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b240bbe10 msgr2=0x7f8b24144920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:30.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.129+0000 7f8b296a2700 1 --2- 172.21.15.110:0/1846166399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b240bbe10 0x7f8b24144920 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f8b1400ef20 tx=0x7f8b14006e20).stop 2021-03-25T14:16:30.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.129+0000 7f8b237fe700 1 -- 172.21.15.110:0/1846166399 reap_dead start 2021-03-25T14:16:30.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.129+0000 7f8b296a2700 1 -- 172.21.15.110:0/1846166399 shutdown_connections 2021-03-25T14:16:30.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.129+0000 7f8b296a2700 1 -- 172.21.15.110:0/1846166399 >> 172.21.15.110:0/1846166399 conn(0x7f8b24060c40 msgr2=0x7f8b24148fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:30.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.129+0000 7f8b296a2700 1 -- 172.21.15.110:0/1846166399 shutdown_connections 2021-03-25T14:16:30.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.129+0000 7f8b296a2700 1 -- 172.21.15.110:0/1846166399 wait complete. 2021-03-25T14:16:30.142 INFO:teuthology.orchestra.run.smithi110.stdout:55834574858 2021-03-25T14:16:30.142 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2021-03-25T14:16:30.256 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.251+0000 7f5302ab9700 1 Processor -- start 2021-03-25T14:16:30.256 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.251+0000 7f5302ab9700 1 -- start start 2021-03-25T14:16:30.256 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.252+0000 7f5302ab9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f52fc0b9ba0 0x7f52fc143980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:30.256 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.252+0000 7f5302ab9700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52fc14d0e0 con 0x7f52fc09d2a0 2021-03-25T14:16:30.256 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.252+0000 7f5302ab9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52fc14d380 con 0x7f52fc0be5a0 2021-03-25T14:16:30.256 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.252+0000 7f5302ab9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52fc09d6f0 con 0x7f52fc0b9ba0 2021-03-25T14:16:30.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.252+0000 7f5301056700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f52fc09d2a0 0x7f52fc149a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:40942/0 (socket says 172.21.15.110:40942) 2021-03-25T14:16:30.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.252+0000 7f5301056700 1 -- 172.21.15.110:0/2777167370 learned_addr learned my addr 172.21.15.110:0/2777167370 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:30.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.252+0000 7f52fbfff700 1 --2- 172.21.15.110:0/2777167370 >> v2:172.21.15.174:3300/0 conn(0x7f52fc0b9ba0 0x7f52fc143980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:30.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.252+0000 7f52fb7fe700 1 -- 172.21.15.110:0/2777167370 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3025182241 0 0) 0x7f52fc14d0e0 con 0x7f52fc09d2a0 2021-03-25T14:16:30.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.252+0000 7f52fb7fe700 1 -- 172.21.15.110:0/2777167370 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52e0003270 con 0x7f52fc09d2a0 2021-03-25T14:16:30.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.252+0000 7f52fb7fe700 1 -- 172.21.15.110:0/2777167370 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2744485662 0 0) 0x7f52fc14d380 con 0x7f52fc0be5a0 2021-03-25T14:16:30.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.252+0000 7f52fb7fe700 1 -- 172.21.15.110:0/2777167370 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52fc14d0e0 con 0x7f52fc0be5a0 2021-03-25T14:16:30.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.252+0000 7f52fbfff700 1 -- 172.21.15.110:0/2777167370 >> v1:172.21.15.174:6789/0 conn(0x7f52fc0be5a0 legacy=0x7f52fc143270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:30.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.252+0000 7f52fb7fe700 1 -- 172.21.15.110:0/2777167370 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1606978411 0 0) 0x7f52e0003270 con 0x7f52fc09d2a0 2021-03-25T14:16:30.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.253+0000 7f52fbfff700 1 -- 172.21.15.110:0/2777167370 >> v1:172.21.15.110:6789/0 conn(0x7f52fc09d2a0 legacy=0x7f52fc149a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:30.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.253+0000 7f52fbfff700 1 -- 172.21.15.110:0/2777167370 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52fc14d620 con 0x7f52fc0b9ba0 2021-03-25T14:16:30.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.253+0000 7f52fbfff700 1 --2- 172.21.15.110:0/2777167370 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52fc0b9ba0 0x7f52fc143980 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f52e800b9c0 tx=0x7f52e8006e20).ready entity=mon.1 client_cookie=addaa49f2373b27b server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:30.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.253+0000 7f52fb7fe700 1 -- 172.21.15.110:0/2777167370 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f40018a0 con 0x7f52fc0b9ba0 2021-03-25T14:16:30.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.253+0000 7f52fb7fe700 1 -- 172.21.15.110:0/2777167370 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e8011400 con 0x7f52fc0b9ba0 2021-03-25T14:16:30.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.253+0000 7f52fb7fe700 1 -- 172.21.15.110:0/2777167370 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e8011780 con 0x7f52fc0b9ba0 2021-03-25T14:16:30.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.253+0000 7f5302ab9700 1 -- 172.21.15.110:0/2777167370 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52fc0b9ba0 msgr2=0x7f52fc143980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:30.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.253+0000 7f5302ab9700 1 --2- 172.21.15.110:0/2777167370 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52fc0b9ba0 0x7f52fc143980 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f52e800b9c0 tx=0x7f52e8006e20).stop 2021-03-25T14:16:30.259 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.253+0000 7f5302ab9700 1 -- 172.21.15.110:0/2777167370 shutdown_connections 2021-03-25T14:16:30.259 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.253+0000 7f5302ab9700 1 --2- 172.21.15.110:0/2777167370 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52fc0b9ba0 0x7f52fc143980 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:30.259 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.253+0000 7f5302ab9700 1 -- 172.21.15.110:0/2777167370 >> 172.21.15.110:0/2777167370 conn(0x7f52fc0616d0 msgr2=0x7f52fc0bdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:30.259 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.253+0000 7f5302ab9700 1 -- 172.21.15.110:0/2777167370 shutdown_connections 2021-03-25T14:16:30.259 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.253+0000 7f5302ab9700 1 -- 172.21.15.110:0/2777167370 wait complete. 2021-03-25T14:16:30.260 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.254+0000 7f5302ab9700 1 Processor -- start 2021-03-25T14:16:30.265 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.255+0000 7f5302ab9700 1 -- start start 2021-03-25T14:16:30.266 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.255+0000 7f5302ab9700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52fc09d2a0 0x7f52fc159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:30.266 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.255+0000 7f5302ab9700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52fc0b9ba0 0x7f52fc063250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:30.266 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.255+0000 7f5302ab9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f52fc0be5a0 0x7f52fc145180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:30.266 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.255+0000 7f5302ab9700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc0a2f20 con 0x7f52fc0b9ba0 2021-03-25T14:16:30.266 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.255+0000 7f5302ab9700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc0a31c0 con 0x7f52fc09d2a0 2021-03-25T14:16:30.266 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.255+0000 7f5302ab9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc0a3460 con 0x7f52fc0be5a0 2021-03-25T14:16:30.267 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.255+0000 7f52fbfff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52fc0b9ba0 0x7f52fc063250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:30.267 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.255+0000 7f52fbfff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52fc0b9ba0 0x7f52fc063250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48010/0 (socket says 172.21.15.110:48010) 2021-03-25T14:16:30.267 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.255+0000 7f52fbfff700 1 -- 172.21.15.110:0/4052671893 learned_addr learned my addr 172.21.15.110:0/4052671893 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:30.267 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.256+0000 7f5301056700 1 --2- 172.21.15.110:0/4052671893 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f52fc0be5a0 0x7f52fc145180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:30.267 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.256+0000 7f5300855700 1 --2- 172.21.15.110:0/4052671893 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52fc09d2a0 0x7f52fc159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:30.268 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.256+0000 7f52fbfff700 1 -- 172.21.15.110:0/4052671893 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f52fc0be5a0 msgr2=0x7f52fc145180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:30.268 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.256+0000 7f52fbfff700 1 --2- 172.21.15.110:0/4052671893 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f52fc0be5a0 0x7f52fc145180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:30.268 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.256+0000 7f52fbfff700 1 -- 172.21.15.110:0/4052671893 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52fc09d2a0 msgr2=0x7f52fc159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:30.268 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.256+0000 7f52fbfff700 1 --2- 172.21.15.110:0/4052671893 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52fc09d2a0 0x7f52fc159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:30.268 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.256+0000 7f52fbfff700 1 -- 172.21.15.110:0/4052671893 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52fc0a0d00 con 0x7f52fc0b9ba0 2021-03-25T14:16:30.268 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.256+0000 7f52fbfff700 1 --2- 172.21.15.110:0/4052671893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52fc0b9ba0 0x7f52fc063250 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f52e800bfb0 tx=0x7f52e8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:30.269 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.256+0000 7f52f8ff9700 1 -- 172.21.15.110:0/4052671893 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e8010bb0 con 0x7f52fc0b9ba0 2021-03-25T14:16:30.269 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.256+0000 7f52f8ff9700 1 -- 172.21.15.110:0/4052671893 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e8010d10 con 0x7f52fc0b9ba0 2021-03-25T14:16:30.269 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.256+0000 7f5302ab9700 1 -- 172.21.15.110:0/4052671893 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52fc14a420 con 0x7f52fc0b9ba0 2021-03-25T14:16:30.269 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.256+0000 7f52f8ff9700 1 -- 172.21.15.110:0/4052671893 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e801d660 con 0x7f52fc0b9ba0 2021-03-25T14:16:30.269 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.256+0000 7f5302ab9700 1 -- 172.21.15.110:0/4052671893 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52fc0a3870 con 0x7f52fc0b9ba0 2021-03-25T14:16:30.270 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.257+0000 7f5302ab9700 1 -- 172.21.15.110:0/4052671893 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52fc05d7b0 con 0x7f52fc0b9ba0 2021-03-25T14:16:30.270 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.257+0000 7f52f8ff9700 1 -- 172.21.15.110:0/4052671893 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f52e8024030 con 0x7f52fc0b9ba0 2021-03-25T14:16:30.270 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.257+0000 7f52f8ff9700 1 --2- 172.21.15.110:0/4052671893 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f52dc05a0b0 0x7f52dc05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:30.270 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.258+0000 7f52f8ff9700 1 -- 172.21.15.110:0/4052671893 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f52e8074f60 con 0x7f52fc0b9ba0 2021-03-25T14:16:30.270 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.258+0000 7f5300855700 1 --2- 172.21.15.110:0/4052671893 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f52dc05a0b0 0x7f52dc05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:30.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.258+0000 7f5300855700 1 --2- 172.21.15.110:0/4052671893 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f52dc05a0b0 0x7f52dc05c570 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f52f0007fd0 tx=0x7f52f0009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:30.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.261+0000 7f52f8ff9700 1 -- 172.21.15.110:0/4052671893 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f52e8048610 con 0x7f52fc0b9ba0 2021-03-25T14:16:30.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.410+0000 7f5302ab9700 1 -- 172.21.15.110:0/4052671893 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f52fc062cc0 con 0x7f52fc0b9ba0 2021-03-25T14:16:30.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.411+0000 7f52f8ff9700 1 -- 172.21.15.110:0/4052671893 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f52e8022070 con 0x7f52fc0b9ba0 2021-03-25T14:16:30.413 INFO:teuthology.orchestra.run.smithi110.stdout:55834574856 2021-03-25T14:16:30.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.412+0000 7f5302ab9700 1 -- 172.21.15.110:0/4052671893 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f52dc05a0b0 msgr2=0x7f52dc05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:30.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.412+0000 7f5302ab9700 1 --2- 172.21.15.110:0/4052671893 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f52dc05a0b0 0x7f52dc05c570 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f52f0007fd0 tx=0x7f52f0009040).stop 2021-03-25T14:16:30.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.412+0000 7f5302ab9700 1 -- 172.21.15.110:0/4052671893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52fc0b9ba0 msgr2=0x7f52fc063250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:30.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.412+0000 7f5302ab9700 1 --2- 172.21.15.110:0/4052671893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52fc0b9ba0 0x7f52fc063250 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f52e800bfb0 tx=0x7f52e8016000).stop 2021-03-25T14:16:30.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.412+0000 7f5302ab9700 1 -- 172.21.15.110:0/4052671893 shutdown_connections 2021-03-25T14:16:30.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.412+0000 7f5302ab9700 1 --2- 172.21.15.110:0/4052671893 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f52dc05a0b0 0x7f52dc05c570 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:30.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.412+0000 7f5302ab9700 1 --2- 172.21.15.110:0/4052671893 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52fc09d2a0 0x7f52fc159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:30.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.412+0000 7f5302ab9700 1 --2- 172.21.15.110:0/4052671893 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f52fc0be5a0 0x7f52fc145180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:30.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.412+0000 7f5302ab9700 1 --2- 172.21.15.110:0/4052671893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52fc0b9ba0 0x7f52fc063250 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:30.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.412+0000 7f5302ab9700 1 -- 172.21.15.110:0/4052671893 >> 172.21.15.110:0/4052671893 conn(0x7f52fc0616d0 msgr2=0x7f52fc149b90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:30.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.412+0000 7f5302ab9700 1 -- 172.21.15.110:0/4052671893 shutdown_connections 2021-03-25T14:16:30.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:30.412+0000 7f5302ab9700 1 -- 172.21.15.110:0/4052671893 wait complete. 2021-03-25T14:16:30.426 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.0 2021-03-25T14:16:31.427 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2021-03-25T14:16:31.550 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.548+0000 7faf58f78700 1 Processor -- start 2021-03-25T14:16:31.550 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.548+0000 7faf58f78700 1 -- start start 2021-03-25T14:16:31.556 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.549+0000 7faf58f78700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7faf54143980 0x7faf5409d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:31.556 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.549+0000 7faf58f78700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf5414d0e0 con 0x7faf540be5a0 2021-03-25T14:16:31.556 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.549+0000 7faf58f78700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf5414d380 con 0x7faf540b9ba0 2021-03-25T14:16:31.557 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.549+0000 7faf58f78700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf5414d620 con 0x7faf54143980 2021-03-25T14:16:31.557 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.549+0000 7faf5259c700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7faf540be5a0 0x7faf54143270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:40954/0 (socket says 172.21.15.110:40954) 2021-03-25T14:16:31.557 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.549+0000 7faf5259c700 1 -- 172.21.15.110:0/3180829438 learned_addr learned my addr 172.21.15.110:0/3180829438 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:31.557 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.549+0000 7faf51d9b700 1 -- 172.21.15.110:0/3180829438 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195927561 0 0) 0x7faf5414d0e0 con 0x7faf540be5a0 2021-03-25T14:16:31.557 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.549+0000 7faf51d9b700 1 -- 172.21.15.110:0/3180829438 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf34003270 con 0x7faf540be5a0 2021-03-25T14:16:31.557 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.549+0000 7faf52d9d700 1 --2- 172.21.15.110:0/3180829438 >> v2:172.21.15.174:3300/0 conn(0x7faf54143980 0x7faf5409d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:31.557 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.550+0000 7faf51d9b700 1 -- 172.21.15.110:0/3180829438 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3101501811 0 0) 0x7faf34003270 con 0x7faf540be5a0 2021-03-25T14:16:31.557 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.550+0000 7faf51d9b700 1 -- 172.21.15.110:0/3180829438 >> v2:172.21.15.174:3300/0 conn(0x7faf54143980 msgr2=0x7faf5409d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:31.557 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.550+0000 7faf51d9b700 1 --2- 172.21.15.110:0/3180829438 >> v2:172.21.15.174:3300/0 conn(0x7faf54143980 0x7faf5409d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:31.557 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.550+0000 7faf51d9b700 1 -- 172.21.15.110:0/3180829438 >> v1:172.21.15.174:6789/0 conn(0x7faf540b9ba0 legacy=0x7faf54149a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:31.557 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.550+0000 7faf51d9b700 1 -- 172.21.15.110:0/3180829438 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5414d8c0 con 0x7faf540be5a0 2021-03-25T14:16:31.558 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.550+0000 7faf51d9b700 1 -- 172.21.15.110:0/3180829438 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7faf44001520 con 0x7faf540be5a0 2021-03-25T14:16:31.558 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.550+0000 7faf51d9b700 1 -- 172.21.15.110:0/3180829438 >> v1:172.21.15.110:6789/0 conn(0x7faf540be5a0 legacy=0x7faf54143270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:31.558 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.550+0000 7faf51d9b700 1 --2- 172.21.15.110:0/3180829438 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf34003760 0x7faf34003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:31.558 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.550+0000 7faf51d9b700 1 --2- 172.21.15.110:0/3180829438 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faf34004510 0x7faf34004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:31.558 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.550+0000 7faf51d9b700 1 --2- 172.21.15.110:0/3180829438 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf34004e80 0x7faf3400b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:31.558 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.550+0000 7faf51d9b700 1 -- 172.21.15.110:0/3180829438 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5414d620 con 0x7faf34004e80 2021-03-25T14:16:31.558 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.550+0000 7faf51d9b700 1 -- 172.21.15.110:0/3180829438 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf34004290 con 0x7faf34003760 2021-03-25T14:16:31.558 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.550+0000 7faf51d9b700 1 -- 172.21.15.110:0/3180829438 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3400bc50 con 0x7faf34004510 2021-03-25T14:16:31.558 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.550+0000 7faf5259c700 1 --2- 172.21.15.110:0/3180829438 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf34003760 0x7faf34003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:31.558 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.550+0000 7faf52d9d700 1 --2- 172.21.15.110:0/3180829438 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf34004e80 0x7faf3400b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:31.558 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.550+0000 7faf4bfff700 1 --2- 172.21.15.110:0/3180829438 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faf34004510 0x7faf34004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:31.558 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.550+0000 7faf52d9d700 1 -- 172.21.15.110:0/3180829438 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faf34004510 msgr2=0x7faf34004990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:31.559 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.550+0000 7faf52d9d700 1 --2- 172.21.15.110:0/3180829438 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faf34004510 0x7faf34004990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:31.559 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.550+0000 7faf52d9d700 1 -- 172.21.15.110:0/3180829438 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf34003760 msgr2=0x7faf34003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:31.559 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.550+0000 7faf52d9d700 1 --2- 172.21.15.110:0/3180829438 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf34003760 0x7faf34003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:31.559 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.550+0000 7faf52d9d700 1 -- 172.21.15.110:0/3180829438 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf34003270 con 0x7faf34004e80 2021-03-25T14:16:31.559 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.550+0000 7faf5259c700 1 --2- 172.21.15.110:0/3180829438 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf34003760 0x7faf34003b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:16:31.559 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.550+0000 7faf52d9d700 1 -- 172.21.15.110:0/3180829438 reap_dead start 2021-03-25T14:16:31.559 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.550+0000 7faf52d9d700 1 --2- 172.21.15.110:0/3180829438 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf34004e80 0x7faf3400b760 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7faf4c009ed0 tx=0x7faf4c009220).ready entity=mon.0 client_cookie=9ecb0f22cf73b78b server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:31.559 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.551+0000 7faf51d9b700 1 -- 172.21.15.110:0/3180829438 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c0095f0 con 0x7faf34004e80 2021-03-25T14:16:31.560 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.551+0000 7faf51d9b700 1 -- 172.21.15.110:0/3180829438 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4c00ec80 con 0x7faf34004e80 2021-03-25T14:16:31.560 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.551+0000 7faf51d9b700 1 -- 172.21.15.110:0/3180829438 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c0123f0 con 0x7faf34004e80 2021-03-25T14:16:31.560 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.551+0000 7faf58f78700 1 -- 172.21.15.110:0/3180829438 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf34004e80 msgr2=0x7faf3400b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:31.560 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.551+0000 7faf58f78700 1 --2- 172.21.15.110:0/3180829438 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf34004e80 0x7faf3400b760 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7faf4c009ed0 tx=0x7faf4c009220).stop 2021-03-25T14:16:31.560 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.551+0000 7faf58f78700 1 -- 172.21.15.110:0/3180829438 shutdown_connections 2021-03-25T14:16:31.560 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.551+0000 7faf58f78700 1 --2- 172.21.15.110:0/3180829438 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf34004e80 0x7faf3400b760 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:31.560 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.551+0000 7faf58f78700 1 -- 172.21.15.110:0/3180829438 >> 172.21.15.110:0/3180829438 conn(0x7faf540616d0 msgr2=0x7faf540bdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:31.560 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.551+0000 7faf58f78700 1 -- 172.21.15.110:0/3180829438 shutdown_connections 2021-03-25T14:16:31.560 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.551+0000 7faf58f78700 1 -- 172.21.15.110:0/3180829438 wait complete. 2021-03-25T14:16:31.560 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.552+0000 7faf58f78700 1 Processor -- start 2021-03-25T14:16:31.560 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.552+0000 7faf58f78700 1 -- start start 2021-03-25T14:16:31.560 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.553+0000 7faf58f78700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faf34004e80 0x7faf54158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:31.560 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.553+0000 7faf58f78700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf54143e30 0x7faf5414e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:31.561 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.553+0000 7faf58f78700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf5415cb60 0x7faf5415cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:31.561 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.553+0000 7faf58f78700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5415c490 con 0x7faf5415cb60 2021-03-25T14:16:31.561 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.553+0000 7faf58f78700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf540a1720 con 0x7faf54143e30 2021-03-25T14:16:31.561 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.553+0000 7faf58f78700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf540a1c30 con 0x7faf34004e80 2021-03-25T14:16:31.561 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.553+0000 7faf52d9d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf5415cb60 0x7faf5415cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:31.561 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.553+0000 7faf52d9d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf5415cb60 0x7faf5415cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48032/0 (socket says 172.21.15.110:48032) 2021-03-25T14:16:31.561 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.553+0000 7faf52d9d700 1 -- 172.21.15.110:0/2845448441 learned_addr learned my addr 172.21.15.110:0/2845448441 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:31.561 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.553+0000 7faf4bfff700 1 --2- 172.21.15.110:0/2845448441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf54143e30 0x7faf5414e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:31.561 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.553+0000 7faf5259c700 1 --2- 172.21.15.110:0/2845448441 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faf34004e80 0x7faf54158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:31.561 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.553+0000 7faf52d9d700 1 -- 172.21.15.110:0/2845448441 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faf34004e80 msgr2=0x7faf54158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:31.561 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.553+0000 7faf52d9d700 1 --2- 172.21.15.110:0/2845448441 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faf34004e80 0x7faf54158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:31.561 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.553+0000 7faf52d9d700 1 -- 172.21.15.110:0/2845448441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf54143e30 msgr2=0x7faf5414e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:31.562 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.553+0000 7faf52d9d700 1 --2- 172.21.15.110:0/2845448441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf54143e30 0x7faf5414e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:31.562 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.553+0000 7faf52d9d700 1 -- 172.21.15.110:0/2845448441 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5415c6c0 con 0x7faf5415cb60 2021-03-25T14:16:31.562 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.553+0000 7faf52d9d700 1 --2- 172.21.15.110:0/2845448441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf5415cb60 0x7faf5415cfa0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7faf4c008000 tx=0x7faf4c019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:31.562 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.554+0000 7faf4a7fc700 1 -- 172.21.15.110:0/2845448441 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c01b460 con 0x7faf5415cb60 2021-03-25T14:16:31.562 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.554+0000 7faf4a7fc700 1 -- 172.21.15.110:0/2845448441 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4c01b5c0 con 0x7faf5415cb60 2021-03-25T14:16:31.562 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.554+0000 7faf58f78700 1 -- 172.21.15.110:0/2845448441 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf540a1ed0 con 0x7faf5415cb60 2021-03-25T14:16:31.562 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.554+0000 7faf4a7fc700 1 -- 172.21.15.110:0/2845448441 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c01b960 con 0x7faf5415cb60 2021-03-25T14:16:31.562 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.554+0000 7faf58f78700 1 -- 172.21.15.110:0/2845448441 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf54149490 con 0x7faf5415cb60 2021-03-25T14:16:31.562 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.555+0000 7faf58f78700 1 -- 172.21.15.110:0/2845448441 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf5415c850 con 0x7faf5415cb60 2021-03-25T14:16:31.563 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.555+0000 7faf4a7fc700 1 -- 172.21.15.110:0/2845448441 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7faf4c018020 con 0x7faf5415cb60 2021-03-25T14:16:31.563 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.555+0000 7faf4a7fc700 1 --2- 172.21.15.110:0/2845448441 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7faf3805a0b0 0x7faf3805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:31.563 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.555+0000 7faf4a7fc700 1 -- 172.21.15.110:0/2845448441 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7faf4c075b00 con 0x7faf5415cb60 2021-03-25T14:16:31.563 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.555+0000 7faf5259c700 1 --2- 172.21.15.110:0/2845448441 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7faf3805a0b0 0x7faf3805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:31.564 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.556+0000 7faf5259c700 1 --2- 172.21.15.110:0/2845448441 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7faf3805a0b0 0x7faf3805c570 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7faf44001e70 tx=0x7faf44007800).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:31.564 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.559+0000 7faf4a7fc700 1 -- 172.21.15.110:0/2845448441 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7faf4c0491b0 con 0x7faf5415cb60 2021-03-25T14:16:31.713 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.711+0000 7faf58f78700 1 -- 172.21.15.110:0/2845448441 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faf5405d7b0 con 0x7faf5415cb60 2021-03-25T14:16:31.713 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.711+0000 7faf4a7fc700 1 -- 172.21.15.110:0/2845448441 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faf4c04c7d0 con 0x7faf5415cb60 2021-03-25T14:16:31.714 INFO:teuthology.orchestra.run.smithi110.stdout:55834574857 2021-03-25T14:16:31.715 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.713+0000 7faf58f78700 1 -- 172.21.15.110:0/2845448441 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7faf3805a0b0 msgr2=0x7faf3805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:31.715 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.713+0000 7faf58f78700 1 --2- 172.21.15.110:0/2845448441 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7faf3805a0b0 0x7faf3805c570 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7faf44001e70 tx=0x7faf44007800).stop 2021-03-25T14:16:31.715 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.713+0000 7faf58f78700 1 -- 172.21.15.110:0/2845448441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf5415cb60 msgr2=0x7faf5415cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:31.715 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.713+0000 7faf58f78700 1 --2- 172.21.15.110:0/2845448441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf5415cb60 0x7faf5415cfa0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7faf4c008000 tx=0x7faf4c019000).stop 2021-03-25T14:16:31.716 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.713+0000 7faf58f78700 1 -- 172.21.15.110:0/2845448441 shutdown_connections 2021-03-25T14:16:31.716 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.713+0000 7faf58f78700 1 --2- 172.21.15.110:0/2845448441 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7faf3805a0b0 0x7faf3805c570 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:31.716 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.713+0000 7faf58f78700 1 --2- 172.21.15.110:0/2845448441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf5415cb60 0x7faf5415cfa0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:31.716 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.713+0000 7faf58f78700 1 --2- 172.21.15.110:0/2845448441 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faf34004e80 0x7faf54158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:31.716 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.713+0000 7faf58f78700 1 --2- 172.21.15.110:0/2845448441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf54143e30 0x7faf5414e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:31.716 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.713+0000 7faf58f78700 1 -- 172.21.15.110:0/2845448441 >> 172.21.15.110:0/2845448441 conn(0x7faf540616d0 msgr2=0x7faf540bdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:31.716 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.713+0000 7faf58f78700 1 -- 172.21.15.110:0/2845448441 shutdown_connections 2021-03-25T14:16:31.716 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.713+0000 7faf58f78700 1 -- 172.21.15.110:0/2845448441 wait complete. 2021-03-25T14:16:31.726 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2021-03-25T14:16:31.727 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2021-03-25T14:16:31.839 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.837+0000 7f27c9975700 1 Processor -- start 2021-03-25T14:16:31.839 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.837+0000 7f27c9975700 1 -- start start 2021-03-25T14:16:31.842 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.838+0000 7f27c9975700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f27c40b6410 0x7f27c40ba870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:31.842 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.838+0000 7f27c9975700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27c40bad60 0x7f27c40bc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:31.842 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.838+0000 7f27c9975700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27c40bb2d0 con 0x7f27c40b67f0 2021-03-25T14:16:31.842 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.838+0000 7f27c9975700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27c40bb570 con 0x7f27c40b6410 2021-03-25T14:16:31.842 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.838+0000 7f27c9975700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c40bb810 con 0x7f27c40bad60 2021-03-25T14:16:31.842 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.838+0000 7f27c2ffd700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f27c40b6410 0x7f27c40ba870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:31.842 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.838+0000 7f27c2ffd700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f27c40b6410 0x7f27c40ba870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48036/0 (socket says 172.21.15.110:48036) 2021-03-25T14:16:31.842 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.838+0000 7f27c2ffd700 1 -- 172.21.15.110:0/3368561133 learned_addr learned my addr 172.21.15.110:0/3368561133 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:31.843 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.838+0000 7f27c37fe700 1 --2- 172.21.15.110:0/3368561133 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27c40bad60 0x7f27c40bc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:31.843 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.839+0000 7f27c2ffd700 1 -- 172.21.15.110:0/3368561133 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27c40bad60 msgr2=0x7f27c40bc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:31.843 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.839+0000 7f27c2ffd700 1 --2- 172.21.15.110:0/3368561133 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27c40bad60 0x7f27c40bc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:31.843 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.839+0000 7f27c2ffd700 1 -- 172.21.15.110:0/3368561133 >> v1:172.21.15.174:6789/0 conn(0x7f27c40b67f0 legacy=0x7f27c4149ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:31.843 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.839+0000 7f27c2ffd700 1 -- 172.21.15.110:0/3368561133 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c40bc210 con 0x7f27c40b6410 2021-03-25T14:16:31.843 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.839+0000 7f27c2ffd700 1 --2- 172.21.15.110:0/3368561133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27c40b6410 0x7f27c40ba870 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f27b400ba20 tx=0x7f27b4006ee0).ready entity=mon.0 client_cookie=c893f4acb0fc5d98 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:31.843 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.839+0000 7f27c27fc700 1 -- 172.21.15.110:0/3368561133 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b40098d0 con 0x7f27c40b6410 2021-03-25T14:16:31.843 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.839+0000 7f27c27fc700 1 -- 172.21.15.110:0/3368561133 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b4009a30 con 0x7f27c40b6410 2021-03-25T14:16:31.843 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.839+0000 7f27c27fc700 1 -- 172.21.15.110:0/3368561133 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b4009db0 con 0x7f27c40b6410 2021-03-25T14:16:31.843 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.839+0000 7f27c9975700 1 -- 172.21.15.110:0/3368561133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27c40b6410 msgr2=0x7f27c40ba870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:31.843 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.839+0000 7f27c9975700 1 --2- 172.21.15.110:0/3368561133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27c40b6410 0x7f27c40ba870 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f27b400ba20 tx=0x7f27b4006ee0).stop 2021-03-25T14:16:31.843 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.839+0000 7f27c9975700 1 -- 172.21.15.110:0/3368561133 shutdown_connections 2021-03-25T14:16:31.843 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.839+0000 7f27c9975700 1 --2- 172.21.15.110:0/3368561133 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27c40bad60 0x7f27c40bc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:31.844 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.839+0000 7f27c9975700 1 --2- 172.21.15.110:0/3368561133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27c40b6410 0x7f27c40ba870 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:31.844 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.839+0000 7f27c9975700 1 -- 172.21.15.110:0/3368561133 >> 172.21.15.110:0/3368561133 conn(0x7f27c4060c40 msgr2=0x7f27c4061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:31.844 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.839+0000 7f27c9975700 1 -- 172.21.15.110:0/3368561133 shutdown_connections 2021-03-25T14:16:31.844 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.839+0000 7f27c9975700 1 -- 172.21.15.110:0/3368561133 wait complete. 2021-03-25T14:16:31.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.840+0000 7f27c9975700 1 Processor -- start 2021-03-25T14:16:31.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.841+0000 7f27c9975700 1 -- start start 2021-03-25T14:16:31.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.841+0000 7f27c9975700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27c40b6410 0x7f27c4063250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:31.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.841+0000 7f27c9975700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27c40b67f0 0x7f27c4141010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:31.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.841+0000 7f27c9975700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27c40bad60 0x7f27c4141500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:31.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.841+0000 7f27c9975700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c40a5cb0 con 0x7f27c40bad60 2021-03-25T14:16:31.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.841+0000 7f27c9975700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c414c330 con 0x7f27c40b6410 2021-03-25T14:16:31.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.841+0000 7f27c9975700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c414c5d0 con 0x7f27c40b67f0 2021-03-25T14:16:31.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.841+0000 7f27c37fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27c40bad60 0x7f27c4141500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:31.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.841+0000 7f27c37fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27c40bad60 0x7f27c4141500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48046/0 (socket says 172.21.15.110:48046) 2021-03-25T14:16:31.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.841+0000 7f27c37fe700 1 -- 172.21.15.110:0/2553977825 learned_addr learned my addr 172.21.15.110:0/2553977825 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:31.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.841+0000 7f27c2ffd700 1 --2- 172.21.15.110:0/2553977825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27c40b6410 0x7f27c4063250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:31.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.841+0000 7f27bbfff700 1 --2- 172.21.15.110:0/2553977825 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27c40b67f0 0x7f27c4141010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:31.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.841+0000 7f27c37fe700 1 -- 172.21.15.110:0/2553977825 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27c40b67f0 msgr2=0x7f27c4141010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:31.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.841+0000 7f27c37fe700 1 --2- 172.21.15.110:0/2553977825 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27c40b67f0 0x7f27c4141010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:31.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.842+0000 7f27c37fe700 1 -- 172.21.15.110:0/2553977825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27c40b6410 msgr2=0x7f27c4063250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:31.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.842+0000 7f27c37fe700 1 --2- 172.21.15.110:0/2553977825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27c40b6410 0x7f27c4063250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:31.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.842+0000 7f27c37fe700 1 -- 172.21.15.110:0/2553977825 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c414c870 con 0x7f27c40bad60 2021-03-25T14:16:31.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.842+0000 7f27c2ffd700 1 --2- 172.21.15.110:0/2553977825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27c40b6410 0x7f27c4063250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:31.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.842+0000 7f27c37fe700 1 --2- 172.21.15.110:0/2553977825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27c40bad60 0x7f27c4141500 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f27bc00ef50 tx=0x7f27bc009220).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:31.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.842+0000 7f27baffd700 1 -- 172.21.15.110:0/2553977825 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc00cc30 con 0x7f27c40bad60 2021-03-25T14:16:31.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.842+0000 7f27baffd700 1 -- 172.21.15.110:0/2553977825 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27bc00cd90 con 0x7f27c40bad60 2021-03-25T14:16:31.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.842+0000 7f27c9975700 1 -- 172.21.15.110:0/2553977825 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27c414cb10 con 0x7f27c40bad60 2021-03-25T14:16:31.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.842+0000 7f27baffd700 1 -- 172.21.15.110:0/2553977825 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc012620 con 0x7f27c40bad60 2021-03-25T14:16:31.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.842+0000 7f27c9975700 1 -- 172.21.15.110:0/2553977825 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27c4063740 con 0x7f27c40bad60 2021-03-25T14:16:31.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.843+0000 7f27c9975700 1 -- 172.21.15.110:0/2553977825 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27c405d7b0 con 0x7f27c40bad60 2021-03-25T14:16:31.849 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.843+0000 7f27baffd700 1 -- 172.21.15.110:0/2553977825 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f27bc022070 con 0x7f27c40bad60 2021-03-25T14:16:31.849 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.843+0000 7f27baffd700 1 --2- 172.21.15.110:0/2553977825 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f27a805a0b0 0x7f27a805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:31.849 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.843+0000 7f27baffd700 1 -- 172.21.15.110:0/2553977825 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f27bc074880 con 0x7f27c40bad60 2021-03-25T14:16:31.849 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.843+0000 7f27c2ffd700 1 --2- 172.21.15.110:0/2553977825 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f27a805a0b0 0x7f27a805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:31.849 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.844+0000 7f27c2ffd700 1 --2- 172.21.15.110:0/2553977825 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f27a805a0b0 0x7f27a805c570 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f27c40a2740 tx=0x7f27b4016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:31.849 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.847+0000 7f27baffd700 1 -- 172.21.15.110:0/2553977825 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f27bc047f30 con 0x7f27c40bad60 2021-03-25T14:16:31.999 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.997+0000 7f27c9975700 1 -- 172.21.15.110:0/2553977825 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f27c414dbc0 con 0x7f27c40bad60 2021-03-25T14:16:31.999 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.997+0000 7f27baffd700 1 -- 172.21.15.110:0/2553977825 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f27bc016070 con 0x7f27c40bad60 2021-03-25T14:16:31.999 INFO:teuthology.orchestra.run.smithi110.stdout:55834574855 2021-03-25T14:16:32.001 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.999+0000 7f27c9975700 1 -- 172.21.15.110:0/2553977825 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f27a805a0b0 msgr2=0x7f27a805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:32.001 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.999+0000 7f27c9975700 1 --2- 172.21.15.110:0/2553977825 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f27a805a0b0 0x7f27a805c570 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f27c40a2740 tx=0x7f27b4016000).stop 2021-03-25T14:16:32.001 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.999+0000 7f27c9975700 1 -- 172.21.15.110:0/2553977825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27c40bad60 msgr2=0x7f27c4141500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:32.001 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.999+0000 7f27c9975700 1 --2- 172.21.15.110:0/2553977825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27c40bad60 0x7f27c4141500 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f27bc00ef50 tx=0x7f27bc009220).stop 2021-03-25T14:16:32.002 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.999+0000 7f27c9975700 1 -- 172.21.15.110:0/2553977825 shutdown_connections 2021-03-25T14:16:32.002 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.999+0000 7f27c9975700 1 --2- 172.21.15.110:0/2553977825 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f27a805a0b0 0x7f27a805c570 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:32.002 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.999+0000 7f27c9975700 1 --2- 172.21.15.110:0/2553977825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27c40b6410 0x7f27c4063250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:32.002 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.999+0000 7f27c9975700 1 --2- 172.21.15.110:0/2553977825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27c40bad60 0x7f27c4141500 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:32.002 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.999+0000 7f27c9975700 1 --2- 172.21.15.110:0/2553977825 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27c40b67f0 0x7f27c4141010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:32.002 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.999+0000 7f27c9975700 1 -- 172.21.15.110:0/2553977825 >> 172.21.15.110:0/2553977825 conn(0x7f27c4060c40 msgr2=0x7f27c40be5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:32.002 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.999+0000 7f27c9975700 1 -- 172.21.15.110:0/2553977825 shutdown_connections 2021-03-25T14:16:32.002 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:31.999+0000 7f27c9975700 1 -- 172.21.15.110:0/2553977825 wait complete. 2021-03-25T14:16:32.012 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2021-03-25T14:16:32.012 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2021-03-25T14:16:32.122 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.120+0000 7f8bc35be700 1 Processor -- start 2021-03-25T14:16:32.123 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.121+0000 7f8bc35be700 1 -- start start 2021-03-25T14:16:32.126 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.121+0000 7f8bc35be700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8bbc0bc950 0x7f8bbc0bcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:32.126 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.121+0000 7f8bc35be700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bbc0bb2d0 con 0x7f8bbc0b6410 2021-03-25T14:16:32.126 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.121+0000 7f8bc35be700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bbc0bb570 con 0x7f8bbc0b67f0 2021-03-25T14:16:32.126 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.121+0000 7f8bc35be700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bbc0bd2b0 con 0x7f8bbc0bc950 2021-03-25T14:16:32.126 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.121+0000 7f8bc1b5b700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8bbc0bc950 0x7f8bbc0bcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:32.126 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.121+0000 7f8bc135a700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f8bbc0b6410 0x7f8bbc0ba870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:40986/0 (socket says 172.21.15.110:40986) 2021-03-25T14:16:32.126 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.121+0000 7f8bc135a700 1 -- 172.21.15.110:0/1146518809 learned_addr learned my addr 172.21.15.110:0/1146518809 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:32.126 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.122+0000 7f8bc1b5b700 1 -- 172.21.15.110:0/1146518809 >> v1:172.21.15.174:6789/0 conn(0x7f8bbc0b67f0 legacy=0x7f8bbc149ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:32.126 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.122+0000 7f8bc1b5b700 1 -- 172.21.15.110:0/1146518809 >> v1:172.21.15.110:6789/0 conn(0x7f8bbc0b6410 legacy=0x7f8bbc0ba870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:32.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.122+0000 7f8babfff700 1 -- 172.21.15.110:0/1146518809 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3262738218 0 0) 0x7f8bbc0bb2d0 con 0x7f8bbc0b6410 2021-03-25T14:16:32.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.122+0000 7f8bc1b5b700 1 -- 172.21.15.110:0/1146518809 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bbc0bb810 con 0x7f8bbc0bc950 2021-03-25T14:16:32.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.122+0000 7f8bc1b5b700 1 --2- 172.21.15.110:0/1146518809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8bbc0bc950 0x7f8bbc0bcdc0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f8bb4009cc0 tx=0x7f8bb4009220).ready entity=mon.0 client_cookie=42af32eaedb40248 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:32.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.122+0000 7f8babfff700 1 -- 172.21.15.110:0/1146518809 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb400bc80 con 0x7f8bbc0bc950 2021-03-25T14:16:32.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.122+0000 7f8babfff700 1 -- 172.21.15.110:0/1146518809 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb400bde0 con 0x7f8bbc0bc950 2021-03-25T14:16:32.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.122+0000 7f8babfff700 1 -- 172.21.15.110:0/1146518809 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb4011610 con 0x7f8bbc0bc950 2021-03-25T14:16:32.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.122+0000 7f8bc35be700 1 -- 172.21.15.110:0/1146518809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8bbc0bc950 msgr2=0x7f8bbc0bcdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:32.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.122+0000 7f8bc35be700 1 --2- 172.21.15.110:0/1146518809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8bbc0bc950 0x7f8bbc0bcdc0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f8bb4009cc0 tx=0x7f8bb4009220).stop 2021-03-25T14:16:32.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.123+0000 7f8bc35be700 1 -- 172.21.15.110:0/1146518809 shutdown_connections 2021-03-25T14:16:32.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.123+0000 7f8bc35be700 1 --2- 172.21.15.110:0/1146518809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8bbc0bc950 0x7f8bbc0bcdc0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:32.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.123+0000 7f8bc35be700 1 -- 172.21.15.110:0/1146518809 >> 172.21.15.110:0/1146518809 conn(0x7f8bbc060c40 msgr2=0x7f8bbc061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:32.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.123+0000 7f8bc35be700 1 -- 172.21.15.110:0/1146518809 shutdown_connections 2021-03-25T14:16:32.128 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.123+0000 7f8bc35be700 1 -- 172.21.15.110:0/1146518809 wait complete. 2021-03-25T14:16:32.128 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.124+0000 7f8bc35be700 1 Processor -- start 2021-03-25T14:16:32.128 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.124+0000 7f8bc35be700 1 -- start start 2021-03-25T14:16:32.130 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.124+0000 7f8bc35be700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bbc0b6410 0x7f8bbc159be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:32.130 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.124+0000 7f8bc35be700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8bbc0b67f0 0x7f8bbc1448b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:32.130 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.124+0000 7f8bc35be700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8bbc0bc950 0x7f8bbc14c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:32.130 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.124+0000 7f8bc35be700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc15a0d0 con 0x7f8bbc0b67f0 2021-03-25T14:16:32.130 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.124+0000 7f8bc35be700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc14bc00 con 0x7f8bbc0bc950 2021-03-25T14:16:32.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.124+0000 7f8bc35be700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc1451c0 con 0x7f8bbc0b6410 2021-03-25T14:16:32.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.125+0000 7f8bc0b59700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8bbc0b67f0 0x7f8bbc1448b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:32.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.125+0000 7f8bc0b59700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8bbc0b67f0 0x7f8bbc1448b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48060/0 (socket says 172.21.15.110:48060) 2021-03-25T14:16:32.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.125+0000 7f8bc0b59700 1 -- 172.21.15.110:0/3839429133 learned_addr learned my addr 172.21.15.110:0/3839429133 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:32.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.125+0000 7f8bc135a700 1 --2- 172.21.15.110:0/3839429133 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bbc0b6410 0x7f8bbc159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:32.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.125+0000 7f8bc1b5b700 1 --2- 172.21.15.110:0/3839429133 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8bbc0bc950 0x7f8bbc14c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:32.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.125+0000 7f8bc0b59700 1 -- 172.21.15.110:0/3839429133 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bbc0b6410 msgr2=0x7f8bbc159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:32.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.125+0000 7f8bc0b59700 1 --2- 172.21.15.110:0/3839429133 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bbc0b6410 0x7f8bbc159be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:32.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.125+0000 7f8bc0b59700 1 -- 172.21.15.110:0/3839429133 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8bbc0bc950 msgr2=0x7f8bbc14c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:32.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.125+0000 7f8bc0b59700 1 --2- 172.21.15.110:0/3839429133 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8bbc0bc950 0x7f8bbc14c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:32.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.125+0000 7f8bc0b59700 1 -- 172.21.15.110:0/3839429133 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bbc0b73a0 con 0x7f8bbc0b67f0 2021-03-25T14:16:32.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.125+0000 7f8bc0b59700 1 --2- 172.21.15.110:0/3839429133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8bbc0b67f0 0x7f8bbc1448b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f8bac00c710 tx=0x7f8bac007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:32.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.125+0000 7f8ba97fa700 1 -- 172.21.15.110:0/3839429133 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac007020 con 0x7f8bbc0b67f0 2021-03-25T14:16:32.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.125+0000 7f8ba97fa700 1 -- 172.21.15.110:0/3839429133 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bac007180 con 0x7f8bbc0b67f0 2021-03-25T14:16:32.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.126+0000 7f8bc35be700 1 -- 172.21.15.110:0/3839429133 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bbc0b7640 con 0x7f8bbc0b67f0 2021-03-25T14:16:32.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.126+0000 7f8bc35be700 1 -- 172.21.15.110:0/3839429133 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bbc0b78e0 con 0x7f8bbc0b67f0 2021-03-25T14:16:32.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.126+0000 7f8ba97fa700 1 -- 172.21.15.110:0/3839429133 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac007020 con 0x7f8bbc0b67f0 2021-03-25T14:16:32.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.126+0000 7f8bc35be700 1 -- 172.21.15.110:0/3839429133 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bbc14bff0 con 0x7f8bbc0b67f0 2021-03-25T14:16:32.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.127+0000 7f8ba97fa700 1 -- 172.21.15.110:0/3839429133 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f8bac018020 con 0x7f8bbc0b67f0 2021-03-25T14:16:32.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.127+0000 7f8ba97fa700 1 --2- 172.21.15.110:0/3839429133 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f8b9c05a120 0x7f8b9c05c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:32.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.127+0000 7f8ba97fa700 1 -- 172.21.15.110:0/3839429133 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f8bac0735b0 con 0x7f8bbc0b67f0 2021-03-25T14:16:32.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.127+0000 7f8bc135a700 1 --2- 172.21.15.110:0/3839429133 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f8b9c05a120 0x7f8b9c05c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:32.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.128+0000 7f8bc135a700 1 --2- 172.21.15.110:0/3839429133 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f8b9c05a120 0x7f8b9c05c5e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f8bb80011e0 tx=0x7f8bb8009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:32.133 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.131+0000 7f8ba97fa700 1 -- 172.21.15.110:0/3839429133 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f8bac046b50 con 0x7f8bbc0b67f0 2021-03-25T14:16:32.284 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.282+0000 7f8bc35be700 1 -- 172.21.15.110:0/3839429133 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8bbc05d7b0 con 0x7f8bbc0b67f0 2021-03-25T14:16:32.284 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.283+0000 7f8ba97fa700 1 -- 172.21.15.110:0/3839429133 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8bac04a170 con 0x7f8bbc0b67f0 2021-03-25T14:16:32.285 INFO:teuthology.orchestra.run.smithi110.stdout:55834574856 2021-03-25T14:16:32.286 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.284+0000 7f8bc35be700 1 -- 172.21.15.110:0/3839429133 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f8b9c05a120 msgr2=0x7f8b9c05c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:32.286 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.284+0000 7f8bc35be700 1 --2- 172.21.15.110:0/3839429133 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f8b9c05a120 0x7f8b9c05c5e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f8bb80011e0 tx=0x7f8bb8009040).stop 2021-03-25T14:16:32.287 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.284+0000 7f8bc35be700 1 -- 172.21.15.110:0/3839429133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8bbc0b67f0 msgr2=0x7f8bbc1448b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:32.287 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.284+0000 7f8bc35be700 1 --2- 172.21.15.110:0/3839429133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8bbc0b67f0 0x7f8bbc1448b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f8bac00c710 tx=0x7f8bac007c80).stop 2021-03-25T14:16:32.287 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.284+0000 7f8bc35be700 1 -- 172.21.15.110:0/3839429133 shutdown_connections 2021-03-25T14:16:32.287 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.284+0000 7f8bc35be700 1 --2- 172.21.15.110:0/3839429133 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f8b9c05a120 0x7f8b9c05c5e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:32.287 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.284+0000 7f8bc35be700 1 --2- 172.21.15.110:0/3839429133 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8bbc0bc950 0x7f8bbc14c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:32.287 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.284+0000 7f8bc35be700 1 --2- 172.21.15.110:0/3839429133 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bbc0b6410 0x7f8bbc159be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:32.287 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.284+0000 7f8bc35be700 1 --2- 172.21.15.110:0/3839429133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8bbc0b67f0 0x7f8bbc1448b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:32.287 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.284+0000 7f8bc35be700 1 -- 172.21.15.110:0/3839429133 >> 172.21.15.110:0/3839429133 conn(0x7f8bbc060c40 msgr2=0x7f8bbc068a70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:32.287 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.284+0000 7f8bc35be700 1 -- 172.21.15.110:0/3839429133 shutdown_connections 2021-03-25T14:16:32.287 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.284+0000 7f8bc35be700 1 -- 172.21.15.110:0/3839429133 wait complete. 2021-03-25T14:16:32.298 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.2 2021-03-25T14:16:32.298 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2021-03-25T14:16:32.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.407+0000 7f3c5ebf9700 1 Processor -- start 2021-03-25T14:16:32.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.407+0000 7f3c5ebf9700 1 -- start start 2021-03-25T14:16:32.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.408+0000 7f3c5ebf9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3c58063250 0x7f3c58068d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:32.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.408+0000 7f3c5ebf9700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c580ba820 con 0x7f3c5814cb90 2021-03-25T14:16:32.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.408+0000 7f3c5ebf9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c5814d0a0 con 0x7f3c58146c80 2021-03-25T14:16:32.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.408+0000 7f3c5ebf9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c581495c0 con 0x7f3c58063250 2021-03-25T14:16:32.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.408+0000 7f3c5d3f6700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f3c5814cb90 0x7f3c58146570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41004/0 (socket says 172.21.15.110:41004) 2021-03-25T14:16:32.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.408+0000 7f3c5d3f6700 1 -- 172.21.15.110:0/2170079554 learned_addr learned my addr 172.21.15.110:0/2170079554 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:32.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.409+0000 7f3c5dbf7700 1 --2- 172.21.15.110:0/2170079554 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3c58063250 0x7f3c58068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:32.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.409+0000 7f3c5cbf5700 1 -- 172.21.15.110:0/2170079554 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2218958474 0 0) 0x7f3c580ba820 con 0x7f3c5814cb90 2021-03-25T14:16:32.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.409+0000 7f3c5cbf5700 1 -- 172.21.15.110:0/2170079554 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c40003270 con 0x7f3c5814cb90 2021-03-25T14:16:32.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.409+0000 7f3c5cbf5700 1 -- 172.21.15.110:0/2170079554 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3433432323 0 0) 0x7f3c5814d0a0 con 0x7f3c58146c80 2021-03-25T14:16:32.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.409+0000 7f3c5cbf5700 1 -- 172.21.15.110:0/2170079554 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c580ba820 con 0x7f3c58146c80 2021-03-25T14:16:32.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.409+0000 7f3c5cbf5700 1 -- 172.21.15.110:0/2170079554 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4231957275 0 0) 0x7f3c40003270 con 0x7f3c5814cb90 2021-03-25T14:16:32.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.409+0000 7f3c5cbf5700 1 -- 172.21.15.110:0/2170079554 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3c58063250 msgr2=0x7f3c58068d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:32.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.409+0000 7f3c5cbf5700 1 --2- 172.21.15.110:0/2170079554 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3c58063250 0x7f3c58068d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:32.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.409+0000 7f3c5cbf5700 1 -- 172.21.15.110:0/2170079554 >> v1:172.21.15.174:6789/0 conn(0x7f3c58146c80 legacy=0x7f3c581499b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:32.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.409+0000 7f3c5cbf5700 1 -- 172.21.15.110:0/2170079554 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5814d340 con 0x7f3c5814cb90 2021-03-25T14:16:32.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.409+0000 7f3c5cbf5700 1 -- 172.21.15.110:0/2170079554 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f3c4c001520 con 0x7f3c5814cb90 2021-03-25T14:16:32.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.409+0000 7f3c5cbf5700 1 -- 172.21.15.110:0/2170079554 >> v1:172.21.15.110:6789/0 conn(0x7f3c5814cb90 legacy=0x7f3c58146570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:32.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.409+0000 7f3c5cbf5700 1 --2- 172.21.15.110:0/2170079554 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3c58063250 0x7f3c40003920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:32.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.409+0000 7f3c5cbf5700 1 --2- 172.21.15.110:0/2170079554 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c40003e10 0x7f3c40004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:32.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.409+0000 7f3c5cbf5700 1 --2- 172.21.15.110:0/2170079554 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c40004a00 0x7f3c40004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:32.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.409+0000 7f3c5cbf5700 1 -- 172.21.15.110:0/2170079554 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c40005370 con 0x7f3c40004a00 2021-03-25T14:16:32.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.409+0000 7f3c5cbf5700 1 -- 172.21.15.110:0/2170079554 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4000b760 con 0x7f3c40003e10 2021-03-25T14:16:32.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.409+0000 7f3c5cbf5700 1 -- 172.21.15.110:0/2170079554 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4000b8f0 con 0x7f3c58063250 2021-03-25T14:16:32.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.409+0000 7f3c5e3f8700 1 --2- 172.21.15.110:0/2170079554 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c40004a00 0x7f3c40004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:32.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.409+0000 7f3c5d3f6700 1 --2- 172.21.15.110:0/2170079554 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c40003e10 0x7f3c40004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:32.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.409+0000 7f3c5dbf7700 1 --2- 172.21.15.110:0/2170079554 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3c58063250 0x7f3c40003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:32.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.409+0000 7f3c5e3f8700 1 -- 172.21.15.110:0/2170079554 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3c58063250 msgr2=0x7f3c40003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:32.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.409+0000 7f3c5e3f8700 1 --2- 172.21.15.110:0/2170079554 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3c58063250 0x7f3c40003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:32.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.409+0000 7f3c5e3f8700 1 -- 172.21.15.110:0/2170079554 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c40003e10 msgr2=0x7f3c40004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:32.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.409+0000 7f3c5e3f8700 1 --2- 172.21.15.110:0/2170079554 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c40003e10 0x7f3c40004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:32.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.409+0000 7f3c5e3f8700 1 -- 172.21.15.110:0/2170079554 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c40003270 con 0x7f3c40004a00 2021-03-25T14:16:32.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.410+0000 7f3c5e3f8700 1 --2- 172.21.15.110:0/2170079554 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c40004a00 0x7f3c40004e80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f3c50002070 tx=0x7f3c50007f40).ready entity=mon.0 client_cookie=6477c85956272406 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:32.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.410+0000 7f3c5cbf5700 1 -- 172.21.15.110:0/2170079554 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5000cb00 con 0x7f3c40004a00 2021-03-25T14:16:32.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.410+0000 7f3c5cbf5700 1 -- 172.21.15.110:0/2170079554 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5000cc60 con 0x7f3c40004a00 2021-03-25T14:16:32.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.410+0000 7f3c5cbf5700 1 -- 172.21.15.110:0/2170079554 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c500068a0 con 0x7f3c40004a00 2021-03-25T14:16:32.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.410+0000 7f3c5ebf9700 1 -- 172.21.15.110:0/2170079554 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c40004a00 msgr2=0x7f3c40004e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:32.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.410+0000 7f3c5ebf9700 1 --2- 172.21.15.110:0/2170079554 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c40004a00 0x7f3c40004e80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f3c50002070 tx=0x7f3c50007f40).stop 2021-03-25T14:16:32.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.410+0000 7f3c5e3f8700 1 -- 172.21.15.110:0/2170079554 reap_dead start 2021-03-25T14:16:32.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.410+0000 7f3c5ebf9700 1 -- 172.21.15.110:0/2170079554 shutdown_connections 2021-03-25T14:16:32.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.410+0000 7f3c5ebf9700 1 -- 172.21.15.110:0/2170079554 >> 172.21.15.110:0/2170079554 conn(0x7f3c58064900 msgr2=0x7f3c580663e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:32.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.410+0000 7f3c5ebf9700 1 -- 172.21.15.110:0/2170079554 shutdown_connections 2021-03-25T14:16:32.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.410+0000 7f3c5ebf9700 1 -- 172.21.15.110:0/2170079554 wait complete. 2021-03-25T14:16:32.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.411+0000 7f3c5ebf9700 1 Processor -- start 2021-03-25T14:16:32.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.411+0000 7f3c5ebf9700 1 -- start start 2021-03-25T14:16:32.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.412+0000 7f3c5ebf9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3c58143bc0 0x7f3c581372e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:32.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.412+0000 7f3c5ebf9700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c58143fa0 0x7f3c581593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:32.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.412+0000 7f3c5ebf9700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c58149910 0x7f3c58158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:32.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.412+0000 7f3c5ebf9700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5814c230 con 0x7f3c58143fa0 2021-03-25T14:16:32.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.412+0000 7f3c5ebf9700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5814c4d0 con 0x7f3c58149910 2021-03-25T14:16:32.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.412+0000 7f3c5ebf9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c58158ca0 con 0x7f3c58143bc0 2021-03-25T14:16:32.420 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.412+0000 7f3c5d3f6700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c58143fa0 0x7f3c581593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:32.420 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.412+0000 7f3c5d3f6700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c58143fa0 0x7f3c581593e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48080/0 (socket says 172.21.15.110:48080) 2021-03-25T14:16:32.420 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.412+0000 7f3c5d3f6700 1 -- 172.21.15.110:0/547488454 learned_addr learned my addr 172.21.15.110:0/547488454 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:32.420 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.412+0000 7f3c5e3f8700 1 --2- 172.21.15.110:0/547488454 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c58149910 0x7f3c58158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:32.420 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.412+0000 7f3c5dbf7700 1 --2- 172.21.15.110:0/547488454 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3c58143bc0 0x7f3c581372e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:32.420 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.412+0000 7f3c5d3f6700 1 -- 172.21.15.110:0/547488454 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3c58143bc0 msgr2=0x7f3c581372e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:32.420 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.412+0000 7f3c5d3f6700 1 --2- 172.21.15.110:0/547488454 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3c58143bc0 0x7f3c581372e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:32.420 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.412+0000 7f3c5d3f6700 1 -- 172.21.15.110:0/547488454 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c58149910 msgr2=0x7f3c58158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:32.420 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.412+0000 7f3c5d3f6700 1 --2- 172.21.15.110:0/547488454 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c58149910 0x7f3c58158080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:32.420 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.412+0000 7f3c5d3f6700 1 -- 172.21.15.110:0/547488454 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c58158f40 con 0x7f3c58143fa0 2021-03-25T14:16:32.420 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.412+0000 7f3c5d3f6700 1 --2- 172.21.15.110:0/547488454 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c58143fa0 0x7f3c581593e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f3c4c004590 tx=0x7f3c58068c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:32.420 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.413+0000 7f3c49ffb700 1 -- 172.21.15.110:0/547488454 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c00f600 con 0x7f3c58143fa0 2021-03-25T14:16:32.421 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.413+0000 7f3c49ffb700 1 -- 172.21.15.110:0/547488454 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4c00f760 con 0x7f3c58143fa0 2021-03-25T14:16:32.421 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.413+0000 7f3c5ebf9700 1 -- 172.21.15.110:0/547488454 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c5814c770 con 0x7f3c58143fa0 2021-03-25T14:16:32.421 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.413+0000 7f3c49ffb700 1 -- 172.21.15.110:0/547488454 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c00fb00 con 0x7f3c58143fa0 2021-03-25T14:16:32.421 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.413+0000 7f3c5ebf9700 1 -- 172.21.15.110:0/547488454 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c580b8830 con 0x7f3c58143fa0 2021-03-25T14:16:32.421 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.414+0000 7f3c5ebf9700 1 -- 172.21.15.110:0/547488454 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c581590d0 con 0x7f3c58143fa0 2021-03-25T14:16:32.421 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.414+0000 7f3c49ffb700 1 -- 172.21.15.110:0/547488454 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f3c4c01b030 con 0x7f3c58143fa0 2021-03-25T14:16:32.422 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.414+0000 7f3c49ffb700 1 --2- 172.21.15.110:0/547488454 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3c3805a0b0 0x7f3c3805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:32.422 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.414+0000 7f3c49ffb700 1 -- 172.21.15.110:0/547488454 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f3c4c0734f0 con 0x7f3c58143fa0 2021-03-25T14:16:32.422 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.414+0000 7f3c5dbf7700 1 --2- 172.21.15.110:0/547488454 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3c3805a0b0 0x7f3c3805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:32.422 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.415+0000 7f3c5dbf7700 1 --2- 172.21.15.110:0/547488454 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3c3805a0b0 0x7f3c3805c570 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f3c54006ac0 tx=0x7f3c54006e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:32.422 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.418+0000 7f3c49ffb700 1 -- 172.21.15.110:0/547488454 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f3c4c046c50 con 0x7f3c58143fa0 2021-03-25T14:16:32.569 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.568+0000 7f3c5ebf9700 1 -- 172.21.15.110:0/547488454 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3c58045ae0 con 0x7f3c58143fa0 2021-03-25T14:16:32.570 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.568+0000 7f3c49ffb700 1 -- 172.21.15.110:0/547488454 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3c4c019020 con 0x7f3c58143fa0 2021-03-25T14:16:32.570 INFO:teuthology.orchestra.run.smithi110.stdout:55834574855 2021-03-25T14:16:32.572 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.570+0000 7f3c5ebf9700 1 -- 172.21.15.110:0/547488454 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3c3805a0b0 msgr2=0x7f3c3805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:32.572 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.570+0000 7f3c5ebf9700 1 --2- 172.21.15.110:0/547488454 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3c3805a0b0 0x7f3c3805c570 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f3c54006ac0 tx=0x7f3c54006e20).stop 2021-03-25T14:16:32.572 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.570+0000 7f3c5ebf9700 1 -- 172.21.15.110:0/547488454 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c58143fa0 msgr2=0x7f3c581593e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:32.572 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.570+0000 7f3c5ebf9700 1 --2- 172.21.15.110:0/547488454 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c58143fa0 0x7f3c581593e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f3c4c004590 tx=0x7f3c58068c30).stop 2021-03-25T14:16:32.572 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.570+0000 7f3c5ebf9700 1 -- 172.21.15.110:0/547488454 shutdown_connections 2021-03-25T14:16:32.572 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.570+0000 7f3c5ebf9700 1 --2- 172.21.15.110:0/547488454 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3c3805a0b0 0x7f3c3805c570 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:32.572 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.570+0000 7f3c5ebf9700 1 --2- 172.21.15.110:0/547488454 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c58149910 0x7f3c58158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:32.572 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.570+0000 7f3c5ebf9700 1 --2- 172.21.15.110:0/547488454 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3c58143bc0 0x7f3c581372e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:32.572 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.570+0000 7f3c5ebf9700 1 --2- 172.21.15.110:0/547488454 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c58143fa0 0x7f3c581593e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:32.573 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.570+0000 7f3c5ebf9700 1 -- 172.21.15.110:0/547488454 >> 172.21.15.110:0/547488454 conn(0x7f3c58064900 msgr2=0x7f3c58144e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:32.573 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.570+0000 7f3c5ebf9700 1 -- 172.21.15.110:0/547488454 shutdown_connections 2021-03-25T14:16:32.573 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.570+0000 7f3c5ebf9700 1 -- 172.21.15.110:0/547488454 wait complete. 2021-03-25T14:16:32.583 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2021-03-25T14:16:32.583 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2021-03-25T14:16:32.694 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.692+0000 7f67ee879700 1 Processor -- start 2021-03-25T14:16:32.694 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.692+0000 7f67ee879700 1 -- start start 2021-03-25T14:16:32.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.693+0000 7f67ee879700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67e80b62c0 0x7f67e80b6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:32.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.693+0000 7f67ee879700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f67e80bbe10 0x7f67e80bc260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:32.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.693+0000 7f67ee879700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67e80bacd0 con 0x7f67e8149c40 2021-03-25T14:16:32.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.693+0000 7f67ee879700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67e81472c0 con 0x7f67e80bbe10 2021-03-25T14:16:32.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.693+0000 7f67ee879700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67e80baf70 con 0x7f67e80b62c0 2021-03-25T14:16:32.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.693+0000 7f67ece16700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f67e80bbe10 0x7f67e80bc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:32.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.693+0000 7f67ece16700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f67e80bbe10 0x7f67e80bc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48088/0 (socket says 172.21.15.110:48088) 2021-03-25T14:16:32.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.693+0000 7f67ece16700 1 -- 172.21.15.110:0/3891726692 learned_addr learned my addr 172.21.15.110:0/3891726692 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:32.701 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.693+0000 7f67e77fe700 1 --2- 172.21.15.110:0/3891726692 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67e80b62c0 0x7f67e80b6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:32.701 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.693+0000 7f67ece16700 1 -- 172.21.15.110:0/3891726692 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67e80b62c0 msgr2=0x7f67e80b6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:32.701 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.693+0000 7f67ece16700 1 --2- 172.21.15.110:0/3891726692 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67e80b62c0 0x7f67e80b6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:32.701 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.693+0000 7f67ece16700 1 -- 172.21.15.110:0/3891726692 >> v1:172.21.15.174:6789/0 conn(0x7f67e8149c40 legacy=0x7f67e814a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:32.701 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.693+0000 7f67ece16700 1 -- 172.21.15.110:0/3891726692 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e80bb210 con 0x7f67e80bbe10 2021-03-25T14:16:32.701 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.693+0000 7f67ece16700 1 --2- 172.21.15.110:0/3891726692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67e80bbe10 0x7f67e80bc260 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f67e0009d90 tx=0x7f67e00092d0).ready entity=mon.0 client_cookie=7e881695b6e71365 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:32.701 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.693+0000 7f67e6ffd700 1 -- 172.21.15.110:0/3891726692 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e000bbb0 con 0x7f67e80bbe10 2021-03-25T14:16:32.701 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.693+0000 7f67e6ffd700 1 -- 172.21.15.110:0/3891726692 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e000bd10 con 0x7f67e80bbe10 2021-03-25T14:16:32.701 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.693+0000 7f67e6ffd700 1 -- 172.21.15.110:0/3891726692 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e0011610 con 0x7f67e80bbe10 2021-03-25T14:16:32.701 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.694+0000 7f67ee879700 1 -- 172.21.15.110:0/3891726692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67e80bbe10 msgr2=0x7f67e80bc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:32.701 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.694+0000 7f67ee879700 1 --2- 172.21.15.110:0/3891726692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67e80bbe10 0x7f67e80bc260 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f67e0009d90 tx=0x7f67e00092d0).stop 2021-03-25T14:16:32.701 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.694+0000 7f67ee879700 1 -- 172.21.15.110:0/3891726692 shutdown_connections 2021-03-25T14:16:32.702 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.694+0000 7f67ee879700 1 --2- 172.21.15.110:0/3891726692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67e80bbe10 0x7f67e80bc260 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:32.702 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.694+0000 7f67ee879700 1 --2- 172.21.15.110:0/3891726692 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67e80b62c0 0x7f67e80b6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:32.702 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.694+0000 7f67ee879700 1 -- 172.21.15.110:0/3891726692 >> 172.21.15.110:0/3891726692 conn(0x7f67e8060c40 msgr2=0x7f67e8061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:32.702 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.694+0000 7f67ee879700 1 -- 172.21.15.110:0/3891726692 shutdown_connections 2021-03-25T14:16:32.702 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.694+0000 7f67ee879700 1 -- 172.21.15.110:0/3891726692 wait complete. 2021-03-25T14:16:32.702 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.695+0000 7f67ee879700 1 Processor -- start 2021-03-25T14:16:32.702 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.695+0000 7f67ee879700 1 -- start start 2021-03-25T14:16:32.702 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.696+0000 7f67ee879700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67e80b62c0 0x7f67e8159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:32.702 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.696+0000 7f67ee879700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f67e80bbe10 0x7f67e80a3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:32.702 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.696+0000 7f67ee879700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67e8149c40 0x7f67e80bf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:32.702 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.696+0000 7f67ee879700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e80a3970 con 0x7f67e8149c40 2021-03-25T14:16:32.702 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.696+0000 7f67ee879700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e80bfae0 con 0x7f67e80bbe10 2021-03-25T14:16:32.703 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.696+0000 7f67ee879700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67e80a3b90 con 0x7f67e80b62c0 2021-03-25T14:16:32.703 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.696+0000 7f67ece16700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67e8149c40 0x7f67e80bf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:32.703 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.696+0000 7f67ece16700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67e8149c40 0x7f67e80bf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48094/0 (socket says 172.21.15.110:48094) 2021-03-25T14:16:32.703 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.696+0000 7f67ece16700 1 -- 172.21.15.110:0/2010918673 learned_addr learned my addr 172.21.15.110:0/2010918673 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:32.703 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.696+0000 7f67e7fff700 1 --2- 172.21.15.110:0/2010918673 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67e80b62c0 0x7f67e8159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:32.703 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.696+0000 7f67e77fe700 1 --2- 172.21.15.110:0/2010918673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f67e80bbe10 0x7f67e80a3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:32.703 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.696+0000 7f67ece16700 1 -- 172.21.15.110:0/2010918673 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67e80b62c0 msgr2=0x7f67e8159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:32.703 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.696+0000 7f67ece16700 1 --2- 172.21.15.110:0/2010918673 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67e80b62c0 0x7f67e8159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:32.703 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.696+0000 7f67ece16700 1 -- 172.21.15.110:0/2010918673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f67e80bbe10 msgr2=0x7f67e80a3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:32.703 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.696+0000 7f67ece16700 1 --2- 172.21.15.110:0/2010918673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f67e80bbe10 0x7f67e80a3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:32.703 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.696+0000 7f67ece16700 1 -- 172.21.15.110:0/2010918673 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e80a3e30 con 0x7f67e8149c40 2021-03-25T14:16:32.703 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.696+0000 7f67e77fe700 1 --2- 172.21.15.110:0/2010918673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f67e80bbe10 0x7f67e80a3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:32.704 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.696+0000 7f67ece16700 1 --2- 172.21.15.110:0/2010918673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67e8149c40 0x7f67e80bf5f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f67e0006fd0 tx=0x7f67e0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:32.704 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.697+0000 7f67cffff700 1 -- 172.21.15.110:0/2010918673 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e000bbb0 con 0x7f67e8149c40 2021-03-25T14:16:32.704 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.697+0000 7f67cffff700 1 -- 172.21.15.110:0/2010918673 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e0011e70 con 0x7f67e8149c40 2021-03-25T14:16:32.704 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.697+0000 7f67ee879700 1 -- 172.21.15.110:0/2010918673 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67e8159230 con 0x7f67e8149c40 2021-03-25T14:16:32.704 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.697+0000 7f67cffff700 1 -- 172.21.15.110:0/2010918673 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e0010d20 con 0x7f67e8149c40 2021-03-25T14:16:32.704 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.697+0000 7f67ee879700 1 -- 172.21.15.110:0/2010918673 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67e8159770 con 0x7f67e8149c40 2021-03-25T14:16:32.704 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.698+0000 7f67ee879700 1 -- 172.21.15.110:0/2010918673 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67e80bb690 con 0x7f67e8149c40 2021-03-25T14:16:32.704 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.698+0000 7f67cffff700 1 -- 172.21.15.110:0/2010918673 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f67e000f070 con 0x7f67e8149c40 2021-03-25T14:16:32.704 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.698+0000 7f67cffff700 1 --2- 172.21.15.110:0/2010918673 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f67c805a0b0 0x7f67c805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:32.704 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.698+0000 7f67cffff700 1 -- 172.21.15.110:0/2010918673 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f67e0075f50 con 0x7f67e8149c40 2021-03-25T14:16:32.704 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.698+0000 7f67e7fff700 1 --2- 172.21.15.110:0/2010918673 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f67c805a0b0 0x7f67c805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:32.705 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.698+0000 7f67e7fff700 1 --2- 172.21.15.110:0/2010918673 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f67c805a0b0 0x7f67c805c570 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f67d800c8a0 tx=0x7f67d8008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:32.705 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.702+0000 7f67cffff700 1 -- 172.21.15.110:0/2010918673 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f67e0049600 con 0x7f67e8149c40 2021-03-25T14:16:32.855 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.852+0000 7f67ee879700 1 -- 172.21.15.110:0/2010918673 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f67e805d7b0 con 0x7f67e8149c40 2021-03-25T14:16:32.855 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.853+0000 7f67cffff700 1 -- 172.21.15.110:0/2010918673 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f67e004cc20 con 0x7f67e8149c40 2021-03-25T14:16:32.855 INFO:teuthology.orchestra.run.smithi110.stdout:55834574857 2021-03-25T14:16:32.856 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.854+0000 7f67ee879700 1 -- 172.21.15.110:0/2010918673 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f67c805a0b0 msgr2=0x7f67c805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:32.857 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.854+0000 7f67ee879700 1 --2- 172.21.15.110:0/2010918673 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f67c805a0b0 0x7f67c805c570 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f67d800c8a0 tx=0x7f67d8008040).stop 2021-03-25T14:16:32.857 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.854+0000 7f67ee879700 1 -- 172.21.15.110:0/2010918673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67e8149c40 msgr2=0x7f67e80bf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:32.857 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.854+0000 7f67ee879700 1 --2- 172.21.15.110:0/2010918673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67e8149c40 0x7f67e80bf5f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f67e0006fd0 tx=0x7f67e0017000).stop 2021-03-25T14:16:32.857 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.854+0000 7f67ee879700 1 -- 172.21.15.110:0/2010918673 shutdown_connections 2021-03-25T14:16:32.857 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.854+0000 7f67ee879700 1 --2- 172.21.15.110:0/2010918673 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f67c805a0b0 0x7f67c805c570 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:32.857 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.854+0000 7f67ee879700 1 --2- 172.21.15.110:0/2010918673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67e8149c40 0x7f67e80bf5f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:32.857 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.854+0000 7f67ee879700 1 --2- 172.21.15.110:0/2010918673 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67e80b62c0 0x7f67e8159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:32.857 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.854+0000 7f67ee879700 1 --2- 172.21.15.110:0/2010918673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f67e80bbe10 0x7f67e80a3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:32.857 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.854+0000 7f67ee879700 1 -- 172.21.15.110:0/2010918673 >> 172.21.15.110:0/2010918673 conn(0x7f67e8060c40 msgr2=0x7f67e8148e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:32.857 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.854+0000 7f67ee879700 1 -- 172.21.15.110:0/2010918673 shutdown_connections 2021-03-25T14:16:32.857 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.854+0000 7f67ee879700 1 -- 172.21.15.110:0/2010918673 wait complete. 2021-03-25T14:16:32.868 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.4 2021-03-25T14:16:32.868 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2021-03-25T14:16:32.978 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.976+0000 7f0eb3ba1700 1 Processor -- start 2021-03-25T14:16:32.978 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.976+0000 7f0eb3ba1700 1 -- start start 2021-03-25T14:16:32.981 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.977+0000 7f0eb3ba1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0eac0be5a0 0x7f0eac09d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:32.981 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.977+0000 7f0eb3ba1700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0eac0b9ba0 0x7f0eac143270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:32.981 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.977+0000 7f0eb3ba1700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eac14d0e0 con 0x7f0eac143760 2021-03-25T14:16:32.981 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.977+0000 7f0eb3ba1700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eac14d380 con 0x7f0eac0b9ba0 2021-03-25T14:16:32.981 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.977+0000 7f0eb3ba1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eac14d620 con 0x7f0eac0be5a0 2021-03-25T14:16:32.982 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.977+0000 7f0eb113c700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0eac0b9ba0 0x7f0eac143270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:32.982 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.977+0000 7f0eb213e700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f0eac143760 0x7f0eac149a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41036/0 (socket says 172.21.15.110:41036) 2021-03-25T14:16:32.982 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.977+0000 7f0eb213e700 1 -- 172.21.15.110:0/2123290480 learned_addr learned my addr 172.21.15.110:0/2123290480 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:32.982 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.977+0000 7f0eb193d700 1 --2- 172.21.15.110:0/2123290480 >> v2:172.21.15.174:3300/0 conn(0x7f0eac0be5a0 0x7f0eac09d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:32.982 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.977+0000 7f0eb113c700 1 -- 172.21.15.110:0/2123290480 >> v2:172.21.15.174:3300/0 conn(0x7f0eac0be5a0 msgr2=0x7f0eac09d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:32.982 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.977+0000 7f0eb113c700 1 --2- 172.21.15.110:0/2123290480 >> v2:172.21.15.174:3300/0 conn(0x7f0eac0be5a0 0x7f0eac09d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:32.982 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.977+0000 7f0eb113c700 1 -- 172.21.15.110:0/2123290480 >> v1:172.21.15.110:6789/0 conn(0x7f0eac143760 legacy=0x7f0eac149a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:32.982 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.977+0000 7f0eb093b700 1 -- 172.21.15.110:0/2123290480 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1600387922 0 0) 0x7f0eac14d0e0 con 0x7f0eac143760 2021-03-25T14:16:32.982 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.978+0000 7f0eb113c700 1 -- 172.21.15.110:0/2123290480 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eac14d8c0 con 0x7f0eac0b9ba0 2021-03-25T14:16:32.982 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.978+0000 7f0eb113c700 1 --2- 172.21.15.110:0/2123290480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0eac0b9ba0 0x7f0eac143270 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f0eac060560 tx=0x7f0e9c006e20).ready entity=mon.0 client_cookie=4197399b583241ae server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:32.982 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.978+0000 7f0eb093b700 1 -- 172.21.15.110:0/2123290480 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c009870 con 0x7f0eac0b9ba0 2021-03-25T14:16:32.982 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.978+0000 7f0eb093b700 1 -- 172.21.15.110:0/2123290480 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9c0099d0 con 0x7f0eac0b9ba0 2021-03-25T14:16:32.983 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.978+0000 7f0eb093b700 1 -- 172.21.15.110:0/2123290480 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c009d50 con 0x7f0eac0b9ba0 2021-03-25T14:16:32.983 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.978+0000 7f0eb3ba1700 1 -- 172.21.15.110:0/2123290480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0eac0b9ba0 msgr2=0x7f0eac143270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:32.983 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.978+0000 7f0eb3ba1700 1 --2- 172.21.15.110:0/2123290480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0eac0b9ba0 0x7f0eac143270 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f0eac060560 tx=0x7f0e9c006e20).stop 2021-03-25T14:16:32.983 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.978+0000 7f0eb3ba1700 1 -- 172.21.15.110:0/2123290480 shutdown_connections 2021-03-25T14:16:32.983 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.978+0000 7f0eb3ba1700 1 --2- 172.21.15.110:0/2123290480 >> v2:172.21.15.174:3300/0 conn(0x7f0eac0be5a0 0x7f0eac09d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:32.983 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.978+0000 7f0eb3ba1700 1 --2- 172.21.15.110:0/2123290480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0eac0b9ba0 0x7f0eac143270 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:32.983 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.978+0000 7f0eb3ba1700 1 -- 172.21.15.110:0/2123290480 >> 172.21.15.110:0/2123290480 conn(0x7f0eac0616d0 msgr2=0x7f0eac0bdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:32.983 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.978+0000 7f0eb3ba1700 1 -- 172.21.15.110:0/2123290480 shutdown_connections 2021-03-25T14:16:32.983 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.978+0000 7f0eb3ba1700 1 -- 172.21.15.110:0/2123290480 wait complete. 2021-03-25T14:16:32.983 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.979+0000 7f0eb3ba1700 1 Processor -- start 2021-03-25T14:16:32.983 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.979+0000 7f0eb3ba1700 1 -- start start 2021-03-25T14:16:32.986 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.980+0000 7f0eb3ba1700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0eac0b9ba0 0x7f0eac15cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:32.986 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.980+0000 7f0eb3ba1700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0eac0be5a0 0x7f0eac159960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:32.986 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.980+0000 7f0eb3ba1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0eac143760 0x7f0eac0a2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:32.986 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.980+0000 7f0eb3ba1700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac0a1650 con 0x7f0eac0be5a0 2021-03-25T14:16:32.986 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.980+0000 7f0eb3ba1700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac15d420 con 0x7f0eac0b9ba0 2021-03-25T14:16:32.986 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.980+0000 7f0eb3ba1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac0a1880 con 0x7f0eac143760 2021-03-25T14:16:32.986 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.980+0000 7f0eb113c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0eac0be5a0 0x7f0eac159960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:32.987 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.980+0000 7f0eb113c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0eac0be5a0 0x7f0eac159960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48106/0 (socket says 172.21.15.110:48106) 2021-03-25T14:16:32.987 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.980+0000 7f0eb113c700 1 -- 172.21.15.110:0/4123097571 learned_addr learned my addr 172.21.15.110:0/4123097571 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:32.987 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.980+0000 7f0eb193d700 1 --2- 172.21.15.110:0/4123097571 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0eac0b9ba0 0x7f0eac15cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:32.987 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.980+0000 7f0eb213e700 1 --2- 172.21.15.110:0/4123097571 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0eac143760 0x7f0eac0a2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:32.987 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.981+0000 7f0eb113c700 1 -- 172.21.15.110:0/4123097571 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0eac143760 msgr2=0x7f0eac0a2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:32.987 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.981+0000 7f0eb113c700 1 --2- 172.21.15.110:0/4123097571 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0eac143760 0x7f0eac0a2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:32.987 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.981+0000 7f0eb113c700 1 -- 172.21.15.110:0/4123097571 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0eac0b9ba0 msgr2=0x7f0eac15cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:32.987 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.981+0000 7f0eb113c700 1 --2- 172.21.15.110:0/4123097571 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0eac0b9ba0 0x7f0eac15cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:32.987 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.981+0000 7f0eb113c700 1 -- 172.21.15.110:0/4123097571 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eac0a1b20 con 0x7f0eac0be5a0 2021-03-25T14:16:32.987 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.981+0000 7f0eb213e700 1 --2- 172.21.15.110:0/4123097571 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0eac143760 0x7f0eac0a2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:32.987 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.981+0000 7f0eb113c700 1 --2- 172.21.15.110:0/4123097571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0eac0be5a0 0x7f0eac159960 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f0eac0b8570 tx=0x7f0e9c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:32.987 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.981+0000 7f0e99ffb700 1 -- 172.21.15.110:0/4123097571 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c011e70 con 0x7f0eac0be5a0 2021-03-25T14:16:32.987 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.981+0000 7f0e99ffb700 1 -- 172.21.15.110:0/4123097571 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9c01d430 con 0x7f0eac0be5a0 2021-03-25T14:16:32.988 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.981+0000 7f0eb3ba1700 1 -- 172.21.15.110:0/4123097571 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eac159220 con 0x7f0eac0be5a0 2021-03-25T14:16:32.988 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.981+0000 7f0e99ffb700 1 -- 172.21.15.110:0/4123097571 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c01d7b0 con 0x7f0eac0be5a0 2021-03-25T14:16:32.988 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.981+0000 7f0eb3ba1700 1 -- 172.21.15.110:0/4123097571 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eac158f40 con 0x7f0eac0be5a0 2021-03-25T14:16:32.988 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.982+0000 7f0eb3ba1700 1 -- 172.21.15.110:0/4123097571 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eac159680 con 0x7f0eac0be5a0 2021-03-25T14:16:32.988 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.982+0000 7f0e99ffb700 1 -- 172.21.15.110:0/4123097571 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f0e9c024030 con 0x7f0eac0be5a0 2021-03-25T14:16:32.988 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.983+0000 7f0e99ffb700 1 --2- 172.21.15.110:0/4123097571 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f0e8c05a0b0 0x7f0e8c05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:32.988 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.983+0000 7f0e99ffb700 1 -- 172.21.15.110:0/4123097571 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f0e9c075280 con 0x7f0eac0be5a0 2021-03-25T14:16:32.988 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.983+0000 7f0eb193d700 1 --2- 172.21.15.110:0/4123097571 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f0e8c05a0b0 0x7f0e8c05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:32.988 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.983+0000 7f0eb193d700 1 --2- 172.21.15.110:0/4123097571 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f0e8c05a0b0 0x7f0e8c05c570 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f0ea8006fd0 tx=0x7f0ea8008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:32.989 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:32.986+0000 7f0e99ffb700 1 -- 172.21.15.110:0/4123097571 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f0e9c0488d0 con 0x7f0eac0be5a0 2021-03-25T14:16:33.138 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.136+0000 7f0eb3ba1700 1 -- 172.21.15.110:0/4123097571 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f0eac05d7b0 con 0x7f0eac0be5a0 2021-03-25T14:16:33.138 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.136+0000 7f0e99ffb700 1 -- 172.21.15.110:0/4123097571 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0e9c022070 con 0x7f0eac0be5a0 2021-03-25T14:16:33.139 INFO:teuthology.orchestra.run.smithi110.stdout:55834574856 2021-03-25T14:16:33.141 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.138+0000 7f0eb3ba1700 1 -- 172.21.15.110:0/4123097571 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f0e8c05a0b0 msgr2=0x7f0e8c05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:33.141 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.138+0000 7f0eb3ba1700 1 --2- 172.21.15.110:0/4123097571 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f0e8c05a0b0 0x7f0e8c05c570 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f0ea8006fd0 tx=0x7f0ea8008040).stop 2021-03-25T14:16:33.141 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.138+0000 7f0eb3ba1700 1 -- 172.21.15.110:0/4123097571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0eac0be5a0 msgr2=0x7f0eac159960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:33.141 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.138+0000 7f0eb3ba1700 1 --2- 172.21.15.110:0/4123097571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0eac0be5a0 0x7f0eac159960 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f0eac0b8570 tx=0x7f0e9c016000).stop 2021-03-25T14:16:33.141 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.138+0000 7f0eb3ba1700 1 -- 172.21.15.110:0/4123097571 shutdown_connections 2021-03-25T14:16:33.142 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.138+0000 7f0eb3ba1700 1 --2- 172.21.15.110:0/4123097571 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f0e8c05a0b0 0x7f0e8c05c570 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:33.142 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.138+0000 7f0eb3ba1700 1 --2- 172.21.15.110:0/4123097571 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0eac0b9ba0 0x7f0eac15cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:33.142 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.138+0000 7f0eb3ba1700 1 --2- 172.21.15.110:0/4123097571 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0eac143760 0x7f0eac0a2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:33.142 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.138+0000 7f0eb3ba1700 1 --2- 172.21.15.110:0/4123097571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0eac0be5a0 0x7f0eac159960 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:33.142 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.138+0000 7f0eb3ba1700 1 -- 172.21.15.110:0/4123097571 >> 172.21.15.110:0/4123097571 conn(0x7f0eac0616d0 msgr2=0x7f0eac14ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:33.142 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.138+0000 7f0eb3ba1700 1 -- 172.21.15.110:0/4123097571 shutdown_connections 2021-03-25T14:16:33.142 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.138+0000 7f0eb3ba1700 1 -- 172.21.15.110:0/4123097571 wait complete. 2021-03-25T14:16:33.151 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.5 2021-03-25T14:16:33.152 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2021-03-25T14:16:33.263 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.260+0000 7eff6a343700 1 Processor -- start 2021-03-25T14:16:33.263 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.261+0000 7eff6a343700 1 -- start start 2021-03-25T14:16:33.266 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.261+0000 7eff6a343700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff640bc950 0x7eff640bce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:33.266 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.261+0000 7eff6a343700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff640bb2d0 con 0x7eff640b67f0 2021-03-25T14:16:33.266 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.261+0000 7eff6a343700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff640bb570 con 0x7eff640b6410 2021-03-25T14:16:33.266 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.261+0000 7eff6a343700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff640bb810 con 0x7eff640bc950 2021-03-25T14:16:33.266 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.261+0000 7eff637fe700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7eff640b67f0 0x7eff64149ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41046/0 (socket says 172.21.15.110:41046) 2021-03-25T14:16:33.266 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.261+0000 7eff637fe700 1 -- 172.21.15.110:0/2948776156 learned_addr learned my addr 172.21.15.110:0/2948776156 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:33.266 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.262+0000 7eff688e0700 1 --2- 172.21.15.110:0/2948776156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff640bc950 0x7eff640bce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:33.266 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.262+0000 7eff62ffd700 1 -- 172.21.15.110:0/2948776156 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1196475580 0 0) 0x7eff640bb2d0 con 0x7eff640b67f0 2021-03-25T14:16:33.266 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.262+0000 7eff62ffd700 1 -- 172.21.15.110:0/2948776156 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff50003270 con 0x7eff640b67f0 2021-03-25T14:16:33.267 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.262+0000 7eff62ffd700 1 -- 172.21.15.110:0/2948776156 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1604367433 0 0) 0x7eff640bb570 con 0x7eff640b6410 2021-03-25T14:16:33.267 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.262+0000 7eff62ffd700 1 -- 172.21.15.110:0/2948776156 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff640bb2d0 con 0x7eff640b6410 2021-03-25T14:16:33.267 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.262+0000 7eff688e0700 1 -- 172.21.15.110:0/2948776156 >> v1:172.21.15.174:6789/0 conn(0x7eff640b6410 legacy=0x7eff640ba870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:33.267 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.262+0000 7eff62ffd700 1 -- 172.21.15.110:0/2948776156 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2800011152 0 0) 0x7eff50003270 con 0x7eff640b67f0 2021-03-25T14:16:33.267 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.262+0000 7eff688e0700 1 -- 172.21.15.110:0/2948776156 >> v1:172.21.15.110:6789/0 conn(0x7eff640b67f0 legacy=0x7eff64149ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:33.267 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.262+0000 7eff688e0700 1 -- 172.21.15.110:0/2948776156 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff640bc210 con 0x7eff640bc950 2021-03-25T14:16:33.267 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.262+0000 7eff688e0700 1 --2- 172.21.15.110:0/2948776156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff640bc950 0x7eff640bce00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7eff5c009cf0 tx=0x7eff5c009220).ready entity=mon.2 client_cookie=d4a686c72f1e76c9 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:33.267 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.262+0000 7eff62ffd700 1 -- 172.21.15.110:0/2948776156 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c00ba20 con 0x7eff640bc950 2021-03-25T14:16:33.267 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.262+0000 7eff62ffd700 1 -- 172.21.15.110:0/2948776156 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5c00bb80 con 0x7eff640bc950 2021-03-25T14:16:33.267 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.262+0000 7eff62ffd700 1 -- 172.21.15.110:0/2948776156 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c011400 con 0x7eff640bc950 2021-03-25T14:16:33.267 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.263+0000 7eff6a343700 1 -- 172.21.15.110:0/2948776156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff640bc950 msgr2=0x7eff640bce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:33.267 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.263+0000 7eff6a343700 1 --2- 172.21.15.110:0/2948776156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff640bc950 0x7eff640bce00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7eff5c009cf0 tx=0x7eff5c009220).stop 2021-03-25T14:16:33.267 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.263+0000 7eff6a343700 1 -- 172.21.15.110:0/2948776156 shutdown_connections 2021-03-25T14:16:33.268 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.263+0000 7eff6a343700 1 --2- 172.21.15.110:0/2948776156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff640bc950 0x7eff640bce00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:33.268 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.263+0000 7eff6a343700 1 -- 172.21.15.110:0/2948776156 >> 172.21.15.110:0/2948776156 conn(0x7eff64060c40 msgr2=0x7eff64061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:33.268 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.263+0000 7eff6a343700 1 -- 172.21.15.110:0/2948776156 shutdown_connections 2021-03-25T14:16:33.268 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.263+0000 7eff6a343700 1 -- 172.21.15.110:0/2948776156 wait complete. 2021-03-25T14:16:33.268 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.264+0000 7eff6a343700 1 Processor -- start 2021-03-25T14:16:33.268 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.264+0000 7eff6a343700 1 -- start start 2021-03-25T14:16:33.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.265+0000 7eff6a343700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff640b6410 0x7eff64147d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:33.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.265+0000 7eff6a343700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff640b67f0 0x7eff6415c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:33.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.265+0000 7eff6a343700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff640bc950 0x7eff6415c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:33.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.265+0000 7eff6a343700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff640a2ec0 con 0x7eff640b67f0 2021-03-25T14:16:33.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.265+0000 7eff6a343700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6414d5f0 con 0x7eff640b6410 2021-03-25T14:16:33.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.265+0000 7eff6a343700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff6414d890 con 0x7eff640bc950 2021-03-25T14:16:33.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.265+0000 7eff637fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff640b67f0 0x7eff6415c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:33.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.265+0000 7eff637fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff640b67f0 0x7eff6415c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48118/0 (socket says 172.21.15.110:48118) 2021-03-25T14:16:33.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.265+0000 7eff637fe700 1 -- 172.21.15.110:0/217608240 learned_addr learned my addr 172.21.15.110:0/217608240 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:33.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.265+0000 7eff688e0700 1 --2- 172.21.15.110:0/217608240 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff640bc950 0x7eff6415c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:33.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.265+0000 7eff63fff700 1 --2- 172.21.15.110:0/217608240 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff640b6410 0x7eff64147d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:33.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.265+0000 7eff637fe700 1 -- 172.21.15.110:0/217608240 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff640bc950 msgr2=0x7eff6415c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:33.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.265+0000 7eff637fe700 1 --2- 172.21.15.110:0/217608240 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff640bc950 0x7eff6415c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:33.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.265+0000 7eff637fe700 1 -- 172.21.15.110:0/217608240 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff640b6410 msgr2=0x7eff64147d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:33.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.265+0000 7eff637fe700 1 --2- 172.21.15.110:0/217608240 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff640b6410 0x7eff64147d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:33.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.265+0000 7eff637fe700 1 -- 172.21.15.110:0/217608240 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff640a30f0 con 0x7eff640b67f0 2021-03-25T14:16:33.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.265+0000 7eff637fe700 1 --2- 172.21.15.110:0/217608240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff640b67f0 0x7eff6415c2a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7eff5800c760 tx=0x7eff58001830).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:33.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.265+0000 7eff4bfff700 1 -- 172.21.15.110:0/217608240 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff58007170 con 0x7eff640b67f0 2021-03-25T14:16:33.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.265+0000 7eff4bfff700 1 -- 172.21.15.110:0/217608240 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff580072d0 con 0x7eff640b67f0 2021-03-25T14:16:33.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.265+0000 7eff6a343700 1 -- 172.21.15.110:0/217608240 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff640a3390 con 0x7eff640b67f0 2021-03-25T14:16:33.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.265+0000 7eff4bfff700 1 -- 172.21.15.110:0/217608240 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff58004950 con 0x7eff640b67f0 2021-03-25T14:16:33.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.265+0000 7eff6a343700 1 -- 172.21.15.110:0/217608240 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff640a5c90 con 0x7eff640b67f0 2021-03-25T14:16:33.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.266+0000 7eff6a343700 1 -- 172.21.15.110:0/217608240 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff640a3520 con 0x7eff640b67f0 2021-03-25T14:16:33.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.266+0000 7eff4bfff700 1 -- 172.21.15.110:0/217608240 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7eff58010070 con 0x7eff640b67f0 2021-03-25T14:16:33.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.267+0000 7eff4bfff700 1 --2- 172.21.15.110:0/217608240 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7eff4405a0b0 0x7eff4405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:33.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.267+0000 7eff4bfff700 1 -- 172.21.15.110:0/217608240 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7eff58073860 con 0x7eff640b67f0 2021-03-25T14:16:33.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.267+0000 7eff63fff700 1 --2- 172.21.15.110:0/217608240 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7eff4405a0b0 0x7eff4405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:33.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.267+0000 7eff63fff700 1 --2- 172.21.15.110:0/217608240 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7eff4405a0b0 0x7eff4405c570 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7eff54007fd0 tx=0x7eff54009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:33.274 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.270+0000 7eff4bfff700 1 -- 172.21.15.110:0/217608240 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7eff58046f10 con 0x7eff640b67f0 2021-03-25T14:16:33.423 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.421+0000 7eff6a343700 1 -- 172.21.15.110:0/217608240 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7eff6405d7b0 con 0x7eff640b67f0 2021-03-25T14:16:33.424 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.421+0000 7eff4bfff700 1 -- 172.21.15.110:0/217608240 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7eff5804a530 con 0x7eff640b67f0 2021-03-25T14:16:33.424 INFO:teuthology.orchestra.run.smithi110.stdout:55834574856 2021-03-25T14:16:33.426 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.423+0000 7eff6a343700 1 -- 172.21.15.110:0/217608240 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7eff4405a0b0 msgr2=0x7eff4405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:33.426 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.423+0000 7eff6a343700 1 --2- 172.21.15.110:0/217608240 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7eff4405a0b0 0x7eff4405c570 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7eff54007fd0 tx=0x7eff54009040).stop 2021-03-25T14:16:33.426 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.423+0000 7eff6a343700 1 -- 172.21.15.110:0/217608240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff640b67f0 msgr2=0x7eff6415c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:33.426 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.423+0000 7eff6a343700 1 --2- 172.21.15.110:0/217608240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff640b67f0 0x7eff6415c2a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7eff5800c760 tx=0x7eff58001830).stop 2021-03-25T14:16:33.426 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.423+0000 7eff6a343700 1 -- 172.21.15.110:0/217608240 shutdown_connections 2021-03-25T14:16:33.426 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.423+0000 7eff6a343700 1 --2- 172.21.15.110:0/217608240 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7eff4405a0b0 0x7eff4405c570 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:33.426 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.423+0000 7eff6a343700 1 --2- 172.21.15.110:0/217608240 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff640b6410 0x7eff64147d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:33.426 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.423+0000 7eff6a343700 1 --2- 172.21.15.110:0/217608240 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff640bc950 0x7eff6415c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:33.427 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.423+0000 7eff6a343700 1 --2- 172.21.15.110:0/217608240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff640b67f0 0x7eff6415c2a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:33.427 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.423+0000 7eff6a343700 1 -- 172.21.15.110:0/217608240 >> 172.21.15.110:0/217608240 conn(0x7eff64060c40 msgr2=0x7eff640c06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:33.427 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.423+0000 7eff6a343700 1 -- 172.21.15.110:0/217608240 shutdown_connections 2021-03-25T14:16:33.427 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.423+0000 7eff6a343700 1 -- 172.21.15.110:0/217608240 wait complete. 2021-03-25T14:16:33.436 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.6 2021-03-25T14:16:33.436 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2021-03-25T14:16:33.547 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.545+0000 7fd869d89700 1 Processor -- start 2021-03-25T14:16:33.547 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.545+0000 7fd869d89700 1 -- start start 2021-03-25T14:16:33.550 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.546+0000 7fd869d89700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd8640b62c0 0x7fd8640b6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:33.550 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.546+0000 7fd869d89700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8640bacd0 con 0x7fd8640bbe10 2021-03-25T14:16:33.550 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.546+0000 7fd869d89700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8640baf70 con 0x7fd864149c40 2021-03-25T14:16:33.550 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.546+0000 7fd869d89700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8641472c0 con 0x7fd8640b62c0 2021-03-25T14:16:33.550 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.546+0000 7fd863fff700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fd8640bbe10 0x7fd8640bc2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41064/0 (socket says 172.21.15.110:41064) 2021-03-25T14:16:33.550 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.546+0000 7fd863fff700 1 -- 172.21.15.110:0/4212531615 learned_addr learned my addr 172.21.15.110:0/4212531615 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:33.550 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.547+0000 7fd862ffd700 1 --2- 172.21.15.110:0/4212531615 >> v2:172.21.15.174:3300/0 conn(0x7fd8640b62c0 0x7fd8640b6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:33.550 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.547+0000 7fd8627fc700 1 -- 172.21.15.110:0/4212531615 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 279811509 0 0) 0x7fd8640bacd0 con 0x7fd8640bbe10 2021-03-25T14:16:33.550 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.547+0000 7fd8627fc700 1 -- 172.21.15.110:0/4212531615 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd850003270 con 0x7fd8640bbe10 2021-03-25T14:16:33.551 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.547+0000 7fd8627fc700 1 -- 172.21.15.110:0/4212531615 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4195569017 0 0) 0x7fd850003270 con 0x7fd8640bbe10 2021-03-25T14:16:33.551 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.547+0000 7fd862ffd700 1 -- 172.21.15.110:0/4212531615 >> v1:172.21.15.174:6789/0 conn(0x7fd864149c40 legacy=0x7fd86414a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:33.551 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.547+0000 7fd862ffd700 1 -- 172.21.15.110:0/4212531615 >> v1:172.21.15.110:6789/0 conn(0x7fd8640bbe10 legacy=0x7fd8640bc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:33.551 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.547+0000 7fd862ffd700 1 -- 172.21.15.110:0/4212531615 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8640bb210 con 0x7fd8640b62c0 2021-03-25T14:16:33.551 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.547+0000 7fd862ffd700 1 --2- 172.21.15.110:0/4212531615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8640b62c0 0x7fd8640b6750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fd85800b9c0 tx=0x7fd858006e20).ready entity=mon.1 client_cookie=907c6133e9b414c8 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:33.551 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.547+0000 7fd8627fc700 1 -- 172.21.15.110:0/4212531615 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c0018a0 con 0x7fd8640b62c0 2021-03-25T14:16:33.551 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.547+0000 7fd8627fc700 1 -- 172.21.15.110:0/4212531615 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85800beb0 con 0x7fd8640b62c0 2021-03-25T14:16:33.551 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.547+0000 7fd8627fc700 1 -- 172.21.15.110:0/4212531615 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8580096e0 con 0x7fd8640b62c0 2021-03-25T14:16:33.551 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.548+0000 7fd869d89700 1 -- 172.21.15.110:0/4212531615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8640b62c0 msgr2=0x7fd8640b6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:33.551 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.548+0000 7fd869d89700 1 --2- 172.21.15.110:0/4212531615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8640b62c0 0x7fd8640b6750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fd85800b9c0 tx=0x7fd858006e20).stop 2021-03-25T14:16:33.551 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.548+0000 7fd869d89700 1 -- 172.21.15.110:0/4212531615 shutdown_connections 2021-03-25T14:16:33.551 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.548+0000 7fd869d89700 1 --2- 172.21.15.110:0/4212531615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8640b62c0 0x7fd8640b6750 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:33.551 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.548+0000 7fd869d89700 1 -- 172.21.15.110:0/4212531615 >> 172.21.15.110:0/4212531615 conn(0x7fd864060c40 msgr2=0x7fd864061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:33.552 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.548+0000 7fd869d89700 1 -- 172.21.15.110:0/4212531615 shutdown_connections 2021-03-25T14:16:33.552 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.548+0000 7fd869d89700 1 -- 172.21.15.110:0/4212531615 wait complete. 2021-03-25T14:16:33.554 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.549+0000 7fd869d89700 1 Processor -- start 2021-03-25T14:16:33.555 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.549+0000 7fd869d89700 1 -- start start 2021-03-25T14:16:33.555 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.550+0000 7fd869d89700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8640b62c0 0x7fd864067d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:33.555 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.550+0000 7fd869d89700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8640bbe10 0x7fd8640bef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:33.555 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.550+0000 7fd869d89700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd864149c40 0x7fd8640bf470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:33.555 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.550+0000 7fd869d89700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8640bfa50 con 0x7fd8640bbe10 2021-03-25T14:16:33.555 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.550+0000 7fd869d89700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86415c720 con 0x7fd8640b62c0 2021-03-25T14:16:33.555 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.550+0000 7fd869d89700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd86415c9c0 con 0x7fd864149c40 2021-03-25T14:16:33.555 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.550+0000 7fd862ffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8640bbe10 0x7fd8640bef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:33.555 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.550+0000 7fd862ffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8640bbe10 0x7fd8640bef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48130/0 (socket says 172.21.15.110:48130) 2021-03-25T14:16:33.555 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.550+0000 7fd862ffd700 1 -- 172.21.15.110:0/255880221 learned_addr learned my addr 172.21.15.110:0/255880221 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:33.555 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.550+0000 7fd863fff700 1 --2- 172.21.15.110:0/255880221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd864149c40 0x7fd8640bf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:33.555 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.550+0000 7fd8637fe700 1 --2- 172.21.15.110:0/255880221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8640b62c0 0x7fd864067d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:33.556 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.550+0000 7fd862ffd700 1 -- 172.21.15.110:0/255880221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd864149c40 msgr2=0x7fd8640bf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:33.556 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.550+0000 7fd862ffd700 1 --2- 172.21.15.110:0/255880221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd864149c40 0x7fd8640bf470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:33.556 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.550+0000 7fd862ffd700 1 -- 172.21.15.110:0/255880221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8640b62c0 msgr2=0x7fd864067d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:33.556 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.550+0000 7fd862ffd700 1 --2- 172.21.15.110:0/255880221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8640b62c0 0x7fd864067d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:33.556 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.550+0000 7fd862ffd700 1 -- 172.21.15.110:0/255880221 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd86415cc60 con 0x7fd8640bbe10 2021-03-25T14:16:33.556 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.550+0000 7fd862ffd700 1 --2- 172.21.15.110:0/255880221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8640bbe10 0x7fd8640bef80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fd864066090 tx=0x7fd858016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:33.556 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.550+0000 7fd84b7fe700 1 -- 172.21.15.110:0/255880221 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8580119c0 con 0x7fd8640bbe10 2021-03-25T14:16:33.556 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.550+0000 7fd84b7fe700 1 -- 172.21.15.110:0/255880221 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd858011b20 con 0x7fd8640bbe10 2021-03-25T14:16:33.556 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.550+0000 7fd84b7fe700 1 -- 172.21.15.110:0/255880221 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd858011ea0 con 0x7fd8640bbe10 2021-03-25T14:16:33.556 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.550+0000 7fd869d89700 1 -- 172.21.15.110:0/255880221 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd86415cf00 con 0x7fd8640bbe10 2021-03-25T14:16:33.556 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.550+0000 7fd869d89700 1 -- 172.21.15.110:0/255880221 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd86415d3a0 con 0x7fd8640bbe10 2021-03-25T14:16:33.556 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.551+0000 7fd869d89700 1 -- 172.21.15.110:0/255880221 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd86405d7b0 con 0x7fd8640bbe10 2021-03-25T14:16:33.557 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.551+0000 7fd84b7fe700 1 -- 172.21.15.110:0/255880221 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fd858024030 con 0x7fd8640bbe10 2021-03-25T14:16:33.557 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.552+0000 7fd84b7fe700 1 --2- 172.21.15.110:0/255880221 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd84405a0b0 0x7fd84405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:33.557 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.552+0000 7fd84b7fe700 1 -- 172.21.15.110:0/255880221 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fd858074eb0 con 0x7fd8640bbe10 2021-03-25T14:16:33.557 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.552+0000 7fd8637fe700 1 --2- 172.21.15.110:0/255880221 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd84405a0b0 0x7fd84405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:33.557 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.552+0000 7fd8637fe700 1 --2- 172.21.15.110:0/255880221 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd84405a0b0 0x7fd84405c570 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fd854007fd0 tx=0x7fd854009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:33.557 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.555+0000 7fd84b7fe700 1 -- 172.21.15.110:0/255880221 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fd858048690 con 0x7fd8640bbe10 2021-03-25T14:16:33.708 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.706+0000 7fd869d89700 1 -- 172.21.15.110:0/255880221 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fd8640a5ef0 con 0x7fd8640bbe10 2021-03-25T14:16:33.709 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.707+0000 7fd84b7fe700 1 -- 172.21.15.110:0/255880221 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd858022030 con 0x7fd8640bbe10 2021-03-25T14:16:33.709 INFO:teuthology.orchestra.run.smithi110.stdout:55834574858 2021-03-25T14:16:33.710 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.708+0000 7fd869d89700 1 -- 172.21.15.110:0/255880221 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd84405a0b0 msgr2=0x7fd84405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:33.711 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.708+0000 7fd869d89700 1 --2- 172.21.15.110:0/255880221 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd84405a0b0 0x7fd84405c570 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fd854007fd0 tx=0x7fd854009040).stop 2021-03-25T14:16:33.711 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.708+0000 7fd869d89700 1 -- 172.21.15.110:0/255880221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8640bbe10 msgr2=0x7fd8640bef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:33.711 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.708+0000 7fd869d89700 1 --2- 172.21.15.110:0/255880221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8640bbe10 0x7fd8640bef80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fd864066090 tx=0x7fd858016000).stop 2021-03-25T14:16:33.711 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.708+0000 7fd869d89700 1 -- 172.21.15.110:0/255880221 shutdown_connections 2021-03-25T14:16:33.711 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.708+0000 7fd869d89700 1 --2- 172.21.15.110:0/255880221 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd84405a0b0 0x7fd84405c570 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:33.711 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.708+0000 7fd869d89700 1 --2- 172.21.15.110:0/255880221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8640b62c0 0x7fd864067d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:33.711 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.708+0000 7fd869d89700 1 --2- 172.21.15.110:0/255880221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd864149c40 0x7fd8640bf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:33.711 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.708+0000 7fd869d89700 1 --2- 172.21.15.110:0/255880221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8640bbe10 0x7fd8640bef80 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:33.711 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.708+0000 7fd869d89700 1 -- 172.21.15.110:0/255880221 >> 172.21.15.110:0/255880221 conn(0x7fd864060c40 msgr2=0x7fd86414a020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:33.711 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.708+0000 7fd869d89700 1 -- 172.21.15.110:0/255880221 shutdown_connections 2021-03-25T14:16:33.711 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.708+0000 7fd869d89700 1 -- 172.21.15.110:0/255880221 wait complete. 2021-03-25T14:16:33.721 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2021-03-25T14:16:33.722 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2021-03-25T14:16:33.722 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-03-25T14:16:33.833 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.831+0000 7f6aea3db700 1 Processor -- start 2021-03-25T14:16:33.834 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.831+0000 7f6aea3db700 1 -- start start 2021-03-25T14:16:33.836 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.832+0000 7f6aea3db700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ae40b1340 0x7f6ae40b1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:33.836 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.832+0000 7f6aea3db700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6ae4066420 0x7f6ae40668a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:33.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.832+0000 7f6aea3db700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae4067510 con 0x7f6ae4149cf0 2021-03-25T14:16:33.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.832+0000 7f6aea3db700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae40677b0 con 0x7f6ae4066420 2021-03-25T14:16:33.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.832+0000 7f6aea3db700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae4067a50 con 0x7f6ae40b1340 2021-03-25T14:16:33.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.832+0000 7f6ae37fe700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6ae4066420 0x7f6ae40668a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:33.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.832+0000 7f6ae37fe700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6ae4066420 0x7f6ae40668a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48140/0 (socket says 172.21.15.110:48140) 2021-03-25T14:16:33.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.832+0000 7f6ae37fe700 1 -- 172.21.15.110:0/3822019042 learned_addr learned my addr 172.21.15.110:0/3822019042 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:33.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.832+0000 7f6ae3fff700 1 --2- 172.21.15.110:0/3822019042 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ae40b1340 0x7f6ae40b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:33.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.832+0000 7f6ae37fe700 1 -- 172.21.15.110:0/3822019042 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ae40b1340 msgr2=0x7f6ae40b1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:33.838 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.833+0000 7f6ae37fe700 1 --2- 172.21.15.110:0/3822019042 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ae40b1340 0x7f6ae40b1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:33.838 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.833+0000 7f6ae37fe700 1 -- 172.21.15.110:0/3822019042 >> v1:172.21.15.174:6789/0 conn(0x7f6ae4149cf0 legacy=0x7f6ae414cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:33.838 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.833+0000 7f6ae37fe700 1 -- 172.21.15.110:0/3822019042 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae4067cf0 con 0x7f6ae4066420 2021-03-25T14:16:33.838 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.833+0000 7f6ae37fe700 1 --2- 172.21.15.110:0/3822019042 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ae4066420 0x7f6ae40668a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f6ad800ba20 tx=0x7f6ad8006ee0).ready entity=mon.0 client_cookie=fac0a8c912143d7 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:33.838 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.833+0000 7f6ae2ffd700 1 -- 172.21.15.110:0/3822019042 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8009890 con 0x7f6ae4066420 2021-03-25T14:16:33.838 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.833+0000 7f6ae2ffd700 1 -- 172.21.15.110:0/3822019042 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad80099f0 con 0x7f6ae4066420 2021-03-25T14:16:33.838 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.833+0000 7f6ae2ffd700 1 -- 172.21.15.110:0/3822019042 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8009d70 con 0x7f6ae4066420 2021-03-25T14:16:33.838 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.833+0000 7f6aea3db700 1 -- 172.21.15.110:0/3822019042 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ae4066420 msgr2=0x7f6ae40668a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:33.838 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.833+0000 7f6aea3db700 1 --2- 172.21.15.110:0/3822019042 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ae4066420 0x7f6ae40668a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f6ad800ba20 tx=0x7f6ad8006ee0).stop 2021-03-25T14:16:33.838 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.833+0000 7f6aea3db700 1 -- 172.21.15.110:0/3822019042 shutdown_connections 2021-03-25T14:16:33.838 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.833+0000 7f6aea3db700 1 --2- 172.21.15.110:0/3822019042 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ae40b1340 0x7f6ae40b1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:33.838 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.833+0000 7f6aea3db700 1 --2- 172.21.15.110:0/3822019042 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ae4066420 0x7f6ae40668a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:33.839 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.833+0000 7f6aea3db700 1 -- 172.21.15.110:0/3822019042 >> 172.21.15.110:0/3822019042 conn(0x7f6ae40649a0 msgr2=0x7f6ae405c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:33.839 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.833+0000 7f6aea3db700 1 -- 172.21.15.110:0/3822019042 shutdown_connections 2021-03-25T14:16:33.839 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.833+0000 7f6aea3db700 1 -- 172.21.15.110:0/3822019042 wait complete. 2021-03-25T14:16:33.839 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.834+0000 7f6aea3db700 1 Processor -- start 2021-03-25T14:16:33.839 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.835+0000 7f6aea3db700 1 -- start start 2021-03-25T14:16:33.842 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.835+0000 7f6aea3db700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ae4066420 0x7f6ae414c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:33.842 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.835+0000 7f6aea3db700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ae40b1340 0x7f6ae40bb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:33.842 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.835+0000 7f6aea3db700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ae4149cf0 0x7f6ae4158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:33.842 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.835+0000 7f6aea3db700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae40bbae0 con 0x7f6ae40b1340 2021-03-25T14:16:33.842 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.835+0000 7f6aea3db700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae415c3c0 con 0x7f6ae4149cf0 2021-03-25T14:16:33.842 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.835+0000 7f6aea3db700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae415c660 con 0x7f6ae4066420 2021-03-25T14:16:33.842 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.835+0000 7f6ae37fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ae40b1340 0x7f6ae40bb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:33.842 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.835+0000 7f6ae37fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ae40b1340 0x7f6ae40bb160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48144/0 (socket says 172.21.15.110:48144) 2021-03-25T14:16:33.842 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.835+0000 7f6ae37fe700 1 -- 172.21.15.110:0/2908345037 learned_addr learned my addr 172.21.15.110:0/2908345037 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:33.842 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.835+0000 7f6ae3fff700 1 --2- 172.21.15.110:0/2908345037 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ae4066420 0x7f6ae414c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:33.843 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.835+0000 7f6ae8978700 1 --2- 172.21.15.110:0/2908345037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ae4149cf0 0x7f6ae4158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:33.843 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.836+0000 7f6ae37fe700 1 -- 172.21.15.110:0/2908345037 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ae4066420 msgr2=0x7f6ae414c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:33.843 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.836+0000 7f6ae37fe700 1 --2- 172.21.15.110:0/2908345037 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ae4066420 0x7f6ae414c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:33.843 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.836+0000 7f6ae37fe700 1 -- 172.21.15.110:0/2908345037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ae4149cf0 msgr2=0x7f6ae4158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:33.843 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.836+0000 7f6ae37fe700 1 --2- 172.21.15.110:0/2908345037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ae4149cf0 0x7f6ae4158d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:33.843 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.836+0000 7f6ae37fe700 1 -- 172.21.15.110:0/2908345037 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae415c900 con 0x7f6ae40b1340 2021-03-25T14:16:33.843 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.836+0000 7f6ae37fe700 1 --2- 172.21.15.110:0/2908345037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ae40b1340 0x7f6ae40bb160 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f6ae405d040 tx=0x7f6ad8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:33.843 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.836+0000 7f6acbfff700 1 -- 172.21.15.110:0/2908345037 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8009890 con 0x7f6ae40b1340 2021-03-25T14:16:33.843 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.836+0000 7f6acbfff700 1 -- 172.21.15.110:0/2908345037 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad8011d10 con 0x7f6ae40b1340 2021-03-25T14:16:33.843 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.836+0000 7f6aea3db700 1 -- 172.21.15.110:0/2908345037 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae415cba0 con 0x7f6ae40b1340 2021-03-25T14:16:33.843 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.836+0000 7f6acbfff700 1 -- 172.21.15.110:0/2908345037 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad801c630 con 0x7f6ae40b1340 2021-03-25T14:16:33.843 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.836+0000 7f6aea3db700 1 -- 172.21.15.110:0/2908345037 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ae4068650 con 0x7f6ae40b1340 2021-03-25T14:16:33.844 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.837+0000 7f6aea3db700 1 -- 172.21.15.110:0/2908345037 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ae415cd30 con 0x7f6ae40b1340 2021-03-25T14:16:33.844 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.837+0000 7f6acbfff700 1 -- 172.21.15.110:0/2908345037 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f6ad800f070 con 0x7f6ae40b1340 2021-03-25T14:16:33.844 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.837+0000 7f6acbfff700 1 --2- 172.21.15.110:0/2908345037 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6ac405a0b0 0x7f6ac405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:33.844 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.838+0000 7f6acbfff700 1 -- 172.21.15.110:0/2908345037 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f6ad8075620 con 0x7f6ae40b1340 2021-03-25T14:16:33.844 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.838+0000 7f6ae3fff700 1 --2- 172.21.15.110:0/2908345037 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6ac405a0b0 0x7f6ac405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:33.844 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.838+0000 7f6ae3fff700 1 --2- 172.21.15.110:0/2908345037 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6ac405a0b0 0x7f6ac405c570 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f6ae4147040 tx=0x7f6ad4008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:33.844 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.841+0000 7f6acbfff700 1 -- 172.21.15.110:0/2908345037 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f6ad8048cd0 con 0x7f6ae40b1340 2021-03-25T14:16:33.989 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.988+0000 7f6aea3db700 1 -- 172.21.15.110:0/2908345037 --> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6ae405d7b0 con 0x7f6ac405a0b0 2021-03-25T14:16:33.993 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.991+0000 7f6acbfff700 1 -- 172.21.15.110:0/2908345037 <== mgr.4104 v2:172.21.15.110:6832/36740 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+108235 (secure 0 0 0) 0x7f6ae405d7b0 con 0x7f6ac405a0b0 2021-03-25T14:16:33.994 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:16:34.133 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.993+0000 7f6aea3db700 1 -- 172.21.15.110:0/2908345037 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6ac405a0b0 msgr2=0x7f6ac405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:34.133 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.993+0000 7f6aea3db700 1 --2- 172.21.15.110:0/2908345037 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6ac405a0b0 0x7f6ac405c570 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f6ae4147040 tx=0x7f6ad4008040).stop 2021-03-25T14:16:34.133 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.993+0000 7f6aea3db700 1 -- 172.21.15.110:0/2908345037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ae40b1340 msgr2=0x7f6ae40bb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:34.133 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.993+0000 7f6aea3db700 1 --2- 172.21.15.110:0/2908345037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ae40b1340 0x7f6ae40bb160 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f6ae405d040 tx=0x7f6ad8016000).stop 2021-03-25T14:16:34.133 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.993+0000 7f6aea3db700 1 -- 172.21.15.110:0/2908345037 shutdown_connections 2021-03-25T14:16:34.133 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.993+0000 7f6aea3db700 1 --2- 172.21.15.110:0/2908345037 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6ac405a0b0 0x7f6ac405c570 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:34.133 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.993+0000 7f6aea3db700 1 --2- 172.21.15.110:0/2908345037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ae4149cf0 0x7f6ae4158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:34.133 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.993+0000 7f6aea3db700 1 --2- 172.21.15.110:0/2908345037 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ae4066420 0x7f6ae414c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:34.133 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.993+0000 7f6aea3db700 1 --2- 172.21.15.110:0/2908345037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ae40b1340 0x7f6ae40bb160 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:34.133 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.993+0000 7f6aea3db700 1 -- 172.21.15.110:0/2908345037 >> 172.21.15.110:0/2908345037 conn(0x7f6ae40649a0 msgr2=0x7f6ae414d420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:34.134 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.993+0000 7f6aea3db700 1 -- 172.21.15.110:0/2908345037 shutdown_connections 2021-03-25T14:16:34.134 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:33.993+0000 7f6aea3db700 1 -- 172.21.15.110:0/2908345037 wait complete. 2021-03-25T14:16:34.134 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2021-03-25T14:16:34.134 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2021-03-25T14:16:33.907285+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3694,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":41304,"kb_used_data":2136,"kb_used_omap":0,"kb_used_meta":39104,"kb_avail":754933416,"statfs":{"total":773094113280,"available":773051817984,"internally_reserved":0,"allocated":2187264,"data_stored":886098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40042496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002628"},"pg_stats":[{"pgid":"5.3","version":"0'0","reported_seq":"11","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.257694+0000","last_change":"2021-03-25T14:16:15.256822+0000","last_active":"2021-03-25T14:16:15.257694+0000","last_peered":"2021-03-25T14:16:15.257694+0000","last_clean":"2021-03-25T14:16:15.257694+0000","last_became_active":"2021-03-25T14:16:15.254487+0000","last_became_peered":"2021-03-25T14:16:15.254487+0000","last_unstale":"2021-03-25T14:16:15.257694+0000","last_undegraded":"2021-03-25T14:16:15.257694+0000","last_fullsized":"2021-03-25T14:16:15.257694+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:14.103276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:14.103276+0000","last_clean_scrub_stamp":"2021-03-25T14:16:14.103276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":"13","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.252525+0000","last_change":"2021-03-25T14:16:11.106425+0000","last_active":"2021-03-25T14:16:15.252525+0000","last_peered":"2021-03-25T14:16:15.252525+0000","last_clean":"2021-03-25T14:16:15.252525+0000","last_became_active":"2021-03-25T14:16:11.106053+0000","last_became_peered":"2021-03-25T14:16:11.106053+0000","last_unstale":"2021-03-25T14:16:15.252525+0000","last_undegraded":"2021-03-25T14:16:15.252525+0000","last_fullsized":"2021-03-25T14:16:15.252525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:10.755483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:10.755483+0000","last_clean_scrub_stamp":"2021-03-25T14:16:10.755483+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"17","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.252763+0000","last_change":"2021-03-25T14:16:02.105202+0000","last_active":"2021-03-25T14:16:15.252763+0000","last_peered":"2021-03-25T14:16:15.252763+0000","last_clean":"2021-03-25T14:16:15.252763+0000","last_became_active":"2021-03-25T14:16:02.104918+0000","last_became_peered":"2021-03-25T14:16:02.104918+0000","last_unstale":"2021-03-25T14:16:15.252763+0000","last_undegraded":"2021-03-25T14:16:15.252763+0000","last_fullsized":"2021-03-25T14:16:15.252763+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:01.019551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:01.019551+0000","last_clean_scrub_stamp":"2021-03-25T14:16:01.019551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"20'6","reported_seq":"20","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.117478+0000","last_change":"2021-03-25T14:16:10.768940+0000","last_active":"2021-03-25T14:16:15.117478+0000","last_peered":"2021-03-25T14:16:15.117478+0000","last_clean":"2021-03-25T14:16:15.117478+0000","last_became_active":"2021-03-25T14:16:10.768642+0000","last_became_peered":"2021-03-25T14:16:10.768642+0000","last_unstale":"2021-03-25T14:16:15.117478+0000","last_undegraded":"2021-03-25T14:16:15.117478+0000","last_fullsized":"2021-03-25T14:16:15.117478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:09.748434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:09.748434+0000","last_clean_scrub_stamp":"2021-03-25T14:16:09.748434+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":"11","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.257604+0000","last_change":"2021-03-25T14:16:15.255767+0000","last_active":"2021-03-25T14:16:15.257604+0000","last_peered":"2021-03-25T14:16:15.257604+0000","last_clean":"2021-03-25T14:16:15.257604+0000","last_became_active":"2021-03-25T14:16:15.255298+0000","last_became_peered":"2021-03-25T14:16:15.255298+0000","last_unstale":"2021-03-25T14:16:15.257604+0000","last_undegraded":"2021-03-25T14:16:15.257604+0000","last_fullsized":"2021-03-25T14:16:15.257604+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:14.103276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:14.103276+0000","last_clean_scrub_stamp":"2021-03-25T14:16:14.103276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"13","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.252610+0000","last_change":"2021-03-25T14:16:11.105078+0000","last_active":"2021-03-25T14:16:15.252610+0000","last_peered":"2021-03-25T14:16:15.252610+0000","last_clean":"2021-03-25T14:16:15.252610+0000","last_became_active":"2021-03-25T14:16:11.104774+0000","last_became_peered":"2021-03-25T14:16:11.104774+0000","last_unstale":"2021-03-25T14:16:15.252610+0000","last_undegraded":"2021-03-25T14:16:15.252610+0000","last_fullsized":"2021-03-25T14:16:15.252610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:10.755483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:10.755483+0000","last_clean_scrub_stamp":"2021-03-25T14:16:10.755483+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"17","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.117326+0000","last_change":"2021-03-25T14:16:02.045870+0000","last_active":"2021-03-25T14:16:15.117326+0000","last_peered":"2021-03-25T14:16:15.117326+0000","last_clean":"2021-03-25T14:16:15.117326+0000","last_became_active":"2021-03-25T14:16:02.045582+0000","last_became_peered":"2021-03-25T14:16:02.045582+0000","last_unstale":"2021-03-25T14:16:15.117326+0000","last_undegraded":"2021-03-25T14:16:15.117326+0000","last_fullsized":"2021-03-25T14:16:15.117326+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:01.019551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:01.019551+0000","last_clean_scrub_stamp":"2021-03-25T14:16:01.019551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"20'5","reported_seq":"19","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.115611+0000","last_change":"2021-03-25T14:16:10.768731+0000","last_active":"2021-03-25T14:16:15.115611+0000","last_peered":"2021-03-25T14:16:15.115611+0000","last_clean":"2021-03-25T14:16:15.115611+0000","last_became_active":"2021-03-25T14:16:10.768393+0000","last_became_peered":"2021-03-25T14:16:10.768393+0000","last_unstale":"2021-03-25T14:16:15.115611+0000","last_undegraded":"2021-03-25T14:16:15.115611+0000","last_fullsized":"2021-03-25T14:16:15.115611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:09.748434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:09.748434+0000","last_clean_scrub_stamp":"2021-03-25T14:16:09.748434+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":"11","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.257011+0000","last_change":"2021-03-25T14:16:15.256305+0000","last_active":"2021-03-25T14:16:15.257011+0000","last_peered":"2021-03-25T14:16:15.257011+0000","last_clean":"2021-03-25T14:16:15.257011+0000","last_became_active":"2021-03-25T14:16:15.255799+0000","last_became_peered":"2021-03-25T14:16:15.255799+0000","last_unstale":"2021-03-25T14:16:15.257011+0000","last_undegraded":"2021-03-25T14:16:15.257011+0000","last_fullsized":"2021-03-25T14:16:15.257011+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:14.103276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:14.103276+0000","last_clean_scrub_stamp":"2021-03-25T14:16:14.103276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"13","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.252647+0000","last_change":"2021-03-25T14:16:11.107686+0000","last_active":"2021-03-25T14:16:15.252647+0000","last_peered":"2021-03-25T14:16:15.252647+0000","last_clean":"2021-03-25T14:16:15.252647+0000","last_became_active":"2021-03-25T14:16:11.107343+0000","last_became_peered":"2021-03-25T14:16:11.107343+0000","last_unstale":"2021-03-25T14:16:15.252647+0000","last_undegraded":"2021-03-25T14:16:15.252647+0000","last_fullsized":"2021-03-25T14:16:15.252647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:10.755483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:10.755483+0000","last_clean_scrub_stamp":"2021-03-25T14:16:10.755483+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"17","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.110820+0000","last_change":"2021-03-25T14:16:02.154258+0000","last_active":"2021-03-25T14:16:15.110820+0000","last_peered":"2021-03-25T14:16:15.110820+0000","last_clean":"2021-03-25T14:16:15.110820+0000","last_became_active":"2021-03-25T14:16:02.153912+0000","last_became_peered":"2021-03-25T14:16:02.153912+0000","last_unstale":"2021-03-25T14:16:15.110820+0000","last_undegraded":"2021-03-25T14:16:15.110820+0000","last_fullsized":"2021-03-25T14:16:15.110820+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:01.019551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:01.019551+0000","last_clean_scrub_stamp":"2021-03-25T14:16:01.019551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"20'8","reported_seq":"22","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.252521+0000","last_change":"2021-03-25T14:16:10.768915+0000","last_active":"2021-03-25T14:16:15.252521+0000","last_peered":"2021-03-25T14:16:15.252521+0000","last_clean":"2021-03-25T14:16:15.252521+0000","last_became_active":"2021-03-25T14:16:10.768586+0000","last_became_peered":"2021-03-25T14:16:10.768586+0000","last_unstale":"2021-03-25T14:16:15.252521+0000","last_undegraded":"2021-03-25T14:16:15.252521+0000","last_fullsized":"2021-03-25T14:16:15.252521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:09.748434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:09.748434+0000","last_clean_scrub_stamp":"2021-03-25T14:16:09.748434+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":"11","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.123231+0000","last_change":"2021-03-25T14:16:15.122151+0000","last_active":"2021-03-25T14:16:15.123231+0000","last_peered":"2021-03-25T14:16:15.123231+0000","last_clean":"2021-03-25T14:16:15.123231+0000","last_became_active":"2021-03-25T14:16:15.121493+0000","last_became_peered":"2021-03-25T14:16:15.121493+0000","last_unstale":"2021-03-25T14:16:15.123231+0000","last_undegraded":"2021-03-25T14:16:15.123231+0000","last_fullsized":"2021-03-25T14:16:15.123231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:14.103276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:14.103276+0000","last_clean_scrub_stamp":"2021-03-25T14:16:14.103276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"13","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.111971+0000","last_change":"2021-03-25T14:16:11.105661+0000","last_active":"2021-03-25T14:16:15.111971+0000","last_peered":"2021-03-25T14:16:15.111971+0000","last_clean":"2021-03-25T14:16:15.111971+0000","last_became_active":"2021-03-25T14:16:11.105325+0000","last_became_peered":"2021-03-25T14:16:11.105325+0000","last_unstale":"2021-03-25T14:16:15.111971+0000","last_undegraded":"2021-03-25T14:16:15.111971+0000","last_fullsized":"2021-03-25T14:16:15.111971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:10.755483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:10.755483+0000","last_clean_scrub_stamp":"2021-03-25T14:16:10.755483+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"17","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.117638+0000","last_change":"2021-03-25T14:16:02.043408+0000","last_active":"2021-03-25T14:16:15.117638+0000","last_peered":"2021-03-25T14:16:15.117638+0000","last_clean":"2021-03-25T14:16:15.117638+0000","last_became_active":"2021-03-25T14:16:02.042899+0000","last_became_peered":"2021-03-25T14:16:02.042899+0000","last_unstale":"2021-03-25T14:16:15.117638+0000","last_undegraded":"2021-03-25T14:16:15.117638+0000","last_fullsized":"2021-03-25T14:16:15.117638+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:01.019551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:01.019551+0000","last_clean_scrub_stamp":"2021-03-25T14:16:01.019551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"18","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.112720+0000","last_change":"2021-03-25T14:16:01.032643+0000","last_active":"2021-03-25T14:16:15.112720+0000","last_peered":"2021-03-25T14:16:15.112720+0000","last_clean":"2021-03-25T14:16:15.112720+0000","last_became_active":"2021-03-25T14:16:01.032304+0000","last_became_peered":"2021-03-25T14:16:01.032304+0000","last_unstale":"2021-03-25T14:16:15.112720+0000","last_undegraded":"2021-03-25T14:16:15.112720+0000","last_fullsized":"2021-03-25T14:16:15.112720+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:00.015444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:00.015444+0000","last_clean_scrub_stamp":"2021-03-25T14:16:00.015444+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"20'1","reported_seq":"15","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.112643+0000","last_change":"2021-03-25T14:16:10.771389+0000","last_active":"2021-03-25T14:16:15.112643+0000","last_peered":"2021-03-25T14:16:15.112643+0000","last_clean":"2021-03-25T14:16:15.112643+0000","last_became_active":"2021-03-25T14:16:10.771043+0000","last_became_peered":"2021-03-25T14:16:10.771043+0000","last_unstale":"2021-03-25T14:16:15.112643+0000","last_undegraded":"2021-03-25T14:16:15.112643+0000","last_fullsized":"2021-03-25T14:16:15.112643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:09.748434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:09.748434+0000","last_clean_scrub_stamp":"2021-03-25T14:16:09.748434+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":"11","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.254834+0000","last_change":"2021-03-25T14:16:15.253828+0000","last_active":"2021-03-25T14:16:15.254834+0000","last_peered":"2021-03-25T14:16:15.254834+0000","last_clean":"2021-03-25T14:16:15.254834+0000","last_became_active":"2021-03-25T14:16:15.253337+0000","last_became_peered":"2021-03-25T14:16:15.253337+0000","last_unstale":"2021-03-25T14:16:15.254834+0000","last_undegraded":"2021-03-25T14:16:15.254834+0000","last_fullsized":"2021-03-25T14:16:15.254834+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:14.103276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:14.103276+0000","last_clean_scrub_stamp":"2021-03-25T14:16:14.103276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"13","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.117146+0000","last_change":"2021-03-25T14:16:11.103310+0000","last_active":"2021-03-25T14:16:15.117146+0000","last_peered":"2021-03-25T14:16:15.117146+0000","last_clean":"2021-03-25T14:16:15.117146+0000","last_became_active":"2021-03-25T14:16:11.102997+0000","last_became_peered":"2021-03-25T14:16:11.102997+0000","last_unstale":"2021-03-25T14:16:15.117146+0000","last_undegraded":"2021-03-25T14:16:15.117146+0000","last_fullsized":"2021-03-25T14:16:15.117146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:10.755483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:10.755483+0000","last_clean_scrub_stamp":"2021-03-25T14:16:10.755483+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"17","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.112806+0000","last_change":"2021-03-25T14:16:02.038804+0000","last_active":"2021-03-25T14:16:15.112806+0000","last_peered":"2021-03-25T14:16:15.112806+0000","last_clean":"2021-03-25T14:16:15.112806+0000","last_became_active":"2021-03-25T14:16:02.038363+0000","last_became_peered":"2021-03-25T14:16:02.038363+0000","last_unstale":"2021-03-25T14:16:15.112806+0000","last_undegraded":"2021-03-25T14:16:15.112806+0000","last_fullsized":"2021-03-25T14:16:15.112806+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:01.019551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:01.019551+0000","last_clean_scrub_stamp":"2021-03-25T14:16:01.019551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"14","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.116728+0000","last_change":"2021-03-25T14:16:10.769106+0000","last_active":"2021-03-25T14:16:15.116728+0000","last_peered":"2021-03-25T14:16:15.116728+0000","last_clean":"2021-03-25T14:16:15.116728+0000","last_became_active":"2021-03-25T14:16:10.768852+0000","last_became_peered":"2021-03-25T14:16:10.768852+0000","last_unstale":"2021-03-25T14:16:15.116728+0000","last_undegraded":"2021-03-25T14:16:15.116728+0000","last_fullsized":"2021-03-25T14:16:15.116728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:09.748434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:09.748434+0000","last_clean_scrub_stamp":"2021-03-25T14:16:09.748434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":"11","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.123906+0000","last_change":"2021-03-25T14:16:15.123013+0000","last_active":"2021-03-25T14:16:15.123906+0000","last_peered":"2021-03-25T14:16:15.123906+0000","last_clean":"2021-03-25T14:16:15.123906+0000","last_became_active":"2021-03-25T14:16:15.122541+0000","last_became_peered":"2021-03-25T14:16:15.122541+0000","last_unstale":"2021-03-25T14:16:15.123906+0000","last_undegraded":"2021-03-25T14:16:15.123906+0000","last_fullsized":"2021-03-25T14:16:15.123906+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:14.103276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:14.103276+0000","last_clean_scrub_stamp":"2021-03-25T14:16:14.103276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"13","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.116583+0000","last_change":"2021-03-25T14:16:11.105568+0000","last_active":"2021-03-25T14:16:15.116583+0000","last_peered":"2021-03-25T14:16:15.116583+0000","last_clean":"2021-03-25T14:16:15.116583+0000","last_became_active":"2021-03-25T14:16:11.105227+0000","last_became_peered":"2021-03-25T14:16:11.105227+0000","last_unstale":"2021-03-25T14:16:15.116583+0000","last_undegraded":"2021-03-25T14:16:15.116583+0000","last_fullsized":"2021-03-25T14:16:15.116583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:10.755483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:10.755483+0000","last_clean_scrub_stamp":"2021-03-25T14:16:10.755483+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"17","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.112756+0000","last_change":"2021-03-25T14:16:02.105511+0000","last_active":"2021-03-25T14:16:15.112756+0000","last_peered":"2021-03-25T14:16:15.112756+0000","last_clean":"2021-03-25T14:16:15.112756+0000","last_became_active":"2021-03-25T14:16:02.105125+0000","last_became_peered":"2021-03-25T14:16:02.105125+0000","last_unstale":"2021-03-25T14:16:15.112756+0000","last_undegraded":"2021-03-25T14:16:15.112756+0000","last_fullsized":"2021-03-25T14:16:15.112756+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:01.019551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:01.019551+0000","last_clean_scrub_stamp":"2021-03-25T14:16:01.019551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"25'11","reported_seq":"25","reported_epoch":"25","state":"active+clean","last_fresh":"2021-03-25T14:16:18.427929+0000","last_change":"2021-03-25T14:16:10.769051+0000","last_active":"2021-03-25T14:16:18.427929+0000","last_peered":"2021-03-25T14:16:18.427929+0000","last_clean":"2021-03-25T14:16:18.427929+0000","last_became_active":"2021-03-25T14:16:10.768737+0000","last_became_peered":"2021-03-25T14:16:10.768737+0000","last_unstale":"2021-03-25T14:16:18.427929+0000","last_undegraded":"2021-03-25T14:16:18.427929+0000","last_fullsized":"2021-03-25T14:16:18.427929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:09.748434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:09.748434+0000","last_clean_scrub_stamp":"2021-03-25T14:16:09.748434+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2924,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":"11","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.120651+0000","last_change":"2021-03-25T14:16:15.119981+0000","last_active":"2021-03-25T14:16:15.120651+0000","last_peered":"2021-03-25T14:16:15.120651+0000","last_clean":"2021-03-25T14:16:15.120651+0000","last_became_active":"2021-03-25T14:16:15.119536+0000","last_became_peered":"2021-03-25T14:16:15.119536+0000","last_unstale":"2021-03-25T14:16:15.120651+0000","last_undegraded":"2021-03-25T14:16:15.120651+0000","last_fullsized":"2021-03-25T14:16:15.120651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:14.103276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:14.103276+0000","last_clean_scrub_stamp":"2021-03-25T14:16:14.103276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"13","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.113254+0000","last_change":"2021-03-25T14:16:11.100402+0000","last_active":"2021-03-25T14:16:15.113254+0000","last_peered":"2021-03-25T14:16:15.113254+0000","last_clean":"2021-03-25T14:16:15.113254+0000","last_became_active":"2021-03-25T14:16:11.100104+0000","last_became_peered":"2021-03-25T14:16:11.100104+0000","last_unstale":"2021-03-25T14:16:15.113254+0000","last_undegraded":"2021-03-25T14:16:15.113254+0000","last_fullsized":"2021-03-25T14:16:15.113254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:10.755483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:10.755483+0000","last_clean_scrub_stamp":"2021-03-25T14:16:10.755483+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"20'6","reported_seq":"20","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.112671+0000","last_change":"2021-03-25T14:16:10.773718+0000","last_active":"2021-03-25T14:16:15.112671+0000","last_peered":"2021-03-25T14:16:15.112671+0000","last_clean":"2021-03-25T14:16:15.112671+0000","last_became_active":"2021-03-25T14:16:10.773461+0000","last_became_peered":"2021-03-25T14:16:10.773461+0000","last_unstale":"2021-03-25T14:16:15.112671+0000","last_undegraded":"2021-03-25T14:16:15.112671+0000","last_fullsized":"2021-03-25T14:16:15.112671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:09.748434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:09.748434+0000","last_clean_scrub_stamp":"2021-03-25T14:16:09.748434+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":576,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"17","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.254469+0000","last_change":"2021-03-25T14:16:02.043903+0000","last_active":"2021-03-25T14:16:15.254469+0000","last_peered":"2021-03-25T14:16:15.254469+0000","last_clean":"2021-03-25T14:16:15.254469+0000","last_became_active":"2021-03-25T14:16:02.043536+0000","last_became_peered":"2021-03-25T14:16:02.043536+0000","last_unstale":"2021-03-25T14:16:15.254469+0000","last_undegraded":"2021-03-25T14:16:15.254469+0000","last_fullsized":"2021-03-25T14:16:15.254469+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:01.019551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:01.019551+0000","last_clean_scrub_stamp":"2021-03-25T14:16:01.019551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":"11","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.254721+0000","last_change":"2021-03-25T14:16:15.254380+0000","last_active":"2021-03-25T14:16:15.254721+0000","last_peered":"2021-03-25T14:16:15.254721+0000","last_clean":"2021-03-25T14:16:15.254721+0000","last_became_active":"2021-03-25T14:16:15.253806+0000","last_became_peered":"2021-03-25T14:16:15.253806+0000","last_unstale":"2021-03-25T14:16:15.254721+0000","last_undegraded":"2021-03-25T14:16:15.254721+0000","last_fullsized":"2021-03-25T14:16:15.254721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:14.103276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:14.103276+0000","last_clean_scrub_stamp":"2021-03-25T14:16:14.103276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"13","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.115927+0000","last_change":"2021-03-25T14:16:11.105917+0000","last_active":"2021-03-25T14:16:15.115927+0000","last_peered":"2021-03-25T14:16:15.115927+0000","last_clean":"2021-03-25T14:16:15.115927+0000","last_became_active":"2021-03-25T14:16:11.105564+0000","last_became_peered":"2021-03-25T14:16:11.105564+0000","last_unstale":"2021-03-25T14:16:15.115927+0000","last_undegraded":"2021-03-25T14:16:15.115927+0000","last_fullsized":"2021-03-25T14:16:15.115927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:10.755483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:10.755483+0000","last_clean_scrub_stamp":"2021-03-25T14:16:10.755483+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"17","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.112015+0000","last_change":"2021-03-25T14:16:02.043644+0000","last_active":"2021-03-25T14:16:15.112015+0000","last_peered":"2021-03-25T14:16:15.112015+0000","last_clean":"2021-03-25T14:16:15.112015+0000","last_became_active":"2021-03-25T14:16:02.043304+0000","last_became_peered":"2021-03-25T14:16:02.043304+0000","last_unstale":"2021-03-25T14:16:15.112015+0000","last_undegraded":"2021-03-25T14:16:15.112015+0000","last_fullsized":"2021-03-25T14:16:15.112015+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:01.019551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:01.019551+0000","last_clean_scrub_stamp":"2021-03-25T14:16:01.019551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"21'4","reported_seq":"18","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.117204+0000","last_change":"2021-03-25T14:16:10.766193+0000","last_active":"2021-03-25T14:16:15.117204+0000","last_peered":"2021-03-25T14:16:15.117204+0000","last_clean":"2021-03-25T14:16:15.117204+0000","last_became_active":"2021-03-25T14:16:10.765873+0000","last_became_peered":"2021-03-25T14:16:10.765873+0000","last_unstale":"2021-03-25T14:16:15.117204+0000","last_undegraded":"2021-03-25T14:16:15.117204+0000","last_fullsized":"2021-03-25T14:16:15.117204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:09.748434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:09.748434+0000","last_clean_scrub_stamp":"2021-03-25T14:16:09.748434+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":3694,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5140,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366700,"statfs":{"total":96636764160,"available":96631500800,"internally_reserved":0,"allocated":274432,"data_stored":110653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.351}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3839999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7350000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.677}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5132,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366708,"statfs":{"total":96636764160,"available":96631508992,"internally_reserved":0,"allocated":266240,"data_stored":110077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2689999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5208,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366632,"statfs":{"total":96636764160,"available":96631431168,"internally_reserved":0,"allocated":278528,"data_stored":113001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4630000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1819999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5196,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366644,"statfs":{"total":96636764160,"available":96631443456,"internally_reserved":0,"allocated":266240,"data_stored":109158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.296}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.272}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5208,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366632,"statfs":{"total":96636764160,"available":96631431168,"internally_reserved":0,"allocated":278528,"data_stored":113001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0389999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1910000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5148,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366692,"statfs":{"total":96636764160,"available":96631492608,"internally_reserved":0,"allocated":282624,"data_stored":110813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.593}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5132,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366708,"statfs":{"total":96636764160,"available":96631508992,"internally_reserved":0,"allocated":266240,"data_stored":109158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.365}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2030000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.411}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5140,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366700,"statfs":{"total":96636764160,"available":96631500800,"internally_reserved":0,"allocated":274432,"data_stored":110237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.552}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-03-25T14:16:34.136 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-03-25T14:16:34.251 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.246+0000 7fbc3f2c2700 1 Processor -- start 2021-03-25T14:16:34.251 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.246+0000 7fbc3f2c2700 1 -- start start 2021-03-25T14:16:34.251 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.247+0000 7fbc3f2c2700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbc380675d0 0x7fbc380b1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:34.251 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.247+0000 7fbc3f2c2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbc380bc220 0x7fbc3814cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:34.251 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.247+0000 7fbc3f2c2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc380bafc0 con 0x7fbc3814d0a0 2021-03-25T14:16:34.251 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.247+0000 7fbc3f2c2700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc380b1830 con 0x7fbc380675d0 2021-03-25T14:16:34.252 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.247+0000 7fbc3f2c2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc380baa80 con 0x7fbc380bc220 2021-03-25T14:16:34.252 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.247+0000 7fbc3d05e700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbc380675d0 0x7fbc380b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:34.252 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.247+0000 7fbc3d05e700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbc380675d0 0x7fbc380b1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48150/0 (socket says 172.21.15.110:48150) 2021-03-25T14:16:34.252 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.247+0000 7fbc3d05e700 1 -- 172.21.15.110:0/4173189068 learned_addr learned my addr 172.21.15.110:0/4173189068 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:34.252 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.247+0000 7fbc3d05e700 1 -- 172.21.15.110:0/4173189068 >> v2:172.21.15.174:3300/0 conn(0x7fbc380bc220 msgr2=0x7fbc3814cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:34.252 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.247+0000 7fbc3d05e700 1 --2- 172.21.15.110:0/4173189068 >> v2:172.21.15.174:3300/0 conn(0x7fbc380bc220 0x7fbc3814cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-03-25T14:16:34.252 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.247+0000 7fbc3d05e700 1 -- 172.21.15.110:0/4173189068 >> v1:172.21.15.174:6789/0 conn(0x7fbc3814d0a0 legacy=0x7fbc38148970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:34.252 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.247+0000 7fbc3d05e700 1 -- 172.21.15.110:0/4173189068 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc380bad20 con 0x7fbc380675d0 2021-03-25T14:16:34.252 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.247+0000 7fbc3d05e700 1 --2- 172.21.15.110:0/4173189068 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc380675d0 0x7fbc380b1340 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fbc380bd460 tx=0x7fbc34006ee0).ready entity=mon.0 client_cookie=6576e6362c2dddee server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:34.253 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.247+0000 7fbc27fff700 1 -- 172.21.15.110:0/4173189068 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc34009890 con 0x7fbc380675d0 2021-03-25T14:16:34.253 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.247+0000 7fbc27fff700 1 -- 172.21.15.110:0/4173189068 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc340099f0 con 0x7fbc380675d0 2021-03-25T14:16:34.253 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.247+0000 7fbc27fff700 1 -- 172.21.15.110:0/4173189068 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc34009d70 con 0x7fbc380675d0 2021-03-25T14:16:34.253 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.248+0000 7fbc3f2c2700 1 -- 172.21.15.110:0/4173189068 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc380675d0 msgr2=0x7fbc380b1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:34.253 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.248+0000 7fbc3f2c2700 1 --2- 172.21.15.110:0/4173189068 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc380675d0 0x7fbc380b1340 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fbc380bd460 tx=0x7fbc34006ee0).stop 2021-03-25T14:16:34.253 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.248+0000 7fbc3f2c2700 1 -- 172.21.15.110:0/4173189068 shutdown_connections 2021-03-25T14:16:34.253 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.248+0000 7fbc3f2c2700 1 --2- 172.21.15.110:0/4173189068 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc380675d0 0x7fbc380b1340 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:34.253 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.248+0000 7fbc3f2c2700 1 --2- 172.21.15.110:0/4173189068 >> v2:172.21.15.174:3300/0 conn(0x7fbc380bc220 0x7fbc3814cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-03-25T14:16:34.253 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.248+0000 7fbc3f2c2700 1 -- 172.21.15.110:0/4173189068 >> 172.21.15.110:0/4173189068 conn(0x7fbc38064a10 msgr2=0x7fbc3805c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:34.254 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.248+0000 7fbc3f2c2700 1 -- 172.21.15.110:0/4173189068 shutdown_connections 2021-03-25T14:16:34.254 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.248+0000 7fbc3f2c2700 1 -- 172.21.15.110:0/4173189068 wait complete. 2021-03-25T14:16:34.254 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.249+0000 7fbc3f2c2700 1 Processor -- start 2021-03-25T14:16:34.254 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.249+0000 7fbc3f2c2700 1 -- start start 2021-03-25T14:16:34.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.250+0000 7fbc3f2c2700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc380675d0 0x7fbc3814af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:34.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.250+0000 7fbc3f2c2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbc380bc220 0x7fbc38144940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:34.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.250+0000 7fbc3f2c2700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc3814d0a0 0x7fbc38143620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:34.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.250+0000 7fbc3f2c2700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc38151040 con 0x7fbc3814d0a0 2021-03-25T14:16:34.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.250+0000 7fbc3f2c2700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc381512e0 con 0x7fbc380675d0 2021-03-25T14:16:34.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.250+0000 7fbc3f2c2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc38149e40 con 0x7fbc380bc220 2021-03-25T14:16:34.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.250+0000 7fbc3d85f700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc3814d0a0 0x7fbc38143620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:34.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.250+0000 7fbc3d85f700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc3814d0a0 0x7fbc38143620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48160/0 (socket says 172.21.15.110:48160) 2021-03-25T14:16:34.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.250+0000 7fbc3d85f700 1 -- 172.21.15.110:0/514680027 learned_addr learned my addr 172.21.15.110:0/514680027 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:34.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.250+0000 7fbc3d05e700 1 --2- 172.21.15.110:0/514680027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc380675d0 0x7fbc3814af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:34.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.250+0000 7fbc3c85d700 1 --2- 172.21.15.110:0/514680027 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbc380bc220 0x7fbc38144940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:34.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.250+0000 7fbc3d85f700 1 -- 172.21.15.110:0/514680027 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbc380bc220 msgr2=0x7fbc38144940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:34.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.250+0000 7fbc3d85f700 1 --2- 172.21.15.110:0/514680027 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbc380bc220 0x7fbc38144940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:34.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.250+0000 7fbc3d85f700 1 -- 172.21.15.110:0/514680027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc380675d0 msgr2=0x7fbc3814af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:34.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.250+0000 7fbc3d85f700 1 --2- 172.21.15.110:0/514680027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc380675d0 0x7fbc3814af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:34.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.250+0000 7fbc3d85f700 1 -- 172.21.15.110:0/514680027 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3814a0e0 con 0x7fbc3814d0a0 2021-03-25T14:16:34.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.250+0000 7fbc3c85d700 1 --2- 172.21.15.110:0/514680027 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbc380bc220 0x7fbc38144940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:34.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.250+0000 7fbc3d05e700 1 --2- 172.21.15.110:0/514680027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc380675d0 0x7fbc3814af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:34.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.250+0000 7fbc3d85f700 1 --2- 172.21.15.110:0/514680027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc3814d0a0 0x7fbc38143620 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fbc3000bae0 tx=0x7fbc300090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:34.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.250+0000 7fbc257fa700 1 -- 172.21.15.110:0/514680027 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3000c830 con 0x7fbc3814d0a0 2021-03-25T14:16:34.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.250+0000 7fbc257fa700 1 -- 172.21.15.110:0/514680027 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3000c9b0 con 0x7fbc3814d0a0 2021-03-25T14:16:34.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.250+0000 7fbc3f2c2700 1 -- 172.21.15.110:0/514680027 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc3814a380 con 0x7fbc3814d0a0 2021-03-25T14:16:34.259 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.250+0000 7fbc257fa700 1 -- 172.21.15.110:0/514680027 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3000cb60 con 0x7fbc3814d0a0 2021-03-25T14:16:34.259 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.251+0000 7fbc3f2c2700 1 -- 172.21.15.110:0/514680027 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc380b1c20 con 0x7fbc3814d0a0 2021-03-25T14:16:34.259 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.251+0000 7fbc3f2c2700 1 -- 172.21.15.110:0/514680027 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc380b1ed0 con 0x7fbc3814d0a0 2021-03-25T14:16:34.259 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.252+0000 7fbc257fa700 1 -- 172.21.15.110:0/514680027 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fbc3001c070 con 0x7fbc3814d0a0 2021-03-25T14:16:34.259 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.252+0000 7fbc257fa700 1 --2- 172.21.15.110:0/514680027 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fbc1805a0e0 0x7fbc1805c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:34.260 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.252+0000 7fbc257fa700 1 -- 172.21.15.110:0/514680027 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fbc30073720 con 0x7fbc3814d0a0 2021-03-25T14:16:34.260 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.252+0000 7fbc3d05e700 1 --2- 172.21.15.110:0/514680027 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fbc1805a0e0 0x7fbc1805c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:34.260 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.252+0000 7fbc3d05e700 1 --2- 172.21.15.110:0/514680027 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fbc1805a0e0 0x7fbc1805c5a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fbc34006f20 tx=0x7fbc34016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:34.261 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.256+0000 7fbc257fa700 1 -- 172.21.15.110:0/514680027 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fbc30046dd0 con 0x7fbc3814d0a0 2021-03-25T14:16:34.402 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.400+0000 7fbc3f2c2700 1 -- 172.21.15.110:0/514680027 --> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbc38149cc0 con 0x7fbc1805a0e0 2021-03-25T14:16:34.405 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.403+0000 7fbc257fa700 1 -- 172.21.15.110:0/514680027 <== mgr.4104 v2:172.21.15.110:6832/36740 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+108235 (secure 0 0 0) 0x7fbc34000bc0 con 0x7fbc1805a0e0 2021-03-25T14:16:34.407 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:16:34.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.405+0000 7fbc3f2c2700 1 -- 172.21.15.110:0/514680027 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fbc1805a0e0 msgr2=0x7fbc1805c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:34.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.405+0000 7fbc3f2c2700 1 --2- 172.21.15.110:0/514680027 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fbc1805a0e0 0x7fbc1805c5a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fbc34006f20 tx=0x7fbc34016000).stop 2021-03-25T14:16:34.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.405+0000 7fbc3f2c2700 1 -- 172.21.15.110:0/514680027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc3814d0a0 msgr2=0x7fbc38143620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:34.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.405+0000 7fbc3f2c2700 1 --2- 172.21.15.110:0/514680027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc3814d0a0 0x7fbc38143620 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fbc3000bae0 tx=0x7fbc300090f0).stop 2021-03-25T14:16:34.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.405+0000 7fbc3f2c2700 1 -- 172.21.15.110:0/514680027 shutdown_connections 2021-03-25T14:16:34.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.405+0000 7fbc3f2c2700 1 --2- 172.21.15.110:0/514680027 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fbc1805a0e0 0x7fbc1805c5a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:34.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.405+0000 7fbc3f2c2700 1 --2- 172.21.15.110:0/514680027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc380675d0 0x7fbc3814af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:34.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.405+0000 7fbc3f2c2700 1 --2- 172.21.15.110:0/514680027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc3814d0a0 0x7fbc38143620 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:34.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.405+0000 7fbc3f2c2700 1 --2- 172.21.15.110:0/514680027 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbc380bc220 0x7fbc38144940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:34.410 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.405+0000 7fbc3f2c2700 1 -- 172.21.15.110:0/514680027 >> 172.21.15.110:0/514680027 conn(0x7fbc38064a10 msgr2=0x7fbc3814c990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:34.410 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.405+0000 7fbc3f2c2700 1 -- 172.21.15.110:0/514680027 shutdown_connections 2021-03-25T14:16:34.410 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.405+0000 7fbc3f2c2700 1 -- 172.21.15.110:0/514680027 wait complete. 2021-03-25T14:16:34.410 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2021-03-25T14:16:34.418 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2021-03-25T14:16:33.907285+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3694,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":41304,"kb_used_data":2136,"kb_used_omap":0,"kb_used_meta":39104,"kb_avail":754933416,"statfs":{"total":773094113280,"available":773051817984,"internally_reserved":0,"allocated":2187264,"data_stored":886098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40042496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002628"},"pg_stats":[{"pgid":"5.3","version":"0'0","reported_seq":"11","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.257694+0000","last_change":"2021-03-25T14:16:15.256822+0000","last_active":"2021-03-25T14:16:15.257694+0000","last_peered":"2021-03-25T14:16:15.257694+0000","last_clean":"2021-03-25T14:16:15.257694+0000","last_became_active":"2021-03-25T14:16:15.254487+0000","last_became_peered":"2021-03-25T14:16:15.254487+0000","last_unstale":"2021-03-25T14:16:15.257694+0000","last_undegraded":"2021-03-25T14:16:15.257694+0000","last_fullsized":"2021-03-25T14:16:15.257694+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:14.103276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:14.103276+0000","last_clean_scrub_stamp":"2021-03-25T14:16:14.103276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":"13","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.252525+0000","last_change":"2021-03-25T14:16:11.106425+0000","last_active":"2021-03-25T14:16:15.252525+0000","last_peered":"2021-03-25T14:16:15.252525+0000","last_clean":"2021-03-25T14:16:15.252525+0000","last_became_active":"2021-03-25T14:16:11.106053+0000","last_became_peered":"2021-03-25T14:16:11.106053+0000","last_unstale":"2021-03-25T14:16:15.252525+0000","last_undegraded":"2021-03-25T14:16:15.252525+0000","last_fullsized":"2021-03-25T14:16:15.252525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:10.755483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:10.755483+0000","last_clean_scrub_stamp":"2021-03-25T14:16:10.755483+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"17","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.252763+0000","last_change":"2021-03-25T14:16:02.105202+0000","last_active":"2021-03-25T14:16:15.252763+0000","last_peered":"2021-03-25T14:16:15.252763+0000","last_clean":"2021-03-25T14:16:15.252763+0000","last_became_active":"2021-03-25T14:16:02.104918+0000","last_became_peered":"2021-03-25T14:16:02.104918+0000","last_unstale":"2021-03-25T14:16:15.252763+0000","last_undegraded":"2021-03-25T14:16:15.252763+0000","last_fullsized":"2021-03-25T14:16:15.252763+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:01.019551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:01.019551+0000","last_clean_scrub_stamp":"2021-03-25T14:16:01.019551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"20'6","reported_seq":"20","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.117478+0000","last_change":"2021-03-25T14:16:10.768940+0000","last_active":"2021-03-25T14:16:15.117478+0000","last_peered":"2021-03-25T14:16:15.117478+0000","last_clean":"2021-03-25T14:16:15.117478+0000","last_became_active":"2021-03-25T14:16:10.768642+0000","last_became_peered":"2021-03-25T14:16:10.768642+0000","last_unstale":"2021-03-25T14:16:15.117478+0000","last_undegraded":"2021-03-25T14:16:15.117478+0000","last_fullsized":"2021-03-25T14:16:15.117478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:09.748434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:09.748434+0000","last_clean_scrub_stamp":"2021-03-25T14:16:09.748434+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":"11","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.257604+0000","last_change":"2021-03-25T14:16:15.255767+0000","last_active":"2021-03-25T14:16:15.257604+0000","last_peered":"2021-03-25T14:16:15.257604+0000","last_clean":"2021-03-25T14:16:15.257604+0000","last_became_active":"2021-03-25T14:16:15.255298+0000","last_became_peered":"2021-03-25T14:16:15.255298+0000","last_unstale":"2021-03-25T14:16:15.257604+0000","last_undegraded":"2021-03-25T14:16:15.257604+0000","last_fullsized":"2021-03-25T14:16:15.257604+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:14.103276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:14.103276+0000","last_clean_scrub_stamp":"2021-03-25T14:16:14.103276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"13","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.252610+0000","last_change":"2021-03-25T14:16:11.105078+0000","last_active":"2021-03-25T14:16:15.252610+0000","last_peered":"2021-03-25T14:16:15.252610+0000","last_clean":"2021-03-25T14:16:15.252610+0000","last_became_active":"2021-03-25T14:16:11.104774+0000","last_became_peered":"2021-03-25T14:16:11.104774+0000","last_unstale":"2021-03-25T14:16:15.252610+0000","last_undegraded":"2021-03-25T14:16:15.252610+0000","last_fullsized":"2021-03-25T14:16:15.252610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:10.755483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:10.755483+0000","last_clean_scrub_stamp":"2021-03-25T14:16:10.755483+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"17","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.117326+0000","last_change":"2021-03-25T14:16:02.045870+0000","last_active":"2021-03-25T14:16:15.117326+0000","last_peered":"2021-03-25T14:16:15.117326+0000","last_clean":"2021-03-25T14:16:15.117326+0000","last_became_active":"2021-03-25T14:16:02.045582+0000","last_became_peered":"2021-03-25T14:16:02.045582+0000","last_unstale":"2021-03-25T14:16:15.117326+0000","last_undegraded":"2021-03-25T14:16:15.117326+0000","last_fullsized":"2021-03-25T14:16:15.117326+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:01.019551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:01.019551+0000","last_clean_scrub_stamp":"2021-03-25T14:16:01.019551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"20'5","reported_seq":"19","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.115611+0000","last_change":"2021-03-25T14:16:10.768731+0000","last_active":"2021-03-25T14:16:15.115611+0000","last_peered":"2021-03-25T14:16:15.115611+0000","last_clean":"2021-03-25T14:16:15.115611+0000","last_became_active":"2021-03-25T14:16:10.768393+0000","last_became_peered":"2021-03-25T14:16:10.768393+0000","last_unstale":"2021-03-25T14:16:15.115611+0000","last_undegraded":"2021-03-25T14:16:15.115611+0000","last_fullsized":"2021-03-25T14:16:15.115611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:09.748434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:09.748434+0000","last_clean_scrub_stamp":"2021-03-25T14:16:09.748434+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":"11","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.257011+0000","last_change":"2021-03-25T14:16:15.256305+0000","last_active":"2021-03-25T14:16:15.257011+0000","last_peered":"2021-03-25T14:16:15.257011+0000","last_clean":"2021-03-25T14:16:15.257011+0000","last_became_active":"2021-03-25T14:16:15.255799+0000","last_became_peered":"2021-03-25T14:16:15.255799+0000","last_unstale":"2021-03-25T14:16:15.257011+0000","last_undegraded":"2021-03-25T14:16:15.257011+0000","last_fullsized":"2021-03-25T14:16:15.257011+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:14.103276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:14.103276+0000","last_clean_scrub_stamp":"2021-03-25T14:16:14.103276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"13","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.252647+0000","last_change":"2021-03-25T14:16:11.107686+0000","last_active":"2021-03-25T14:16:15.252647+0000","last_peered":"2021-03-25T14:16:15.252647+0000","last_clean":"2021-03-25T14:16:15.252647+0000","last_became_active":"2021-03-25T14:16:11.107343+0000","last_became_peered":"2021-03-25T14:16:11.107343+0000","last_unstale":"2021-03-25T14:16:15.252647+0000","last_undegraded":"2021-03-25T14:16:15.252647+0000","last_fullsized":"2021-03-25T14:16:15.252647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:10.755483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:10.755483+0000","last_clean_scrub_stamp":"2021-03-25T14:16:10.755483+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"17","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.110820+0000","last_change":"2021-03-25T14:16:02.154258+0000","last_active":"2021-03-25T14:16:15.110820+0000","last_peered":"2021-03-25T14:16:15.110820+0000","last_clean":"2021-03-25T14:16:15.110820+0000","last_became_active":"2021-03-25T14:16:02.153912+0000","last_became_peered":"2021-03-25T14:16:02.153912+0000","last_unstale":"2021-03-25T14:16:15.110820+0000","last_undegraded":"2021-03-25T14:16:15.110820+0000","last_fullsized":"2021-03-25T14:16:15.110820+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:01.019551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:01.019551+0000","last_clean_scrub_stamp":"2021-03-25T14:16:01.019551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"20'8","reported_seq":"22","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.252521+0000","last_change":"2021-03-25T14:16:10.768915+0000","last_active":"2021-03-25T14:16:15.252521+0000","last_peered":"2021-03-25T14:16:15.252521+0000","last_clean":"2021-03-25T14:16:15.252521+0000","last_became_active":"2021-03-25T14:16:10.768586+0000","last_became_peered":"2021-03-25T14:16:10.768586+0000","last_unstale":"2021-03-25T14:16:15.252521+0000","last_undegraded":"2021-03-25T14:16:15.252521+0000","last_fullsized":"2021-03-25T14:16:15.252521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:09.748434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:09.748434+0000","last_clean_scrub_stamp":"2021-03-25T14:16:09.748434+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":"11","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.123231+0000","last_change":"2021-03-25T14:16:15.122151+0000","last_active":"2021-03-25T14:16:15.123231+0000","last_peered":"2021-03-25T14:16:15.123231+0000","last_clean":"2021-03-25T14:16:15.123231+0000","last_became_active":"2021-03-25T14:16:15.121493+0000","last_became_peered":"2021-03-25T14:16:15.121493+0000","last_unstale":"2021-03-25T14:16:15.123231+0000","last_undegraded":"2021-03-25T14:16:15.123231+0000","last_fullsized":"2021-03-25T14:16:15.123231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:14.103276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:14.103276+0000","last_clean_scrub_stamp":"2021-03-25T14:16:14.103276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"13","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.111971+0000","last_change":"2021-03-25T14:16:11.105661+0000","last_active":"2021-03-25T14:16:15.111971+0000","last_peered":"2021-03-25T14:16:15.111971+0000","last_clean":"2021-03-25T14:16:15.111971+0000","last_became_active":"2021-03-25T14:16:11.105325+0000","last_became_peered":"2021-03-25T14:16:11.105325+0000","last_unstale":"2021-03-25T14:16:15.111971+0000","last_undegraded":"2021-03-25T14:16:15.111971+0000","last_fullsized":"2021-03-25T14:16:15.111971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:10.755483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:10.755483+0000","last_clean_scrub_stamp":"2021-03-25T14:16:10.755483+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"17","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.117638+0000","last_change":"2021-03-25T14:16:02.043408+0000","last_active":"2021-03-25T14:16:15.117638+0000","last_peered":"2021-03-25T14:16:15.117638+0000","last_clean":"2021-03-25T14:16:15.117638+0000","last_became_active":"2021-03-25T14:16:02.042899+0000","last_became_peered":"2021-03-25T14:16:02.042899+0000","last_unstale":"2021-03-25T14:16:15.117638+0000","last_undegraded":"2021-03-25T14:16:15.117638+0000","last_fullsized":"2021-03-25T14:16:15.117638+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:01.019551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:01.019551+0000","last_clean_scrub_stamp":"2021-03-25T14:16:01.019551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"18","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.112720+0000","last_change":"2021-03-25T14:16:01.032643+0000","last_active":"2021-03-25T14:16:15.112720+0000","last_peered":"2021-03-25T14:16:15.112720+0000","last_clean":"2021-03-25T14:16:15.112720+0000","last_became_active":"2021-03-25T14:16:01.032304+0000","last_became_peered":"2021-03-25T14:16:01.032304+0000","last_unstale":"2021-03-25T14:16:15.112720+0000","last_undegraded":"2021-03-25T14:16:15.112720+0000","last_fullsized":"2021-03-25T14:16:15.112720+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:00.015444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:00.015444+0000","last_clean_scrub_stamp":"2021-03-25T14:16:00.015444+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"20'1","reported_seq":"15","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.112643+0000","last_change":"2021-03-25T14:16:10.771389+0000","last_active":"2021-03-25T14:16:15.112643+0000","last_peered":"2021-03-25T14:16:15.112643+0000","last_clean":"2021-03-25T14:16:15.112643+0000","last_became_active":"2021-03-25T14:16:10.771043+0000","last_became_peered":"2021-03-25T14:16:10.771043+0000","last_unstale":"2021-03-25T14:16:15.112643+0000","last_undegraded":"2021-03-25T14:16:15.112643+0000","last_fullsized":"2021-03-25T14:16:15.112643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:09.748434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:09.748434+0000","last_clean_scrub_stamp":"2021-03-25T14:16:09.748434+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":"11","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.254834+0000","last_change":"2021-03-25T14:16:15.253828+0000","last_active":"2021-03-25T14:16:15.254834+0000","last_peered":"2021-03-25T14:16:15.254834+0000","last_clean":"2021-03-25T14:16:15.254834+0000","last_became_active":"2021-03-25T14:16:15.253337+0000","last_became_peered":"2021-03-25T14:16:15.253337+0000","last_unstale":"2021-03-25T14:16:15.254834+0000","last_undegraded":"2021-03-25T14:16:15.254834+0000","last_fullsized":"2021-03-25T14:16:15.254834+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:14.103276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:14.103276+0000","last_clean_scrub_stamp":"2021-03-25T14:16:14.103276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"13","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.117146+0000","last_change":"2021-03-25T14:16:11.103310+0000","last_active":"2021-03-25T14:16:15.117146+0000","last_peered":"2021-03-25T14:16:15.117146+0000","last_clean":"2021-03-25T14:16:15.117146+0000","last_became_active":"2021-03-25T14:16:11.102997+0000","last_became_peered":"2021-03-25T14:16:11.102997+0000","last_unstale":"2021-03-25T14:16:15.117146+0000","last_undegraded":"2021-03-25T14:16:15.117146+0000","last_fullsized":"2021-03-25T14:16:15.117146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:10.755483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:10.755483+0000","last_clean_scrub_stamp":"2021-03-25T14:16:10.755483+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"17","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.112806+0000","last_change":"2021-03-25T14:16:02.038804+0000","last_active":"2021-03-25T14:16:15.112806+0000","last_peered":"2021-03-25T14:16:15.112806+0000","last_clean":"2021-03-25T14:16:15.112806+0000","last_became_active":"2021-03-25T14:16:02.038363+0000","last_became_peered":"2021-03-25T14:16:02.038363+0000","last_unstale":"2021-03-25T14:16:15.112806+0000","last_undegraded":"2021-03-25T14:16:15.112806+0000","last_fullsized":"2021-03-25T14:16:15.112806+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:01.019551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:01.019551+0000","last_clean_scrub_stamp":"2021-03-25T14:16:01.019551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"14","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.116728+0000","last_change":"2021-03-25T14:16:10.769106+0000","last_active":"2021-03-25T14:16:15.116728+0000","last_peered":"2021-03-25T14:16:15.116728+0000","last_clean":"2021-03-25T14:16:15.116728+0000","last_became_active":"2021-03-25T14:16:10.768852+0000","last_became_peered":"2021-03-25T14:16:10.768852+0000","last_unstale":"2021-03-25T14:16:15.116728+0000","last_undegraded":"2021-03-25T14:16:15.116728+0000","last_fullsized":"2021-03-25T14:16:15.116728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:09.748434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:09.748434+0000","last_clean_scrub_stamp":"2021-03-25T14:16:09.748434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":"11","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.123906+0000","last_change":"2021-03-25T14:16:15.123013+0000","last_active":"2021-03-25T14:16:15.123906+0000","last_peered":"2021-03-25T14:16:15.123906+0000","last_clean":"2021-03-25T14:16:15.123906+0000","last_became_active":"2021-03-25T14:16:15.122541+0000","last_became_peered":"2021-03-25T14:16:15.122541+0000","last_unstale":"2021-03-25T14:16:15.123906+0000","last_undegraded":"2021-03-25T14:16:15.123906+0000","last_fullsized":"2021-03-25T14:16:15.123906+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:14.103276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:14.103276+0000","last_clean_scrub_stamp":"2021-03-25T14:16:14.103276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"13","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.116583+0000","last_change":"2021-03-25T14:16:11.105568+0000","last_active":"2021-03-25T14:16:15.116583+0000","last_peered":"2021-03-25T14:16:15.116583+0000","last_clean":"2021-03-25T14:16:15.116583+0000","last_became_active":"2021-03-25T14:16:11.105227+0000","last_became_peered":"2021-03-25T14:16:11.105227+0000","last_unstale":"2021-03-25T14:16:15.116583+0000","last_undegraded":"2021-03-25T14:16:15.116583+0000","last_fullsized":"2021-03-25T14:16:15.116583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:10.755483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:10.755483+0000","last_clean_scrub_stamp":"2021-03-25T14:16:10.755483+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"17","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.112756+0000","last_change":"2021-03-25T14:16:02.105511+0000","last_active":"2021-03-25T14:16:15.112756+0000","last_peered":"2021-03-25T14:16:15.112756+0000","last_clean":"2021-03-25T14:16:15.112756+0000","last_became_active":"2021-03-25T14:16:02.105125+0000","last_became_peered":"2021-03-25T14:16:02.105125+0000","last_unstale":"2021-03-25T14:16:15.112756+0000","last_undegraded":"2021-03-25T14:16:15.112756+0000","last_fullsized":"2021-03-25T14:16:15.112756+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:01.019551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:01.019551+0000","last_clean_scrub_stamp":"2021-03-25T14:16:01.019551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"25'11","reported_seq":"25","reported_epoch":"25","state":"active+clean","last_fresh":"2021-03-25T14:16:18.427929+0000","last_change":"2021-03-25T14:16:10.769051+0000","last_active":"2021-03-25T14:16:18.427929+0000","last_peered":"2021-03-25T14:16:18.427929+0000","last_clean":"2021-03-25T14:16:18.427929+0000","last_became_active":"2021-03-25T14:16:10.768737+0000","last_became_peered":"2021-03-25T14:16:10.768737+0000","last_unstale":"2021-03-25T14:16:18.427929+0000","last_undegraded":"2021-03-25T14:16:18.427929+0000","last_fullsized":"2021-03-25T14:16:18.427929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:09.748434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:09.748434+0000","last_clean_scrub_stamp":"2021-03-25T14:16:09.748434+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2924,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":"11","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.120651+0000","last_change":"2021-03-25T14:16:15.119981+0000","last_active":"2021-03-25T14:16:15.120651+0000","last_peered":"2021-03-25T14:16:15.120651+0000","last_clean":"2021-03-25T14:16:15.120651+0000","last_became_active":"2021-03-25T14:16:15.119536+0000","last_became_peered":"2021-03-25T14:16:15.119536+0000","last_unstale":"2021-03-25T14:16:15.120651+0000","last_undegraded":"2021-03-25T14:16:15.120651+0000","last_fullsized":"2021-03-25T14:16:15.120651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:14.103276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:14.103276+0000","last_clean_scrub_stamp":"2021-03-25T14:16:14.103276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"13","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.113254+0000","last_change":"2021-03-25T14:16:11.100402+0000","last_active":"2021-03-25T14:16:15.113254+0000","last_peered":"2021-03-25T14:16:15.113254+0000","last_clean":"2021-03-25T14:16:15.113254+0000","last_became_active":"2021-03-25T14:16:11.100104+0000","last_became_peered":"2021-03-25T14:16:11.100104+0000","last_unstale":"2021-03-25T14:16:15.113254+0000","last_undegraded":"2021-03-25T14:16:15.113254+0000","last_fullsized":"2021-03-25T14:16:15.113254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:10.755483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:10.755483+0000","last_clean_scrub_stamp":"2021-03-25T14:16:10.755483+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"20'6","reported_seq":"20","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.112671+0000","last_change":"2021-03-25T14:16:10.773718+0000","last_active":"2021-03-25T14:16:15.112671+0000","last_peered":"2021-03-25T14:16:15.112671+0000","last_clean":"2021-03-25T14:16:15.112671+0000","last_became_active":"2021-03-25T14:16:10.773461+0000","last_became_peered":"2021-03-25T14:16:10.773461+0000","last_unstale":"2021-03-25T14:16:15.112671+0000","last_undegraded":"2021-03-25T14:16:15.112671+0000","last_fullsized":"2021-03-25T14:16:15.112671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:09.748434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:09.748434+0000","last_clean_scrub_stamp":"2021-03-25T14:16:09.748434+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":576,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"17","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.254469+0000","last_change":"2021-03-25T14:16:02.043903+0000","last_active":"2021-03-25T14:16:15.254469+0000","last_peered":"2021-03-25T14:16:15.254469+0000","last_clean":"2021-03-25T14:16:15.254469+0000","last_became_active":"2021-03-25T14:16:02.043536+0000","last_became_peered":"2021-03-25T14:16:02.043536+0000","last_unstale":"2021-03-25T14:16:15.254469+0000","last_undegraded":"2021-03-25T14:16:15.254469+0000","last_fullsized":"2021-03-25T14:16:15.254469+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:01.019551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:01.019551+0000","last_clean_scrub_stamp":"2021-03-25T14:16:01.019551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":"11","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.254721+0000","last_change":"2021-03-25T14:16:15.254380+0000","last_active":"2021-03-25T14:16:15.254721+0000","last_peered":"2021-03-25T14:16:15.254721+0000","last_clean":"2021-03-25T14:16:15.254721+0000","last_became_active":"2021-03-25T14:16:15.253806+0000","last_became_peered":"2021-03-25T14:16:15.253806+0000","last_unstale":"2021-03-25T14:16:15.254721+0000","last_undegraded":"2021-03-25T14:16:15.254721+0000","last_fullsized":"2021-03-25T14:16:15.254721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:14.103276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:14.103276+0000","last_clean_scrub_stamp":"2021-03-25T14:16:14.103276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"13","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.115927+0000","last_change":"2021-03-25T14:16:11.105917+0000","last_active":"2021-03-25T14:16:15.115927+0000","last_peered":"2021-03-25T14:16:15.115927+0000","last_clean":"2021-03-25T14:16:15.115927+0000","last_became_active":"2021-03-25T14:16:11.105564+0000","last_became_peered":"2021-03-25T14:16:11.105564+0000","last_unstale":"2021-03-25T14:16:15.115927+0000","last_undegraded":"2021-03-25T14:16:15.115927+0000","last_fullsized":"2021-03-25T14:16:15.115927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:10.755483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:10.755483+0000","last_clean_scrub_stamp":"2021-03-25T14:16:10.755483+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"17","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.112015+0000","last_change":"2021-03-25T14:16:02.043644+0000","last_active":"2021-03-25T14:16:15.112015+0000","last_peered":"2021-03-25T14:16:15.112015+0000","last_clean":"2021-03-25T14:16:15.112015+0000","last_became_active":"2021-03-25T14:16:02.043304+0000","last_became_peered":"2021-03-25T14:16:02.043304+0000","last_unstale":"2021-03-25T14:16:15.112015+0000","last_undegraded":"2021-03-25T14:16:15.112015+0000","last_fullsized":"2021-03-25T14:16:15.112015+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:01.019551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:01.019551+0000","last_clean_scrub_stamp":"2021-03-25T14:16:01.019551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"21'4","reported_seq":"18","reported_epoch":"24","state":"active+clean","last_fresh":"2021-03-25T14:16:15.117204+0000","last_change":"2021-03-25T14:16:10.766193+0000","last_active":"2021-03-25T14:16:15.117204+0000","last_peered":"2021-03-25T14:16:15.117204+0000","last_clean":"2021-03-25T14:16:15.117204+0000","last_became_active":"2021-03-25T14:16:10.765873+0000","last_became_peered":"2021-03-25T14:16:10.765873+0000","last_unstale":"2021-03-25T14:16:15.117204+0000","last_undegraded":"2021-03-25T14:16:15.117204+0000","last_fullsized":"2021-03-25T14:16:15.117204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-25T14:16:09.748434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-25T14:16:09.748434+0000","last_clean_scrub_stamp":"2021-03-25T14:16:09.748434+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":3694,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5140,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366700,"statfs":{"total":96636764160,"available":96631500800,"internally_reserved":0,"allocated":274432,"data_stored":110653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.351}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3839999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7350000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.677}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5132,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366708,"statfs":{"total":96636764160,"available":96631508992,"internally_reserved":0,"allocated":266240,"data_stored":110077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2689999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5208,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366632,"statfs":{"total":96636764160,"available":96631431168,"internally_reserved":0,"allocated":278528,"data_stored":113001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4630000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1819999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5196,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366644,"statfs":{"total":96636764160,"available":96631443456,"internally_reserved":0,"allocated":266240,"data_stored":109158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.296}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.272}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5208,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366632,"statfs":{"total":96636764160,"available":96631431168,"internally_reserved":0,"allocated":278528,"data_stored":113001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0389999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1910000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5148,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366692,"statfs":{"total":96636764160,"available":96631492608,"internally_reserved":0,"allocated":282624,"data_stored":110813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.593}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5132,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366708,"statfs":{"total":96636764160,"available":96631508992,"internally_reserved":0,"allocated":266240,"data_stored":109158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.365}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2030000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.411}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5140,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366700,"statfs":{"total":96636764160,"available":96631500800,"internally_reserved":0,"allocated":274432,"data_stored":110237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.552}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-03-25T14:16:34.420 INFO:tasks.ceph.ceph_manager.ceph:clean! 2021-03-25T14:16:34.421 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2021-03-25T14:16:34.421 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2021-03-25T14:16:34.421 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-03-25T14:16:34.531 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.529+0000 7f3d4b51e700 1 Processor -- start 2021-03-25T14:16:34.531 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.529+0000 7f3d4b51e700 1 -- start start 2021-03-25T14:16:34.533 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.530+0000 7f3d4b51e700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3d440672d0 0x7f3d440b6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:34.533 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.530+0000 7f3d4b51e700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d440bbff0 con 0x7f3d440bac60 2021-03-25T14:16:34.533 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.530+0000 7f3d4b51e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d440b79a0 con 0x7f3d440b7420 2021-03-25T14:16:34.533 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.530+0000 7f3d4b51e700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d440bb610 con 0x7f3d440672d0 2021-03-25T14:16:34.533 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.530+0000 7f3d492ba700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3d440672d0 0x7f3d440b6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:34.534 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.530+0000 7f3d49abb700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f3d440bac60 0x7f3d44154130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41104/0 (socket says 172.21.15.110:41104) 2021-03-25T14:16:34.534 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.530+0000 7f3d49abb700 1 -- 172.21.15.110:0/2059735934 learned_addr learned my addr 172.21.15.110:0/2059735934 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:34.534 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.530+0000 7f3d492ba700 1 -- 172.21.15.110:0/2059735934 >> v1:172.21.15.174:6789/0 conn(0x7f3d440b7420 legacy=0x7f3d441497e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:34.534 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.530+0000 7f3d492ba700 1 -- 172.21.15.110:0/2059735934 >> v1:172.21.15.110:6789/0 conn(0x7f3d440bac60 legacy=0x7f3d44154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:34.534 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.530+0000 7f3d492ba700 1 -- 172.21.15.110:0/2059735934 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d440bb8b0 con 0x7f3d440672d0 2021-03-25T14:16:34.534 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.530+0000 7f3d33fff700 1 -- 172.21.15.110:0/2059735934 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 254869540 0 0) 0x7f3d440bbff0 con 0x7f3d440bac60 2021-03-25T14:16:34.534 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.530+0000 7f3d492ba700 1 --2- 172.21.15.110:0/2059735934 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d440672d0 0x7f3d440b6930 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f3d4000b9c0 tx=0x7f3d40006e20).ready entity=mon.0 client_cookie=9e6648e920e2fe05 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:34.534 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.530+0000 7f3d33fff700 1 -- 172.21.15.110:0/2059735934 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d40009870 con 0x7f3d440672d0 2021-03-25T14:16:34.534 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.530+0000 7f3d33fff700 1 -- 172.21.15.110:0/2059735934 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d400099d0 con 0x7f3d440672d0 2021-03-25T14:16:34.534 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.530+0000 7f3d33fff700 1 -- 172.21.15.110:0/2059735934 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d40009d50 con 0x7f3d440672d0 2021-03-25T14:16:34.534 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.531+0000 7f3d4b51e700 1 -- 172.21.15.110:0/2059735934 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d440672d0 msgr2=0x7f3d440b6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:34.535 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.531+0000 7f3d4b51e700 1 --2- 172.21.15.110:0/2059735934 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d440672d0 0x7f3d440b6930 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f3d4000b9c0 tx=0x7f3d40006e20).stop 2021-03-25T14:16:34.535 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.531+0000 7f3d4b51e700 1 -- 172.21.15.110:0/2059735934 shutdown_connections 2021-03-25T14:16:34.535 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.531+0000 7f3d4b51e700 1 --2- 172.21.15.110:0/2059735934 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d440672d0 0x7f3d440b6930 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:34.535 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.531+0000 7f3d4b51e700 1 -- 172.21.15.110:0/2059735934 >> 172.21.15.110:0/2059735934 conn(0x7f3d44063090 msgr2=0x7f3d440634a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:34.535 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.531+0000 7f3d4b51e700 1 -- 172.21.15.110:0/2059735934 shutdown_connections 2021-03-25T14:16:34.535 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.531+0000 7f3d4b51e700 1 -- 172.21.15.110:0/2059735934 wait complete. 2021-03-25T14:16:34.538 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.532+0000 7f3d4b51e700 1 Processor -- start 2021-03-25T14:16:34.538 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.532+0000 7f3d4b51e700 1 -- start start 2021-03-25T14:16:34.538 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.533+0000 7f3d4b51e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d440672d0 0x7f3d4414d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:34.538 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.533+0000 7f3d4b51e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d440b7420 0x7f3d440bde00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:34.539 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.533+0000 7f3d4b51e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d440bac60 0x7f3d44158770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:34.539 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.533+0000 7f3d4b51e700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4414d3d0 con 0x7f3d440672d0 2021-03-25T14:16:34.539 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.533+0000 7f3d4b51e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d44143780 con 0x7f3d440b7420 2021-03-25T14:16:34.539 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.533+0000 7f3d4b51e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4415d2f0 con 0x7f3d440bac60 2021-03-25T14:16:34.539 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.533+0000 7f3d492ba700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d440672d0 0x7f3d4414d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:34.539 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.533+0000 7f3d492ba700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d440672d0 0x7f3d4414d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48170/0 (socket says 172.21.15.110:48170) 2021-03-25T14:16:34.539 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.533+0000 7f3d492ba700 1 -- 172.21.15.110:0/1926320298 learned_addr learned my addr 172.21.15.110:0/1926320298 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:34.539 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.533+0000 7f3d48ab9700 1 --2- 172.21.15.110:0/1926320298 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d440b7420 0x7f3d440bde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:34.539 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.533+0000 7f3d49abb700 1 --2- 172.21.15.110:0/1926320298 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d440bac60 0x7f3d44158770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:34.539 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.533+0000 7f3d492ba700 1 -- 172.21.15.110:0/1926320298 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d440bac60 msgr2=0x7f3d44158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:34.539 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.533+0000 7f3d492ba700 1 --2- 172.21.15.110:0/1926320298 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d440bac60 0x7f3d44158770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:34.539 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.533+0000 7f3d492ba700 1 -- 172.21.15.110:0/1926320298 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d440b7420 msgr2=0x7f3d440bde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:34.540 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.533+0000 7f3d492ba700 1 --2- 172.21.15.110:0/1926320298 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d440b7420 0x7f3d440bde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:34.540 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.533+0000 7f3d492ba700 1 -- 172.21.15.110:0/1926320298 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d440b92f0 con 0x7f3d440672d0 2021-03-25T14:16:34.540 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.533+0000 7f3d49abb700 1 --2- 172.21.15.110:0/1926320298 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d440bac60 0x7f3d44158770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:34.540 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.533+0000 7f3d492ba700 1 --2- 172.21.15.110:0/1926320298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d440672d0 0x7f3d4414d7c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f3d40006e60 tx=0x7f3d40016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:34.540 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.533+0000 7f3d317fa700 1 -- 172.21.15.110:0/1926320298 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4001d430 con 0x7f3d440672d0 2021-03-25T14:16:34.540 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.533+0000 7f3d317fa700 1 -- 172.21.15.110:0/1926320298 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4001d590 con 0x7f3d440672d0 2021-03-25T14:16:34.540 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.533+0000 7f3d4b51e700 1 -- 172.21.15.110:0/1926320298 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d440b9590 con 0x7f3d440672d0 2021-03-25T14:16:34.540 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.533+0000 7f3d317fa700 1 -- 172.21.15.110:0/1926320298 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4001d910 con 0x7f3d440672d0 2021-03-25T14:16:34.540 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.534+0000 7f3d4b51e700 1 -- 172.21.15.110:0/1926320298 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d440b1340 con 0x7f3d440672d0 2021-03-25T14:16:34.540 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.534+0000 7f3d4b51e700 1 -- 172.21.15.110:0/1926320298 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d440b99f0 con 0x7f3d440672d0 2021-03-25T14:16:34.540 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.535+0000 7f3d317fa700 1 -- 172.21.15.110:0/1926320298 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f3d40024030 con 0x7f3d440672d0 2021-03-25T14:16:34.540 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.535+0000 7f3d317fa700 1 --2- 172.21.15.110:0/1926320298 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3d2405a0e0 0x7f3d2405c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:34.541 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.535+0000 7f3d317fa700 1 -- 172.21.15.110:0/1926320298 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f3d400751b0 con 0x7f3d440672d0 2021-03-25T14:16:34.541 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.535+0000 7f3d48ab9700 1 --2- 172.21.15.110:0/1926320298 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3d2405a0e0 0x7f3d2405c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:34.541 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.535+0000 7f3d48ab9700 1 --2- 172.21.15.110:0/1926320298 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3d2405a0e0 0x7f3d2405c5a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f3d44061260 tx=0x7f3d34009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:34.541 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.539+0000 7f3d317fa700 1 -- 172.21.15.110:0/1926320298 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f3d40048910 con 0x7f3d440672d0 2021-03-25T14:16:34.746 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.744+0000 7f3d4b51e700 1 -- 172.21.15.110:0/1926320298 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3d4405d7b0 con 0x7f3d440672d0 2021-03-25T14:16:34.747 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.745+0000 7f3d317fa700 1 -- 172.21.15.110:0/1926320298 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f3d40022080 con 0x7f3d440672d0 2021-03-25T14:16:34.747 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:16:34.747 INFO:teuthology.orchestra.run.smithi110.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-03-25T14:16:34.749 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.746+0000 7f3d4b51e700 1 -- 172.21.15.110:0/1926320298 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3d2405a0e0 msgr2=0x7f3d2405c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:34.749 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.746+0000 7f3d4b51e700 1 --2- 172.21.15.110:0/1926320298 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3d2405a0e0 0x7f3d2405c5a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f3d44061260 tx=0x7f3d34009040).stop 2021-03-25T14:16:34.749 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.746+0000 7f3d4b51e700 1 -- 172.21.15.110:0/1926320298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d440672d0 msgr2=0x7f3d4414d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:34.749 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.746+0000 7f3d4b51e700 1 --2- 172.21.15.110:0/1926320298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d440672d0 0x7f3d4414d7c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f3d40006e60 tx=0x7f3d40016000).stop 2021-03-25T14:16:34.749 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.746+0000 7f3d4b51e700 1 -- 172.21.15.110:0/1926320298 shutdown_connections 2021-03-25T14:16:34.749 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.746+0000 7f3d4b51e700 1 --2- 172.21.15.110:0/1926320298 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3d2405a0e0 0x7f3d2405c5a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:34.749 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.746+0000 7f3d4b51e700 1 --2- 172.21.15.110:0/1926320298 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d440bac60 0x7f3d44158770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:34.749 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.746+0000 7f3d4b51e700 1 --2- 172.21.15.110:0/1926320298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d440672d0 0x7f3d4414d7c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:34.749 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.746+0000 7f3d4b51e700 1 --2- 172.21.15.110:0/1926320298 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d440b7420 0x7f3d440bde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:34.749 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.746+0000 7f3d4b51e700 1 -- 172.21.15.110:0/1926320298 >> 172.21.15.110:0/1926320298 conn(0x7f3d44063090 msgr2=0x7f3d44146250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:34.749 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.746+0000 7f3d4b51e700 1 -- 172.21.15.110:0/1926320298 shutdown_connections 2021-03-25T14:16:34.750 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.746+0000 7f3d4b51e700 1 -- 172.21.15.110:0/1926320298 wait complete. 2021-03-25T14:16:34.759 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2021-03-25T14:16:34.760 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:16:34.870 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.868+0000 7fc242fce700 1 Processor -- start 2021-03-25T14:16:34.870 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.868+0000 7fc242fce700 1 -- start start 2021-03-25T14:16:34.873 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.869+0000 7fc242fce700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc23c0b1340 0x7fc23c0b1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:34.873 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.869+0000 7fc242fce700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc23c067510 con 0x7fc23c0668d0 2021-03-25T14:16:34.873 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.869+0000 7fc242fce700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc23c0677b0 con 0x7fc23c066420 2021-03-25T14:16:34.873 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.869+0000 7fc242fce700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc23c067a50 con 0x7fc23c0b1340 2021-03-25T14:16:34.873 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.869+0000 7fc240d6a700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc23c0b1340 0x7fc23c0b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:34.873 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.869+0000 7fc24156b700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fc23c0668d0 0x7fc23c14cee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41116/0 (socket says 172.21.15.110:41116) 2021-03-25T14:16:34.873 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.869+0000 7fc24156b700 1 -- 172.21.15.110:0/1229971619 learned_addr learned my addr 172.21.15.110:0/1229971619 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:34.873 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.869+0000 7fc240d6a700 1 -- 172.21.15.110:0/1229971619 >> v1:172.21.15.174:6789/0 conn(0x7fc23c066420 legacy=0x7fc23c149cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:34.873 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.869+0000 7fc240d6a700 1 -- 172.21.15.110:0/1229971619 >> v1:172.21.15.110:6789/0 conn(0x7fc23c0668d0 legacy=0x7fc23c14cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:34.873 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.869+0000 7fc240d6a700 1 -- 172.21.15.110:0/1229971619 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc23c067cf0 con 0x7fc23c0b1340 2021-03-25T14:16:34.873 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.869+0000 7fc23b7fe700 1 -- 172.21.15.110:0/1229971619 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 575037716 0 0) 0x7fc23c067510 con 0x7fc23c0668d0 2021-03-25T14:16:34.874 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.869+0000 7fc240d6a700 1 --2- 172.21.15.110:0/1229971619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc23c0b1340 0x7fc23c0b1720 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fc23000b9f0 tx=0x7fc230006e20).ready entity=mon.0 client_cookie=bcff2c3db56952fa server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:34.874 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.869+0000 7fc23b7fe700 1 -- 172.21.15.110:0/1229971619 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2300097f0 con 0x7fc23c0b1340 2021-03-25T14:16:34.874 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.869+0000 7fc23b7fe700 1 -- 172.21.15.110:0/1229971619 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc230009950 con 0x7fc23c0b1340 2021-03-25T14:16:34.874 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.869+0000 7fc23b7fe700 1 -- 172.21.15.110:0/1229971619 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc230009cd0 con 0x7fc23c0b1340 2021-03-25T14:16:34.874 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.870+0000 7fc242fce700 1 -- 172.21.15.110:0/1229971619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc23c0b1340 msgr2=0x7fc23c0b1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:34.874 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.870+0000 7fc242fce700 1 --2- 172.21.15.110:0/1229971619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc23c0b1340 0x7fc23c0b1720 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fc23000b9f0 tx=0x7fc230006e20).stop 2021-03-25T14:16:34.874 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.870+0000 7fc242fce700 1 -- 172.21.15.110:0/1229971619 shutdown_connections 2021-03-25T14:16:34.874 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.870+0000 7fc242fce700 1 --2- 172.21.15.110:0/1229971619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc23c0b1340 0x7fc23c0b1720 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:34.874 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.870+0000 7fc242fce700 1 -- 172.21.15.110:0/1229971619 >> 172.21.15.110:0/1229971619 conn(0x7fc23c0649a0 msgr2=0x7fc23c05c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:34.874 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.870+0000 7fc242fce700 1 -- 172.21.15.110:0/1229971619 shutdown_connections 2021-03-25T14:16:34.874 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.870+0000 7fc242fce700 1 -- 172.21.15.110:0/1229971619 wait complete. 2021-03-25T14:16:34.874 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.871+0000 7fc242fce700 1 Processor -- start 2021-03-25T14:16:34.875 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.871+0000 7fc242fce700 1 -- start start 2021-03-25T14:16:34.877 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.872+0000 7fc242fce700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc23c066420 0x7fc23c144370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:34.877 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.872+0000 7fc242fce700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc23c0668d0 0x7fc23c0c0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:34.877 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.872+0000 7fc242fce700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc23c0b1340 0x7fc23c1472e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:34.878 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.872+0000 7fc242fce700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c0b4a80 con 0x7fc23c0668d0 2021-03-25T14:16:34.878 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.872+0000 7fc242fce700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c15c220 con 0x7fc23c0b1340 2021-03-25T14:16:34.878 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.872+0000 7fc242fce700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c0c0ba0 con 0x7fc23c066420 2021-03-25T14:16:34.878 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.872+0000 7fc23bfff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc23c0668d0 0x7fc23c0c0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:34.878 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.872+0000 7fc23bfff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc23c0668d0 0x7fc23c0c0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48186/0 (socket says 172.21.15.110:48186) 2021-03-25T14:16:34.878 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.872+0000 7fc23bfff700 1 -- 172.21.15.110:0/1762294850 learned_addr learned my addr 172.21.15.110:0/1762294850 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:34.878 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.872+0000 7fc23bfff700 1 -- 172.21.15.110:0/1762294850 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc23c066420 msgr2=0x7fc23c144370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:34.878 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.872+0000 7fc24156b700 1 --2- 172.21.15.110:0/1762294850 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc23c0b1340 0x7fc23c1472e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:34.878 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.872+0000 7fc240d6a700 1 --2- 172.21.15.110:0/1762294850 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc23c066420 0x7fc23c144370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:34.878 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.872+0000 7fc23bfff700 1 --2- 172.21.15.110:0/1762294850 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc23c066420 0x7fc23c144370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:34.878 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.872+0000 7fc23bfff700 1 -- 172.21.15.110:0/1762294850 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc23c0b1340 msgr2=0x7fc23c1472e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:34.878 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.872+0000 7fc23bfff700 1 --2- 172.21.15.110:0/1762294850 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc23c0b1340 0x7fc23c1472e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:34.879 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.872+0000 7fc23bfff700 1 -- 172.21.15.110:0/1762294850 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc23c15c450 con 0x7fc23c0668d0 2021-03-25T14:16:34.879 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.872+0000 7fc24156b700 1 --2- 172.21.15.110:0/1762294850 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc23c0b1340 0x7fc23c1472e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:34.879 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.872+0000 7fc23bfff700 1 --2- 172.21.15.110:0/1762294850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc23c0668d0 0x7fc23c0c0500 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fc22800c760 tx=0x7fc228007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:34.879 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.872+0000 7fc238ff9700 1 -- 172.21.15.110:0/1762294850 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc228010510 con 0x7fc23c0668d0 2021-03-25T14:16:34.879 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.872+0000 7fc238ff9700 1 -- 172.21.15.110:0/1762294850 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc228010690 con 0x7fc23c0668d0 2021-03-25T14:16:34.879 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.872+0000 7fc242fce700 1 -- 172.21.15.110:0/1762294850 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc23c15c6f0 con 0x7fc23c0668d0 2021-03-25T14:16:34.879 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.872+0000 7fc238ff9700 1 -- 172.21.15.110:0/1762294850 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc228010a50 con 0x7fc23c0668d0 2021-03-25T14:16:34.879 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.873+0000 7fc242fce700 1 -- 172.21.15.110:0/1762294850 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc23c1477d0 con 0x7fc23c0668d0 2021-03-25T14:16:34.879 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.873+0000 7fc242fce700 1 -- 172.21.15.110:0/1762294850 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc23c15cb50 con 0x7fc23c0668d0 2021-03-25T14:16:34.879 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.874+0000 7fc238ff9700 1 -- 172.21.15.110:0/1762294850 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fc228010070 con 0x7fc23c0668d0 2021-03-25T14:16:34.879 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.874+0000 7fc238ff9700 1 --2- 172.21.15.110:0/1762294850 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc21c05a0b0 0x7fc21c05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:34.879 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.874+0000 7fc238ff9700 1 -- 172.21.15.110:0/1762294850 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fc228073bf0 con 0x7fc23c0668d0 2021-03-25T14:16:34.880 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.874+0000 7fc240d6a700 1 --2- 172.21.15.110:0/1762294850 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc21c05a0b0 0x7fc21c05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:34.880 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.874+0000 7fc240d6a700 1 --2- 172.21.15.110:0/1762294850 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc21c05a0b0 0x7fc21c05c570 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fc23c148070 tx=0x7fc230016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:34.880 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:34.878+0000 7fc238ff9700 1 -- 172.21.15.110:0/1762294850 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fc2280472a0 con 0x7fc23c0668d0 2021-03-25T14:16:35.030 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.028+0000 7fc242fce700 1 -- 172.21.15.110:0/1762294850 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc23c05d7b0 con 0x7fc23c0668d0 2021-03-25T14:16:35.031 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.029+0000 7fc238ff9700 1 -- 172.21.15.110:0/1762294850 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18685 (secure 0 0 0) 0x7fc22804a8c0 con 0x7fc23c0668d0 2021-03-25T14:16:35.031 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:16:35.031 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":25,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:16:15.446609+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-03-25T14:16:09.478442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-03-25T14:16:10.071152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2021-03-25T14:16:13.122119+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:16:35.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.031+0000 7fc242fce700 1 -- 172.21.15.110:0/1762294850 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc21c05a0b0 msgr2=0x7fc21c05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:35.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.031+0000 7fc242fce700 1 --2- 172.21.15.110:0/1762294850 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc21c05a0b0 0x7fc21c05c570 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fc23c148070 tx=0x7fc230016000).stop 2021-03-25T14:16:35.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.031+0000 7fc242fce700 1 -- 172.21.15.110:0/1762294850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc23c0668d0 msgr2=0x7fc23c0c0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:35.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.031+0000 7fc242fce700 1 --2- 172.21.15.110:0/1762294850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc23c0668d0 0x7fc23c0c0500 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fc22800c760 tx=0x7fc228007c60).stop 2021-03-25T14:16:35.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.031+0000 7fc242fce700 1 -- 172.21.15.110:0/1762294850 shutdown_connections 2021-03-25T14:16:35.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.031+0000 7fc242fce700 1 --2- 172.21.15.110:0/1762294850 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc21c05a0b0 0x7fc21c05c570 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:35.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.031+0000 7fc242fce700 1 --2- 172.21.15.110:0/1762294850 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc23c0b1340 0x7fc23c1472e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:35.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.031+0000 7fc242fce700 1 --2- 172.21.15.110:0/1762294850 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc23c066420 0x7fc23c144370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:35.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.031+0000 7fc242fce700 1 --2- 172.21.15.110:0/1762294850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc23c0668d0 0x7fc23c0c0500 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:35.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.031+0000 7fc242fce700 1 -- 172.21.15.110:0/1762294850 >> 172.21.15.110:0/1762294850 conn(0x7fc23c0649a0 msgr2=0x7fc23c05c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:35.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.031+0000 7fc242fce700 1 -- 172.21.15.110:0/1762294850 shutdown_connections 2021-03-25T14:16:35.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.031+0000 7fc242fce700 1 -- 172.21.15.110:0/1762294850 wait complete. 2021-03-25T14:16:35.045 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-03-25T14:15:59.047299+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-03-25T14:16:00.537926+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-03-25T14:16:09.478442+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-03-25T14:16:10.071152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2021-03-25T14:16:13.122119+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-03-25T14:16:35.045 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-03-25T14:16:35.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.156+0000 7f94dc0ab700 1 Processor -- start 2021-03-25T14:16:35.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.156+0000 7f94dc0ab700 1 -- start start 2021-03-25T14:16:35.160 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.157+0000 7f94dc0ab700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94d414cc90 0x7f94d414d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:35.160 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.157+0000 7f94dc0ab700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f94d40685d0 0x7f94d4068a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:35.161 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.157+0000 7f94dc0ab700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94d40691b0 con 0x7f94d414d470 2021-03-25T14:16:35.161 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.157+0000 7f94dc0ab700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94d40bc2b0 con 0x7f94d40685d0 2021-03-25T14:16:35.161 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.157+0000 7f94dc0ab700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d4149dd0 con 0x7f94d414cc90 2021-03-25T14:16:35.161 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.157+0000 7f94d9e47700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f94d414d470 0x7f94d41493c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41128/0 (socket says 172.21.15.110:41128) 2021-03-25T14:16:35.161 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.157+0000 7f94da648700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f94d40685d0 0x7f94d4068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:35.161 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.157+0000 7f94d9e47700 1 -- 172.21.15.110:0/4099882395 learned_addr learned my addr 172.21.15.110:0/4099882395 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:35.161 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.157+0000 7f94d9646700 1 --2- 172.21.15.110:0/4099882395 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94d414cc90 0x7f94d414d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:35.161 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.157+0000 7f94d8e45700 1 -- 172.21.15.110:0/4099882395 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 346560354 0 0) 0x7f94d40691b0 con 0x7f94d414d470 2021-03-25T14:16:35.161 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.157+0000 7f94da648700 1 -- 172.21.15.110:0/4099882395 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94d414cc90 msgr2=0x7f94d414d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:35.161 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.157+0000 7f94da648700 1 --2- 172.21.15.110:0/4099882395 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94d414cc90 0x7f94d414d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:35.161 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.157+0000 7f94da648700 1 -- 172.21.15.110:0/4099882395 >> v1:172.21.15.110:6789/0 conn(0x7f94d414d470 legacy=0x7f94d41493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:35.161 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.157+0000 7f94da648700 1 -- 172.21.15.110:0/4099882395 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d414a070 con 0x7f94d40685d0 2021-03-25T14:16:35.162 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.157+0000 7f94da648700 1 --2- 172.21.15.110:0/4099882395 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d40685d0 0x7f94d4068a40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f94cc009cc0 tx=0x7f94cc009220).ready entity=mon.0 client_cookie=44ceb4562a097009 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:35.162 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.158+0000 7f94d8e45700 1 -- 172.21.15.110:0/4099882395 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc00bbf0 con 0x7f94d40685d0 2021-03-25T14:16:35.162 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.158+0000 7f94d8e45700 1 -- 172.21.15.110:0/4099882395 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94cc00bd50 con 0x7f94d40685d0 2021-03-25T14:16:35.162 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.158+0000 7f94d8e45700 1 -- 172.21.15.110:0/4099882395 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc011630 con 0x7f94d40685d0 2021-03-25T14:16:35.162 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.158+0000 7f94dc0ab700 1 -- 172.21.15.110:0/4099882395 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d40685d0 msgr2=0x7f94d4068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:35.162 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.158+0000 7f94dc0ab700 1 --2- 172.21.15.110:0/4099882395 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d40685d0 0x7f94d4068a40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f94cc009cc0 tx=0x7f94cc009220).stop 2021-03-25T14:16:35.162 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.158+0000 7f94dc0ab700 1 -- 172.21.15.110:0/4099882395 shutdown_connections 2021-03-25T14:16:35.162 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.158+0000 7f94dc0ab700 1 --2- 172.21.15.110:0/4099882395 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d40685d0 0x7f94d4068a40 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:35.162 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.158+0000 7f94dc0ab700 1 --2- 172.21.15.110:0/4099882395 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94d414cc90 0x7f94d414d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:35.162 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.158+0000 7f94dc0ab700 1 -- 172.21.15.110:0/4099882395 >> 172.21.15.110:0/4099882395 conn(0x7f94d4060c40 msgr2=0x7f94d4061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:35.162 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.158+0000 7f94dc0ab700 1 -- 172.21.15.110:0/4099882395 shutdown_connections 2021-03-25T14:16:35.162 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.158+0000 7f94dc0ab700 1 -- 172.21.15.110:0/4099882395 wait complete. 2021-03-25T14:16:35.165 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.159+0000 7f94dc0ab700 1 Processor -- start 2021-03-25T14:16:35.166 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.159+0000 7f94dc0ab700 1 -- start start 2021-03-25T14:16:35.166 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.160+0000 7f94dc0ab700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94d40685d0 0x7f94d40a56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:35.166 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.160+0000 7f94dc0ab700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94d414cc90 0x7f94d40b8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:35.166 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.160+0000 7f94dc0ab700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d414d470 0x7f94d40b8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:35.166 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.160+0000 7f94dc0ab700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d4159680 con 0x7f94d414d470 2021-03-25T14:16:35.166 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.160+0000 7f94dc0ab700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d4158c00 con 0x7f94d414cc90 2021-03-25T14:16:35.166 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.160+0000 7f94dc0ab700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d4158ea0 con 0x7f94d40685d0 2021-03-25T14:16:35.166 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.160+0000 7f94da648700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d414d470 0x7f94d40b8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:35.166 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.160+0000 7f94da648700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d414d470 0x7f94d40b8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48198/0 (socket says 172.21.15.110:48198) 2021-03-25T14:16:35.166 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.160+0000 7f94da648700 1 -- 172.21.15.110:0/2507979575 learned_addr learned my addr 172.21.15.110:0/2507979575 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:35.166 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.160+0000 7f94d9e47700 1 --2- 172.21.15.110:0/2507979575 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94d40685d0 0x7f94d40a56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:35.167 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.160+0000 7f94d9646700 1 --2- 172.21.15.110:0/2507979575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94d414cc90 0x7f94d40b8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:35.167 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.160+0000 7f94da648700 1 -- 172.21.15.110:0/2507979575 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94d40685d0 msgr2=0x7f94d40a56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:35.167 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.160+0000 7f94da648700 1 --2- 172.21.15.110:0/2507979575 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94d40685d0 0x7f94d40a56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:35.167 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.160+0000 7f94da648700 1 -- 172.21.15.110:0/2507979575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94d414cc90 msgr2=0x7f94d40b8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:35.167 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.160+0000 7f94da648700 1 --2- 172.21.15.110:0/2507979575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94d414cc90 0x7f94d40b8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:35.167 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.160+0000 7f94da648700 1 -- 172.21.15.110:0/2507979575 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d4159140 con 0x7f94d414d470 2021-03-25T14:16:35.167 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.160+0000 7f94d9646700 1 --2- 172.21.15.110:0/2507979575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94d414cc90 0x7f94d40b8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:35.167 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.160+0000 7f94da648700 1 --2- 172.21.15.110:0/2507979575 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d414d470 0x7f94d40b8770 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f94d405d650 tx=0x7f94cc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:35.167 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.160+0000 7f94c1ffb700 1 -- 172.21.15.110:0/2507979575 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc011e50 con 0x7f94d414d470 2021-03-25T14:16:35.167 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.161+0000 7f94c1ffb700 1 -- 172.21.15.110:0/2507979575 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94cc01e070 con 0x7f94d414d470 2021-03-25T14:16:35.167 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.161+0000 7f94dc0ab700 1 -- 172.21.15.110:0/2507979575 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94d41593e0 con 0x7f94d414d470 2021-03-25T14:16:35.167 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.161+0000 7f94c1ffb700 1 -- 172.21.15.110:0/2507979575 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc010b90 con 0x7f94d414d470 2021-03-25T14:16:35.167 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.161+0000 7f94dc0ab700 1 -- 172.21.15.110:0/2507979575 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94d40a5c20 con 0x7f94d414d470 2021-03-25T14:16:35.168 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.161+0000 7f94dc0ab700 1 -- 172.21.15.110:0/2507979575 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94d405d7b0 con 0x7f94d414d470 2021-03-25T14:16:35.168 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.162+0000 7f94c1ffb700 1 -- 172.21.15.110:0/2507979575 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f94cc02b070 con 0x7f94d414d470 2021-03-25T14:16:35.168 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.162+0000 7f94c1ffb700 1 --2- 172.21.15.110:0/2507979575 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f94b405a0e0 0x7f94b405c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:35.168 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.162+0000 7f94c1ffb700 1 -- 172.21.15.110:0/2507979575 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f94cc075840 con 0x7f94d414d470 2021-03-25T14:16:35.168 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.162+0000 7f94d9e47700 1 --2- 172.21.15.110:0/2507979575 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f94b405a0e0 0x7f94b405c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:35.168 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.163+0000 7f94d9e47700 1 --2- 172.21.15.110:0/2507979575 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f94b405a0e0 0x7f94b405c5a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f94d0007fd0 tx=0x7f94d0007c50).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:35.168 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.166+0000 7f94c1ffb700 1 -- 172.21.15.110:0/2507979575 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f94cc048ef0 con 0x7f94d414d470 2021-03-25T14:16:35.316 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.314+0000 7f94dc0ab700 1 -- 172.21.15.110:0/2507979575 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f94d40b8000 con 0x7f94d414d470 2021-03-25T14:16:35.316 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.315+0000 7f94c1ffb700 1 -- 172.21.15.110:0/2507979575 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7f94cc04c510 con 0x7f94d414d470 2021-03-25T14:16:35.317 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 1 2021-03-25T14:16:35.318 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.316+0000 7f94dc0ab700 1 -- 172.21.15.110:0/2507979575 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f94b405a0e0 msgr2=0x7f94b405c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:35.318 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.316+0000 7f94dc0ab700 1 --2- 172.21.15.110:0/2507979575 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f94b405a0e0 0x7f94b405c5a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f94d0007fd0 tx=0x7f94d0007c50).stop 2021-03-25T14:16:35.318 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.316+0000 7f94dc0ab700 1 -- 172.21.15.110:0/2507979575 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d414d470 msgr2=0x7f94d40b8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:35.319 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.316+0000 7f94dc0ab700 1 --2- 172.21.15.110:0/2507979575 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d414d470 0x7f94d40b8770 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f94d405d650 tx=0x7f94cc017000).stop 2021-03-25T14:16:35.319 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.316+0000 7f94dc0ab700 1 -- 172.21.15.110:0/2507979575 shutdown_connections 2021-03-25T14:16:35.319 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.316+0000 7f94dc0ab700 1 --2- 172.21.15.110:0/2507979575 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f94b405a0e0 0x7f94b405c5a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:35.319 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.316+0000 7f94dc0ab700 1 --2- 172.21.15.110:0/2507979575 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d414d470 0x7f94d40b8770 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:35.319 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.316+0000 7f94dc0ab700 1 --2- 172.21.15.110:0/2507979575 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94d40685d0 0x7f94d40a56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:35.319 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.316+0000 7f94dc0ab700 1 --2- 172.21.15.110:0/2507979575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94d414cc90 0x7f94d40b8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:35.319 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.316+0000 7f94dc0ab700 1 -- 172.21.15.110:0/2507979575 >> 172.21.15.110:0/2507979575 conn(0x7f94d4060c40 msgr2=0x7f94d40b68e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:35.319 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.316+0000 7f94dc0ab700 1 -- 172.21.15.110:0/2507979575 shutdown_connections 2021-03-25T14:16:35.319 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.316+0000 7f94dc0ab700 1 -- 172.21.15.110:0/2507979575 wait complete. 2021-03-25T14:16:35.329 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-03-25T14:16:35.444 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.439+0000 7f6d28a9f700 1 Processor -- start 2021-03-25T14:16:35.444 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.439+0000 7f6d28a9f700 1 -- start start 2021-03-25T14:16:35.444 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.440+0000 7f6d28a9f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6d240bb660 0x7f6d240ba9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:35.444 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.440+0000 7f6d28a9f700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6d2414cdc0 0x7f6d24148c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:35.444 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.440+0000 7f6d28a9f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d240b1920 con 0x7f6d240bc110 2021-03-25T14:16:35.444 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.440+0000 7f6d28a9f700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d24068850 con 0x7f6d2414cdc0 2021-03-25T14:16:35.444 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.440+0000 7f6d28a9f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d24067d30 con 0x7f6d240bb660 2021-03-25T14:16:35.444 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.440+0000 7f6d23fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6d2414cdc0 0x7f6d24148c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:35.444 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.440+0000 7f6d23fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6d2414cdc0 0x7f6d24148c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48208/0 (socket says 172.21.15.110:48208) 2021-03-25T14:16:35.444 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.440+0000 7f6d23fff700 1 -- 172.21.15.110:0/3056838758 learned_addr learned my addr 172.21.15.110:0/3056838758 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:35.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.440+0000 7f6d237fe700 1 --2- 172.21.15.110:0/3056838758 >> v2:172.21.15.174:3300/0 conn(0x7f6d240bb660 0x7f6d240ba9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:35.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.441+0000 7f6d23fff700 1 -- 172.21.15.110:0/3056838758 >> v2:172.21.15.174:3300/0 conn(0x7f6d240bb660 msgr2=0x7f6d240ba9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:35.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.441+0000 7f6d23fff700 1 --2- 172.21.15.110:0/3056838758 >> v2:172.21.15.174:3300/0 conn(0x7f6d240bb660 0x7f6d240ba9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:35.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.441+0000 7f6d23fff700 1 -- 172.21.15.110:0/3056838758 >> v1:172.21.15.174:6789/0 conn(0x7f6d240bc110 legacy=0x7f6d24067620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:35.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.441+0000 7f6d23fff700 1 -- 172.21.15.110:0/3056838758 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d240bc620 con 0x7f6d2414cdc0 2021-03-25T14:16:35.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.441+0000 7f6d237fe700 1 --2- 172.21.15.110:0/3056838758 >> v2:172.21.15.174:3300/0 conn(0x7f6d240bb660 0x7f6d240ba9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:35.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.441+0000 7f6d23fff700 1 --2- 172.21.15.110:0/3056838758 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d2414cdc0 0x7f6d24148c60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f6d240655d0 tx=0x7f6d1c0092d0).ready entity=mon.0 client_cookie=a3ffa13937677ae3 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:35.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.441+0000 7f6d227fc700 1 -- 172.21.15.110:0/3056838758 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c00bbb0 con 0x7f6d2414cdc0 2021-03-25T14:16:35.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.441+0000 7f6d227fc700 1 -- 172.21.15.110:0/3056838758 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1c00bd10 con 0x7f6d2414cdc0 2021-03-25T14:16:35.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.441+0000 7f6d227fc700 1 -- 172.21.15.110:0/3056838758 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c011610 con 0x7f6d2414cdc0 2021-03-25T14:16:35.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.441+0000 7f6d28a9f700 1 -- 172.21.15.110:0/3056838758 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d2414cdc0 msgr2=0x7f6d24148c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:35.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.441+0000 7f6d28a9f700 1 --2- 172.21.15.110:0/3056838758 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d2414cdc0 0x7f6d24148c60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f6d240655d0 tx=0x7f6d1c0092d0).stop 2021-03-25T14:16:35.446 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.441+0000 7f6d28a9f700 1 -- 172.21.15.110:0/3056838758 shutdown_connections 2021-03-25T14:16:35.446 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.441+0000 7f6d28a9f700 1 --2- 172.21.15.110:0/3056838758 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d2414cdc0 0x7f6d24148c60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:35.446 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.441+0000 7f6d28a9f700 1 --2- 172.21.15.110:0/3056838758 >> v2:172.21.15.174:3300/0 conn(0x7f6d240bb660 0x7f6d240ba9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:35.446 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.441+0000 7f6d28a9f700 1 -- 172.21.15.110:0/3056838758 >> 172.21.15.110:0/3056838758 conn(0x7f6d24063090 msgr2=0x7f6d240634a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:35.446 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.441+0000 7f6d28a9f700 1 -- 172.21.15.110:0/3056838758 shutdown_connections 2021-03-25T14:16:35.446 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.441+0000 7f6d28a9f700 1 -- 172.21.15.110:0/3056838758 wait complete. 2021-03-25T14:16:35.449 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.443+0000 7f6d28a9f700 1 Processor -- start 2021-03-25T14:16:35.449 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.443+0000 7f6d28a9f700 1 -- start start 2021-03-25T14:16:35.449 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.443+0000 7f6d28a9f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6d240bb660 0x7f6d2414f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:35.449 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.443+0000 7f6d28a9f700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d240bc110 0x7f6d240bf040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:35.449 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.443+0000 7f6d28a9f700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d2414cdc0 0x7f6d2413eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:35.449 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.443+0000 7f6d28a9f700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d241406b0 con 0x7f6d2414cdc0 2021-03-25T14:16:35.449 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.443+0000 7f6d28a9f700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d240c0020 con 0x7f6d240bc110 2021-03-25T14:16:35.449 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.443+0000 7f6d28a9f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d240bfad0 con 0x7f6d240bb660 2021-03-25T14:16:35.450 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.443+0000 7f6d23fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d2414cdc0 0x7f6d2413eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:35.450 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.443+0000 7f6d23fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d2414cdc0 0x7f6d2413eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48216/0 (socket says 172.21.15.110:48216) 2021-03-25T14:16:35.450 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.443+0000 7f6d23fff700 1 -- 172.21.15.110:0/533804348 learned_addr learned my addr 172.21.15.110:0/533804348 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:35.450 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.443+0000 7f6d237fe700 1 --2- 172.21.15.110:0/533804348 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6d240bb660 0x7f6d2414f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:35.450 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.443+0000 7f6d22ffd700 1 --2- 172.21.15.110:0/533804348 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d240bc110 0x7f6d240bf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:35.450 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.444+0000 7f6d23fff700 1 -- 172.21.15.110:0/533804348 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6d240bb660 msgr2=0x7f6d2414f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:35.450 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.444+0000 7f6d23fff700 1 --2- 172.21.15.110:0/533804348 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6d240bb660 0x7f6d2414f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:35.450 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.444+0000 7f6d23fff700 1 -- 172.21.15.110:0/533804348 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d240bc110 msgr2=0x7f6d240bf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:35.450 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.444+0000 7f6d23fff700 1 --2- 172.21.15.110:0/533804348 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d240bc110 0x7f6d240bf040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:35.450 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.444+0000 7f6d23fff700 1 -- 172.21.15.110:0/533804348 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d24140210 con 0x7f6d2414cdc0 2021-03-25T14:16:35.450 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.444+0000 7f6d23fff700 1 --2- 172.21.15.110:0/533804348 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d2414cdc0 0x7f6d2413eb30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f6d1c009310 tx=0x7f6d1c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:35.450 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.444+0000 7f6d0b7fe700 1 -- 172.21.15.110:0/533804348 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c00be80 con 0x7f6d2414cdc0 2021-03-25T14:16:35.451 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.444+0000 7f6d0b7fe700 1 -- 172.21.15.110:0/533804348 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1c011e30 con 0x7f6d2414cdc0 2021-03-25T14:16:35.451 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.444+0000 7f6d0b7fe700 1 -- 172.21.15.110:0/533804348 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c010c90 con 0x7f6d2414cdc0 2021-03-25T14:16:35.451 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.444+0000 7f6d28a9f700 1 -- 172.21.15.110:0/533804348 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d2414f5d0 con 0x7f6d2414cdc0 2021-03-25T14:16:35.451 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.444+0000 7f6d28a9f700 1 -- 172.21.15.110:0/533804348 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d240bf530 con 0x7f6d2414cdc0 2021-03-25T14:16:35.451 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.445+0000 7f6d28a9f700 1 -- 172.21.15.110:0/533804348 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d240bfc90 con 0x7f6d2414cdc0 2021-03-25T14:16:35.451 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.445+0000 7f6d0b7fe700 1 -- 172.21.15.110:0/533804348 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f6d1c00f070 con 0x7f6d2414cdc0 2021-03-25T14:16:35.451 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.445+0000 7f6d0b7fe700 1 --2- 172.21.15.110:0/533804348 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6d0405a0b0 0x7f6d0405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:35.451 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.446+0000 7f6d0b7fe700 1 -- 172.21.15.110:0/533804348 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f6d1c075d00 con 0x7f6d2414cdc0 2021-03-25T14:16:35.451 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.446+0000 7f6d237fe700 1 --2- 172.21.15.110:0/533804348 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6d0405a0b0 0x7f6d0405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:35.452 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.446+0000 7f6d237fe700 1 --2- 172.21.15.110:0/533804348 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6d0405a0b0 0x7f6d0405c570 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f6d24144ff0 tx=0x7f6d14008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:35.452 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.449+0000 7f6d0b7fe700 1 -- 172.21.15.110:0/533804348 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f6d1c079030 con 0x7f6d2414cdc0 2021-03-25T14:16:35.602 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.601+0000 7f6d28a9f700 1 -- 172.21.15.110:0/533804348 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6d24140050 con 0x7f6d2414cdc0 2021-03-25T14:16:35.603 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.601+0000 7f6d0b7fe700 1 -- 172.21.15.110:0/533804348 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6d1c0493b0 con 0x7f6d2414cdc0 2021-03-25T14:16:35.603 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:16:35.605 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.603+0000 7f6d28a9f700 1 -- 172.21.15.110:0/533804348 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6d0405a0b0 msgr2=0x7f6d0405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:35.605 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.603+0000 7f6d28a9f700 1 --2- 172.21.15.110:0/533804348 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6d0405a0b0 0x7f6d0405c570 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f6d24144ff0 tx=0x7f6d14008040).stop 2021-03-25T14:16:35.605 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.603+0000 7f6d28a9f700 1 -- 172.21.15.110:0/533804348 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d2414cdc0 msgr2=0x7f6d2413eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:35.605 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.603+0000 7f6d28a9f700 1 --2- 172.21.15.110:0/533804348 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d2414cdc0 0x7f6d2413eb30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f6d1c009310 tx=0x7f6d1c017000).stop 2021-03-25T14:16:35.605 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.603+0000 7f6d28a9f700 1 -- 172.21.15.110:0/533804348 shutdown_connections 2021-03-25T14:16:35.605 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.603+0000 7f6d28a9f700 1 --2- 172.21.15.110:0/533804348 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6d0405a0b0 0x7f6d0405c570 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:35.605 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.603+0000 7f6d28a9f700 1 --2- 172.21.15.110:0/533804348 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d2414cdc0 0x7f6d2413eb30 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:35.606 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.603+0000 7f6d28a9f700 1 --2- 172.21.15.110:0/533804348 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6d240bb660 0x7f6d2414f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:35.606 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.603+0000 7f6d28a9f700 1 --2- 172.21.15.110:0/533804348 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d240bc110 0x7f6d240bf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:35.606 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.603+0000 7f6d28a9f700 1 -- 172.21.15.110:0/533804348 >> 172.21.15.110:0/533804348 conn(0x7f6d24063090 msgr2=0x7f6d2414b230 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:35.606 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.603+0000 7f6d28a9f700 1 -- 172.21.15.110:0/533804348 shutdown_connections 2021-03-25T14:16:35.606 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.603+0000 7f6d28a9f700 1 -- 172.21.15.110:0/533804348 wait complete. 2021-03-25T14:16:35.616 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-03-25T14:16:35.728 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.726+0000 7fb282565700 1 Processor -- start 2021-03-25T14:16:35.728 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.726+0000 7fb282565700 1 -- start start 2021-03-25T14:16:35.731 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.727+0000 7fb282565700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb27c14cc90 0x7fb27c14d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:35.731 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.727+0000 7fb282565700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb27c0685d0 0x7fb27c068a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:35.731 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.727+0000 7fb282565700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb27c0691b0 con 0x7fb27c14d470 2021-03-25T14:16:35.731 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.727+0000 7fb282565700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb27c0bc2b0 con 0x7fb27c14cc90 2021-03-25T14:16:35.731 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.727+0000 7fb282565700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb27c149dd0 con 0x7fb27c0685d0 2021-03-25T14:16:35.731 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.727+0000 7fb27b7fe700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb27c14cc90 0x7fb27c14d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:35.731 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.727+0000 7fb27bfff700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fb27c14d470 0x7fb27c1493c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41156/0 (socket says 172.21.15.110:41156) 2021-03-25T14:16:35.731 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.727+0000 7fb27b7fe700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb27c14cc90 0x7fb27c14d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48224/0 (socket says 172.21.15.110:48224) 2021-03-25T14:16:35.732 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.727+0000 7fb27bfff700 1 -- 172.21.15.110:0/1859726678 learned_addr learned my addr 172.21.15.110:0/1859726678 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:35.732 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.727+0000 7fb27b7fe700 1 -- 172.21.15.110:0/1859726678 >> v2:172.21.15.174:3300/0 conn(0x7fb27c0685d0 msgr2=0x7fb27c068a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:35.732 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.727+0000 7fb27b7fe700 1 --2- 172.21.15.110:0/1859726678 >> v2:172.21.15.174:3300/0 conn(0x7fb27c0685d0 0x7fb27c068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-03-25T14:16:35.732 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.727+0000 7fb27b7fe700 1 -- 172.21.15.110:0/1859726678 >> v1:172.21.15.110:6789/0 conn(0x7fb27c14d470 legacy=0x7fb27c1493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:35.732 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.727+0000 7fb27affd700 1 -- 172.21.15.110:0/1859726678 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1075062834 0 0) 0x7fb27c0691b0 con 0x7fb27c14d470 2021-03-25T14:16:35.732 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.727+0000 7fb27b7fe700 1 -- 172.21.15.110:0/1859726678 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb27c14a070 con 0x7fb27c14cc90 2021-03-25T14:16:35.732 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.728+0000 7fb27b7fe700 1 --2- 172.21.15.110:0/1859726678 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb27c14cc90 0x7fb27c14d850 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fb27c0bc110 tx=0x7fb270006e20).ready entity=mon.0 client_cookie=9d47e0b9bec890a4 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:35.732 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.728+0000 7fb27affd700 1 -- 172.21.15.110:0/1859726678 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb270009870 con 0x7fb27c14cc90 2021-03-25T14:16:35.732 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.728+0000 7fb27affd700 1 -- 172.21.15.110:0/1859726678 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2700099d0 con 0x7fb27c14cc90 2021-03-25T14:16:35.732 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.728+0000 7fb27affd700 1 -- 172.21.15.110:0/1859726678 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb270009d50 con 0x7fb27c14cc90 2021-03-25T14:16:35.732 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.728+0000 7fb282565700 1 -- 172.21.15.110:0/1859726678 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb27c14cc90 msgr2=0x7fb27c14d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:35.732 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.728+0000 7fb282565700 1 --2- 172.21.15.110:0/1859726678 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb27c14cc90 0x7fb27c14d850 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fb27c0bc110 tx=0x7fb270006e20).stop 2021-03-25T14:16:35.732 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.728+0000 7fb282565700 1 -- 172.21.15.110:0/1859726678 shutdown_connections 2021-03-25T14:16:35.732 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.728+0000 7fb282565700 1 --2- 172.21.15.110:0/1859726678 >> v2:172.21.15.174:3300/0 conn(0x7fb27c0685d0 0x7fb27c068a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-03-25T14:16:35.733 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.728+0000 7fb282565700 1 --2- 172.21.15.110:0/1859726678 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb27c14cc90 0x7fb27c14d850 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:35.733 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.728+0000 7fb282565700 1 -- 172.21.15.110:0/1859726678 >> 172.21.15.110:0/1859726678 conn(0x7fb27c060c40 msgr2=0x7fb27c061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:35.733 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.728+0000 7fb282565700 1 -- 172.21.15.110:0/1859726678 shutdown_connections 2021-03-25T14:16:35.733 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.728+0000 7fb282565700 1 -- 172.21.15.110:0/1859726678 wait complete. 2021-03-25T14:16:35.733 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.729+0000 7fb282565700 1 Processor -- start 2021-03-25T14:16:35.733 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.729+0000 7fb282565700 1 -- start start 2021-03-25T14:16:35.735 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.730+0000 7fb282565700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb27c0685d0 0x7fb27c0a3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:35.735 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.730+0000 7fb282565700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb27c14cc90 0x7fb27c0b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:35.735 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.730+0000 7fb282565700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb27c14d470 0x7fb27c15c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:35.735 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.730+0000 7fb282565700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c0a55d0 con 0x7fb27c14cc90 2021-03-25T14:16:35.736 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.730+0000 7fb282565700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c0a5870 con 0x7fb27c0685d0 2021-03-25T14:16:35.736 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.730+0000 7fb282565700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c0a5b10 con 0x7fb27c14d470 2021-03-25T14:16:35.736 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.730+0000 7fb27b7fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb27c14cc90 0x7fb27c0b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:35.736 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.730+0000 7fb27b7fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb27c14cc90 0x7fb27c0b7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48230/0 (socket says 172.21.15.110:48230) 2021-03-25T14:16:35.736 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.730+0000 7fb27b7fe700 1 -- 172.21.15.110:0/1544751938 learned_addr learned my addr 172.21.15.110:0/1544751938 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:35.736 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.730+0000 7fb27bfff700 1 --2- 172.21.15.110:0/1544751938 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb27c0685d0 0x7fb27c0a3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:35.736 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.730+0000 7fb280b02700 1 --2- 172.21.15.110:0/1544751938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb27c14d470 0x7fb27c15c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:35.736 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.730+0000 7fb27b7fe700 1 -- 172.21.15.110:0/1544751938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb27c14d470 msgr2=0x7fb27c15c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:35.736 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.730+0000 7fb27b7fe700 1 --2- 172.21.15.110:0/1544751938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb27c14d470 0x7fb27c15c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:35.736 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.730+0000 7fb27b7fe700 1 -- 172.21.15.110:0/1544751938 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb27c0685d0 msgr2=0x7fb27c0a3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:35.736 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.730+0000 7fb27b7fe700 1 --2- 172.21.15.110:0/1544751938 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb27c0685d0 0x7fb27c0a3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:35.736 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.730+0000 7fb27b7fe700 1 -- 172.21.15.110:0/1544751938 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb27c0a5db0 con 0x7fb27c14cc90 2021-03-25T14:16:35.736 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.731+0000 7fb27b7fe700 1 --2- 172.21.15.110:0/1544751938 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb27c14cc90 0x7fb27c0b7030 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fb27c05d650 tx=0x7fb270016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:35.737 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.731+0000 7fb263fff700 1 -- 172.21.15.110:0/1544751938 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27001d430 con 0x7fb27c14cc90 2021-03-25T14:16:35.737 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.731+0000 7fb263fff700 1 -- 172.21.15.110:0/1544751938 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb27001d590 con 0x7fb27c14cc90 2021-03-25T14:16:35.737 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.731+0000 7fb263fff700 1 -- 172.21.15.110:0/1544751938 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27001d930 con 0x7fb27c14cc90 2021-03-25T14:16:35.737 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.731+0000 7fb282565700 1 -- 172.21.15.110:0/1544751938 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb27c0a40d0 con 0x7fb27c14cc90 2021-03-25T14:16:35.737 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.731+0000 7fb282565700 1 -- 172.21.15.110:0/1544751938 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb27c0a4c10 con 0x7fb27c14cc90 2021-03-25T14:16:35.737 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.732+0000 7fb282565700 1 -- 172.21.15.110:0/1544751938 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb27c05d7b0 con 0x7fb27c14cc90 2021-03-25T14:16:35.737 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.732+0000 7fb263fff700 1 -- 172.21.15.110:0/1544751938 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fb27000f070 con 0x7fb27c14cc90 2021-03-25T14:16:35.737 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.732+0000 7fb263fff700 1 --2- 172.21.15.110:0/1544751938 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb25c05a0b0 0x7fb25c05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:35.737 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.732+0000 7fb263fff700 1 -- 172.21.15.110:0/1544751938 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fb270075ca0 con 0x7fb27c14cc90 2021-03-25T14:16:35.737 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.732+0000 7fb27bfff700 1 --2- 172.21.15.110:0/1544751938 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb25c05a0b0 0x7fb25c05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:35.737 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.733+0000 7fb27bfff700 1 --2- 172.21.15.110:0/1544751938 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb25c05a0b0 0x7fb25c05c570 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fb27c0bfe30 tx=0x7fb26c009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:35.738 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.736+0000 7fb263fff700 1 -- 172.21.15.110:0/1544751938 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fb27007a070 con 0x7fb27c14cc90 2021-03-25T14:16:35.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.886+0000 7fb282565700 1 -- 172.21.15.110:0/1544751938 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb27c15bf90 con 0x7fb27c14cc90 2021-03-25T14:16:35.888 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.886+0000 7fb263fff700 1 -- 172.21.15.110:0/1544751938 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7fb270049350 con 0x7fb27c14cc90 2021-03-25T14:16:35.888 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:16:35.890 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.888+0000 7fb282565700 1 -- 172.21.15.110:0/1544751938 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb25c05a0b0 msgr2=0x7fb25c05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:35.890 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.888+0000 7fb282565700 1 --2- 172.21.15.110:0/1544751938 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb25c05a0b0 0x7fb25c05c570 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fb27c0bfe30 tx=0x7fb26c009040).stop 2021-03-25T14:16:35.890 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.888+0000 7fb282565700 1 -- 172.21.15.110:0/1544751938 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb27c14cc90 msgr2=0x7fb27c0b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:35.890 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.888+0000 7fb282565700 1 --2- 172.21.15.110:0/1544751938 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb27c14cc90 0x7fb27c0b7030 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fb27c05d650 tx=0x7fb270016000).stop 2021-03-25T14:16:35.890 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.888+0000 7fb282565700 1 -- 172.21.15.110:0/1544751938 shutdown_connections 2021-03-25T14:16:35.890 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.888+0000 7fb282565700 1 --2- 172.21.15.110:0/1544751938 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb25c05a0b0 0x7fb25c05c570 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:35.890 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.888+0000 7fb282565700 1 --2- 172.21.15.110:0/1544751938 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb27c0685d0 0x7fb27c0a3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:35.890 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.888+0000 7fb282565700 1 --2- 172.21.15.110:0/1544751938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb27c14d470 0x7fb27c15c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:35.890 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.888+0000 7fb282565700 1 --2- 172.21.15.110:0/1544751938 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb27c14cc90 0x7fb27c0b7030 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:35.891 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.888+0000 7fb282565700 1 -- 172.21.15.110:0/1544751938 >> 172.21.15.110:0/1544751938 conn(0x7fb27c060c40 msgr2=0x7fb27c0b5110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:35.891 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.888+0000 7fb282565700 1 -- 172.21.15.110:0/1544751938 shutdown_connections 2021-03-25T14:16:35.891 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:35.888+0000 7fb282565700 1 -- 172.21.15.110:0/1544751938 wait complete. 2021-03-25T14:16:35.901 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-03-25T14:16:36.014 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.012+0000 7f3d6589a700 1 Processor -- start 2021-03-25T14:16:36.014 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.012+0000 7f3d6589a700 1 -- start start 2021-03-25T14:16:36.017 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.013+0000 7f3d6589a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3d600be3a0 0x7f3d600b4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:36.017 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.013+0000 7f3d6589a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d600b47a0 0x7f3d60148c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:36.017 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.013+0000 7f3d6589a700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3d60149120 0x7f3d600b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:36.017 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.013+0000 7f3d6589a700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d600b4c20 con 0x7f3d60149120 2021-03-25T14:16:36.017 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.013+0000 7f3d6589a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d60149960 con 0x7f3d600be3a0 2021-03-25T14:16:36.017 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.013+0000 7f3d6589a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d60149c00 con 0x7f3d600b47a0 2021-03-25T14:16:36.018 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.013+0000 7f3d5f7fe700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3d60149120 0x7f3d600b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:36.018 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.013+0000 7f3d5f7fe700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3d60149120 0x7f3d600b8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48236/0 (socket says 172.21.15.110:48236) 2021-03-25T14:16:36.018 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.013+0000 7f3d5f7fe700 1 -- 172.21.15.110:0/4132943084 learned_addr learned my addr 172.21.15.110:0/4132943084 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:36.018 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.013+0000 7f3d5effd700 1 --2- 172.21.15.110:0/4132943084 >> v2:172.21.15.174:3300/0 conn(0x7f3d600be3a0 0x7f3d600b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:36.018 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.013+0000 7f3d5e7fc700 1 --2- 172.21.15.110:0/4132943084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d600b47a0 0x7f3d60148c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:36.018 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.013+0000 7f3d5f7fe700 1 -- 172.21.15.110:0/4132943084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d600b47a0 msgr2=0x7f3d60148c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:36.018 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.013+0000 7f3d5f7fe700 1 --2- 172.21.15.110:0/4132943084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d600b47a0 0x7f3d60148c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:36.018 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.013+0000 7f3d5f7fe700 1 -- 172.21.15.110:0/4132943084 >> v2:172.21.15.174:3300/0 conn(0x7f3d600be3a0 msgr2=0x7f3d600b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:36.018 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.013+0000 7f3d5f7fe700 1 --2- 172.21.15.110:0/4132943084 >> v2:172.21.15.174:3300/0 conn(0x7f3d600be3a0 0x7f3d600b4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:36.018 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.013+0000 7f3d5f7fe700 1 -- 172.21.15.110:0/4132943084 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d60149ea0 con 0x7f3d60149120 2021-03-25T14:16:36.018 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.013+0000 7f3d5e7fc700 1 --2- 172.21.15.110:0/4132943084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d600b47a0 0x7f3d60148c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:36.019 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.013+0000 7f3d5f7fe700 1 --2- 172.21.15.110:0/4132943084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d60149120 0x7f3d600b8cc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f3d60068250 tx=0x7f3d580092d0).ready entity=mon.0 client_cookie=e9c6b54ec23b561f server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:36.019 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.013+0000 7f3d5dffb700 1 -- 172.21.15.110:0/4132943084 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5800bbf0 con 0x7f3d60149120 2021-03-25T14:16:36.019 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.013+0000 7f3d5dffb700 1 -- 172.21.15.110:0/4132943084 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d5800bd50 con 0x7f3d60149120 2021-03-25T14:16:36.019 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.013+0000 7f3d5dffb700 1 -- 172.21.15.110:0/4132943084 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d58011610 con 0x7f3d60149120 2021-03-25T14:16:36.019 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.014+0000 7f3d6589a700 1 -- 172.21.15.110:0/4132943084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d60149120 msgr2=0x7f3d600b8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:36.019 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.014+0000 7f3d6589a700 1 --2- 172.21.15.110:0/4132943084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d60149120 0x7f3d600b8cc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f3d60068250 tx=0x7f3d580092d0).stop 2021-03-25T14:16:36.019 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.014+0000 7f3d6589a700 1 -- 172.21.15.110:0/4132943084 shutdown_connections 2021-03-25T14:16:36.019 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.014+0000 7f3d6589a700 1 --2- 172.21.15.110:0/4132943084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d60149120 0x7f3d600b8cc0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:36.019 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.014+0000 7f3d6589a700 1 --2- 172.21.15.110:0/4132943084 >> v2:172.21.15.174:3300/0 conn(0x7f3d600be3a0 0x7f3d600b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:36.019 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.014+0000 7f3d6589a700 1 --2- 172.21.15.110:0/4132943084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d600b47a0 0x7f3d60148c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:36.019 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.014+0000 7f3d6589a700 1 -- 172.21.15.110:0/4132943084 >> 172.21.15.110:0/4132943084 conn(0x7f3d600686f0 msgr2=0x7f3d60068b00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:36.019 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.014+0000 7f3d6589a700 1 -- 172.21.15.110:0/4132943084 shutdown_connections 2021-03-25T14:16:36.020 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.014+0000 7f3d6589a700 1 -- 172.21.15.110:0/4132943084 wait complete. 2021-03-25T14:16:36.020 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.015+0000 7f3d6589a700 1 Processor -- start 2021-03-25T14:16:36.020 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.015+0000 7f3d6589a700 1 -- start start 2021-03-25T14:16:36.022 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.016+0000 7f3d6589a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d600b47a0 0x7f3d600a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:36.022 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.016+0000 7f3d6589a700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d600be3a0 0x7f3d6014d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:36.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.016+0000 7f3d6589a700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d60149120 0x7f3d600642b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:36.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.016+0000 7f3d6589a700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d600a26e0 con 0x7f3d600be3a0 2021-03-25T14:16:36.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.016+0000 7f3d6589a700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6014db50 con 0x7f3d60149120 2021-03-25T14:16:36.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.016+0000 7f3d6589a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6014d8b0 con 0x7f3d600b47a0 2021-03-25T14:16:36.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.016+0000 7f3d5e7fc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d600be3a0 0x7f3d6014d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:36.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.016+0000 7f3d5e7fc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d600be3a0 0x7f3d6014d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48242/0 (socket says 172.21.15.110:48242) 2021-03-25T14:16:36.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.016+0000 7f3d5e7fc700 1 -- 172.21.15.110:0/2813884375 learned_addr learned my addr 172.21.15.110:0/2813884375 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:36.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.016+0000 7f3d5f7fe700 1 --2- 172.21.15.110:0/2813884375 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d60149120 0x7f3d600642b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:36.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.016+0000 7f3d5effd700 1 --2- 172.21.15.110:0/2813884375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d600b47a0 0x7f3d600a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:36.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.016+0000 7f3d5e7fc700 1 -- 172.21.15.110:0/2813884375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d600b47a0 msgr2=0x7f3d600a3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:36.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.016+0000 7f3d5e7fc700 1 --2- 172.21.15.110:0/2813884375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d600b47a0 0x7f3d600a3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:36.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.016+0000 7f3d5e7fc700 1 -- 172.21.15.110:0/2813884375 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d60149120 msgr2=0x7f3d600642b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:36.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.016+0000 7f3d5e7fc700 1 --2- 172.21.15.110:0/2813884375 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d60149120 0x7f3d600642b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:36.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.016+0000 7f3d5e7fc700 1 -- 172.21.15.110:0/2813884375 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d600a2d60 con 0x7f3d600be3a0 2021-03-25T14:16:36.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.016+0000 7f3d5f7fe700 1 --2- 172.21.15.110:0/2813884375 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d60149120 0x7f3d600642b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:36.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.016+0000 7f3d5e7fc700 1 --2- 172.21.15.110:0/2813884375 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d600be3a0 0x7f3d6014d210 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f3d5400c920 tx=0x7f3d54008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:36.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.017+0000 7f3d46ffd700 1 -- 172.21.15.110:0/2813884375 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5400cec0 con 0x7f3d600be3a0 2021-03-25T14:16:36.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.017+0000 7f3d46ffd700 1 -- 172.21.15.110:0/2813884375 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d54007740 con 0x7f3d600be3a0 2021-03-25T14:16:36.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.017+0000 7f3d6589a700 1 -- 172.21.15.110:0/2813884375 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d600a3000 con 0x7f3d600be3a0 2021-03-25T14:16:36.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.017+0000 7f3d46ffd700 1 -- 172.21.15.110:0/2813884375 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d54007ac0 con 0x7f3d600be3a0 2021-03-25T14:16:36.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.017+0000 7f3d6589a700 1 -- 172.21.15.110:0/2813884375 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d60061910 con 0x7f3d600be3a0 2021-03-25T14:16:36.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.018+0000 7f3d6589a700 1 -- 172.21.15.110:0/2813884375 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d6005d7b0 con 0x7f3d600be3a0 2021-03-25T14:16:36.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.018+0000 7f3d46ffd700 1 -- 172.21.15.110:0/2813884375 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f3d54011410 con 0x7f3d600be3a0 2021-03-25T14:16:36.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.018+0000 7f3d46ffd700 1 --2- 172.21.15.110:0/2813884375 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3d4005a0b0 0x7f3d4005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:36.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.018+0000 7f3d46ffd700 1 -- 172.21.15.110:0/2813884375 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f3d54073f60 con 0x7f3d600be3a0 2021-03-25T14:16:36.025 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.018+0000 7f3d5effd700 1 --2- 172.21.15.110:0/2813884375 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3d4005a0b0 0x7f3d4005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:36.025 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.019+0000 7f3d5effd700 1 --2- 172.21.15.110:0/2813884375 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3d4005a0b0 0x7f3d4005c570 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f3d50006fd0 tx=0x7f3d50008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:36.025 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.022+0000 7f3d46ffd700 1 -- 172.21.15.110:0/2813884375 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f3d540475b0 con 0x7f3d600be3a0 2021-03-25T14:16:36.172 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.170+0000 7f3d6589a700 1 -- 172.21.15.110:0/2813884375 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3d60061c50 con 0x7f3d600be3a0 2021-03-25T14:16:36.173 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.171+0000 7f3d46ffd700 1 -- 172.21.15.110:0/2813884375 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7f3d5404abd0 con 0x7f3d600be3a0 2021-03-25T14:16:36.173 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:16:36.175 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.172+0000 7f3d6589a700 1 -- 172.21.15.110:0/2813884375 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3d4005a0b0 msgr2=0x7f3d4005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:36.175 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.172+0000 7f3d6589a700 1 --2- 172.21.15.110:0/2813884375 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3d4005a0b0 0x7f3d4005c570 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f3d50006fd0 tx=0x7f3d50008040).stop 2021-03-25T14:16:36.175 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.172+0000 7f3d6589a700 1 -- 172.21.15.110:0/2813884375 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d600be3a0 msgr2=0x7f3d6014d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:36.175 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.172+0000 7f3d6589a700 1 --2- 172.21.15.110:0/2813884375 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d600be3a0 0x7f3d6014d210 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f3d5400c920 tx=0x7f3d54008040).stop 2021-03-25T14:16:36.175 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.172+0000 7f3d6589a700 1 -- 172.21.15.110:0/2813884375 shutdown_connections 2021-03-25T14:16:36.175 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.172+0000 7f3d6589a700 1 --2- 172.21.15.110:0/2813884375 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3d4005a0b0 0x7f3d4005c570 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:36.175 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.172+0000 7f3d6589a700 1 --2- 172.21.15.110:0/2813884375 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d60149120 0x7f3d600642b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:36.175 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.172+0000 7f3d6589a700 1 --2- 172.21.15.110:0/2813884375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d600b47a0 0x7f3d600a3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:36.175 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.172+0000 7f3d6589a700 1 --2- 172.21.15.110:0/2813884375 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d600be3a0 0x7f3d6014d210 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:36.176 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.172+0000 7f3d6589a700 1 -- 172.21.15.110:0/2813884375 >> 172.21.15.110:0/2813884375 conn(0x7f3d600686f0 msgr2=0x7f3d600bc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:36.176 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.172+0000 7f3d6589a700 1 -- 172.21.15.110:0/2813884375 shutdown_connections 2021-03-25T14:16:36.176 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.172+0000 7f3d6589a700 1 -- 172.21.15.110:0/2813884375 wait complete. 2021-03-25T14:16:36.186 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2021-03-25T14:16:36.304 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.296+0000 7fb82dc74700 1 Processor -- start 2021-03-25T14:16:36.305 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.296+0000 7fb82dc74700 1 -- start start 2021-03-25T14:16:36.305 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.297+0000 7fb82dc74700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb82814d470 0x7fb82814d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:36.305 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.297+0000 7fb82dc74700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8280691b0 con 0x7fb82814cc90 2021-03-25T14:16:36.305 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.297+0000 7fb82dc74700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8280bc2b0 con 0x7fb8280685d0 2021-03-25T14:16:36.305 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.297+0000 7fb82dc74700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb828149dd0 con 0x7fb82814d470 2021-03-25T14:16:36.305 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.297+0000 7fb826ffd700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fb82814cc90 0x7fb8281493c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41188/0 (socket says 172.21.15.110:41188) 2021-03-25T14:16:36.305 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.297+0000 7fb826ffd700 1 -- 172.21.15.110:0/3298426433 learned_addr learned my addr 172.21.15.110:0/3298426433 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:36.305 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.297+0000 7fb8277fe700 1 --2- 172.21.15.110:0/3298426433 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb82814d470 0x7fb82814d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:36.305 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.297+0000 7fb8267fc700 1 -- 172.21.15.110:0/3298426433 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4223457402 0 0) 0x7fb8280691b0 con 0x7fb82814cc90 2021-03-25T14:16:36.305 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.297+0000 7fb8267fc700 1 -- 172.21.15.110:0/3298426433 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb814003270 con 0x7fb82814cc90 2021-03-25T14:16:36.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.297+0000 7fb8267fc700 1 -- 172.21.15.110:0/3298426433 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2448499172 0 0) 0x7fb8280bc2b0 con 0x7fb8280685d0 2021-03-25T14:16:36.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.297+0000 7fb8267fc700 1 -- 172.21.15.110:0/3298426433 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8280691b0 con 0x7fb8280685d0 2021-03-25T14:16:36.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.297+0000 7fb8277fe700 1 -- 172.21.15.110:0/3298426433 >> v1:172.21.15.174:6789/0 conn(0x7fb8280685d0 legacy=0x7fb8280bc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:36.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.297+0000 7fb8277fe700 1 -- 172.21.15.110:0/3298426433 >> v1:172.21.15.110:6789/0 conn(0x7fb82814cc90 legacy=0x7fb8281493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:36.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.297+0000 7fb8277fe700 1 -- 172.21.15.110:0/3298426433 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82814a070 con 0x7fb82814d470 2021-03-25T14:16:36.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.298+0000 7fb8277fe700 1 --2- 172.21.15.110:0/3298426433 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb82814d470 0x7fb82814d850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fb81800b9f0 tx=0x7fb818006e20).ready entity=mon.2 client_cookie=54a56ed89f8c3181 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:36.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.298+0000 7fb8267fc700 1 -- 172.21.15.110:0/3298426433 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb818009630 con 0x7fb82814d470 2021-03-25T14:16:36.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.298+0000 7fb8267fc700 1 -- 172.21.15.110:0/3298426433 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb818009790 con 0x7fb82814d470 2021-03-25T14:16:36.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.298+0000 7fb8267fc700 1 -- 172.21.15.110:0/3298426433 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb818009b10 con 0x7fb82814d470 2021-03-25T14:16:36.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.298+0000 7fb82dc74700 1 -- 172.21.15.110:0/3298426433 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb82814d470 msgr2=0x7fb82814d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:36.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.298+0000 7fb82dc74700 1 --2- 172.21.15.110:0/3298426433 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb82814d470 0x7fb82814d850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fb81800b9f0 tx=0x7fb818006e20).stop 2021-03-25T14:16:36.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.298+0000 7fb82dc74700 1 -- 172.21.15.110:0/3298426433 shutdown_connections 2021-03-25T14:16:36.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.298+0000 7fb82dc74700 1 --2- 172.21.15.110:0/3298426433 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb82814d470 0x7fb82814d850 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:36.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.298+0000 7fb82dc74700 1 -- 172.21.15.110:0/3298426433 >> 172.21.15.110:0/3298426433 conn(0x7fb828060c40 msgr2=0x7fb828061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:36.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.298+0000 7fb82dc74700 1 -- 172.21.15.110:0/3298426433 shutdown_connections 2021-03-25T14:16:36.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.298+0000 7fb82dc74700 1 -- 172.21.15.110:0/3298426433 wait complete. 2021-03-25T14:16:36.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.299+0000 7fb82dc74700 1 Processor -- start 2021-03-25T14:16:36.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.299+0000 7fb82dc74700 1 -- start start 2021-03-25T14:16:36.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.300+0000 7fb82dc74700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8280685d0 0x7fb8280b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:36.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.300+0000 7fb82dc74700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb82814cc90 0x7fb8280a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:36.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.300+0000 7fb82dc74700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb82814d470 0x7fb8280a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:36.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.300+0000 7fb82dc74700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8280a29c0 con 0x7fb8280685d0 2021-03-25T14:16:36.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.300+0000 7fb82dc74700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8280a4a10 con 0x7fb82814d470 2021-03-25T14:16:36.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.300+0000 7fb82dc74700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8280a4cb0 con 0x7fb82814cc90 2021-03-25T14:16:36.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.300+0000 7fb8277fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8280685d0 0x7fb8280b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:36.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.300+0000 7fb8277fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8280685d0 0x7fb8280b4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48254/0 (socket says 172.21.15.110:48254) 2021-03-25T14:16:36.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.300+0000 7fb8277fe700 1 -- 172.21.15.110:0/405902552 learned_addr learned my addr 172.21.15.110:0/405902552 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:36.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.300+0000 7fb826ffd700 1 --2- 172.21.15.110:0/405902552 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb82814cc90 0x7fb8280a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:36.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.300+0000 7fb827fff700 1 --2- 172.21.15.110:0/405902552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb82814d470 0x7fb8280a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:36.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.300+0000 7fb8277fe700 1 -- 172.21.15.110:0/405902552 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb82814cc90 msgr2=0x7fb8280a3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:36.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.300+0000 7fb8277fe700 1 --2- 172.21.15.110:0/405902552 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb82814cc90 0x7fb8280a3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:36.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.300+0000 7fb8277fe700 1 -- 172.21.15.110:0/405902552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb82814d470 msgr2=0x7fb8280a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:36.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.300+0000 7fb8277fe700 1 --2- 172.21.15.110:0/405902552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb82814d470 0x7fb8280a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:36.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.300+0000 7fb8277fe700 1 -- 172.21.15.110:0/405902552 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8280b6780 con 0x7fb8280685d0 2021-03-25T14:16:36.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.301+0000 7fb826ffd700 1 --2- 172.21.15.110:0/405902552 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb82814cc90 0x7fb8280a3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:36.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.301+0000 7fb827fff700 1 --2- 172.21.15.110:0/405902552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb82814d470 0x7fb8280a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:36.309 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.301+0000 7fb8277fe700 1 --2- 172.21.15.110:0/405902552 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8280685d0 0x7fb8280b4f10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7fb81800b150 tx=0x7fb818016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:36.309 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.301+0000 7fb80f7fe700 1 -- 172.21.15.110:0/405902552 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb818011cc0 con 0x7fb8280685d0 2021-03-25T14:16:36.309 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.301+0000 7fb80f7fe700 1 -- 172.21.15.110:0/405902552 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb818011e20 con 0x7fb8280685d0 2021-03-25T14:16:36.309 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.301+0000 7fb82dc74700 1 -- 172.21.15.110:0/405902552 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8280b6a20 con 0x7fb8280685d0 2021-03-25T14:16:36.309 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.301+0000 7fb80f7fe700 1 -- 172.21.15.110:0/405902552 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81801d610 con 0x7fb8280685d0 2021-03-25T14:16:36.309 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.301+0000 7fb82dc74700 1 -- 172.21.15.110:0/405902552 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8280b7160 con 0x7fb8280685d0 2021-03-25T14:16:36.309 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.302+0000 7fb82dc74700 1 -- 172.21.15.110:0/405902552 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb82805d350 con 0x7fb8280685d0 2021-03-25T14:16:36.309 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.302+0000 7fb80f7fe700 1 -- 172.21.15.110:0/405902552 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fb81800f070 con 0x7fb8280685d0 2021-03-25T14:16:36.309 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.302+0000 7fb80f7fe700 1 --2- 172.21.15.110:0/405902552 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb80805a0b0 0x7fb80805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:36.309 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.302+0000 7fb80f7fe700 1 -- 172.21.15.110:0/405902552 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fb8180758e0 con 0x7fb8280685d0 2021-03-25T14:16:36.309 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.302+0000 7fb826ffd700 1 --2- 172.21.15.110:0/405902552 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb80805a0b0 0x7fb80805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:36.309 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.303+0000 7fb826ffd700 1 --2- 172.21.15.110:0/405902552 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb80805a0b0 0x7fb80805c570 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fb81c007fd0 tx=0x7fb81c009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:36.310 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.306+0000 7fb80f7fe700 1 -- 172.21.15.110:0/405902552 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fb82805d350 con 0x7fb8280685d0 2021-03-25T14:16:36.458 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.456+0000 7fb82dc74700 1 -- 172.21.15.110:0/405902552 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb82805d350 con 0x7fb8280685d0 2021-03-25T14:16:36.458 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.456+0000 7fb80f7fe700 1 -- 172.21.15.110:0/405902552 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+10 (secure 0 0 0) 0x7fb82805d350 con 0x7fb8280685d0 2021-03-25T14:16:36.458 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:16:36.460 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.458+0000 7fb82dc74700 1 -- 172.21.15.110:0/405902552 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb80805a0b0 msgr2=0x7fb80805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:36.460 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.458+0000 7fb82dc74700 1 --2- 172.21.15.110:0/405902552 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb80805a0b0 0x7fb80805c570 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fb81c007fd0 tx=0x7fb81c009040).stop 2021-03-25T14:16:36.460 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.458+0000 7fb82dc74700 1 -- 172.21.15.110:0/405902552 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8280685d0 msgr2=0x7fb8280b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:36.460 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.458+0000 7fb82dc74700 1 --2- 172.21.15.110:0/405902552 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8280685d0 0x7fb8280b4f10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7fb81800b150 tx=0x7fb818016000).stop 2021-03-25T14:16:36.461 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.458+0000 7fb82dc74700 1 -- 172.21.15.110:0/405902552 shutdown_connections 2021-03-25T14:16:36.461 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.458+0000 7fb82dc74700 1 --2- 172.21.15.110:0/405902552 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb80805a0b0 0x7fb80805c570 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:36.461 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.458+0000 7fb82dc74700 1 --2- 172.21.15.110:0/405902552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb82814d470 0x7fb8280a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:36.461 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.458+0000 7fb82dc74700 1 --2- 172.21.15.110:0/405902552 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8280685d0 0x7fb8280b4f10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:36.461 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.458+0000 7fb82dc74700 1 --2- 172.21.15.110:0/405902552 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb82814cc90 0x7fb8280a3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:36.461 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.458+0000 7fb82dc74700 1 -- 172.21.15.110:0/405902552 >> 172.21.15.110:0/405902552 conn(0x7fb828060c40 msgr2=0x7fb828146ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:36.461 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.458+0000 7fb82dc74700 1 -- 172.21.15.110:0/405902552 shutdown_connections 2021-03-25T14:16:36.461 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.458+0000 7fb82dc74700 1 -- 172.21.15.110:0/405902552 wait complete. 2021-03-25T14:16:36.471 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-03-25T14:16:36.581 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.579+0000 7f6431765700 1 Processor -- start 2021-03-25T14:16:36.581 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.579+0000 7f6431765700 1 -- start start 2021-03-25T14:16:36.584 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.580+0000 7f6431765700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f642c0bbca0 0x7f642c067840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:36.584 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.580+0000 7f6431765700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f642c068ac0 0x7f642c0acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:36.584 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.580+0000 7f6431765700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f642c0afee0 con 0x7f642c0ad420 2021-03-25T14:16:36.584 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.580+0000 7f6431765700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f642c145d40 con 0x7f642c068ac0 2021-03-25T14:16:36.584 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.580+0000 7f6431765700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f642c145fe0 con 0x7f642c0bbca0 2021-03-25T14:16:36.584 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.580+0000 7f642a7fc700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f642c068ac0 0x7f642c0acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:36.584 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.580+0000 7f642a7fc700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f642c068ac0 0x7f642c0acf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48266/0 (socket says 172.21.15.110:48266) 2021-03-25T14:16:36.585 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.580+0000 7f642a7fc700 1 -- 172.21.15.110:0/3141149941 learned_addr learned my addr 172.21.15.110:0/3141149941 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:36.585 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.580+0000 7f642affd700 1 --2- 172.21.15.110:0/3141149941 >> v2:172.21.15.174:3300/0 conn(0x7f642c0bbca0 0x7f642c067840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:36.585 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.580+0000 7f642a7fc700 1 -- 172.21.15.110:0/3141149941 >> v2:172.21.15.174:3300/0 conn(0x7f642c0bbca0 msgr2=0x7f642c067840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:36.585 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.580+0000 7f642a7fc700 1 --2- 172.21.15.110:0/3141149941 >> v2:172.21.15.174:3300/0 conn(0x7f642c0bbca0 0x7f642c067840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:36.585 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.580+0000 7f642a7fc700 1 -- 172.21.15.110:0/3141149941 >> v1:172.21.15.174:6789/0 conn(0x7f642c0ad420 legacy=0x7f642c148fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:36.585 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.580+0000 7f642a7fc700 1 -- 172.21.15.110:0/3141149941 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f642c0ad860 con 0x7f642c068ac0 2021-03-25T14:16:36.585 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.580+0000 7f642a7fc700 1 --2- 172.21.15.110:0/3141149941 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f642c068ac0 0x7f642c0acf30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f642c067140 tx=0x7f6420006ee0).ready entity=mon.0 client_cookie=97d9419b9161f0c0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:36.585 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.581+0000 7f6429ffb700 1 -- 172.21.15.110:0/3141149941 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64200098d0 con 0x7f642c068ac0 2021-03-25T14:16:36.585 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.581+0000 7f6429ffb700 1 -- 172.21.15.110:0/3141149941 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6420009a30 con 0x7f642c068ac0 2021-03-25T14:16:36.585 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.581+0000 7f6429ffb700 1 -- 172.21.15.110:0/3141149941 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6420009db0 con 0x7f642c068ac0 2021-03-25T14:16:36.585 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.581+0000 7f6431765700 1 -- 172.21.15.110:0/3141149941 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f642c068ac0 msgr2=0x7f642c0acf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:36.585 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.581+0000 7f6431765700 1 --2- 172.21.15.110:0/3141149941 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f642c068ac0 0x7f642c0acf30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f642c067140 tx=0x7f6420006ee0).stop 2021-03-25T14:16:36.585 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.581+0000 7f6431765700 1 -- 172.21.15.110:0/3141149941 shutdown_connections 2021-03-25T14:16:36.586 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.581+0000 7f6431765700 1 --2- 172.21.15.110:0/3141149941 >> v2:172.21.15.174:3300/0 conn(0x7f642c0bbca0 0x7f642c067840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:36.586 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.581+0000 7f6431765700 1 --2- 172.21.15.110:0/3141149941 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f642c068ac0 0x7f642c0acf30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:36.586 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.581+0000 7f6431765700 1 -- 172.21.15.110:0/3141149941 >> 172.21.15.110:0/3141149941 conn(0x7f642c063850 msgr2=0x7f642c05c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:36.586 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.581+0000 7f6431765700 1 -- 172.21.15.110:0/3141149941 shutdown_connections 2021-03-25T14:16:36.586 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.581+0000 7f6431765700 1 -- 172.21.15.110:0/3141149941 wait complete. 2021-03-25T14:16:36.586 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.582+0000 7f6431765700 1 Processor -- start 2021-03-25T14:16:36.586 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.582+0000 7f6431765700 1 -- start start 2021-03-25T14:16:36.588 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.583+0000 7f6431765700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f642c068ac0 0x7f642c14d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:36.588 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.583+0000 7f6431765700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f642c0ad420 0x7f642c149360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:36.589 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.583+0000 7f6431765700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f642c0bbca0 0x7f642c13e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:36.589 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.583+0000 7f6431765700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642c159f30 con 0x7f642c0ad420 2021-03-25T14:16:36.589 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.583+0000 7f6431765700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642c14c4d0 con 0x7f642c0bbca0 2021-03-25T14:16:36.589 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.583+0000 7f6431765700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f642c0b0070 con 0x7f642c068ac0 2021-03-25T14:16:36.589 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.583+0000 7f642a7fc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f642c0ad420 0x7f642c149360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:36.589 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.583+0000 7f642a7fc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f642c0ad420 0x7f642c149360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48270/0 (socket says 172.21.15.110:48270) 2021-03-25T14:16:36.589 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.583+0000 7f642a7fc700 1 -- 172.21.15.110:0/1928729754 learned_addr learned my addr 172.21.15.110:0/1928729754 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:36.589 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.583+0000 7f642affd700 1 --2- 172.21.15.110:0/1928729754 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f642c068ac0 0x7f642c14d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:36.589 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.583+0000 7f642b7fe700 1 --2- 172.21.15.110:0/1928729754 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f642c0bbca0 0x7f642c13e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:36.589 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.583+0000 7f642a7fc700 1 -- 172.21.15.110:0/1928729754 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f642c068ac0 msgr2=0x7f642c14d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:36.589 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.583+0000 7f642a7fc700 1 --2- 172.21.15.110:0/1928729754 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f642c068ac0 0x7f642c14d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:36.589 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.583+0000 7f642a7fc700 1 -- 172.21.15.110:0/1928729754 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f642c0bbca0 msgr2=0x7f642c13e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:36.590 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.583+0000 7f642a7fc700 1 --2- 172.21.15.110:0/1928729754 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f642c0bbca0 0x7f642c13e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:36.590 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.583+0000 7f642a7fc700 1 -- 172.21.15.110:0/1928729754 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f642c145b10 con 0x7f642c0ad420 2021-03-25T14:16:36.590 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.583+0000 7f642a7fc700 1 --2- 172.21.15.110:0/1928729754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f642c0ad420 0x7f642c149360 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f642c065e30 tx=0x7f6420016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:36.590 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.584+0000 7f6412ffd700 1 -- 172.21.15.110:0/1928729754 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6420012c00 con 0x7f642c0ad420 2021-03-25T14:16:36.590 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.584+0000 7f6412ffd700 1 -- 172.21.15.110:0/1928729754 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6420012d60 con 0x7f642c0ad420 2021-03-25T14:16:36.590 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.584+0000 7f6431765700 1 -- 172.21.15.110:0/1928729754 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f642c14c730 con 0x7f642c0ad420 2021-03-25T14:16:36.590 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.584+0000 7f6412ffd700 1 -- 172.21.15.110:0/1928729754 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642001c650 con 0x7f642c0ad420 2021-03-25T14:16:36.590 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.584+0000 7f6431765700 1 -- 172.21.15.110:0/1928729754 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f642c157890 con 0x7f642c0ad420 2021-03-25T14:16:36.590 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.585+0000 7f6431765700 1 -- 172.21.15.110:0/1928729754 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f642c15a0a0 con 0x7f642c0ad420 2021-03-25T14:16:36.590 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.585+0000 7f6412ffd700 1 -- 172.21.15.110:0/1928729754 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f642000f070 con 0x7f642c0ad420 2021-03-25T14:16:36.590 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.585+0000 7f6412ffd700 1 --2- 172.21.15.110:0/1928729754 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f640c05a0e0 0x7f640c05c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:36.590 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.585+0000 7f6412ffd700 1 -- 172.21.15.110:0/1928729754 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f64200755d0 con 0x7f642c0ad420 2021-03-25T14:16:36.591 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.585+0000 7f642affd700 1 --2- 172.21.15.110:0/1928729754 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f640c05a0e0 0x7f640c05c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:36.591 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.586+0000 7f642affd700 1 --2- 172.21.15.110:0/1928729754 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f640c05a0e0 0x7f640c05c5a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f641c00cb00 tx=0x7f641c006e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:36.591 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.589+0000 7f6412ffd700 1 -- 172.21.15.110:0/1928729754 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f642c15a0a0 con 0x7f642c0ad420 2021-03-25T14:16:36.777 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.774+0000 7f6431765700 1 -- 172.21.15.110:0/1928729754 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f642c14cb90 con 0x7f642c0ad420 2021-03-25T14:16:36.777 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.775+0000 7f6412ffd700 1 -- 172.21.15.110:0/1928729754 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+2846 (secure 0 0 0) 0x7f6420048c80 con 0x7f642c0ad420 2021-03-25T14:16:36.777 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:16:36.777 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1177985428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6833","nonce":1177985428},{"type":"v1","addr":"172.21.15.174:6835","nonce":1177985428}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.110:6836/3814723779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3814723779},{"type":"v1","addr":"172.21.15.110:6836","nonce":3814723779}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":4},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1613822797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1613822797},{"type":"v1","addr":"172.21.15.110:6837","nonce":1613822797}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-03-25T14:16:11.090720+0000","modified":"2021-03-25T14:16:25.750002+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"b","rank":0,"incarnation":5,"state":"up:active","state_seq":4,"addr":"172.21.15.174:6834/1564441351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1564441351},{"type":"v1","addr":"172.21.15.174:6834","nonce":1564441351}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-03-25T14:16:36.779 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.776+0000 7f6431765700 1 -- 172.21.15.110:0/1928729754 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f640c05a0e0 msgr2=0x7f640c05c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:36.779 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.776+0000 7f6431765700 1 --2- 172.21.15.110:0/1928729754 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f640c05a0e0 0x7f640c05c5a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f641c00cb00 tx=0x7f641c006e20).stop 2021-03-25T14:16:36.779 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.776+0000 7f6431765700 1 -- 172.21.15.110:0/1928729754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f642c0ad420 msgr2=0x7f642c149360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:36.779 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.776+0000 7f6431765700 1 --2- 172.21.15.110:0/1928729754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f642c0ad420 0x7f642c149360 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f642c065e30 tx=0x7f6420016000).stop 2021-03-25T14:16:36.779 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.777+0000 7f6431765700 1 -- 172.21.15.110:0/1928729754 shutdown_connections 2021-03-25T14:16:36.779 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.777+0000 7f6431765700 1 --2- 172.21.15.110:0/1928729754 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f640c05a0e0 0x7f640c05c5a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:36.780 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.777+0000 7f6431765700 1 --2- 172.21.15.110:0/1928729754 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f642c0bbca0 0x7f642c13e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:36.780 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.777+0000 7f6431765700 1 --2- 172.21.15.110:0/1928729754 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f642c068ac0 0x7f642c14d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:36.780 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.777+0000 7f6431765700 1 --2- 172.21.15.110:0/1928729754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f642c0ad420 0x7f642c149360 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:36.780 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.777+0000 7f6431765700 1 -- 172.21.15.110:0/1928729754 >> 172.21.15.110:0/1928729754 conn(0x7f642c063850 msgr2=0x7f642c0af3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:36.780 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.777+0000 7f6431765700 1 -- 172.21.15.110:0/1928729754 shutdown_connections 2021-03-25T14:16:36.780 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:36.777+0000 7f6431765700 1 -- 172.21.15.110:0/1928729754 wait complete. 2021-03-25T14:16:36.780 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 9 2021-03-25T14:16:37.193 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-03-25T14:16:11.090720+0000', 'modified': '2021-03-25T14:16:25.750002+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4284}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4284': {'gid': 4284, 'name': 'b', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.174:6834/1564441351', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6832', 'nonce': 1564441351}, {'type': 'v1', 'addr': '172.21.15.174:6834', 'nonce': 1564441351}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138303579357183, 'flags': 0}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-03-25T14:16:37.193 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-03-25T14:16:37.193 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-03-25T14:16:37.335 INFO:teuthology.orchestra.run.smithi174.stdout:{"cluster_fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","whoami":0,"id":4284,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":26.232052594999999,"mdsmap_epoch":9,"osdmap_epoch":25,"osdmap_epoch_barrier":25,"uptime":35.176604884} 2021-03-25T14:16:37.335 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5524cbad-8383-4081-a708-5d9e9f7cc15c", "fs_name": "cephfs", "id": 4284, "mdsmap_epoch": 9, "osdmap_epoch": 25, "osdmap_epoch_barrier": 25, "rank_uptime": 26.232052595, "state": "up:active", "uptime": 35.176604884, "want_state": "up:active", "whoami": 0 } 2021-03-25T14:16:37.335 INFO:teuthology.run_tasks:Running task kclient... 2021-03-25T14:16:37.352 INFO:tasks.kclient:Mounting kernel clients... 2021-03-25T14:16:37.353 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2021-03-25T14:16:37.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:37.353 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2021-03-25T14:16:37.370 INFO:teuthology.orchestra.run.smithi110.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2021-03-25T14:16:37.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:37.371 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2021-03-25T14:16:37.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:37.451 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link delete ceph-brx 2021-03-25T14:16:37.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:37.546 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list 2021-03-25T14:16:37.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:37.562 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link delete ceph-brx 2021-03-25T14:16:37.630 INFO:teuthology.orchestra.run.smithi174.stderr:Cannot find device "ceph-brx" 2021-03-25T14:16:37.631 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-03-25T14:16:37.631 INFO:tasks.kclient:client.0 config is {} 2021-03-25T14:16:37.632 DEBUG:teuthology.orchestra.run.smithi110:> ceph fs ls 2021-03-25T14:16:37.730 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.728+0000 7f39fb496700 1 Processor -- start 2021-03-25T14:16:37.731 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.728+0000 7f39fb496700 1 -- start start 2021-03-25T14:16:37.739 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.729+0000 7f39fb496700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39f40b8820 0x7f39f4068ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:37.739 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.729+0000 7f39fb496700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39f40b00c0 con 0x7f39f41468e0 2021-03-25T14:16:37.739 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.729+0000 7f39fb496700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39f40690f0 con 0x7f39f40bc4c0 2021-03-25T14:16:37.739 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.729+0000 7f39fb496700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f4145f00 con 0x7f39f40b8820 2021-03-25T14:16:37.739 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.729+0000 7f39f8a31700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f39f41468e0 0x7f39f40ad220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41214/0 (socket says 172.21.15.110:41214) 2021-03-25T14:16:37.739 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.729+0000 7f39f8a31700 1 -- 172.21.15.110:0/2859979665 learned_addr learned my addr 172.21.15.110:0/2859979665 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:37.739 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.730+0000 7f39f9232700 1 --2- 172.21.15.110:0/2859979665 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39f40b8820 0x7f39f4068ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:37.739 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.730+0000 7f39e3fff700 1 -- 172.21.15.110:0/2859979665 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3704822221 0 0) 0x7f39f40b00c0 con 0x7f39f41468e0 2021-03-25T14:16:37.739 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.730+0000 7f39e3fff700 1 -- 172.21.15.110:0/2859979665 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39dc003270 con 0x7f39f41468e0 2021-03-25T14:16:37.739 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.730+0000 7f39e3fff700 1 -- 172.21.15.110:0/2859979665 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1614064539 0 0) 0x7f39dc003270 con 0x7f39f41468e0 2021-03-25T14:16:37.740 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.730+0000 7f39e3fff700 1 -- 172.21.15.110:0/2859979665 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39f40b8820 msgr2=0x7f39f4068ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:37.740 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.730+0000 7f39e3fff700 1 --2- 172.21.15.110:0/2859979665 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39f40b8820 0x7f39f4068ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:37.740 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.730+0000 7f39e3fff700 1 -- 172.21.15.110:0/2859979665 >> v1:172.21.15.174:6789/0 conn(0x7f39f40bc4c0 legacy=0x7f39f413f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:37.740 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.730+0000 7f39e3fff700 1 -- 172.21.15.110:0/2859979665 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f41461a0 con 0x7f39f41468e0 2021-03-25T14:16:37.740 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.730+0000 7f39e3fff700 1 -- 172.21.15.110:0/2859979665 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f39f0001520 con 0x7f39f41468e0 2021-03-25T14:16:37.740 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.730+0000 7f39e3fff700 1 -- 172.21.15.110:0/2859979665 >> v1:172.21.15.110:6789/0 conn(0x7f39f41468e0 legacy=0x7f39f40ad220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:37.740 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.730+0000 7f39e3fff700 1 --2- 172.21.15.110:0/2859979665 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39f40b8820 0x7f39dc003790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:37.740 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.730+0000 7f39e3fff700 1 --2- 172.21.15.110:0/2859979665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39dc003c80 0x7f39dc004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:37.740 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.730+0000 7f39e3fff700 1 --2- 172.21.15.110:0/2859979665 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39dc004a00 0x7f39dc004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:37.741 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.730+0000 7f39e3fff700 1 -- 172.21.15.110:0/2859979665 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f4145f00 con 0x7f39dc003c80 2021-03-25T14:16:37.741 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.730+0000 7f39e3fff700 1 -- 172.21.15.110:0/2859979665 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39dc0041c0 con 0x7f39dc004a00 2021-03-25T14:16:37.741 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.730+0000 7f39e3fff700 1 -- 172.21.15.110:0/2859979665 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39dc004330 con 0x7f39f40b8820 2021-03-25T14:16:37.741 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.730+0000 7f39f8a31700 1 --2- 172.21.15.110:0/2859979665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39dc003c80 0x7f39dc004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:37.741 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.730+0000 7f39f9232700 1 --2- 172.21.15.110:0/2859979665 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39f40b8820 0x7f39dc003790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:37.741 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.730+0000 7f39f9a33700 1 --2- 172.21.15.110:0/2859979665 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39dc004a00 0x7f39dc004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:37.741 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.730+0000 7f39f8a31700 1 -- 172.21.15.110:0/2859979665 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39f40b8820 msgr2=0x7f39dc003790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:37.741 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.730+0000 7f39f8a31700 1 --2- 172.21.15.110:0/2859979665 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39f40b8820 0x7f39dc003790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:37.741 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.730+0000 7f39f8a31700 1 -- 172.21.15.110:0/2859979665 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39dc004a00 msgr2=0x7f39dc004e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:37.741 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.730+0000 7f39f8a31700 1 --2- 172.21.15.110:0/2859979665 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39dc004a00 0x7f39dc004e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:37.741 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.730+0000 7f39f8a31700 1 -- 172.21.15.110:0/2859979665 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39dc003270 con 0x7f39dc003c80 2021-03-25T14:16:37.741 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.730+0000 7f39f8a31700 1 --2- 172.21.15.110:0/2859979665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39dc003c80 0x7f39dc004510 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f39f4063480 tx=0x7f39f4146330).ready entity=mon.0 client_cookie=89c4524348da6939 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:37.742 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.731+0000 7f39e3fff700 1 -- 172.21.15.110:0/2859979665 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f00070d0 con 0x7f39dc003c80 2021-03-25T14:16:37.742 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.731+0000 7f39e3fff700 1 -- 172.21.15.110:0/2859979665 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f0007230 con 0x7f39dc003c80 2021-03-25T14:16:37.742 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.731+0000 7f39e3fff700 1 -- 172.21.15.110:0/2859979665 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f0005620 con 0x7f39dc003c80 2021-03-25T14:16:37.742 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.731+0000 7f39fb496700 1 -- 172.21.15.110:0/2859979665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39dc003c80 msgr2=0x7f39dc004510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:37.742 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.731+0000 7f39fb496700 1 --2- 172.21.15.110:0/2859979665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39dc003c80 0x7f39dc004510 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f39f4063480 tx=0x7f39f4146330).stop 2021-03-25T14:16:37.742 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.731+0000 7f39f9a33700 1 -- 172.21.15.110:0/2859979665 reap_dead start 2021-03-25T14:16:37.742 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.731+0000 7f39fb496700 1 -- 172.21.15.110:0/2859979665 shutdown_connections 2021-03-25T14:16:37.742 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.731+0000 7f39fb496700 1 -- 172.21.15.110:0/2859979665 >> 172.21.15.110:0/2859979665 conn(0x7f39f4062580 msgr2=0x7f39f4062990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:37.742 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.731+0000 7f39fb496700 1 -- 172.21.15.110:0/2859979665 shutdown_connections 2021-03-25T14:16:37.743 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.731+0000 7f39fb496700 1 -- 172.21.15.110:0/2859979665 wait complete. 2021-03-25T14:16:37.743 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.732+0000 7f39fb496700 1 Processor -- start 2021-03-25T14:16:37.743 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.732+0000 7f39fb496700 1 -- start start 2021-03-25T14:16:37.743 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.733+0000 7f39fb496700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39dc003c80 0x7f39f4144f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:37.743 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.733+0000 7f39fb496700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39f413ee60 0x7f39f41453f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:37.743 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.733+0000 7f39fb496700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39f4138560 0x7f39f41389c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:37.743 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.733+0000 7f39fb496700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f4143780 con 0x7f39f4138560 2021-03-25T14:16:37.743 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.733+0000 7f39fb496700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f4158320 con 0x7f39dc003c80 2021-03-25T14:16:37.743 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.733+0000 7f39fb496700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f41585c0 con 0x7f39f413ee60 2021-03-25T14:16:37.743 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.733+0000 7f39f9a33700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39f4138560 0x7f39f41389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:37.744 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.733+0000 7f39f9a33700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39f4138560 0x7f39f41389c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48292/0 (socket says 172.21.15.110:48292) 2021-03-25T14:16:37.744 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.733+0000 7f39f9a33700 1 -- 172.21.15.110:0/3672060160 learned_addr learned my addr 172.21.15.110:0/3672060160 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:37.744 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.733+0000 7f39f8a31700 1 --2- 172.21.15.110:0/3672060160 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39f413ee60 0x7f39f41453f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:37.744 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.733+0000 7f39f9232700 1 --2- 172.21.15.110:0/3672060160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39dc003c80 0x7f39f4144f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:37.744 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.734+0000 7f39f9a33700 1 -- 172.21.15.110:0/3672060160 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39f413ee60 msgr2=0x7f39f41453f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:37.744 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.734+0000 7f39f9a33700 1 --2- 172.21.15.110:0/3672060160 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39f413ee60 0x7f39f41453f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:37.744 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.734+0000 7f39f9a33700 1 -- 172.21.15.110:0/3672060160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39dc003c80 msgr2=0x7f39f4144f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:37.744 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.734+0000 7f39f9a33700 1 --2- 172.21.15.110:0/3672060160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39dc003c80 0x7f39f4144f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:37.744 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.734+0000 7f39f9a33700 1 -- 172.21.15.110:0/3672060160 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f4158860 con 0x7f39f4138560 2021-03-25T14:16:37.744 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.734+0000 7f39f8a31700 1 --2- 172.21.15.110:0/3672060160 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39f413ee60 0x7f39f41453f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:16:37.745 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.734+0000 7f39f9a33700 1 --2- 172.21.15.110:0/3672060160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39f4138560 0x7f39f41389c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f39ec007fd0 tx=0x7f39ec007f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:37.745 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.734+0000 7f39e17fa700 1 -- 172.21.15.110:0/3672060160 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec00eee0 con 0x7f39f4138560 2021-03-25T14:16:37.745 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.734+0000 7f39e17fa700 1 -- 172.21.15.110:0/3672060160 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ec002030 con 0x7f39f4138560 2021-03-25T14:16:37.745 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.734+0000 7f39fb496700 1 -- 172.21.15.110:0/3672060160 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39f4158b00 con 0x7f39f4138560 2021-03-25T14:16:37.745 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.734+0000 7f39e17fa700 1 -- 172.21.15.110:0/3672060160 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec0023d0 con 0x7f39f4138560 2021-03-25T14:16:37.745 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.734+0000 7f39fb496700 1 -- 172.21.15.110:0/3672060160 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39f4158010 con 0x7f39f4138560 2021-03-25T14:16:37.745 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.735+0000 7f39fb496700 1 -- 172.21.15.110:0/3672060160 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39f406aaa0 con 0x7f39f4138560 2021-03-25T14:16:37.745 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.735+0000 7f39e17fa700 1 -- 172.21.15.110:0/3672060160 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f39ec00c7b0 con 0x7f39f4138560 2021-03-25T14:16:37.745 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.735+0000 7f39e17fa700 1 --2- 172.21.15.110:0/3672060160 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f39d405a0e0 0x7f39d405c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:37.745 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.735+0000 7f39e17fa700 1 -- 172.21.15.110:0/3672060160 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f39ec073ea0 con 0x7f39f4138560 2021-03-25T14:16:37.745 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.735+0000 7f39f9232700 1 --2- 172.21.15.110:0/3672060160 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f39d405a0e0 0x7f39d405c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:37.745 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.736+0000 7f39f9232700 1 --2- 172.21.15.110:0/3672060160 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f39d405a0e0 0x7f39d405c5a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f39e400bcc0 tx=0x7f39e4006e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:37.746 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.739+0000 7f39e17fa700 1 -- 172.21.15.110:0/3672060160 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f39ec047550 con 0x7f39f4138560 2021-03-25T14:16:37.927 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.925+0000 7f39fb496700 1 -- 172.21.15.110:0/3672060160 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f39f40b83c0 con 0x7f39f4138560 2021-03-25T14:16:37.928 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.926+0000 7f39e17fa700 1 -- 172.21.15.110:0/3672060160 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f39ec04ab70 con 0x7f39f4138560 2021-03-25T14:16:37.928 INFO:teuthology.orchestra.run.smithi110.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2021-03-25T14:16:37.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.927+0000 7f39fb496700 1 -- 172.21.15.110:0/3672060160 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f39d405a0e0 msgr2=0x7f39d405c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:37.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.927+0000 7f39fb496700 1 --2- 172.21.15.110:0/3672060160 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f39d405a0e0 0x7f39d405c5a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f39e400bcc0 tx=0x7f39e4006e20).stop 2021-03-25T14:16:37.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.927+0000 7f39fb496700 1 -- 172.21.15.110:0/3672060160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39f4138560 msgr2=0x7f39f41389c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:37.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.927+0000 7f39fb496700 1 --2- 172.21.15.110:0/3672060160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39f4138560 0x7f39f41389c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f39ec007fd0 tx=0x7f39ec007f20).stop 2021-03-25T14:16:37.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.927+0000 7f39fb496700 1 -- 172.21.15.110:0/3672060160 shutdown_connections 2021-03-25T14:16:37.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.927+0000 7f39fb496700 1 --2- 172.21.15.110:0/3672060160 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f39d405a0e0 0x7f39d405c5a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:37.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.927+0000 7f39fb496700 1 --2- 172.21.15.110:0/3672060160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39dc003c80 0x7f39f4144f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:37.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.927+0000 7f39fb496700 1 --2- 172.21.15.110:0/3672060160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39f4138560 0x7f39f41389c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:37.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.927+0000 7f39fb496700 1 --2- 172.21.15.110:0/3672060160 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39f413ee60 0x7f39f41453f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:37.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.927+0000 7f39fb496700 1 -- 172.21.15.110:0/3672060160 >> 172.21.15.110:0/3672060160 conn(0x7f39f4062580 msgr2=0x7f39f40adc90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:37.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.927+0000 7f39fb496700 1 -- 172.21.15.110:0/3672060160 shutdown_connections 2021-03-25T14:16:37.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:37.927+0000 7f39fb496700 1 -- 172.21.15.110:0/3672060160 wait complete. 2021-03-25T14:16:37.939 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2021-03-25T14:16:37.939 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2021-03-25T14:16:37.939 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi110.front.sepia.ceph.com 2021-03-25T14:16:37.939 INFO:tasks.cephfs.mount:self.client.name = client.0 2021-03-25T14:16:37.939 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2021-03-25T14:16:37.940 INFO:tasks.cephfs.mount:self.cephfs_name = None 2021-03-25T14:16:37.940 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2021-03-25T14:16:37.940 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2021-03-25T14:16:37.940 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2021-03-25T14:16:37.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:37.940 DEBUG:teuthology.orchestra.run.smithi110:> ip addr 2021-03-25T14:16:37.954 INFO:teuthology.orchestra.run.smithi110.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2021-03-25T14:16:37.954 INFO:teuthology.orchestra.run.smithi110.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2021-03-25T14:16:37.954 INFO:teuthology.orchestra.run.smithi110.stdout: inet 127.0.0.1/8 scope host lo 2021-03-25T14:16:37.955 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:16:37.955 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 ::1/128 scope host 2021-03-25T14:16:37.955 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:16:37.955 INFO:teuthology.orchestra.run.smithi110.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-03-25T14:16:37.955 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:14 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:16:37.955 INFO:teuthology.orchestra.run.smithi110.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-03-25T14:16:37.955 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:15 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:16:37.955 INFO:teuthology.orchestra.run.smithi110.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-03-25T14:16:37.955 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:34 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:16:37.955 INFO:teuthology.orchestra.run.smithi110.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2021-03-25T14:16:37.955 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:35 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:16:37.955 INFO:teuthology.orchestra.run.smithi110.stdout: inet 172.21.15.110/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2021-03-25T14:16:37.956 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft 42604sec preferred_lft 42604sec 2021-03-25T14:16:37.956 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::ec4:7aff:fe8f:cc35/64 scope link 2021-03-25T14:16:37.956 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:16:37.956 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2021-03-25T14:16:37.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:37.956 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec sudo bash -c ' 2021-03-25T14:16:37.956 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2021-03-25T14:16:37.956 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link add name ceph-brx type bridge 2021-03-25T14:16:37.956 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip addr flush dev ceph-brx 2021-03-25T14:16:37.957 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set ceph-brx up 2021-03-25T14:16:37.957 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2021-03-25T14:16:37.957 DEBUG:teuthology.orchestra.run.smithi110:> ') 2021-03-25T14:16:38.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:38.065 DEBUG:teuthology.orchestra.run.smithi110:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2021-03-25T14:16:38.088 INFO:teuthology.orchestra.run.smithi110.stdout:1 2021-03-25T14:16:38.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:38.090 DEBUG:teuthology.orchestra.run.smithi110:> route 2021-03-25T14:16:38.146 INFO:teuthology.orchestra.run.smithi110.stdout:Kernel IP routing table 2021-03-25T14:16:38.147 INFO:teuthology.orchestra.run.smithi110.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2021-03-25T14:16:38.147 INFO:teuthology.orchestra.run.smithi110.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2021-03-25T14:16:38.147 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2021-03-25T14:16:38.147 INFO:teuthology.orchestra.run.smithi110.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2021-03-25T14:16:38.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:38.147 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec sudo bash -c ' 2021-03-25T14:16:38.148 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2021-03-25T14:16:38.148 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2021-03-25T14:16:38.148 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2021-03-25T14:16:38.148 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2021-03-25T14:16:38.148 DEBUG:teuthology.orchestra.run.smithi110:> ') 2021-03-25T14:16:38.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:38.243 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2021-03-25T14:16:38.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:38.258 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list-id 2021-03-25T14:16:38.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:38.312 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec sudo bash -c ' 2021-03-25T14:16:38.312 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2021-03-25T14:16:38.312 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2021-03-25T14:16:38.312 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2021-03-25T14:16:38.312 DEBUG:teuthology.orchestra.run.smithi110:> ') 2021-03-25T14:16:38.397 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2021-03-25T14:16:38.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:38.398 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec sudo bash -c ' 2021-03-25T14:16:38.398 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2021-03-25T14:16:38.398 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2021-03-25T14:16:38.398 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2021-03-25T14:16:38.398 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2021-03-25T14:16:38.398 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2021-03-25T14:16:38.399 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2021-03-25T14:16:38.399 DEBUG:teuthology.orchestra.run.smithi110:> ') 2021-03-25T14:16:38.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:38.580 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec sudo bash -c ' 2021-03-25T14:16:38.580 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2021-03-25T14:16:38.580 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set brx.0 up 2021-03-25T14:16:38.580 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set dev brx.0 master ceph-brx 2021-03-25T14:16:38.580 DEBUG:teuthology.orchestra.run.smithi110:> ') 2021-03-25T14:16:38.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:38.684 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p /home/ubuntu/cephtest/mnt.0 2021-03-25T14:16:38.701 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-03-25T14:16:38.702 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2021-03-25T14:16:38.780 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2021-03-25T14:16:38.780 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2021-03-25T14:16:38.935 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2021-03-25T14:16:38.935 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2021-03-25T14:16:38.938 INFO:tasks.cephfs.kernel_mount:mount command passed 2021-03-25T14:16:38.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:38.938 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2021-03-25T14:16:39.003 INFO:tasks.kclient:client.1 config is {} 2021-03-25T14:16:39.003 DEBUG:teuthology.orchestra.run.smithi174:> ceph fs ls 2021-03-25T14:16:39.122 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.111+0000 7f7371729700 1 Processor -- start 2021-03-25T14:16:39.122 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.111+0000 7f7371729700 1 -- start start 2021-03-25T14:16:39.122 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.112+0000 7f7371729700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f736c0a02c0 0x7f736c0b9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:39.123 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.112+0000 7f7371729700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f736c065970 0x7f736c0ba7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:39.123 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.112+0000 7f7371729700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f736c147220 con 0x7f736c14d720 2021-03-25T14:16:39.123 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.112+0000 7f7371729700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f736c0b7830 con 0x7f736c0a02c0 2021-03-25T14:16:39.123 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.112+0000 7f7371729700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f736c0660f0 con 0x7f736c065970 2021-03-25T14:16:39.123 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.112+0000 7f736b7fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f736c065970 0x7f736c0ba7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:39.124 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.112+0000 7f736a7fc700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f736c14d720 0x7f736c0b7120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:49324/0 (socket says 172.21.15.174:49324) 2021-03-25T14:16:39.124 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.112+0000 7f736a7fc700 1 -- 172.21.15.174:0/4184263924 learned_addr learned my addr 172.21.15.174:0/4184263924 (peer_addr_for_me v1:172.21.15.174:0/0) 2021-03-25T14:16:39.124 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.113+0000 7f736affd700 1 --2- 172.21.15.174:0/4184263924 >> v2:172.21.15.110:3300/0 conn(0x7f736c0a02c0 0x7f736c0b9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:39.124 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.113+0000 7f7369ffb700 1 -- 172.21.15.174:0/4184263924 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3871311624 0 0) 0x7f7360001110 con 0x7f736c14d720 2021-03-25T14:16:39.124 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.113+0000 7f7369ffb700 1 -- 172.21.15.174:0/4184263924 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7358003270 con 0x7f736c14d720 2021-03-25T14:16:39.125 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.113+0000 7f736b7fe700 1 -- 172.21.15.174:0/4184263924 >> v2:172.21.15.110:3300/0 conn(0x7f736c0a02c0 msgr2=0x7f736c0b9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:39.125 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.113+0000 7f736b7fe700 1 --2- 172.21.15.174:0/4184263924 >> v2:172.21.15.110:3300/0 conn(0x7f736c0a02c0 0x7f736c0b9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:39.125 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.113+0000 7f736b7fe700 1 -- 172.21.15.174:0/4184263924 >> v1:172.21.15.174:6789/0 conn(0x7f736c14d720 legacy=0x7f736c0b7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:39.125 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.113+0000 7f736b7fe700 1 -- 172.21.15.174:0/4184263924 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f736c066390 con 0x7f736c065970 2021-03-25T14:16:39.125 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.113+0000 7f736b7fe700 1 --2- 172.21.15.174:0/4184263924 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f736c065970 0x7f736c0ba7e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f7364009cc0 tx=0x7f7364009220).ready entity=mon.2 client_cookie=29790534eaa754d server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:39.125 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.113+0000 7f7369ffb700 1 -- 172.21.15.174:0/4184263924 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736400b9f0 con 0x7f736c065970 2021-03-25T14:16:39.126 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.113+0000 7f7369ffb700 1 -- 172.21.15.174:0/4184263924 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f736400bb50 con 0x7f736c065970 2021-03-25T14:16:39.126 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.113+0000 7f7369ffb700 1 -- 172.21.15.174:0/4184263924 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7364011400 con 0x7f736c065970 2021-03-25T14:16:39.126 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.113+0000 7f7371729700 1 -- 172.21.15.174:0/4184263924 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f736c065970 msgr2=0x7f736c0ba7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:39.126 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.113+0000 7f7371729700 1 --2- 172.21.15.174:0/4184263924 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f736c065970 0x7f736c0ba7e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f7364009cc0 tx=0x7f7364009220).stop 2021-03-25T14:16:39.126 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.113+0000 7f7371729700 1 -- 172.21.15.174:0/4184263924 shutdown_connections 2021-03-25T14:16:39.126 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.113+0000 7f7371729700 1 --2- 172.21.15.174:0/4184263924 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f736c065970 0x7f736c0ba7e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:39.127 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.113+0000 7f7371729700 1 --2- 172.21.15.174:0/4184263924 >> v2:172.21.15.110:3300/0 conn(0x7f736c0a02c0 0x7f736c0b9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:39.127 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.113+0000 7f7371729700 1 -- 172.21.15.174:0/4184263924 >> 172.21.15.174:0/4184263924 conn(0x7f736c060de0 msgr2=0x7f736c0611f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:39.127 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.114+0000 7f7371729700 1 -- 172.21.15.174:0/4184263924 shutdown_connections 2021-03-25T14:16:39.128 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.114+0000 7f7371729700 1 -- 172.21.15.174:0/4184263924 wait complete. 2021-03-25T14:16:39.128 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.115+0000 7f7371729700 1 Processor -- start 2021-03-25T14:16:39.128 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.115+0000 7f7371729700 1 -- start start 2021-03-25T14:16:39.128 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.115+0000 7f7371729700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f736c065970 0x7f736c0be0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:39.129 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.115+0000 7f7371729700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f736c0a02c0 0x7f736c0a1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:39.129 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.115+0000 7f7371729700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f736c14d720 0x7f736c158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:39.129 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.115+0000 7f7371729700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736c0bda60 con 0x7f736c0a02c0 2021-03-25T14:16:39.129 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.115+0000 7f7371729700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736c0be5e0 con 0x7f736c14d720 2021-03-25T14:16:39.129 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.115+0000 7f7371729700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f736c149e50 con 0x7f736c065970 2021-03-25T14:16:39.130 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.116+0000 7f736affd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f736c065970 0x7f736c0be0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:39.130 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.116+0000 7f736b7fe700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f736c14d720 0x7f736c158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:39.130 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.116+0000 7f736affd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f736c065970 0x7f736c0be0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:34736/0 (socket says 172.21.15.174:34736) 2021-03-25T14:16:39.130 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.116+0000 7f736affd700 1 -- 172.21.15.174:0/903344872 learned_addr learned my addr 172.21.15.174:0/903344872 (peer_addr_for_me v2:172.21.15.174:0/0) 2021-03-25T14:16:39.131 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.116+0000 7f736a7fc700 1 --2- 172.21.15.174:0/903344872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f736c0a02c0 0x7f736c0a1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:39.131 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.116+0000 7f736affd700 1 -- 172.21.15.174:0/903344872 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f736c14d720 msgr2=0x7f736c158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:39.131 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.116+0000 7f736affd700 1 --2- 172.21.15.174:0/903344872 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f736c14d720 0x7f736c158c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:39.131 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.116+0000 7f736affd700 1 -- 172.21.15.174:0/903344872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f736c0a02c0 msgr2=0x7f736c0a1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:39.131 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.116+0000 7f736affd700 1 --2- 172.21.15.174:0/903344872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f736c0a02c0 0x7f736c0a1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:39.132 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.116+0000 7f736affd700 1 -- 172.21.15.174:0/903344872 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f736c14a0f0 con 0x7f736c065970 2021-03-25T14:16:39.132 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.116+0000 7f736b7fe700 1 --2- 172.21.15.174:0/903344872 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f736c14d720 0x7f736c158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:16:39.132 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.116+0000 7f736affd700 1 --2- 172.21.15.174:0/903344872 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f736c065970 0x7f736c0be0f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f735c00ec00 tx=0x7f735c006e20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:39.132 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.116+0000 7f7352ffd700 1 -- 172.21.15.174:0/903344872 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735c00c9b0 con 0x7f736c065970 2021-03-25T14:16:39.132 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.116+0000 7f7352ffd700 1 -- 172.21.15.174:0/903344872 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f735c00cb10 con 0x7f736c065970 2021-03-25T14:16:39.133 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.116+0000 7f7352ffd700 1 -- 172.21.15.174:0/903344872 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735c00ce90 con 0x7f736c065970 2021-03-25T14:16:39.133 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.116+0000 7f7371729700 1 -- 172.21.15.174:0/903344872 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f736c0bdc50 con 0x7f736c065970 2021-03-25T14:16:39.133 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.116+0000 7f7371729700 1 -- 172.21.15.174:0/903344872 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f736c0a2830 con 0x7f736c065970 2021-03-25T14:16:39.133 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.117+0000 7f7371729700 1 -- 172.21.15.174:0/903344872 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f736c06aaa0 con 0x7f736c065970 2021-03-25T14:16:39.133 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.117+0000 7f7352ffd700 1 -- 172.21.15.174:0/903344872 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f735c012600 con 0x7f736c065970 2021-03-25T14:16:39.134 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.118+0000 7f7352ffd700 1 --2- 172.21.15.174:0/903344872 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f734c05a0b0 0x7f734c05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:39.134 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.118+0000 7f7352ffd700 1 -- 172.21.15.174:0/903344872 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f735c0743a0 con 0x7f736c065970 2021-03-25T14:16:39.135 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.118+0000 7f736a7fc700 1 --2- 172.21.15.174:0/903344872 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f734c05a0b0 0x7f734c05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:39.135 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.118+0000 7f736a7fc700 1 --2- 172.21.15.174:0/903344872 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f734c05a0b0 0x7f734c05c570 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f736c149a30 tx=0x7f7360009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:39.136 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.122+0000 7f7352ffd700 1 -- 172.21.15.174:0/903344872 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f735c047a50 con 0x7f736c065970 2021-03-25T14:16:39.310 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.308+0000 7f7371729700 1 -- 172.21.15.174:0/903344872 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f736c0b8460 con 0x7f736c065970 2021-03-25T14:16:39.310 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.308+0000 7f7352ffd700 1 -- 172.21.15.174:0/903344872 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f735c04b070 con 0x7f736c065970 2021-03-25T14:16:39.310 INFO:teuthology.orchestra.run.smithi174.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2021-03-25T14:16:39.312 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.310+0000 7f7371729700 1 -- 172.21.15.174:0/903344872 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f734c05a0b0 msgr2=0x7f734c05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:39.312 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.310+0000 7f7371729700 1 --2- 172.21.15.174:0/903344872 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f734c05a0b0 0x7f734c05c570 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f736c149a30 tx=0x7f7360009040).stop 2021-03-25T14:16:39.312 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.310+0000 7f7371729700 1 -- 172.21.15.174:0/903344872 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f736c065970 msgr2=0x7f736c0be0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:39.312 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.310+0000 7f7371729700 1 --2- 172.21.15.174:0/903344872 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f736c065970 0x7f736c0be0f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f735c00ec00 tx=0x7f735c006e20).stop 2021-03-25T14:16:39.312 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.310+0000 7f7371729700 1 -- 172.21.15.174:0/903344872 shutdown_connections 2021-03-25T14:16:39.312 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.310+0000 7f7371729700 1 --2- 172.21.15.174:0/903344872 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f734c05a0b0 0x7f734c05c570 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:39.312 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.310+0000 7f7371729700 1 --2- 172.21.15.174:0/903344872 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f736c14d720 0x7f736c158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:39.313 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.310+0000 7f7371729700 1 --2- 172.21.15.174:0/903344872 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f736c065970 0x7f736c0be0f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:39.313 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.310+0000 7f7371729700 1 --2- 172.21.15.174:0/903344872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f736c0a02c0 0x7f736c0a1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:39.313 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.310+0000 7f7371729700 1 -- 172.21.15.174:0/903344872 >> 172.21.15.174:0/903344872 conn(0x7f736c060de0 msgr2=0x7f736c064c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:39.313 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.310+0000 7f7371729700 1 -- 172.21.15.174:0/903344872 shutdown_connections 2021-03-25T14:16:39.313 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:16:39.310+0000 7f7371729700 1 -- 172.21.15.174:0/903344872 wait complete. 2021-03-25T14:16:39.322 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2021-03-25T14:16:39.322 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2021-03-25T14:16:39.322 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi174.front.sepia.ceph.com 2021-03-25T14:16:39.322 INFO:tasks.cephfs.mount:self.client.name = client.1 2021-03-25T14:16:39.322 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2021-03-25T14:16:39.322 INFO:tasks.cephfs.mount:self.cephfs_name = None 2021-03-25T14:16:39.322 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2021-03-25T14:16:39.322 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2021-03-25T14:16:39.322 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2021-03-25T14:16:39.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:39.323 DEBUG:teuthology.orchestra.run.smithi174:> ip addr 2021-03-25T14:16:39.337 INFO:teuthology.orchestra.run.smithi174.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2021-03-25T14:16:39.337 INFO:teuthology.orchestra.run.smithi174.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2021-03-25T14:16:39.337 INFO:teuthology.orchestra.run.smithi174.stdout: inet 127.0.0.1/8 scope host lo 2021-03-25T14:16:39.338 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:16:39.338 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 ::1/128 scope host 2021-03-25T14:16:39.338 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:16:39.338 INFO:teuthology.orchestra.run.smithi174.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-03-25T14:16:39.338 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:d9:36:e0 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:16:39.338 INFO:teuthology.orchestra.run.smithi174.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-03-25T14:16:39.338 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:d9:36:e1 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:16:39.338 INFO:teuthology.orchestra.run.smithi174.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-03-25T14:16:39.338 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:88:77:1a brd ff:ff:ff:ff:ff:ff 2021-03-25T14:16:39.338 INFO:teuthology.orchestra.run.smithi174.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2021-03-25T14:16:39.339 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:88:77:1b brd ff:ff:ff:ff:ff:ff 2021-03-25T14:16:39.339 INFO:teuthology.orchestra.run.smithi174.stdout: inet 172.21.15.174/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2021-03-25T14:16:39.339 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft 42603sec preferred_lft 42603sec 2021-03-25T14:16:39.339 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::ec4:7aff:fe88:771b/64 scope link 2021-03-25T14:16:39.339 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:16:39.339 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2021-03-25T14:16:39.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:39.340 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec sudo bash -c ' 2021-03-25T14:16:39.340 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2021-03-25T14:16:39.340 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link add name ceph-brx type bridge 2021-03-25T14:16:39.340 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip addr flush dev ceph-brx 2021-03-25T14:16:39.340 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set ceph-brx up 2021-03-25T14:16:39.340 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2021-03-25T14:16:39.340 DEBUG:teuthology.orchestra.run.smithi174:> ') 2021-03-25T14:16:39.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:39.483 DEBUG:teuthology.orchestra.run.smithi174:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2021-03-25T14:16:39.518 INFO:teuthology.orchestra.run.smithi174.stdout:1 2021-03-25T14:16:39.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:39.519 DEBUG:teuthology.orchestra.run.smithi174:> route 2021-03-25T14:16:39.585 INFO:teuthology.orchestra.run.smithi174.stdout:Kernel IP routing table 2021-03-25T14:16:39.585 INFO:teuthology.orchestra.run.smithi174.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2021-03-25T14:16:39.585 INFO:teuthology.orchestra.run.smithi174.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2021-03-25T14:16:39.585 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2021-03-25T14:16:39.585 INFO:teuthology.orchestra.run.smithi174.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2021-03-25T14:16:39.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:39.586 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec sudo bash -c ' 2021-03-25T14:16:39.586 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2021-03-25T14:16:39.586 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2021-03-25T14:16:39.586 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2021-03-25T14:16:39.586 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2021-03-25T14:16:39.586 DEBUG:teuthology.orchestra.run.smithi174:> ') 2021-03-25T14:16:39.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:39.843 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list 2021-03-25T14:16:39.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:39.858 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list-id 2021-03-25T14:16:39.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:39.911 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec sudo bash -c ' 2021-03-25T14:16:39.912 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2021-03-25T14:16:39.912 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2021-03-25T14:16:39.912 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2021-03-25T14:16:39.912 DEBUG:teuthology.orchestra.run.smithi174:> ') 2021-03-25T14:16:39.999 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2021-03-25T14:16:39.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:40.000 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec sudo bash -c ' 2021-03-25T14:16:40.000 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2021-03-25T14:16:40.000 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2021-03-25T14:16:40.000 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2021-03-25T14:16:40.000 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2021-03-25T14:16:40.000 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2021-03-25T14:16:40.000 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2021-03-25T14:16:40.000 DEBUG:teuthology.orchestra.run.smithi174:> ') 2021-03-25T14:16:40.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:40.191 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec sudo bash -c ' 2021-03-25T14:16:40.191 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2021-03-25T14:16:40.191 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set brx.0 up 2021-03-25T14:16:40.191 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set dev brx.0 master ceph-brx 2021-03-25T14:16:40.191 DEBUG:teuthology.orchestra.run.smithi174:> ') 2021-03-25T14:16:40.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:40.294 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p /home/ubuntu/cephtest/mnt.1 2021-03-25T14:16:40.313 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-03-25T14:16:40.313 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,norbytes 2021-03-25T14:16:40.398 INFO:teuthology.orchestra.run.smithi174.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,norbytes 2021-03-25T14:16:40.398 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,name=1,norbytes" will pass to kernel. 2021-03-25T14:16:40.517 INFO:teuthology.orchestra.run.smithi174.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,norbytes 2021-03-25T14:16:40.518 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,name=1,norbytes" will pass to kernel. 2021-03-25T14:16:40.520 INFO:tasks.cephfs.kernel_mount:mount command passed 2021-03-25T14:16:40.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:40.521 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2021-03-25T14:16:40.550 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2021-03-25T14:16:40.569 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:16:40.691 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.689+0000 7f96334dc700 1 Processor -- start 2021-03-25T14:16:40.691 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.689+0000 7f96334dc700 1 -- start start 2021-03-25T14:16:40.694 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.690+0000 7f96334dc700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f962c0bbca0 0x7f962c067840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:40.694 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.690+0000 7f96334dc700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f962c068ac0 0x7f962c0acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:40.694 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.690+0000 7f96334dc700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f962c0afee0 con 0x7f962c0ad420 2021-03-25T14:16:40.694 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.690+0000 7f96334dc700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f962c145d40 con 0x7f962c0bbca0 2021-03-25T14:16:40.694 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.690+0000 7f96334dc700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f962c145fe0 con 0x7f962c068ac0 2021-03-25T14:16:40.694 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.690+0000 7f9631278700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f962c0bbca0 0x7f962c067840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:40.694 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.690+0000 7f9631278700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f962c0bbca0 0x7f962c067840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48302/0 (socket says 172.21.15.110:48302) 2021-03-25T14:16:40.694 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.690+0000 7f9631278700 1 -- 172.21.15.110:0/734357965 learned_addr learned my addr 172.21.15.110:0/734357965 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:40.694 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.690+0000 7f9630a77700 1 --2- 172.21.15.110:0/734357965 >> v2:172.21.15.174:3300/0 conn(0x7f962c068ac0 0x7f962c0acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:40.694 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.691+0000 7f9631278700 1 -- 172.21.15.110:0/734357965 >> v2:172.21.15.174:3300/0 conn(0x7f962c068ac0 msgr2=0x7f962c0acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:40.694 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.691+0000 7f9631278700 1 --2- 172.21.15.110:0/734357965 >> v2:172.21.15.174:3300/0 conn(0x7f962c068ac0 0x7f962c0acf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:40.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.691+0000 7f9631278700 1 -- 172.21.15.110:0/734357965 >> v1:172.21.15.174:6789/0 conn(0x7f962c0ad420 legacy=0x7f962c148fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:40.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.691+0000 7f9631278700 1 -- 172.21.15.110:0/734357965 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f962c0ad860 con 0x7f962c0bbca0 2021-03-25T14:16:40.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.691+0000 7f9631278700 1 --2- 172.21.15.110:0/734357965 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f962c0bbca0 0x7f962c067840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f962c0682d0 tx=0x7f9628006ee0).ready entity=mon.0 client_cookie=8ab687ec8053a9b1 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:40.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.691+0000 7f961bfff700 1 -- 172.21.15.110:0/734357965 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96280098d0 con 0x7f962c0bbca0 2021-03-25T14:16:40.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.691+0000 7f961bfff700 1 -- 172.21.15.110:0/734357965 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9628009a30 con 0x7f962c0bbca0 2021-03-25T14:16:40.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.691+0000 7f961bfff700 1 -- 172.21.15.110:0/734357965 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9628009db0 con 0x7f962c0bbca0 2021-03-25T14:16:40.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.691+0000 7f96334dc700 1 -- 172.21.15.110:0/734357965 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f962c0bbca0 msgr2=0x7f962c067840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:40.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.691+0000 7f96334dc700 1 --2- 172.21.15.110:0/734357965 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f962c0bbca0 0x7f962c067840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f962c0682d0 tx=0x7f9628006ee0).stop 2021-03-25T14:16:40.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.691+0000 7f96334dc700 1 -- 172.21.15.110:0/734357965 shutdown_connections 2021-03-25T14:16:40.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.691+0000 7f96334dc700 1 --2- 172.21.15.110:0/734357965 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f962c0bbca0 0x7f962c067840 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:40.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.691+0000 7f96334dc700 1 --2- 172.21.15.110:0/734357965 >> v2:172.21.15.174:3300/0 conn(0x7f962c068ac0 0x7f962c0acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:40.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.691+0000 7f96334dc700 1 -- 172.21.15.110:0/734357965 >> 172.21.15.110:0/734357965 conn(0x7f962c063850 msgr2=0x7f962c05c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:40.696 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.692+0000 7f96334dc700 1 -- 172.21.15.110:0/734357965 shutdown_connections 2021-03-25T14:16:40.696 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.692+0000 7f96334dc700 1 -- 172.21.15.110:0/734357965 wait complete. 2021-03-25T14:16:40.699 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.693+0000 7f96334dc700 1 Processor -- start 2021-03-25T14:16:40.699 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.693+0000 7f96334dc700 1 -- start start 2021-03-25T14:16:40.699 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.693+0000 7f96334dc700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f962c068ac0 0x7f962c13fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:40.699 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.693+0000 7f96334dc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f962c0ad420 0x7f962c156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:40.699 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.693+0000 7f96334dc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f962c0bbca0 0x7f962c1571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:40.699 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.693+0000 7f96334dc700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962c0b0310 con 0x7f962c0ad420 2021-03-25T14:16:40.699 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.693+0000 7f96334dc700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962c0b0500 con 0x7f962c068ac0 2021-03-25T14:16:40.699 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.693+0000 7f96334dc700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f962c0b07a0 con 0x7f962c0bbca0 2021-03-25T14:16:40.699 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.694+0000 7f9630a77700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f962c0ad420 0x7f962c156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:40.699 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.694+0000 7f9630a77700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f962c0ad420 0x7f962c156ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48310/0 (socket says 172.21.15.110:48310) 2021-03-25T14:16:40.699 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.694+0000 7f9630a77700 1 -- 172.21.15.110:0/2516506001 learned_addr learned my addr 172.21.15.110:0/2516506001 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:40.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.694+0000 7f9631278700 1 --2- 172.21.15.110:0/2516506001 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f962c068ac0 0x7f962c13fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:40.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.694+0000 7f9631a79700 1 --2- 172.21.15.110:0/2516506001 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f962c0bbca0 0x7f962c1571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:40.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.694+0000 7f9630a77700 1 -- 172.21.15.110:0/2516506001 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f962c0bbca0 msgr2=0x7f962c1571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:40.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.694+0000 7f9630a77700 1 --2- 172.21.15.110:0/2516506001 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f962c0bbca0 0x7f962c1571d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:40.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.694+0000 7f9630a77700 1 -- 172.21.15.110:0/2516506001 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f962c068ac0 msgr2=0x7f962c13fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:40.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.694+0000 7f9630a77700 1 --2- 172.21.15.110:0/2516506001 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f962c068ac0 0x7f962c13fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:40.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.694+0000 7f9630a77700 1 -- 172.21.15.110:0/2516506001 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f962c145b10 con 0x7f962c0ad420 2021-03-25T14:16:40.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.694+0000 7f9631a79700 1 --2- 172.21.15.110:0/2516506001 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f962c0bbca0 0x7f962c1571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:40.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.694+0000 7f9630a77700 1 --2- 172.21.15.110:0/2516506001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f962c0ad420 0x7f962c156ce0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f961c00db60 tx=0x7f961c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:40.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.694+0000 7f96197fa700 1 -- 172.21.15.110:0/2516506001 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961c009790 con 0x7f962c0ad420 2021-03-25T14:16:40.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.694+0000 7f96197fa700 1 -- 172.21.15.110:0/2516506001 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961c0098f0 con 0x7f962c0ad420 2021-03-25T14:16:40.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.694+0000 7f96334dc700 1 -- 172.21.15.110:0/2516506001 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f962c0b0a40 con 0x7f962c0ad420 2021-03-25T14:16:40.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.694+0000 7f96197fa700 1 -- 172.21.15.110:0/2516506001 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961c009c70 con 0x7f962c0ad420 2021-03-25T14:16:40.701 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.694+0000 7f96334dc700 1 -- 172.21.15.110:0/2516506001 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f962c1401a0 con 0x7f962c0ad420 2021-03-25T14:16:40.701 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.695+0000 7f96334dc700 1 -- 172.21.15.110:0/2516506001 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f962c0b0ea0 con 0x7f962c0ad420 2021-03-25T14:16:40.701 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.695+0000 7f96197fa700 1 -- 172.21.15.110:0/2516506001 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f961c013480 con 0x7f962c0ad420 2021-03-25T14:16:40.701 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.696+0000 7f96197fa700 1 --2- 172.21.15.110:0/2516506001 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f960c05a0b0 0x7f960c05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:40.701 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.696+0000 7f96197fa700 1 -- 172.21.15.110:0/2516506001 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f961c074120 con 0x7f962c0ad420 2021-03-25T14:16:40.701 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.696+0000 7f9631278700 1 --2- 172.21.15.110:0/2516506001 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f960c05a0b0 0x7f960c05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:40.701 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.696+0000 7f9631278700 1 --2- 172.21.15.110:0/2516506001 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f960c05a0b0 0x7f960c05c570 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f9628006f20 tx=0x7f9628016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:40.701 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.700+0000 7f96197fa700 1 -- 172.21.15.110:0/2516506001 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f961c047660 con 0x7f962c0ad420 2021-03-25T14:16:40.853 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.851+0000 7f96334dc700 1 -- 172.21.15.110:0/2516506001 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f962c05d7b0 con 0x7f962c0ad420 2021-03-25T14:16:40.854 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.852+0000 7f96197fa700 1 -- 172.21.15.110:0/2516506001 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18685 (secure 0 0 0) 0x7f961c04ac80 con 0x7f962c0ad420 2021-03-25T14:16:40.854 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:16:40.854 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":25,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:16:15.446609+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-03-25T14:16:09.478442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-03-25T14:16:10.071152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2021-03-25T14:16:13.122119+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:16:40.856 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.854+0000 7f96334dc700 1 -- 172.21.15.110:0/2516506001 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f960c05a0b0 msgr2=0x7f960c05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:40.856 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.854+0000 7f96334dc700 1 --2- 172.21.15.110:0/2516506001 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f960c05a0b0 0x7f960c05c570 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f9628006f20 tx=0x7f9628016000).stop 2021-03-25T14:16:40.856 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.854+0000 7f96334dc700 1 -- 172.21.15.110:0/2516506001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f962c0ad420 msgr2=0x7f962c156ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:40.856 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.854+0000 7f96334dc700 1 --2- 172.21.15.110:0/2516506001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f962c0ad420 0x7f962c156ce0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f961c00db60 tx=0x7f961c008040).stop 2021-03-25T14:16:40.856 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.854+0000 7f96334dc700 1 -- 172.21.15.110:0/2516506001 shutdown_connections 2021-03-25T14:16:40.856 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.854+0000 7f96334dc700 1 --2- 172.21.15.110:0/2516506001 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f960c05a0b0 0x7f960c05c570 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:40.856 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.854+0000 7f96334dc700 1 --2- 172.21.15.110:0/2516506001 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f962c068ac0 0x7f962c13fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:40.856 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.854+0000 7f96334dc700 1 --2- 172.21.15.110:0/2516506001 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f962c0bbca0 0x7f962c1571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:40.856 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.854+0000 7f96334dc700 1 --2- 172.21.15.110:0/2516506001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f962c0ad420 0x7f962c156ce0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:40.856 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.854+0000 7f96334dc700 1 -- 172.21.15.110:0/2516506001 >> 172.21.15.110:0/2516506001 conn(0x7f962c063850 msgr2=0x7f962c0ba070 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:40.857 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.854+0000 7f96334dc700 1 -- 172.21.15.110:0/2516506001 shutdown_connections 2021-03-25T14:16:40.857 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.854+0000 7f96334dc700 1 -- 172.21.15.110:0/2516506001 wait complete. 2021-03-25T14:16:40.867 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-03-25T14:15:59.047299+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-03-25T14:16:00.537926+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-03-25T14:16:09.478442+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-03-25T14:16:10.071152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2021-03-25T14:16:13.122119+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-03-25T14:16:40.868 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-03-25T14:16:40.981 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.979+0000 7f60755fe700 1 Processor -- start 2021-03-25T14:16:40.981 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.979+0000 7f60755fe700 1 -- start start 2021-03-25T14:16:40.984 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.979+0000 7f60755fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f60700be3a0 0x7f60700b4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:40.984 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.979+0000 7f60755fe700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60700b4c20 con 0x7f6070149340 2021-03-25T14:16:40.984 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.979+0000 7f60755fe700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6070149960 con 0x7f60700b47a0 2021-03-25T14:16:40.984 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.979+0000 7f60755fe700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6070149c00 con 0x7f60700be3a0 2021-03-25T14:16:40.984 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.980+0000 7f606f7fe700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f6070149340 0x7f60700b8cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41250/0 (socket says 172.21.15.110:41250) 2021-03-25T14:16:40.984 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.980+0000 7f606f7fe700 1 -- 172.21.15.110:0/621537762 learned_addr learned my addr 172.21.15.110:0/621537762 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:40.984 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.980+0000 7f606effd700 1 --2- 172.21.15.110:0/621537762 >> v2:172.21.15.174:3300/0 conn(0x7f60700be3a0 0x7f60700b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:40.984 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.980+0000 7f606dffb700 1 -- 172.21.15.110:0/621537762 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2143429550 0 0) 0x7f60700b4c20 con 0x7f6070149340 2021-03-25T14:16:40.984 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.980+0000 7f606dffb700 1 -- 172.21.15.110:0/621537762 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f605c003270 con 0x7f6070149340 2021-03-25T14:16:40.984 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.980+0000 7f606dffb700 1 -- 172.21.15.110:0/621537762 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1883754928 0 0) 0x7f6070149960 con 0x7f60700b47a0 2021-03-25T14:16:40.984 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.980+0000 7f606dffb700 1 -- 172.21.15.110:0/621537762 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60700b4c20 con 0x7f60700b47a0 2021-03-25T14:16:40.985 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.980+0000 7f606effd700 1 -- 172.21.15.110:0/621537762 >> v1:172.21.15.174:6789/0 conn(0x7f60700b47a0 legacy=0x7f6070148c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:40.985 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.980+0000 7f606effd700 1 -- 172.21.15.110:0/621537762 >> v1:172.21.15.110:6789/0 conn(0x7f6070149340 legacy=0x7f60700b8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:40.985 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.980+0000 7f606effd700 1 -- 172.21.15.110:0/621537762 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6070149ea0 con 0x7f60700be3a0 2021-03-25T14:16:40.985 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.980+0000 7f606effd700 1 --2- 172.21.15.110:0/621537762 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60700be3a0 0x7f60700b4100 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f606400b9c0 tx=0x7f6064006e20).ready entity=mon.1 client_cookie=1272cc2c13a9dd4b server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:40.985 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.980+0000 7f606dffb700 1 -- 172.21.15.110:0/621537762 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6064009600 con 0x7f60700be3a0 2021-03-25T14:16:40.985 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.980+0000 7f606dffb700 1 -- 172.21.15.110:0/621537762 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6064009760 con 0x7f60700be3a0 2021-03-25T14:16:40.985 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.980+0000 7f606dffb700 1 -- 172.21.15.110:0/621537762 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6064009ae0 con 0x7f60700be3a0 2021-03-25T14:16:40.985 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.981+0000 7f60755fe700 1 -- 172.21.15.110:0/621537762 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60700be3a0 msgr2=0x7f60700b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:40.985 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.981+0000 7f60755fe700 1 --2- 172.21.15.110:0/621537762 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60700be3a0 0x7f60700b4100 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f606400b9c0 tx=0x7f6064006e20).stop 2021-03-25T14:16:40.985 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.981+0000 7f60755fe700 1 -- 172.21.15.110:0/621537762 shutdown_connections 2021-03-25T14:16:40.985 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.981+0000 7f60755fe700 1 --2- 172.21.15.110:0/621537762 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60700be3a0 0x7f60700b4100 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:40.985 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.981+0000 7f60755fe700 1 -- 172.21.15.110:0/621537762 >> 172.21.15.110:0/621537762 conn(0x7f60700686f0 msgr2=0x7f6070068b00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:40.985 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.981+0000 7f60755fe700 1 -- 172.21.15.110:0/621537762 shutdown_connections 2021-03-25T14:16:40.985 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.981+0000 7f60755fe700 1 -- 172.21.15.110:0/621537762 wait complete. 2021-03-25T14:16:40.986 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.982+0000 7f60755fe700 1 Processor -- start 2021-03-25T14:16:40.986 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.982+0000 7f60755fe700 1 -- start start 2021-03-25T14:16:40.988 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.983+0000 7f60755fe700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60700b47a0 0x7f6070159710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:40.989 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.983+0000 7f60755fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f60700be3a0 0x7f60700a0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:40.989 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.983+0000 7f60755fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6070149340 0x7f60701474e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:40.989 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.983+0000 7f60755fe700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6070158b00 con 0x7f6070149340 2021-03-25T14:16:40.989 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.983+0000 7f60755fe700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60700a39b0 con 0x7f60700b47a0 2021-03-25T14:16:40.989 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.983+0000 7f60755fe700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6070158d30 con 0x7f60700be3a0 2021-03-25T14:16:40.989 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.983+0000 7f606f7fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6070149340 0x7f60701474e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:40.989 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.983+0000 7f606f7fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6070149340 0x7f60701474e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48322/0 (socket says 172.21.15.110:48322) 2021-03-25T14:16:40.989 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.983+0000 7f606f7fe700 1 -- 172.21.15.110:0/765227146 learned_addr learned my addr 172.21.15.110:0/765227146 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:40.989 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.983+0000 7f606effd700 1 --2- 172.21.15.110:0/765227146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60700b47a0 0x7f6070159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:40.989 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.983+0000 7f606e7fc700 1 --2- 172.21.15.110:0/765227146 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f60700be3a0 0x7f60700a0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:40.989 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.983+0000 7f606f7fe700 1 -- 172.21.15.110:0/765227146 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f60700be3a0 msgr2=0x7f60700a0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:40.989 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.983+0000 7f606f7fe700 1 --2- 172.21.15.110:0/765227146 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f60700be3a0 0x7f60700a0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:40.990 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.983+0000 7f606f7fe700 1 -- 172.21.15.110:0/765227146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60700b47a0 msgr2=0x7f6070159710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:40.990 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.983+0000 7f606f7fe700 1 --2- 172.21.15.110:0/765227146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60700b47a0 0x7f6070159710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:40.990 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.983+0000 7f606f7fe700 1 -- 172.21.15.110:0/765227146 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6070158fd0 con 0x7f6070149340 2021-03-25T14:16:40.990 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.983+0000 7f606e7fc700 1 --2- 172.21.15.110:0/765227146 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f60700be3a0 0x7f60700a0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:40.990 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.983+0000 7f606f7fe700 1 --2- 172.21.15.110:0/765227146 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6070149340 0x7f60701474e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f6068001560 tx=0x7f6068007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:40.990 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.983+0000 7f6056ffd700 1 -- 172.21.15.110:0/765227146 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6068005bb0 con 0x7f6070149340 2021-03-25T14:16:40.990 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.983+0000 7f6056ffd700 1 -- 172.21.15.110:0/765227146 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6068005d10 con 0x7f6070149340 2021-03-25T14:16:40.990 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.983+0000 7f60755fe700 1 -- 172.21.15.110:0/765227146 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6070159270 con 0x7f6070149340 2021-03-25T14:16:40.990 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.983+0000 7f6056ffd700 1 -- 172.21.15.110:0/765227146 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6068007340 con 0x7f6070149340 2021-03-25T14:16:40.990 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.983+0000 7f60755fe700 1 -- 172.21.15.110:0/765227146 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60701479d0 con 0x7f6070149340 2021-03-25T14:16:40.990 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.984+0000 7f60755fe700 1 -- 172.21.15.110:0/765227146 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f607005d7b0 con 0x7f6070149340 2021-03-25T14:16:40.990 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.984+0000 7f6056ffd700 1 -- 172.21.15.110:0/765227146 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f6068010030 con 0x7f6070149340 2021-03-25T14:16:40.990 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.985+0000 7f6056ffd700 1 --2- 172.21.15.110:0/765227146 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f605005a0b0 0x7f605005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:40.991 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.985+0000 7f6056ffd700 1 -- 172.21.15.110:0/765227146 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f6068073f70 con 0x7f6070149340 2021-03-25T14:16:40.991 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.985+0000 7f606effd700 1 --2- 172.21.15.110:0/765227146 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f605005a0b0 0x7f605005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:40.991 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.985+0000 7f606effd700 1 --2- 172.21.15.110:0/765227146 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f605005a0b0 0x7f605005c570 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f606400b150 tx=0x7f6064016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:40.991 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:40.989+0000 7f6056ffd700 1 -- 172.21.15.110:0/765227146 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f60680476d0 con 0x7f6070149340 2021-03-25T14:16:41.140 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.137+0000 7f60755fe700 1 -- 172.21.15.110:0/765227146 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f6070061c50 con 0x7f6070149340 2021-03-25T14:16:41.140 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.138+0000 7f6056ffd700 1 -- 172.21.15.110:0/765227146 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7f606804acf0 con 0x7f6070149340 2021-03-25T14:16:41.140 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 1 2021-03-25T14:16:41.142 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.139+0000 7f60755fe700 1 -- 172.21.15.110:0/765227146 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f605005a0b0 msgr2=0x7f605005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:41.142 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.139+0000 7f60755fe700 1 --2- 172.21.15.110:0/765227146 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f605005a0b0 0x7f605005c570 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f606400b150 tx=0x7f6064016000).stop 2021-03-25T14:16:41.142 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.139+0000 7f60755fe700 1 -- 172.21.15.110:0/765227146 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6070149340 msgr2=0x7f60701474e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:41.142 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.139+0000 7f60755fe700 1 --2- 172.21.15.110:0/765227146 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6070149340 0x7f60701474e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f6068001560 tx=0x7f6068007e50).stop 2021-03-25T14:16:41.142 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.140+0000 7f60755fe700 1 -- 172.21.15.110:0/765227146 shutdown_connections 2021-03-25T14:16:41.142 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.140+0000 7f60755fe700 1 --2- 172.21.15.110:0/765227146 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f605005a0b0 0x7f605005c570 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:41.142 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.140+0000 7f60755fe700 1 --2- 172.21.15.110:0/765227146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60700b47a0 0x7f6070159710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:41.142 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.140+0000 7f60755fe700 1 --2- 172.21.15.110:0/765227146 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6070149340 0x7f60701474e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:41.142 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.140+0000 7f60755fe700 1 --2- 172.21.15.110:0/765227146 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f60700be3a0 0x7f60700a0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:41.142 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.140+0000 7f60755fe700 1 -- 172.21.15.110:0/765227146 >> 172.21.15.110:0/765227146 conn(0x7f60700686f0 msgr2=0x7f60700bcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:41.142 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.140+0000 7f60755fe700 1 -- 172.21.15.110:0/765227146 shutdown_connections 2021-03-25T14:16:41.143 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.140+0000 7f60755fe700 1 -- 172.21.15.110:0/765227146 wait complete. 2021-03-25T14:16:41.153 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-03-25T14:16:41.264 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.263+0000 7fa904517700 1 Processor -- start 2021-03-25T14:16:41.265 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.263+0000 7fa904517700 1 -- start start 2021-03-25T14:16:41.267 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.263+0000 7fa904517700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8fc14d470 0x7fa8fc14d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:41.267 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.263+0000 7fa904517700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8fc0691b0 con 0x7fa8fc14cc90 2021-03-25T14:16:41.267 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.263+0000 7fa904517700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8fc0bc2b0 con 0x7fa8fc0685d0 2021-03-25T14:16:41.267 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.263+0000 7fa904517700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8fc149dd0 con 0x7fa8fc14d470 2021-03-25T14:16:41.268 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.264+0000 7fa901ab2700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fa8fc14cc90 0x7fa8fc1493c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41266/0 (socket says 172.21.15.110:41266) 2021-03-25T14:16:41.268 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.264+0000 7fa901ab2700 1 -- 172.21.15.110:0/1494642312 learned_addr learned my addr 172.21.15.110:0/1494642312 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:41.268 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.264+0000 7fa9022b3700 1 --2- 172.21.15.110:0/1494642312 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8fc14d470 0x7fa8fc14d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:41.268 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.264+0000 7fa9012b1700 1 -- 172.21.15.110:0/1494642312 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 585637638 0 0) 0x7fa8fc0691b0 con 0x7fa8fc14cc90 2021-03-25T14:16:41.268 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.264+0000 7fa9012b1700 1 -- 172.21.15.110:0/1494642312 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8e4003270 con 0x7fa8fc14cc90 2021-03-25T14:16:41.268 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.264+0000 7fa9012b1700 1 -- 172.21.15.110:0/1494642312 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1273339971 0 0) 0x7fa8fc0bc2b0 con 0x7fa8fc0685d0 2021-03-25T14:16:41.268 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.264+0000 7fa9012b1700 1 -- 172.21.15.110:0/1494642312 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8fc0691b0 con 0x7fa8fc0685d0 2021-03-25T14:16:41.268 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.264+0000 7fa9022b3700 1 -- 172.21.15.110:0/1494642312 >> v1:172.21.15.174:6789/0 conn(0x7fa8fc0685d0 legacy=0x7fa8fc0bc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:41.268 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.264+0000 7fa9022b3700 1 -- 172.21.15.110:0/1494642312 >> v1:172.21.15.110:6789/0 conn(0x7fa8fc14cc90 legacy=0x7fa8fc1493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:41.268 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.264+0000 7fa9012b1700 1 -- 172.21.15.110:0/1494642312 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2464889032 0 0) 0x7fa8e4003270 con 0x7fa8fc14cc90 2021-03-25T14:16:41.268 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.264+0000 7fa9022b3700 1 -- 172.21.15.110:0/1494642312 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8fc14a070 con 0x7fa8fc14d470 2021-03-25T14:16:41.268 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.264+0000 7fa9022b3700 1 --2- 172.21.15.110:0/1494642312 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8fc14d470 0x7fa8fc14d850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fa8f800b9f0 tx=0x7fa8f8006e20).ready entity=mon.2 client_cookie=86d294f4bb1a8203 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:41.269 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.264+0000 7fa9012b1700 1 -- 172.21.15.110:0/1494642312 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec001520 con 0x7fa8fc14d470 2021-03-25T14:16:41.269 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.265+0000 7fa9012b1700 1 -- 172.21.15.110:0/1494642312 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f8011400 con 0x7fa8fc14d470 2021-03-25T14:16:41.269 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.265+0000 7fa9012b1700 1 -- 172.21.15.110:0/1494642312 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f8011780 con 0x7fa8fc14d470 2021-03-25T14:16:41.269 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.265+0000 7fa904517700 1 -- 172.21.15.110:0/1494642312 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8fc14d470 msgr2=0x7fa8fc14d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:41.269 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.265+0000 7fa904517700 1 --2- 172.21.15.110:0/1494642312 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8fc14d470 0x7fa8fc14d850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fa8f800b9f0 tx=0x7fa8f8006e20).stop 2021-03-25T14:16:41.269 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.265+0000 7fa904517700 1 -- 172.21.15.110:0/1494642312 shutdown_connections 2021-03-25T14:16:41.269 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.265+0000 7fa904517700 1 --2- 172.21.15.110:0/1494642312 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8fc14d470 0x7fa8fc14d850 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:41.269 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.265+0000 7fa904517700 1 -- 172.21.15.110:0/1494642312 >> 172.21.15.110:0/1494642312 conn(0x7fa8fc060c40 msgr2=0x7fa8fc061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:41.269 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.265+0000 7fa904517700 1 -- 172.21.15.110:0/1494642312 shutdown_connections 2021-03-25T14:16:41.269 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.265+0000 7fa904517700 1 -- 172.21.15.110:0/1494642312 wait complete. 2021-03-25T14:16:41.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.266+0000 7fa904517700 1 Processor -- start 2021-03-25T14:16:41.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.266+0000 7fa904517700 1 -- start start 2021-03-25T14:16:41.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.267+0000 7fa904517700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa8fc0685d0 0x7fa8fc15ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:41.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.267+0000 7fa904517700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8fc14cc90 0x7fa8fc0c0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:41.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.267+0000 7fa904517700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8fc14d470 0x7fa8fc158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:41.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.267+0000 7fa904517700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8fc15cf40 con 0x7fa8fc14d470 2021-03-25T14:16:41.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.267+0000 7fa904517700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8fc0b5f70 con 0x7fa8fc0685d0 2021-03-25T14:16:41.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.267+0000 7fa904517700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8fc0b6210 con 0x7fa8fc14cc90 2021-03-25T14:16:41.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.267+0000 7fa902ab4700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8fc14d470 0x7fa8fc158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:41.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.267+0000 7fa902ab4700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8fc14d470 0x7fa8fc158f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48334/0 (socket says 172.21.15.110:48334) 2021-03-25T14:16:41.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.267+0000 7fa902ab4700 1 -- 172.21.15.110:0/3204193659 learned_addr learned my addr 172.21.15.110:0/3204193659 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:41.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.267+0000 7fa9022b3700 1 --2- 172.21.15.110:0/3204193659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa8fc0685d0 0x7fa8fc15ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:41.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.267+0000 7fa901ab2700 1 --2- 172.21.15.110:0/3204193659 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8fc14cc90 0x7fa8fc0c0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:41.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.267+0000 7fa902ab4700 1 -- 172.21.15.110:0/3204193659 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8fc14cc90 msgr2=0x7fa8fc0c0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:41.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.267+0000 7fa902ab4700 1 --2- 172.21.15.110:0/3204193659 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8fc14cc90 0x7fa8fc0c0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:41.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.267+0000 7fa902ab4700 1 -- 172.21.15.110:0/3204193659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa8fc0685d0 msgr2=0x7fa8fc15ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:41.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.267+0000 7fa902ab4700 1 --2- 172.21.15.110:0/3204193659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa8fc0685d0 0x7fa8fc15ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:41.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.267+0000 7fa902ab4700 1 -- 172.21.15.110:0/3204193659 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8fc0b64b0 con 0x7fa8fc14d470 2021-03-25T14:16:41.274 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.267+0000 7fa9022b3700 1 --2- 172.21.15.110:0/3204193659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa8fc0685d0 0x7fa8fc15ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:16:41.274 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.267+0000 7fa902ab4700 1 --2- 172.21.15.110:0/3204193659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8fc14d470 0x7fa8fc158f80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fa8f400ca90 tx=0x7fa8f4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:41.274 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.267+0000 7fa8ea7fc700 1 -- 172.21.15.110:0/3204193659 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f400ce70 con 0x7fa8fc14d470 2021-03-25T14:16:41.274 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.267+0000 7fa8ea7fc700 1 -- 172.21.15.110:0/3204193659 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f4002240 con 0x7fa8fc14d470 2021-03-25T14:16:41.274 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.267+0000 7fa904517700 1 -- 172.21.15.110:0/3204193659 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8fc0b6750 con 0x7fa8fc14d470 2021-03-25T14:16:41.274 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.267+0000 7fa8ea7fc700 1 -- 172.21.15.110:0/3204193659 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f4001590 con 0x7fa8fc14d470 2021-03-25T14:16:41.274 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.268+0000 7fa904517700 1 -- 172.21.15.110:0/3204193659 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8fc158a70 con 0x7fa8fc14d470 2021-03-25T14:16:41.274 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.268+0000 7fa904517700 1 -- 172.21.15.110:0/3204193659 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8fc05d7b0 con 0x7fa8fc14d470 2021-03-25T14:16:41.274 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.269+0000 7fa8ea7fc700 1 -- 172.21.15.110:0/3204193659 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fa8f4019030 con 0x7fa8fc14d470 2021-03-25T14:16:41.274 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.269+0000 7fa8ea7fc700 1 --2- 172.21.15.110:0/3204193659 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa8dc05a0e0 0x7fa8dc05c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:41.274 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.269+0000 7fa8ea7fc700 1 -- 172.21.15.110:0/3204193659 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fa8f40735e0 con 0x7fa8fc14d470 2021-03-25T14:16:41.274 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.269+0000 7fa9022b3700 1 --2- 172.21.15.110:0/3204193659 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa8dc05a0e0 0x7fa8dc05c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:41.274 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.269+0000 7fa9022b3700 1 --2- 172.21.15.110:0/3204193659 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa8dc05a0e0 0x7fa8dc05c5a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fa8f8006e60 tx=0x7fa8f8016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:41.275 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.273+0000 7fa8ea7fc700 1 -- 172.21.15.110:0/3204193659 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fa8f4045620 con 0x7fa8fc14d470 2021-03-25T14:16:41.424 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.422+0000 7fa904517700 1 -- 172.21.15.110:0/3204193659 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa8fc061c50 con 0x7fa8fc14d470 2021-03-25T14:16:41.424 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.422+0000 7fa8ea7fc700 1 -- 172.21.15.110:0/3204193659 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa8f4046d40 con 0x7fa8fc14d470 2021-03-25T14:16:41.424 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:16:41.426 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.424+0000 7fa904517700 1 -- 172.21.15.110:0/3204193659 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa8dc05a0e0 msgr2=0x7fa8dc05c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:41.426 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.424+0000 7fa904517700 1 --2- 172.21.15.110:0/3204193659 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa8dc05a0e0 0x7fa8dc05c5a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fa8f8006e60 tx=0x7fa8f8016000).stop 2021-03-25T14:16:41.426 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.424+0000 7fa904517700 1 -- 172.21.15.110:0/3204193659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8fc14d470 msgr2=0x7fa8fc158f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:41.426 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.424+0000 7fa904517700 1 --2- 172.21.15.110:0/3204193659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8fc14d470 0x7fa8fc158f80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fa8f400ca90 tx=0x7fa8f4007e00).stop 2021-03-25T14:16:41.426 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.424+0000 7fa904517700 1 -- 172.21.15.110:0/3204193659 shutdown_connections 2021-03-25T14:16:41.426 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.424+0000 7fa904517700 1 --2- 172.21.15.110:0/3204193659 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa8dc05a0e0 0x7fa8dc05c5a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:41.426 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.424+0000 7fa904517700 1 --2- 172.21.15.110:0/3204193659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa8fc0685d0 0x7fa8fc15ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:41.426 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.424+0000 7fa904517700 1 --2- 172.21.15.110:0/3204193659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8fc14d470 0x7fa8fc158f80 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:41.427 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.424+0000 7fa904517700 1 --2- 172.21.15.110:0/3204193659 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8fc14cc90 0x7fa8fc0c0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:41.427 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.424+0000 7fa904517700 1 -- 172.21.15.110:0/3204193659 >> 172.21.15.110:0/3204193659 conn(0x7fa8fc060c40 msgr2=0x7fa8fc0a2160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:41.427 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.424+0000 7fa904517700 1 -- 172.21.15.110:0/3204193659 shutdown_connections 2021-03-25T14:16:41.427 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.424+0000 7fa904517700 1 -- 172.21.15.110:0/3204193659 wait complete. 2021-03-25T14:16:41.437 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-03-25T14:16:41.549 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.547+0000 7fdaa5809700 1 Processor -- start 2021-03-25T14:16:41.549 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.547+0000 7fdaa5809700 1 -- start start 2021-03-25T14:16:41.552 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.548+0000 7fdaa5809700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdaa0146c10 0x7fdaa014d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:41.552 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.548+0000 7fdaa5809700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdaa0146ff0 0x7fdaa00b8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:41.552 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.548+0000 7fdaa5809700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdaa0066b30 0x7fdaa00be280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:41.552 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.548+0000 7fdaa5809700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaa00672e0 con 0x7fdaa0146ff0 2021-03-25T14:16:41.552 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.548+0000 7fdaa5809700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaa00b4c50 con 0x7fdaa0066b30 2021-03-25T14:16:41.552 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.548+0000 7fdaa5809700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa0067040 con 0x7fdaa0146c10 2021-03-25T14:16:41.552 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.548+0000 7fda97fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdaa0146ff0 0x7fdaa00b8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:41.552 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.548+0000 7fda97fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdaa0146ff0 0x7fdaa00b8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48340/0 (socket says 172.21.15.110:48340) 2021-03-25T14:16:41.553 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.548+0000 7fda97fff700 1 -- 172.21.15.110:0/3559260965 learned_addr learned my addr 172.21.15.110:0/3559260965 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:41.553 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.548+0000 7fda9f7fe700 1 --2- 172.21.15.110:0/3559260965 >> v2:172.21.15.174:3300/0 conn(0x7fdaa0066b30 0x7fdaa00be280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:41.553 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.548+0000 7fda9effd700 1 --2- 172.21.15.110:0/3559260965 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdaa0146c10 0x7fdaa014d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:41.553 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.548+0000 7fda97fff700 1 -- 172.21.15.110:0/3559260965 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdaa0146c10 msgr2=0x7fdaa014d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:41.553 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.548+0000 7fda97fff700 1 --2- 172.21.15.110:0/3559260965 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdaa0146c10 0x7fdaa014d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:41.553 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.548+0000 7fda97fff700 1 -- 172.21.15.110:0/3559260965 >> v2:172.21.15.174:3300/0 conn(0x7fdaa0066b30 msgr2=0x7fdaa00be280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:41.553 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.548+0000 7fda97fff700 1 --2- 172.21.15.110:0/3559260965 >> v2:172.21.15.174:3300/0 conn(0x7fdaa0066b30 0x7fdaa00be280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:41.553 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.548+0000 7fda97fff700 1 -- 172.21.15.110:0/3559260965 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa014ce70 con 0x7fdaa0146ff0 2021-03-25T14:16:41.553 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.548+0000 7fda9f7fe700 1 --2- 172.21.15.110:0/3559260965 >> v2:172.21.15.174:3300/0 conn(0x7fdaa0066b30 0x7fdaa00be280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:41.553 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.549+0000 7fda97fff700 1 --2- 172.21.15.110:0/3559260965 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdaa0146ff0 0x7fdaa00b8c70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fdaa00b3fe0 tx=0x7fda88006ee0).ready entity=mon.0 client_cookie=6497cc9e4197af19 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:41.553 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.549+0000 7fda9e7fc700 1 -- 172.21.15.110:0/3559260965 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda88009840 con 0x7fdaa0146ff0 2021-03-25T14:16:41.553 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.549+0000 7fda9e7fc700 1 -- 172.21.15.110:0/3559260965 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda880099a0 con 0x7fdaa0146ff0 2021-03-25T14:16:41.553 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.549+0000 7fda9e7fc700 1 -- 172.21.15.110:0/3559260965 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda88009d20 con 0x7fdaa0146ff0 2021-03-25T14:16:41.553 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.549+0000 7fdaa5809700 1 -- 172.21.15.110:0/3559260965 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdaa0146ff0 msgr2=0x7fdaa00b8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:41.554 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.549+0000 7fdaa5809700 1 --2- 172.21.15.110:0/3559260965 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdaa0146ff0 0x7fdaa00b8c70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fdaa00b3fe0 tx=0x7fda88006ee0).stop 2021-03-25T14:16:41.554 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.549+0000 7fdaa5809700 1 -- 172.21.15.110:0/3559260965 shutdown_connections 2021-03-25T14:16:41.554 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.549+0000 7fdaa5809700 1 --2- 172.21.15.110:0/3559260965 >> v2:172.21.15.174:3300/0 conn(0x7fdaa0066b30 0x7fdaa00be280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:41.554 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.549+0000 7fdaa5809700 1 --2- 172.21.15.110:0/3559260965 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdaa0146c10 0x7fdaa014d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:41.554 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.549+0000 7fdaa5809700 1 --2- 172.21.15.110:0/3559260965 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdaa0146ff0 0x7fdaa00b8c70 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:41.554 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.549+0000 7fdaa5809700 1 -- 172.21.15.110:0/3559260965 >> 172.21.15.110:0/3559260965 conn(0x7fdaa00686f0 msgr2=0x7fdaa0068b00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:41.554 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.549+0000 7fdaa5809700 1 -- 172.21.15.110:0/3559260965 shutdown_connections 2021-03-25T14:16:41.554 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.549+0000 7fdaa5809700 1 -- 172.21.15.110:0/3559260965 wait complete. 2021-03-25T14:16:41.554 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.550+0000 7fdaa5809700 1 Processor -- start 2021-03-25T14:16:41.554 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.550+0000 7fdaa5809700 1 -- start start 2021-03-25T14:16:41.557 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.551+0000 7fdaa5809700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdaa0066b30 0x7fdaa014b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:41.557 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.551+0000 7fdaa5809700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdaa0146c10 0x7fdaa009eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:41.557 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.551+0000 7fdaa5809700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdaa0146ff0 0x7fdaa009f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:41.557 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.551+0000 7fdaa5809700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa0159a90 con 0x7fdaa0066b30 2021-03-25T14:16:41.557 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.551+0000 7fdaa5809700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa0158b70 con 0x7fdaa0146ff0 2021-03-25T14:16:41.557 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.551+0000 7fdaa5809700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa0158e10 con 0x7fdaa0146c10 2021-03-25T14:16:41.557 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.551+0000 7fda9effd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdaa0066b30 0x7fdaa014b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:41.557 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.551+0000 7fda9effd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdaa0066b30 0x7fdaa014b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48346/0 (socket says 172.21.15.110:48346) 2021-03-25T14:16:41.557 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.551+0000 7fda9effd700 1 -- 172.21.15.110:0/312125435 learned_addr learned my addr 172.21.15.110:0/312125435 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:41.557 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.551+0000 7fda9f7fe700 1 --2- 172.21.15.110:0/312125435 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdaa0146ff0 0x7fdaa009f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:41.558 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.551+0000 7fda97fff700 1 --2- 172.21.15.110:0/312125435 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdaa0146c10 0x7fdaa009eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:41.558 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.551+0000 7fda9effd700 1 -- 172.21.15.110:0/312125435 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdaa0146c10 msgr2=0x7fdaa009eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:41.558 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.551+0000 7fda9effd700 1 --2- 172.21.15.110:0/312125435 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdaa0146c10 0x7fdaa009eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:41.558 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.551+0000 7fda9effd700 1 -- 172.21.15.110:0/312125435 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdaa0146ff0 msgr2=0x7fdaa009f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:41.558 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.551+0000 7fda9effd700 1 --2- 172.21.15.110:0/312125435 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdaa0146ff0 0x7fdaa009f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:41.558 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.551+0000 7fda9effd700 1 -- 172.21.15.110:0/312125435 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa01590b0 con 0x7fdaa0066b30 2021-03-25T14:16:41.558 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.551+0000 7fda9f7fe700 1 --2- 172.21.15.110:0/312125435 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdaa0146ff0 0x7fdaa009f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:41.558 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.551+0000 7fda9effd700 1 --2- 172.21.15.110:0/312125435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdaa0066b30 0x7fdaa014b520 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fda9000c920 tx=0x7fda90008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:41.558 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.552+0000 7fda96ffd700 1 -- 172.21.15.110:0/312125435 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9000cec0 con 0x7fdaa0066b30 2021-03-25T14:16:41.558 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.552+0000 7fda96ffd700 1 -- 172.21.15.110:0/312125435 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda90007740 con 0x7fdaa0066b30 2021-03-25T14:16:41.558 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.552+0000 7fdaa5809700 1 -- 172.21.15.110:0/312125435 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaa0159350 con 0x7fdaa0066b30 2021-03-25T14:16:41.558 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.552+0000 7fda96ffd700 1 -- 172.21.15.110:0/312125435 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda90007ac0 con 0x7fdaa0066b30 2021-03-25T14:16:41.559 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.552+0000 7fdaa5809700 1 -- 172.21.15.110:0/312125435 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa014ba10 con 0x7fdaa0066b30 2021-03-25T14:16:41.559 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.552+0000 7fdaa5809700 1 -- 172.21.15.110:0/312125435 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaa01597b0 con 0x7fdaa0066b30 2021-03-25T14:16:41.559 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.553+0000 7fda96ffd700 1 -- 172.21.15.110:0/312125435 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fda9001b460 con 0x7fdaa0066b30 2021-03-25T14:16:41.559 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.553+0000 7fda96ffd700 1 --2- 172.21.15.110:0/312125435 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fda8405a0b0 0x7fda8405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:41.559 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.553+0000 7fda96ffd700 1 -- 172.21.15.110:0/312125435 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fda90074120 con 0x7fdaa0066b30 2021-03-25T14:16:41.559 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.553+0000 7fda97fff700 1 --2- 172.21.15.110:0/312125435 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fda8405a0b0 0x7fda8405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:41.559 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.554+0000 7fda97fff700 1 --2- 172.21.15.110:0/312125435 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fda8405a0b0 0x7fda8405c570 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fdaa00b3fe0 tx=0x7fda88016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:41.559 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.557+0000 7fda96ffd700 1 -- 172.21.15.110:0/312125435 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fda900477d0 con 0x7fdaa0066b30 2021-03-25T14:16:41.708 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.706+0000 7fdaa5809700 1 -- 172.21.15.110:0/312125435 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdaa005d7b0 con 0x7fdaa0066b30 2021-03-25T14:16:41.708 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.706+0000 7fda96ffd700 1 -- 172.21.15.110:0/312125435 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7fda9004adf0 con 0x7fdaa0066b30 2021-03-25T14:16:41.708 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:16:41.711 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.708+0000 7fdaa5809700 1 -- 172.21.15.110:0/312125435 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fda8405a0b0 msgr2=0x7fda8405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:41.711 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.708+0000 7fdaa5809700 1 --2- 172.21.15.110:0/312125435 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fda8405a0b0 0x7fda8405c570 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fdaa00b3fe0 tx=0x7fda88016000).stop 2021-03-25T14:16:41.711 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.708+0000 7fdaa5809700 1 -- 172.21.15.110:0/312125435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdaa0066b30 msgr2=0x7fdaa014b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:41.711 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.708+0000 7fdaa5809700 1 --2- 172.21.15.110:0/312125435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdaa0066b30 0x7fdaa014b520 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fda9000c920 tx=0x7fda90008040).stop 2021-03-25T14:16:41.711 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.708+0000 7fdaa5809700 1 -- 172.21.15.110:0/312125435 shutdown_connections 2021-03-25T14:16:41.711 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.708+0000 7fdaa5809700 1 --2- 172.21.15.110:0/312125435 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fda8405a0b0 0x7fda8405c570 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:41.711 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.708+0000 7fdaa5809700 1 --2- 172.21.15.110:0/312125435 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdaa0146ff0 0x7fdaa009f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:41.711 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.708+0000 7fdaa5809700 1 --2- 172.21.15.110:0/312125435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdaa0066b30 0x7fdaa014b520 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:41.711 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.708+0000 7fdaa5809700 1 --2- 172.21.15.110:0/312125435 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdaa0146c10 0x7fdaa009eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:41.712 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.708+0000 7fdaa5809700 1 -- 172.21.15.110:0/312125435 >> 172.21.15.110:0/312125435 conn(0x7fdaa00686f0 msgr2=0x7fdaa0064640 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:41.712 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.708+0000 7fdaa5809700 1 -- 172.21.15.110:0/312125435 shutdown_connections 2021-03-25T14:16:41.712 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.708+0000 7fdaa5809700 1 -- 172.21.15.110:0/312125435 wait complete. 2021-03-25T14:16:41.721 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-03-25T14:16:41.793 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-03-25T14:16:41.795 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-03-25T14:16:41.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.834+0000 7f9161b87700 1 Processor -- start 2021-03-25T14:16:41.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.834+0000 7f9161b87700 1 -- start start 2021-03-25T14:16:41.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.835+0000 7f9161b87700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f915c0bdda0 0x7f915c0b7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:41.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.835+0000 7f9161b87700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f915c0b72b0 con 0x7f915c0be810 2021-03-25T14:16:41.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.835+0000 7f9161b87700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f915c0b74e0 con 0x7f915c14cbe0 2021-03-25T14:16:41.849 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.835+0000 7f9161b87700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f915c0631f0 con 0x7f915c0bdda0 2021-03-25T14:16:41.849 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.835+0000 7f9161386700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f915c0be810 0x7f915c063ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41292/0 (socket says 172.21.15.110:41292) 2021-03-25T14:16:41.849 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.835+0000 7f9161386700 1 -- 172.21.15.110:0/853646283 learned_addr learned my addr 172.21.15.110:0/853646283 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:41.849 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.836+0000 7f9160b85700 1 --2- 172.21.15.110:0/853646283 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f915c0bdda0 0x7f915c0b7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:41.849 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.836+0000 7f915b7fe700 1 -- 172.21.15.110:0/853646283 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 273562155 0 0) 0x7f915c0b72b0 con 0x7f915c0be810 2021-03-25T14:16:41.850 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.836+0000 7f915b7fe700 1 -- 172.21.15.110:0/853646283 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9140003270 con 0x7f915c0be810 2021-03-25T14:16:41.850 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.836+0000 7f915b7fe700 1 -- 172.21.15.110:0/853646283 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 693883401 0 0) 0x7f9140003270 con 0x7f915c0be810 2021-03-25T14:16:41.850 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.836+0000 7f915b7fe700 1 -- 172.21.15.110:0/853646283 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f915c0bdda0 msgr2=0x7f915c0b7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:41.850 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.836+0000 7f915b7fe700 1 --2- 172.21.15.110:0/853646283 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f915c0bdda0 0x7f915c0b7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:41.851 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.836+0000 7f915b7fe700 1 -- 172.21.15.110:0/853646283 >> v1:172.21.15.174:6789/0 conn(0x7f915c14cbe0 legacy=0x7f915c149d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:41.851 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.836+0000 7f915b7fe700 1 -- 172.21.15.110:0/853646283 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f915c0b7780 con 0x7f915c0be810 2021-03-25T14:16:41.851 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.836+0000 7f915b7fe700 1 -- 172.21.15.110:0/853646283 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f91540018a0 con 0x7f915c0be810 2021-03-25T14:16:41.851 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.836+0000 7f915b7fe700 1 -- 172.21.15.110:0/853646283 >> v1:172.21.15.110:6789/0 conn(0x7f915c0be810 legacy=0x7f915c063ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:41.851 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.836+0000 7f915b7fe700 1 --2- 172.21.15.110:0/853646283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9140003790 0x7f9140003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:41.852 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.836+0000 7f915b7fe700 1 --2- 172.21.15.110:0/853646283 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f915c0bdda0 0x7f9140004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:41.852 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.836+0000 7f915b7fe700 1 --2- 172.21.15.110:0/853646283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9140004a00 0x7f9140004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:41.852 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.836+0000 7f915b7fe700 1 -- 172.21.15.110:0/853646283 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f915c0631f0 con 0x7f9140004a00 2021-03-25T14:16:41.852 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.836+0000 7f915b7fe700 1 -- 172.21.15.110:0/853646283 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91400041a0 con 0x7f9140003790 2021-03-25T14:16:41.852 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.836+0000 7f915b7fe700 1 -- 172.21.15.110:0/853646283 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9140004360 con 0x7f915c0bdda0 2021-03-25T14:16:41.853 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.836+0000 7f9161386700 1 --2- 172.21.15.110:0/853646283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9140004a00 0x7f9140004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:41.853 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.836+0000 7f9160b85700 1 --2- 172.21.15.110:0/853646283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9140003790 0x7f9140003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:41.853 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.836+0000 7f915bfff700 1 --2- 172.21.15.110:0/853646283 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f915c0bdda0 0x7f9140004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:41.853 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.836+0000 7f9161386700 1 -- 172.21.15.110:0/853646283 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f915c0bdda0 msgr2=0x7f9140004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:41.853 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.836+0000 7f9161386700 1 --2- 172.21.15.110:0/853646283 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f915c0bdda0 0x7f9140004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:41.854 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.836+0000 7f9161386700 1 -- 172.21.15.110:0/853646283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9140003790 msgr2=0x7f9140003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:41.854 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.836+0000 7f9161386700 1 --2- 172.21.15.110:0/853646283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9140003790 0x7f9140003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:41.855 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.836+0000 7f9161386700 1 -- 172.21.15.110:0/853646283 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9140003270 con 0x7f9140004a00 2021-03-25T14:16:41.855 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.836+0000 7f9161386700 1 --2- 172.21.15.110:0/853646283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9140004a00 0x7f9140004e80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f915400c840 tx=0x7f915c0b7910).ready entity=mon.0 client_cookie=cbf473eb0bfe24a0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:41.855 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.837+0000 7f915b7fe700 1 -- 172.21.15.110:0/853646283 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9154005bb0 con 0x7f9140004a00 2021-03-25T14:16:41.855 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.837+0000 7f915b7fe700 1 -- 172.21.15.110:0/853646283 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9154005d10 con 0x7f9140004a00 2021-03-25T14:16:41.855 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.837+0000 7f915b7fe700 1 -- 172.21.15.110:0/853646283 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9154007300 con 0x7f9140004a00 2021-03-25T14:16:41.856 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.837+0000 7f9161b87700 1 -- 172.21.15.110:0/853646283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9140004a00 msgr2=0x7f9140004e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:41.856 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.837+0000 7f9161b87700 1 --2- 172.21.15.110:0/853646283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9140004a00 0x7f9140004e80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f915400c840 tx=0x7f915c0b7910).stop 2021-03-25T14:16:41.856 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.837+0000 7f9161386700 1 -- 172.21.15.110:0/853646283 reap_dead start 2021-03-25T14:16:41.856 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.837+0000 7f9161b87700 1 -- 172.21.15.110:0/853646283 shutdown_connections 2021-03-25T14:16:41.856 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.837+0000 7f9161b87700 1 -- 172.21.15.110:0/853646283 >> 172.21.15.110:0/853646283 conn(0x7f915c065830 msgr2=0x7f915c0685f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:41.857 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.837+0000 7f9161b87700 1 -- 172.21.15.110:0/853646283 shutdown_connections 2021-03-25T14:16:41.857 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.837+0000 7f9161b87700 1 -- 172.21.15.110:0/853646283 wait complete. 2021-03-25T14:16:41.857 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.838+0000 7f9161b87700 1 Processor -- start 2021-03-25T14:16:41.857 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.838+0000 7f9161b87700 1 -- start start 2021-03-25T14:16:41.858 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.839+0000 7f9161b87700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f915c068800 0x7f915c0a0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:41.858 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.839+0000 7f9161b87700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f915c1593d0 0x7f915c09e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:41.858 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.839+0000 7f9161b87700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f915c0a1140 0x7f915c09e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:41.858 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.839+0000 7f9161b87700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f915c117ef0 con 0x7f915c068800 2021-03-25T14:16:41.859 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.839+0000 7f9161b87700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f915c1587c0 con 0x7f915c0a1140 2021-03-25T14:16:41.859 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.839+0000 7f9161b87700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f915c09fcd0 con 0x7f915c1593d0 2021-03-25T14:16:41.859 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.839+0000 7f9160b85700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f915c068800 0x7f915c0a0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:41.859 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.839+0000 7f9160b85700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f915c068800 0x7f915c0a0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48366/0 (socket says 172.21.15.110:48366) 2021-03-25T14:16:41.859 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.839+0000 7f9160b85700 1 -- 172.21.15.110:0/2423076683 learned_addr learned my addr 172.21.15.110:0/2423076683 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:41.859 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.839+0000 7f915bfff700 1 --2- 172.21.15.110:0/2423076683 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f915c1593d0 0x7f915c09e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:41.860 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.839+0000 7f9161386700 1 --2- 172.21.15.110:0/2423076683 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f915c0a1140 0x7f915c09e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:41.865 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.840+0000 7f9160b85700 1 -- 172.21.15.110:0/2423076683 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f915c1593d0 msgr2=0x7f915c09e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:41.865 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.840+0000 7f9160b85700 1 --2- 172.21.15.110:0/2423076683 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f915c1593d0 0x7f915c09e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:41.865 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.840+0000 7f9160b85700 1 -- 172.21.15.110:0/2423076683 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f915c0a1140 msgr2=0x7f915c09e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:41.865 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.840+0000 7f9160b85700 1 --2- 172.21.15.110:0/2423076683 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f915c0a1140 0x7f915c09e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:41.866 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.840+0000 7f9160b85700 1 -- 172.21.15.110:0/2423076683 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f915c1589f0 con 0x7f915c068800 2021-03-25T14:16:41.866 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.840+0000 7f9160b85700 1 --2- 172.21.15.110:0/2423076683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f915c068800 0x7f915c0a0050 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f9150006890 tx=0x7f9150006e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:41.866 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.840+0000 7f9158ff9700 1 -- 172.21.15.110:0/2423076683 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915000fa10 con 0x7f915c068800 2021-03-25T14:16:41.866 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.840+0000 7f9158ff9700 1 -- 172.21.15.110:0/2423076683 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915000fb70 con 0x7f915c068800 2021-03-25T14:16:41.866 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.840+0000 7f9161b87700 1 -- 172.21.15.110:0/2423076683 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f915c158c90 con 0x7f915c068800 2021-03-25T14:16:41.867 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.840+0000 7f9158ff9700 1 -- 172.21.15.110:0/2423076683 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9150014440 con 0x7f915c068800 2021-03-25T14:16:41.867 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.840+0000 7f9161b87700 1 -- 172.21.15.110:0/2423076683 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f915c0a06f0 con 0x7f915c068800 2021-03-25T14:16:41.867 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.841+0000 7f9161b87700 1 -- 172.21.15.110:0/2423076683 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f915c045ae0 con 0x7f915c068800 2021-03-25T14:16:41.867 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.841+0000 7f9158ff9700 1 -- 172.21.15.110:0/2423076683 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f91500147f0 con 0x7f915c068800 2021-03-25T14:16:41.867 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.841+0000 7f9158ff9700 1 --2- 172.21.15.110:0/2423076683 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f913c05a0b0 0x7f913c05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:41.867 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.841+0000 7f9158ff9700 1 -- 172.21.15.110:0/2423076683 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f91500746d0 con 0x7f915c068800 2021-03-25T14:16:41.867 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.841+0000 7f915bfff700 1 --2- 172.21.15.110:0/2423076683 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f913c05a0b0 0x7f913c05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:41.867 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.842+0000 7f915bfff700 1 --2- 172.21.15.110:0/2423076683 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f913c05a0b0 0x7f913c05c570 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f915c066290 tx=0x7f9148007ba0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:41.867 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.845+0000 7f9158ff9700 1 -- 172.21.15.110:0/2423076683 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f9150047d80 con 0x7f915c068800 2021-03-25T14:16:41.996 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.994+0000 7f9161b87700 1 -- 172.21.15.110:0/2423076683 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f915c061c50 con 0x7f915c068800 2021-03-25T14:16:41.997 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.995+0000 7f9158ff9700 1 -- 172.21.15.110:0/2423076683 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7f9150018070 con 0x7f915c068800 2021-03-25T14:16:41.997 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:16:41.999 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.996+0000 7f9161b87700 1 -- 172.21.15.110:0/2423076683 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f913c05a0b0 msgr2=0x7f913c05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:41.999 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.996+0000 7f9161b87700 1 --2- 172.21.15.110:0/2423076683 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f913c05a0b0 0x7f913c05c570 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f915c066290 tx=0x7f9148007ba0).stop 2021-03-25T14:16:41.999 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.996+0000 7f9161b87700 1 -- 172.21.15.110:0/2423076683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f915c068800 msgr2=0x7f915c0a0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:41.999 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.996+0000 7f9161b87700 1 --2- 172.21.15.110:0/2423076683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f915c068800 0x7f915c0a0050 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f9150006890 tx=0x7f9150006e20).stop 2021-03-25T14:16:41.999 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.997+0000 7f9161b87700 1 -- 172.21.15.110:0/2423076683 shutdown_connections 2021-03-25T14:16:41.999 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.997+0000 7f9161b87700 1 --2- 172.21.15.110:0/2423076683 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f913c05a0b0 0x7f913c05c570 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:41.999 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.997+0000 7f9161b87700 1 --2- 172.21.15.110:0/2423076683 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f915c0a1140 0x7f915c09e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:41.999 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.997+0000 7f9161b87700 1 --2- 172.21.15.110:0/2423076683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f915c068800 0x7f915c0a0050 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:41.999 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.997+0000 7f9161b87700 1 --2- 172.21.15.110:0/2423076683 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f915c1593d0 0x7f915c09e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:42.000 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.997+0000 7f9161b87700 1 -- 172.21.15.110:0/2423076683 >> 172.21.15.110:0/2423076683 conn(0x7f915c065830 msgr2=0x7f915c147b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:42.000 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.997+0000 7f9161b87700 1 -- 172.21.15.110:0/2423076683 shutdown_connections 2021-03-25T14:16:42.000 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:41.997+0000 7f9161b87700 1 -- 172.21.15.110:0/2423076683 wait complete. 2021-03-25T14:16:42.010 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2021-03-25T14:16:42.123 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.121+0000 7f64ce52b700 1 Processor -- start 2021-03-25T14:16:42.171 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.121+0000 7f64ce52b700 1 -- start start 2021-03-25T14:16:42.175 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.122+0000 7f64ce52b700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f64c814d470 0x7f64c814d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:42.176 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.122+0000 7f64ce52b700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64c80691b0 con 0x7f64c814cc90 2021-03-25T14:16:42.176 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.122+0000 7f64ce52b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64c80bc2b0 con 0x7f64c80685d0 2021-03-25T14:16:42.176 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.122+0000 7f64ce52b700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64c8149dd0 con 0x7f64c814d470 2021-03-25T14:16:42.176 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.122+0000 7f64c7fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f64c814d470 0x7f64c814d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:42.176 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.122+0000 7f64c77fe700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f64c814cc90 0x7f64c81493c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41310/0 (socket says 172.21.15.110:41310) 2021-03-25T14:16:42.176 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.122+0000 7f64c7fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f64c814d470 0x7f64c814d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48378/0 (socket says 172.21.15.110:48378) 2021-03-25T14:16:42.176 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.122+0000 7f64c77fe700 1 -- 172.21.15.110:0/3009241661 learned_addr learned my addr 172.21.15.110:0/3009241661 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:42.176 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.123+0000 7f64c7fff700 1 -- 172.21.15.110:0/3009241661 >> v1:172.21.15.174:6789/0 conn(0x7f64c80685d0 legacy=0x7f64c80bc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:42.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.123+0000 7f64c7fff700 1 -- 172.21.15.110:0/3009241661 >> v1:172.21.15.110:6789/0 conn(0x7f64c814cc90 legacy=0x7f64c81493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:42.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.123+0000 7f64c7fff700 1 -- 172.21.15.110:0/3009241661 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c814a070 con 0x7f64c814d470 2021-03-25T14:16:42.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.123+0000 7f64c6ffd700 1 -- 172.21.15.110:0/3009241661 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1671479490 0 0) 0x7f64c80691b0 con 0x7f64c814cc90 2021-03-25T14:16:42.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.123+0000 7f64c7fff700 1 --2- 172.21.15.110:0/3009241661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64c814d470 0x7f64c814d850 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f64b800b9c0 tx=0x7f64b8006e20).ready entity=mon.0 client_cookie=c9b56607a1a8b40f server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:42.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.123+0000 7f64c6ffd700 1 -- 172.21.15.110:0/3009241661 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b80097e0 con 0x7f64c814d470 2021-03-25T14:16:42.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.123+0000 7f64c6ffd700 1 -- 172.21.15.110:0/3009241661 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b8009940 con 0x7f64c814d470 2021-03-25T14:16:42.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.123+0000 7f64c6ffd700 1 -- 172.21.15.110:0/3009241661 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b8009cc0 con 0x7f64c814d470 2021-03-25T14:16:42.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.123+0000 7f64ce52b700 1 -- 172.21.15.110:0/3009241661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64c814d470 msgr2=0x7f64c814d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:42.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.123+0000 7f64ce52b700 1 --2- 172.21.15.110:0/3009241661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64c814d470 0x7f64c814d850 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f64b800b9c0 tx=0x7f64b8006e20).stop 2021-03-25T14:16:42.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.123+0000 7f64ce52b700 1 -- 172.21.15.110:0/3009241661 shutdown_connections 2021-03-25T14:16:42.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.123+0000 7f64ce52b700 1 --2- 172.21.15.110:0/3009241661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64c814d470 0x7f64c814d850 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:42.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.123+0000 7f64ce52b700 1 -- 172.21.15.110:0/3009241661 >> 172.21.15.110:0/3009241661 conn(0x7f64c8060c40 msgr2=0x7f64c8061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:42.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.123+0000 7f64ce52b700 1 -- 172.21.15.110:0/3009241661 shutdown_connections 2021-03-25T14:16:42.178 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.123+0000 7f64ce52b700 1 -- 172.21.15.110:0/3009241661 wait complete. 2021-03-25T14:16:42.178 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.124+0000 7f64ce52b700 1 Processor -- start 2021-03-25T14:16:42.178 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.125+0000 7f64ce52b700 1 -- start start 2021-03-25T14:16:42.178 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.125+0000 7f64ce52b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64c80685d0 0x7f64c80c00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:42.178 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.125+0000 7f64ce52b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64c814cc90 0x7f64c8158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:42.178 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.125+0000 7f64ce52b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64c814d470 0x7f64c8158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:42.178 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.125+0000 7f64ce52b700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c8064230 con 0x7f64c814cc90 2021-03-25T14:16:42.178 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.125+0000 7f64ce52b700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c8065000 con 0x7f64c814d470 2021-03-25T14:16:42.178 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.125+0000 7f64ce52b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c80635b0 con 0x7f64c80685d0 2021-03-25T14:16:42.178 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.125+0000 7f64c77fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64c814cc90 0x7f64c8158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:42.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.125+0000 7f64c77fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64c814cc90 0x7f64c8158a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48384/0 (socket says 172.21.15.110:48384) 2021-03-25T14:16:42.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.125+0000 7f64c77fe700 1 -- 172.21.15.110:0/1622119152 learned_addr learned my addr 172.21.15.110:0/1622119152 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:42.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.126+0000 7f64ccac8700 1 --2- 172.21.15.110:0/1622119152 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64c814d470 0x7f64c8158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:42.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.126+0000 7f64c7fff700 1 --2- 172.21.15.110:0/1622119152 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64c80685d0 0x7f64c80c00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:42.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.126+0000 7f64c77fe700 1 -- 172.21.15.110:0/1622119152 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64c80685d0 msgr2=0x7f64c80c00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:42.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.126+0000 7f64c77fe700 1 --2- 172.21.15.110:0/1622119152 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64c80685d0 0x7f64c80c00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:42.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.126+0000 7f64c77fe700 1 -- 172.21.15.110:0/1622119152 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64c814d470 msgr2=0x7f64c8158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:42.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.126+0000 7f64c77fe700 1 --2- 172.21.15.110:0/1622119152 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64c814d470 0x7f64c8158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:42.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.126+0000 7f64c77fe700 1 -- 172.21.15.110:0/1622119152 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c8063850 con 0x7f64c814cc90 2021-03-25T14:16:42.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.126+0000 7f64ccac8700 1 --2- 172.21.15.110:0/1622119152 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64c814d470 0x7f64c8158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:42.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.126+0000 7f64c77fe700 1 --2- 172.21.15.110:0/1622119152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64c814cc90 0x7f64c8158a70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f64bc00c710 tx=0x7f64bc007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:42.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.126+0000 7f64affff700 1 -- 172.21.15.110:0/1622119152 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64bc007320 con 0x7f64c814cc90 2021-03-25T14:16:42.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.126+0000 7f64affff700 1 -- 172.21.15.110:0/1622119152 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64bc007480 con 0x7f64c814cc90 2021-03-25T14:16:42.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.126+0000 7f64ce52b700 1 -- 172.21.15.110:0/1622119152 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64c8063af0 con 0x7f64c814cc90 2021-03-25T14:16:42.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.126+0000 7f64affff700 1 -- 172.21.15.110:0/1622119152 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64bc005850 con 0x7f64c814cc90 2021-03-25T14:16:42.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.126+0000 7f64ce52b700 1 -- 172.21.15.110:0/1622119152 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64c8148060 con 0x7f64c814cc90 2021-03-25T14:16:42.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.127+0000 7f64ce52b700 1 -- 172.21.15.110:0/1622119152 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64c8063f50 con 0x7f64c814cc90 2021-03-25T14:16:42.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.127+0000 7f64affff700 1 -- 172.21.15.110:0/1622119152 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f64bc010030 con 0x7f64c814cc90 2021-03-25T14:16:42.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.127+0000 7f64affff700 1 --2- 172.21.15.110:0/1622119152 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f64a805a0b0 0x7f64a805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:42.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.127+0000 7f64affff700 1 -- 172.21.15.110:0/1622119152 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f64bc073d70 con 0x7f64c814cc90 2021-03-25T14:16:42.181 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.127+0000 7f64c7fff700 1 --2- 172.21.15.110:0/1622119152 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f64a805a0b0 0x7f64a805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:42.181 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.128+0000 7f64c7fff700 1 --2- 172.21.15.110:0/1622119152 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f64a805a0b0 0x7f64a805c570 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f64b8006e60 tx=0x7f64b8016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:42.181 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.131+0000 7f64affff700 1 -- 172.21.15.110:0/1622119152 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f64bc0474d0 con 0x7f64c814cc90 2021-03-25T14:16:42.283 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.281+0000 7f64ce52b700 1 -- 172.21.15.110:0/1622119152 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f64c805d7b0 con 0x7f64c814cc90 2021-03-25T14:16:42.283 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.282+0000 7f64affff700 1 -- 172.21.15.110:0/1622119152 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+10 (secure 0 0 0) 0x7f64bc04aaf0 con 0x7f64c814cc90 2021-03-25T14:16:42.284 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:16:42.286 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.283+0000 7f64ce52b700 1 -- 172.21.15.110:0/1622119152 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f64a805a0b0 msgr2=0x7f64a805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:42.286 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.283+0000 7f64ce52b700 1 --2- 172.21.15.110:0/1622119152 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f64a805a0b0 0x7f64a805c570 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f64b8006e60 tx=0x7f64b8016000).stop 2021-03-25T14:16:42.286 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.283+0000 7f64ce52b700 1 -- 172.21.15.110:0/1622119152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64c814cc90 msgr2=0x7f64c8158a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:42.286 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.283+0000 7f64ce52b700 1 --2- 172.21.15.110:0/1622119152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64c814cc90 0x7f64c8158a70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f64bc00c710 tx=0x7f64bc007a90).stop 2021-03-25T14:16:42.286 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.283+0000 7f64ce52b700 1 -- 172.21.15.110:0/1622119152 shutdown_connections 2021-03-25T14:16:42.286 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.283+0000 7f64ce52b700 1 --2- 172.21.15.110:0/1622119152 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f64a805a0b0 0x7f64a805c570 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:42.286 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.283+0000 7f64ce52b700 1 --2- 172.21.15.110:0/1622119152 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64c814d470 0x7f64c8158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:42.286 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.283+0000 7f64ce52b700 1 --2- 172.21.15.110:0/1622119152 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64c80685d0 0x7f64c80c00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:42.286 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.283+0000 7f64ce52b700 1 --2- 172.21.15.110:0/1622119152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64c814cc90 0x7f64c8158a70 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:42.286 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.283+0000 7f64ce52b700 1 -- 172.21.15.110:0/1622119152 >> 172.21.15.110:0/1622119152 conn(0x7f64c8060c40 msgr2=0x7f64c80bafa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:42.287 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.284+0000 7f64ce52b700 1 -- 172.21.15.110:0/1622119152 shutdown_connections 2021-03-25T14:16:42.287 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.284+0000 7f64ce52b700 1 -- 172.21.15.110:0/1622119152 wait complete. 2021-03-25T14:16:42.297 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:16:42.406 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.404+0000 7f4534e42700 1 Processor -- start 2021-03-25T14:16:42.406 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.404+0000 7f4534e42700 1 -- start start 2021-03-25T14:16:42.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.405+0000 7f4534e42700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4530149080 0x7f45300b1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:42.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.405+0000 7f4534e42700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45300bafc0 con 0x7f45300bc220 2021-03-25T14:16:42.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.405+0000 7f4534e42700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45300baa80 con 0x7f45300675d0 2021-03-25T14:16:42.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.405+0000 7f4534e42700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45300b1830 con 0x7f4530149080 2021-03-25T14:16:42.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.405+0000 7f452dd9b700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f45300bc220 0x7f4530148970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41324/0 (socket says 172.21.15.110:41324) 2021-03-25T14:16:42.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.405+0000 7f452dd9b700 1 -- 172.21.15.110:0/304931486 learned_addr learned my addr 172.21.15.110:0/304931486 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:42.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.405+0000 7f452d59a700 1 -- 172.21.15.110:0/304931486 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3333413120 0 0) 0x7f45300bafc0 con 0x7f45300bc220 2021-03-25T14:16:42.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.405+0000 7f452d59a700 1 -- 172.21.15.110:0/304931486 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4514003270 con 0x7f45300bc220 2021-03-25T14:16:42.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.405+0000 7f452ed9d700 1 --2- 172.21.15.110:0/304931486 >> v2:172.21.15.174:3300/0 conn(0x7f4530149080 0x7f45300b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:42.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.405+0000 7f452d59a700 1 -- 172.21.15.110:0/304931486 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2137266312 0 0) 0x7f4514003270 con 0x7f45300bc220 2021-03-25T14:16:42.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.406+0000 7f452d59a700 1 -- 172.21.15.110:0/304931486 >> v2:172.21.15.174:3300/0 conn(0x7f4530149080 msgr2=0x7f45300b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:42.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.406+0000 7f452d59a700 1 --2- 172.21.15.110:0/304931486 >> v2:172.21.15.174:3300/0 conn(0x7f4530149080 0x7f45300b1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:42.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.406+0000 7f452d59a700 1 -- 172.21.15.110:0/304931486 >> v1:172.21.15.174:6789/0 conn(0x7f45300675d0 legacy=0x7f453014cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:42.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.406+0000 7f452d59a700 1 -- 172.21.15.110:0/304931486 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45300bad20 con 0x7f45300bc220 2021-03-25T14:16:42.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.406+0000 7f452d59a700 1 -- 172.21.15.110:0/304931486 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f4524001520 con 0x7f45300bc220 2021-03-25T14:16:42.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.406+0000 7f452d59a700 1 -- 172.21.15.110:0/304931486 >> v1:172.21.15.110:6789/0 conn(0x7f45300bc220 legacy=0x7f4530148970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:42.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.406+0000 7f452d59a700 1 --2- 172.21.15.110:0/304931486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4514003760 0x7f4514003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:42.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.406+0000 7f452d59a700 1 --2- 172.21.15.110:0/304931486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4514004510 0x7f4514004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:42.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.406+0000 7f452d59a700 1 --2- 172.21.15.110:0/304931486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4514004e80 0x7f451400b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:42.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.406+0000 7f452d59a700 1 -- 172.21.15.110:0/304931486 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45300b1830 con 0x7f4514004510 2021-03-25T14:16:42.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.406+0000 7f452d59a700 1 -- 172.21.15.110:0/304931486 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4514004290 con 0x7f4514003760 2021-03-25T14:16:42.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.406+0000 7f452d59a700 1 -- 172.21.15.110:0/304931486 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f451400bc50 con 0x7f4514004e80 2021-03-25T14:16:42.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.406+0000 7f452dd9b700 1 --2- 172.21.15.110:0/304931486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4514004510 0x7f4514004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:42.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.406+0000 7f452e59c700 1 --2- 172.21.15.110:0/304931486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4514003760 0x7f4514003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:42.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.406+0000 7f452ed9d700 1 --2- 172.21.15.110:0/304931486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4514004e80 0x7f451400b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:42.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.406+0000 7f452dd9b700 1 -- 172.21.15.110:0/304931486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4514004e80 msgr2=0x7f451400b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:42.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.406+0000 7f452dd9b700 1 --2- 172.21.15.110:0/304931486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4514004e80 0x7f451400b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:42.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.406+0000 7f452dd9b700 1 -- 172.21.15.110:0/304931486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4514003760 msgr2=0x7f4514003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:42.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.406+0000 7f452dd9b700 1 --2- 172.21.15.110:0/304931486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4514003760 0x7f4514003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:42.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.406+0000 7f452ed9d700 1 -- 172.21.15.110:0/304931486 reap_dead start 2021-03-25T14:16:42.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.406+0000 7f452dd9b700 1 -- 172.21.15.110:0/304931486 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4514003270 con 0x7f4514004510 2021-03-25T14:16:42.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.406+0000 7f452dd9b700 1 --2- 172.21.15.110:0/304931486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4514004510 0x7f4514004990 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f452400c410 tx=0x7f45300bac10).ready entity=mon.0 client_cookie=c7007e46c6c83f6 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:42.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.406+0000 7f452d59a700 1 -- 172.21.15.110:0/304931486 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45240070d0 con 0x7f4514004510 2021-03-25T14:16:42.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.406+0000 7f452d59a700 1 -- 172.21.15.110:0/304931486 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4524007230 con 0x7f4514004510 2021-03-25T14:16:42.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.406+0000 7f452d59a700 1 -- 172.21.15.110:0/304931486 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4524005620 con 0x7f4514004510 2021-03-25T14:16:42.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.407+0000 7f4534e42700 1 -- 172.21.15.110:0/304931486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4514004510 msgr2=0x7f4514004990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:42.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.407+0000 7f4534e42700 1 --2- 172.21.15.110:0/304931486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4514004510 0x7f4514004990 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f452400c410 tx=0x7f45300bac10).stop 2021-03-25T14:16:42.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.407+0000 7f4534e42700 1 -- 172.21.15.110:0/304931486 shutdown_connections 2021-03-25T14:16:42.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.407+0000 7f4534e42700 1 --2- 172.21.15.110:0/304931486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4514004510 0x7f4514004990 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:42.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.407+0000 7f4534e42700 1 -- 172.21.15.110:0/304931486 >> 172.21.15.110:0/304931486 conn(0x7f4530064a10 msgr2=0x7f453005c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:42.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.407+0000 7f4534e42700 1 -- 172.21.15.110:0/304931486 shutdown_connections 2021-03-25T14:16:42.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.407+0000 7f4534e42700 1 -- 172.21.15.110:0/304931486 wait complete. 2021-03-25T14:16:42.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.408+0000 7f4534e42700 1 Processor -- start 2021-03-25T14:16:42.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.408+0000 7f4534e42700 1 -- start start 2021-03-25T14:16:42.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.409+0000 7f4534e42700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4514004510 0x7f4530159a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:42.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.409+0000 7f4534e42700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f453014de60 0x7f4530143920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:42.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.409+0000 7f4534e42700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4530143e10 0x7f453014bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:42.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.409+0000 7f4534e42700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45300b5ae0 con 0x7f4514004510 2021-03-25T14:16:42.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.409+0000 7f4534e42700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4530159f70 con 0x7f4530143e10 2021-03-25T14:16:42.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.409+0000 7f4534e42700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45300b5300 con 0x7f453014de60 2021-03-25T14:16:42.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.409+0000 7f452e59c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4514004510 0x7f4530159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:42.420 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.409+0000 7f452e59c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4514004510 0x7f4530159a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48400/0 (socket says 172.21.15.110:48400) 2021-03-25T14:16:42.420 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.409+0000 7f452e59c700 1 -- 172.21.15.110:0/2609685742 learned_addr learned my addr 172.21.15.110:0/2609685742 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:42.420 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.409+0000 7f452ed9d700 1 --2- 172.21.15.110:0/2609685742 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4530143e10 0x7f453014bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:42.420 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.409+0000 7f452dd9b700 1 --2- 172.21.15.110:0/2609685742 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f453014de60 0x7f4530143920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:42.420 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.409+0000 7f452e59c700 1 -- 172.21.15.110:0/2609685742 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f453014de60 msgr2=0x7f4530143920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:42.420 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.409+0000 7f452e59c700 1 --2- 172.21.15.110:0/2609685742 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f453014de60 0x7f4530143920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:42.420 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.409+0000 7f452e59c700 1 -- 172.21.15.110:0/2609685742 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4530143e10 msgr2=0x7f453014bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:42.420 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.409+0000 7f452e59c700 1 --2- 172.21.15.110:0/2609685742 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4530143e10 0x7f453014bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:42.421 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.409+0000 7f452e59c700 1 -- 172.21.15.110:0/2609685742 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45300b55a0 con 0x7f4514004510 2021-03-25T14:16:42.421 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.409+0000 7f452ed9d700 1 --2- 172.21.15.110:0/2609685742 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4530143e10 0x7f453014bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:42.421 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.409+0000 7f452e59c700 1 --2- 172.21.15.110:0/2609685742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4514004510 0x7f4530159a80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f4520002960 tx=0x7f4520007bc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:42.421 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.409+0000 7f451e7fc700 1 -- 172.21.15.110:0/2609685742 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4520007020 con 0x7f4514004510 2021-03-25T14:16:42.421 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.409+0000 7f451e7fc700 1 -- 172.21.15.110:0/2609685742 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4520007180 con 0x7f4514004510 2021-03-25T14:16:42.421 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.409+0000 7f451e7fc700 1 -- 172.21.15.110:0/2609685742 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452000f870 con 0x7f4514004510 2021-03-25T14:16:42.421 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.409+0000 7f4534e42700 1 -- 172.21.15.110:0/2609685742 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45300b5840 con 0x7f4514004510 2021-03-25T14:16:42.421 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.409+0000 7f4534e42700 1 -- 172.21.15.110:0/2609685742 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4530144290 con 0x7f4514004510 2021-03-25T14:16:42.421 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.410+0000 7f4534e42700 1 -- 172.21.15.110:0/2609685742 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f453014bc60 con 0x7f4514004510 2021-03-25T14:16:42.421 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.410+0000 7f451e7fc700 1 -- 172.21.15.110:0/2609685742 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f452000fc60 con 0x7f4514004510 2021-03-25T14:16:42.421 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.411+0000 7f451e7fc700 1 --2- 172.21.15.110:0/2609685742 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f450c05a0e0 0x7f450c05c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:42.421 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.411+0000 7f451e7fc700 1 -- 172.21.15.110:0/2609685742 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f4520073e00 con 0x7f4514004510 2021-03-25T14:16:42.422 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.411+0000 7f452dd9b700 1 --2- 172.21.15.110:0/2609685742 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f450c05a0e0 0x7f450c05c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:42.422 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.411+0000 7f452dd9b700 1 --2- 172.21.15.110:0/2609685742 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f450c05a0e0 0x7f450c05c5a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f4530149d50 tx=0x7f4524013000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:42.422 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.414+0000 7f451e7fc700 1 -- 172.21.15.110:0/2609685742 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f4520046620 con 0x7f4514004510 2021-03-25T14:16:42.566 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.564+0000 7f4534e42700 1 -- 172.21.15.110:0/2609685742 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4530068850 con 0x7f4514004510 2021-03-25T14:16:42.566 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.565+0000 7f451e7fc700 1 -- 172.21.15.110:0/2609685742 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18685 (secure 0 0 0) 0x7f4520026910 con 0x7f4514004510 2021-03-25T14:16:42.567 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:16:42.567 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":25,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:16:15.446609+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-03-25T14:16:09.478442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-03-25T14:16:10.071152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2021-03-25T14:16:13.122119+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:16:42.568 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.566+0000 7f4534e42700 1 -- 172.21.15.110:0/2609685742 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f450c05a0e0 msgr2=0x7f450c05c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:42.569 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.566+0000 7f4534e42700 1 --2- 172.21.15.110:0/2609685742 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f450c05a0e0 0x7f450c05c5a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f4530149d50 tx=0x7f4524013000).stop 2021-03-25T14:16:42.569 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.566+0000 7f4534e42700 1 -- 172.21.15.110:0/2609685742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4514004510 msgr2=0x7f4530159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:42.569 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.566+0000 7f4534e42700 1 --2- 172.21.15.110:0/2609685742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4514004510 0x7f4530159a80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f4520002960 tx=0x7f4520007bc0).stop 2021-03-25T14:16:42.569 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.566+0000 7f4534e42700 1 -- 172.21.15.110:0/2609685742 shutdown_connections 2021-03-25T14:16:42.569 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.566+0000 7f4534e42700 1 --2- 172.21.15.110:0/2609685742 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f450c05a0e0 0x7f450c05c5a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:42.569 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.566+0000 7f4534e42700 1 --2- 172.21.15.110:0/2609685742 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4530143e10 0x7f453014bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:42.569 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.566+0000 7f4534e42700 1 --2- 172.21.15.110:0/2609685742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4514004510 0x7f4530159a80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:42.569 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.566+0000 7f4534e42700 1 --2- 172.21.15.110:0/2609685742 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f453014de60 0x7f4530143920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:42.569 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.566+0000 7f4534e42700 1 -- 172.21.15.110:0/2609685742 >> 172.21.15.110:0/2609685742 conn(0x7f4530064a10 msgr2=0x7f4530147e30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:42.569 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.566+0000 7f4534e42700 1 -- 172.21.15.110:0/2609685742 shutdown_connections 2021-03-25T14:16:42.570 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.566+0000 7f4534e42700 1 -- 172.21.15.110:0/2609685742 wait complete. 2021-03-25T14:16:42.580 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-03-25T14:15:59.047299+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-03-25T14:16:00.537926+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-03-25T14:16:09.478442+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-03-25T14:16:10.071152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2021-03-25T14:16:13.122119+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-03-25T14:16:42.580 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-03-25T14:16:42.692 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.690+0000 7f68fd634700 1 Processor -- start 2021-03-25T14:16:42.693 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.690+0000 7f68fd634700 1 -- start start 2021-03-25T14:16:42.698 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.691+0000 7f68fd634700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f68f8068d50 0x7f68f814a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:42.699 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.691+0000 7f68fd634700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f68f80ba750 0x7f68f8148b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:42.699 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.691+0000 7f68fd634700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68f8149010 0x7f68f80bfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:42.699 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.691+0000 7f68fd634700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68f814a650 con 0x7f68f8068d50 2021-03-25T14:16:42.699 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.691+0000 7f68fd634700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68f8067070 con 0x7f68f80ba750 2021-03-25T14:16:42.699 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.691+0000 7f68fd634700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f80baff0 con 0x7f68f8149010 2021-03-25T14:16:42.699 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.691+0000 7f68f7fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f68f8068d50 0x7f68f814a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:42.699 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.691+0000 7f68f7fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f68f8068d50 0x7f68f814a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48408/0 (socket says 172.21.15.110:48408) 2021-03-25T14:16:42.699 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.691+0000 7f68f7fff700 1 -- 172.21.15.110:0/2491529790 learned_addr learned my addr 172.21.15.110:0/2491529790 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:42.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.692+0000 7f68fce33700 1 --2- 172.21.15.110:0/2491529790 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68f8149010 0x7f68f80bfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:42.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.692+0000 7f68f77fe700 1 --2- 172.21.15.110:0/2491529790 >> v2:172.21.15.174:3300/0 conn(0x7f68f80ba750 0x7f68f8148b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:42.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.692+0000 7f68f7fff700 1 -- 172.21.15.110:0/2491529790 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68f8149010 msgr2=0x7f68f80bfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:42.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.692+0000 7f68f7fff700 1 --2- 172.21.15.110:0/2491529790 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68f8149010 0x7f68f80bfdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:42.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.692+0000 7f68f7fff700 1 -- 172.21.15.110:0/2491529790 >> v2:172.21.15.174:3300/0 conn(0x7f68f80ba750 msgr2=0x7f68f8148b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:42.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.692+0000 7f68f7fff700 1 --2- 172.21.15.110:0/2491529790 >> v2:172.21.15.174:3300/0 conn(0x7f68f80ba750 0x7f68f8148b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:42.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.692+0000 7f68f7fff700 1 -- 172.21.15.110:0/2491529790 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f80bb290 con 0x7f68f8068d50 2021-03-25T14:16:42.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.692+0000 7f68f7fff700 1 --2- 172.21.15.110:0/2491529790 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68f8068d50 0x7f68f814a160 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f68f8066060 tx=0x7f68e8006ee0).ready entity=mon.0 client_cookie=933139693c9df786 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:42.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.692+0000 7f68f6ffd700 1 -- 172.21.15.110:0/2491529790 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e8009890 con 0x7f68f8068d50 2021-03-25T14:16:42.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.692+0000 7f68f6ffd700 1 -- 172.21.15.110:0/2491529790 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e80099f0 con 0x7f68f8068d50 2021-03-25T14:16:42.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.692+0000 7f68f6ffd700 1 -- 172.21.15.110:0/2491529790 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e8009d70 con 0x7f68f8068d50 2021-03-25T14:16:42.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.692+0000 7f68fd634700 1 -- 172.21.15.110:0/2491529790 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68f8068d50 msgr2=0x7f68f814a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:42.701 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.692+0000 7f68fd634700 1 --2- 172.21.15.110:0/2491529790 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68f8068d50 0x7f68f814a160 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f68f8066060 tx=0x7f68e8006ee0).stop 2021-03-25T14:16:42.701 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.692+0000 7f68fd634700 1 -- 172.21.15.110:0/2491529790 shutdown_connections 2021-03-25T14:16:42.701 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.692+0000 7f68fd634700 1 --2- 172.21.15.110:0/2491529790 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68f8149010 0x7f68f80bfdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:42.701 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.692+0000 7f68fd634700 1 --2- 172.21.15.110:0/2491529790 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68f8068d50 0x7f68f814a160 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:42.701 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.692+0000 7f68fd634700 1 --2- 172.21.15.110:0/2491529790 >> v2:172.21.15.174:3300/0 conn(0x7f68f80ba750 0x7f68f8148b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:42.701 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.692+0000 7f68fd634700 1 -- 172.21.15.110:0/2491529790 >> 172.21.15.110:0/2491529790 conn(0x7f68f8066370 msgr2=0x7f68f8066780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:42.701 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.692+0000 7f68fd634700 1 -- 172.21.15.110:0/2491529790 shutdown_connections 2021-03-25T14:16:42.701 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.692+0000 7f68fd634700 1 -- 172.21.15.110:0/2491529790 wait complete. 2021-03-25T14:16:42.701 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.693+0000 7f68fd634700 1 Processor -- start 2021-03-25T14:16:42.701 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.694+0000 7f68fd634700 1 -- start start 2021-03-25T14:16:42.701 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.694+0000 7f68fd634700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68f8068d50 0x7f68f8159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:42.701 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.694+0000 7f68fd634700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68f80ba750 0x7f68f8144290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:42.702 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.694+0000 7f68fd634700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68f8149010 0x7f68f814b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:42.702 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.694+0000 7f68fd634700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f8158bb0 con 0x7f68f8068d50 2021-03-25T14:16:42.702 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.694+0000 7f68fd634700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f814b390 con 0x7f68f8149010 2021-03-25T14:16:42.702 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.694+0000 7f68fd634700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f814b0f0 con 0x7f68f80ba750 2021-03-25T14:16:42.702 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.694+0000 7f68f7fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68f8068d50 0x7f68f8159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:42.702 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.694+0000 7f68f7fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68f8068d50 0x7f68f8159550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48414/0 (socket says 172.21.15.110:48414) 2021-03-25T14:16:42.702 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.694+0000 7f68f7fff700 1 -- 172.21.15.110:0/336969315 learned_addr learned my addr 172.21.15.110:0/336969315 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:42.702 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.695+0000 7f68f77fe700 1 --2- 172.21.15.110:0/336969315 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68f80ba750 0x7f68f8144290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:42.702 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.695+0000 7f68fce33700 1 --2- 172.21.15.110:0/336969315 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68f8149010 0x7f68f814b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:42.702 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.695+0000 7f68f7fff700 1 -- 172.21.15.110:0/336969315 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68f80ba750 msgr2=0x7f68f8144290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:42.702 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.695+0000 7f68f7fff700 1 --2- 172.21.15.110:0/336969315 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68f80ba750 0x7f68f8144290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:42.703 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.695+0000 7f68f7fff700 1 -- 172.21.15.110:0/336969315 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68f8149010 msgr2=0x7f68f814b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:42.703 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.695+0000 7f68f7fff700 1 --2- 172.21.15.110:0/336969315 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68f8149010 0x7f68f814b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:42.703 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.695+0000 7f68f7fff700 1 -- 172.21.15.110:0/336969315 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f8158e10 con 0x7f68f8068d50 2021-03-25T14:16:42.703 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.695+0000 7f68f7fff700 1 --2- 172.21.15.110:0/336969315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68f8068d50 0x7f68f8159550 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f68e8006f20 tx=0x7f68e8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:42.703 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.695+0000 7f68dffff700 1 -- 172.21.15.110:0/336969315 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e8011cd0 con 0x7f68f8068d50 2021-03-25T14:16:42.703 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.695+0000 7f68dffff700 1 -- 172.21.15.110:0/336969315 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e8011e30 con 0x7f68f8068d50 2021-03-25T14:16:42.703 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.695+0000 7f68fd634700 1 -- 172.21.15.110:0/336969315 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f81590b0 con 0x7f68f8068d50 2021-03-25T14:16:42.703 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.695+0000 7f68dffff700 1 -- 172.21.15.110:0/336969315 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e801c670 con 0x7f68f8068d50 2021-03-25T14:16:42.703 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.695+0000 7f68fd634700 1 -- 172.21.15.110:0/336969315 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f814bee0 con 0x7f68f8068d50 2021-03-25T14:16:42.703 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.696+0000 7f68fd634700 1 -- 172.21.15.110:0/336969315 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68f814c0d0 con 0x7f68f8068d50 2021-03-25T14:16:42.703 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.696+0000 7f68dffff700 1 -- 172.21.15.110:0/336969315 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f68e800f070 con 0x7f68f8068d50 2021-03-25T14:16:42.703 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.696+0000 7f68dffff700 1 --2- 172.21.15.110:0/336969315 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f68d805a0b0 0x7f68d805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:42.704 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.697+0000 7f68dffff700 1 -- 172.21.15.110:0/336969315 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f68e8075720 con 0x7f68f8068d50 2021-03-25T14:16:42.704 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.697+0000 7f68f77fe700 1 --2- 172.21.15.110:0/336969315 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f68d805a0b0 0x7f68d805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:42.704 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.697+0000 7f68f77fe700 1 --2- 172.21.15.110:0/336969315 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f68d805a0b0 0x7f68d805c570 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f68f80bfa20 tx=0x7f68ec008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:42.704 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.700+0000 7f68dffff700 1 -- 172.21.15.110:0/336969315 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f68e8048dd0 con 0x7f68f8068d50 2021-03-25T14:16:42.854 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.852+0000 7f68fd634700 1 -- 172.21.15.110:0/336969315 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f68f81589f0 con 0x7f68f8068d50 2021-03-25T14:16:42.855 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.853+0000 7f68dffff700 1 -- 172.21.15.110:0/336969315 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7f68e801ca60 con 0x7f68f8068d50 2021-03-25T14:16:42.855 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 1 2021-03-25T14:16:42.856 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.854+0000 7f68fd634700 1 -- 172.21.15.110:0/336969315 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f68d805a0b0 msgr2=0x7f68d805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:42.856 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.854+0000 7f68fd634700 1 --2- 172.21.15.110:0/336969315 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f68d805a0b0 0x7f68d805c570 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f68f80bfa20 tx=0x7f68ec008040).stop 2021-03-25T14:16:42.856 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.854+0000 7f68fd634700 1 -- 172.21.15.110:0/336969315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68f8068d50 msgr2=0x7f68f8159550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:42.856 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.854+0000 7f68fd634700 1 --2- 172.21.15.110:0/336969315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68f8068d50 0x7f68f8159550 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f68e8006f20 tx=0x7f68e8016000).stop 2021-03-25T14:16:42.857 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.854+0000 7f68fd634700 1 -- 172.21.15.110:0/336969315 shutdown_connections 2021-03-25T14:16:42.857 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.854+0000 7f68fd634700 1 --2- 172.21.15.110:0/336969315 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f68d805a0b0 0x7f68d805c570 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:42.857 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.854+0000 7f68fd634700 1 --2- 172.21.15.110:0/336969315 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68f8149010 0x7f68f814b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:42.857 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.854+0000 7f68fd634700 1 --2- 172.21.15.110:0/336969315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68f8068d50 0x7f68f8159550 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:42.857 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.854+0000 7f68fd634700 1 --2- 172.21.15.110:0/336969315 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68f80ba750 0x7f68f8144290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:42.857 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.854+0000 7f68fd634700 1 -- 172.21.15.110:0/336969315 >> 172.21.15.110:0/336969315 conn(0x7f68f8066370 msgr2=0x7f68f80bb740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:42.857 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.854+0000 7f68fd634700 1 -- 172.21.15.110:0/336969315 shutdown_connections 2021-03-25T14:16:42.857 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.854+0000 7f68fd634700 1 -- 172.21.15.110:0/336969315 wait complete. 2021-03-25T14:16:42.868 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-03-25T14:16:42.980 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.978+0000 7f4f3f8cd700 1 Processor -- start 2021-03-25T14:16:42.981 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.979+0000 7f4f3f8cd700 1 -- start start 2021-03-25T14:16:42.983 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.979+0000 7f4f3f8cd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f38060e00 0x7f4f380a2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:42.984 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.979+0000 7f4f3f8cd700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4f3814da00 0x7f4f381434b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:42.984 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.979+0000 7f4f3f8cd700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f380b6c90 con 0x7f4f38068440 2021-03-25T14:16:42.984 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.979+0000 7f4f3f8cd700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f3814deb0 con 0x7f4f3814da00 2021-03-25T14:16:42.984 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.979+0000 7f4f3f8cd700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3814a080 con 0x7f4f38060e00 2021-03-25T14:16:42.984 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.980+0000 7f4f3de6a700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4f3814da00 0x7f4f381434b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:42.984 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.980+0000 7f4f3de6a700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4f3814da00 0x7f4f381434b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48426/0 (socket says 172.21.15.110:48426) 2021-03-25T14:16:42.984 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.980+0000 7f4f3de6a700 1 -- 172.21.15.110:0/2255440003 learned_addr learned my addr 172.21.15.110:0/2255440003 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:42.984 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.980+0000 7f4f3d669700 1 --2- 172.21.15.110:0/2255440003 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f38060e00 0x7f4f380a2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:42.984 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.980+0000 7f4f3de6a700 1 -- 172.21.15.110:0/2255440003 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f38060e00 msgr2=0x7f4f380a2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:42.984 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.980+0000 7f4f3de6a700 1 --2- 172.21.15.110:0/2255440003 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f38060e00 0x7f4f380a2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:42.984 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.980+0000 7f4f3de6a700 1 -- 172.21.15.110:0/2255440003 >> v1:172.21.15.174:6789/0 conn(0x7f4f38068440 legacy=0x7f4f38149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:42.984 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.980+0000 7f4f3de6a700 1 -- 172.21.15.110:0/2255440003 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f38068ca0 con 0x7f4f3814da00 2021-03-25T14:16:42.985 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.980+0000 7f4f3de6a700 1 --2- 172.21.15.110:0/2255440003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f3814da00 0x7f4f381434b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f4f30009d90 tx=0x7f4f300092d0).ready entity=mon.0 client_cookie=9529e5280e621a1c server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:42.985 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.980+0000 7f4f2bfff700 1 -- 172.21.15.110:0/2255440003 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3000bc80 con 0x7f4f3814da00 2021-03-25T14:16:42.985 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.980+0000 7f4f2bfff700 1 -- 172.21.15.110:0/2255440003 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3000bde0 con 0x7f4f3814da00 2021-03-25T14:16:42.985 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.980+0000 7f4f2bfff700 1 -- 172.21.15.110:0/2255440003 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f30011610 con 0x7f4f3814da00 2021-03-25T14:16:42.985 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.981+0000 7f4f3f8cd700 1 -- 172.21.15.110:0/2255440003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f3814da00 msgr2=0x7f4f381434b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:42.985 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.981+0000 7f4f3f8cd700 1 --2- 172.21.15.110:0/2255440003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f3814da00 0x7f4f381434b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f4f30009d90 tx=0x7f4f300092d0).stop 2021-03-25T14:16:42.985 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.981+0000 7f4f3f8cd700 1 -- 172.21.15.110:0/2255440003 shutdown_connections 2021-03-25T14:16:42.985 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.981+0000 7f4f3f8cd700 1 --2- 172.21.15.110:0/2255440003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f3814da00 0x7f4f381434b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:42.985 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.981+0000 7f4f3f8cd700 1 --2- 172.21.15.110:0/2255440003 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f38060e00 0x7f4f380a2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:42.985 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.981+0000 7f4f3f8cd700 1 -- 172.21.15.110:0/2255440003 >> 172.21.15.110:0/2255440003 conn(0x7f4f38061d50 msgr2=0x7f4f38062160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:42.985 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.981+0000 7f4f3f8cd700 1 -- 172.21.15.110:0/2255440003 shutdown_connections 2021-03-25T14:16:42.985 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.981+0000 7f4f3f8cd700 1 -- 172.21.15.110:0/2255440003 wait complete. 2021-03-25T14:16:42.985 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.982+0000 7f4f3f8cd700 1 Processor -- start 2021-03-25T14:16:42.986 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.982+0000 7f4f3f8cd700 1 -- start start 2021-03-25T14:16:42.988 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.983+0000 7f4f3f8cd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f38060e00 0x7f4f38144f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:42.988 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.983+0000 7f4f3f8cd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f38068440 0x7f4f380bd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:42.988 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.983+0000 7f4f3f8cd700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4f3814da00 0x7f4f380bd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:42.988 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.983+0000 7f4f3f8cd700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f38158ba0 con 0x7f4f38060e00 2021-03-25T14:16:42.988 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.983+0000 7f4f3f8cd700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f381449a0 con 0x7f4f3814da00 2021-03-25T14:16:42.989 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.983+0000 7f4f3f8cd700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f38158dc0 con 0x7f4f38068440 2021-03-25T14:16:42.989 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.983+0000 7f4f3d669700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f38060e00 0x7f4f38144f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:42.989 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.983+0000 7f4f3d669700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f38060e00 0x7f4f38144f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48428/0 (socket says 172.21.15.110:48428) 2021-03-25T14:16:42.989 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.983+0000 7f4f3d669700 1 -- 172.21.15.110:0/2037753567 learned_addr learned my addr 172.21.15.110:0/2037753567 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:42.989 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.983+0000 7f4f3d669700 1 -- 172.21.15.110:0/2037753567 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f38068440 msgr2=0x7f4f380bd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:42.989 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.983+0000 7f4f3d669700 1 --2- 172.21.15.110:0/2037753567 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f38068440 0x7f4f380bd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:16:42.989 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.983+0000 7f4f3d669700 1 -- 172.21.15.110:0/2037753567 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4f3814da00 msgr2=0x7f4f380bd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:42.989 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.983+0000 7f4f3d669700 1 --2- 172.21.15.110:0/2037753567 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4f3814da00 0x7f4f380bd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:16:42.989 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.983+0000 7f4f3d669700 1 -- 172.21.15.110:0/2037753567 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f38159060 con 0x7f4f38060e00 2021-03-25T14:16:42.989 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.983+0000 7f4f3d669700 1 --2- 172.21.15.110:0/2037753567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f38060e00 0x7f4f38144f20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f4f3400bfd0 tx=0x7f4f34008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:42.989 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.983+0000 7f4f297fa700 1 -- 172.21.15.110:0/2037753567 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3400de10 con 0x7f4f38060e00 2021-03-25T14:16:42.989 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.983+0000 7f4f297fa700 1 -- 172.21.15.110:0/2037753567 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f340097c0 con 0x7f4f38060e00 2021-03-25T14:16:42.989 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.983+0000 7f4f297fa700 1 -- 172.21.15.110:0/2037753567 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f34009b40 con 0x7f4f38060e00 2021-03-25T14:16:42.990 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.983+0000 7f4f3f8cd700 1 -- 172.21.15.110:0/2037753567 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f38159300 con 0x7f4f38060e00 2021-03-25T14:16:42.990 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.983+0000 7f4f3f8cd700 1 -- 172.21.15.110:0/2037753567 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f38159a40 con 0x7f4f38060e00 2021-03-25T14:16:42.990 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.984+0000 7f4f3f8cd700 1 -- 172.21.15.110:0/2037753567 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f38159760 con 0x7f4f38060e00 2021-03-25T14:16:42.990 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.984+0000 7f4f297fa700 1 -- 172.21.15.110:0/2037753567 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f4f34013480 con 0x7f4f38060e00 2021-03-25T14:16:42.990 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.985+0000 7f4f297fa700 1 --2- 172.21.15.110:0/2037753567 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4f1805a0b0 0x7f4f1805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:42.990 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.985+0000 7f4f297fa700 1 -- 172.21.15.110:0/2037753567 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f4f34074310 con 0x7f4f38060e00 2021-03-25T14:16:42.990 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.985+0000 7f4f3ce68700 1 --2- 172.21.15.110:0/2037753567 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4f1805a0b0 0x7f4f1805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:42.990 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.985+0000 7f4f3ce68700 1 --2- 172.21.15.110:0/2037753567 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4f1805a0b0 0x7f4f1805c570 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f4f380647c0 tx=0x7f4f2c007800).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:42.991 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:42.988+0000 7f4f297fa700 1 -- 172.21.15.110:0/2037753567 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f4f34047960 con 0x7f4f38060e00 2021-03-25T14:16:43.143 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.141+0000 7f4f3f8cd700 1 -- 172.21.15.110:0/2037753567 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4f38064f20 con 0x7f4f38060e00 2021-03-25T14:16:43.204 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.141+0000 7f4f297fa700 1 -- 172.21.15.110:0/2037753567 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4f3404af80 con 0x7f4f38060e00 2021-03-25T14:16:43.205 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:16:43.206 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.143+0000 7f4f3f8cd700 1 -- 172.21.15.110:0/2037753567 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4f1805a0b0 msgr2=0x7f4f1805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:43.206 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.143+0000 7f4f3f8cd700 1 --2- 172.21.15.110:0/2037753567 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4f1805a0b0 0x7f4f1805c570 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f4f380647c0 tx=0x7f4f2c007800).stop 2021-03-25T14:16:43.206 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.143+0000 7f4f3f8cd700 1 -- 172.21.15.110:0/2037753567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f38060e00 msgr2=0x7f4f38144f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:43.207 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.143+0000 7f4f3f8cd700 1 --2- 172.21.15.110:0/2037753567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f38060e00 0x7f4f38144f20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f4f3400bfd0 tx=0x7f4f34008040).stop 2021-03-25T14:16:43.207 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.143+0000 7f4f3f8cd700 1 -- 172.21.15.110:0/2037753567 shutdown_connections 2021-03-25T14:16:43.207 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.143+0000 7f4f3f8cd700 1 --2- 172.21.15.110:0/2037753567 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4f1805a0b0 0x7f4f1805c570 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:43.207 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.143+0000 7f4f3f8cd700 1 --2- 172.21.15.110:0/2037753567 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4f3814da00 0x7f4f380bd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:16:43.207 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.143+0000 7f4f3f8cd700 1 --2- 172.21.15.110:0/2037753567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f38060e00 0x7f4f38144f20 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:43.207 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.143+0000 7f4f3f8cd700 1 --2- 172.21.15.110:0/2037753567 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f38068440 0x7f4f380bd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:16:43.207 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.143+0000 7f4f3f8cd700 1 -- 172.21.15.110:0/2037753567 >> 172.21.15.110:0/2037753567 conn(0x7f4f38061d50 msgr2=0x7f4f3814b080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:43.207 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.143+0000 7f4f3f8cd700 1 -- 172.21.15.110:0/2037753567 shutdown_connections 2021-03-25T14:16:43.207 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.143+0000 7f4f3f8cd700 1 -- 172.21.15.110:0/2037753567 wait complete. 2021-03-25T14:16:43.207 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-03-25T14:16:43.320 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.318+0000 7f035ff4c700 1 Processor -- start 2021-03-25T14:16:43.320 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.318+0000 7f035ff4c700 1 -- start start 2021-03-25T14:16:43.327 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.319+0000 7f035ff4c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f035814d470 0x7f035814d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:43.327 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.319+0000 7f035ff4c700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03580691b0 con 0x7f035814cc90 2021-03-25T14:16:43.327 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.319+0000 7f035ff4c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03580bc2b0 con 0x7f03580685d0 2021-03-25T14:16:43.327 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.319+0000 7f035ff4c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0358149dd0 con 0x7f035814d470 2021-03-25T14:16:43.327 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.319+0000 7f035d4e7700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f035814cc90 0x7f03581493c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41376/0 (socket says 172.21.15.110:41376) 2021-03-25T14:16:43.327 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.319+0000 7f035d4e7700 1 -- 172.21.15.110:0/3201805633 learned_addr learned my addr 172.21.15.110:0/3201805633 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:43.327 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.319+0000 7f035dce8700 1 --2- 172.21.15.110:0/3201805633 >> v2:172.21.15.174:3300/0 conn(0x7f035814d470 0x7f035814d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:43.327 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.319+0000 7f035cce6700 1 -- 172.21.15.110:0/3201805633 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1868718184 0 0) 0x7f03580691b0 con 0x7f035814cc90 2021-03-25T14:16:43.327 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.319+0000 7f035cce6700 1 -- 172.21.15.110:0/3201805633 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0340003270 con 0x7f035814cc90 2021-03-25T14:16:43.328 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.319+0000 7f035cce6700 1 -- 172.21.15.110:0/3201805633 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1593634812 0 0) 0x7f03580bc2b0 con 0x7f03580685d0 2021-03-25T14:16:43.328 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.319+0000 7f035cce6700 1 -- 172.21.15.110:0/3201805633 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03580691b0 con 0x7f03580685d0 2021-03-25T14:16:43.328 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.319+0000 7f035cce6700 1 -- 172.21.15.110:0/3201805633 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1426786069 0 0) 0x7f0340003270 con 0x7f035814cc90 2021-03-25T14:16:43.328 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.319+0000 7f035cce6700 1 -- 172.21.15.110:0/3201805633 >> v2:172.21.15.174:3300/0 conn(0x7f035814d470 msgr2=0x7f035814d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:43.328 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.319+0000 7f035cce6700 1 --2- 172.21.15.110:0/3201805633 >> v2:172.21.15.174:3300/0 conn(0x7f035814d470 0x7f035814d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:43.328 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.319+0000 7f035cce6700 1 -- 172.21.15.110:0/3201805633 >> v1:172.21.15.174:6789/0 conn(0x7f03580685d0 legacy=0x7f03580bc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:43.328 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.319+0000 7f035cce6700 1 -- 172.21.15.110:0/3201805633 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f035814a070 con 0x7f035814cc90 2021-03-25T14:16:43.328 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.319+0000 7f035cce6700 1 -- 172.21.15.110:0/3201805633 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f0354001520 con 0x7f035814cc90 2021-03-25T14:16:43.328 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.319+0000 7f035cce6700 1 -- 172.21.15.110:0/3201805633 >> v1:172.21.15.110:6789/0 conn(0x7f035814cc90 legacy=0x7f03581493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:43.328 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.319+0000 7f035cce6700 1 --2- 172.21.15.110:0/3201805633 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03400038f0 0x7f0340003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:43.328 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.319+0000 7f035cce6700 1 --2- 172.21.15.110:0/3201805633 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0340004510 0x7f0340004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:43.328 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.319+0000 7f035cce6700 1 --2- 172.21.15.110:0/3201805633 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0340004e80 0x7f034000b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:43.329 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.319+0000 7f035cce6700 1 -- 172.21.15.110:0/3201805633 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0358149dd0 con 0x7f0340004e80 2021-03-25T14:16:43.329 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.319+0000 7f035cce6700 1 -- 172.21.15.110:0/3201805633 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03400053e0 con 0x7f03400038f0 2021-03-25T14:16:43.329 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.319+0000 7f035cce6700 1 -- 172.21.15.110:0/3201805633 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f034000bcd0 con 0x7f0340004510 2021-03-25T14:16:43.329 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.319+0000 7f035e4e9700 1 --2- 172.21.15.110:0/3201805633 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0340004e80 0x7f034000b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:43.329 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.320+0000 7f035dce8700 1 --2- 172.21.15.110:0/3201805633 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03400038f0 0x7f0340003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:43.329 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.320+0000 7f035d4e7700 1 --2- 172.21.15.110:0/3201805633 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0340004510 0x7f0340004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:43.329 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.320+0000 7f035e4e9700 1 -- 172.21.15.110:0/3201805633 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0340004510 msgr2=0x7f0340004990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:43.329 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.320+0000 7f035e4e9700 1 --2- 172.21.15.110:0/3201805633 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0340004510 0x7f0340004990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:43.329 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.320+0000 7f035e4e9700 1 -- 172.21.15.110:0/3201805633 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03400038f0 msgr2=0x7f0340003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:43.329 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.320+0000 7f035e4e9700 1 --2- 172.21.15.110:0/3201805633 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03400038f0 0x7f0340003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:43.329 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.320+0000 7f035e4e9700 1 -- 172.21.15.110:0/3201805633 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0340003270 con 0x7f0340004e80 2021-03-25T14:16:43.329 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.320+0000 7f035e4e9700 1 -- 172.21.15.110:0/3201805633 reap_dead start 2021-03-25T14:16:43.330 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.320+0000 7f035e4e9700 1 --2- 172.21.15.110:0/3201805633 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0340004e80 0x7f034000b760 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f0350002040 tx=0x7f0350007f40).ready entity=mon.0 client_cookie=422fd4af9baa93b8 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:43.330 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.320+0000 7f035cce6700 1 -- 172.21.15.110:0/3201805633 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035000cb40 con 0x7f0340004e80 2021-03-25T14:16:43.330 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.320+0000 7f035cce6700 1 -- 172.21.15.110:0/3201805633 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f035000cca0 con 0x7f0340004e80 2021-03-25T14:16:43.330 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.320+0000 7f035cce6700 1 -- 172.21.15.110:0/3201805633 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0350006ad0 con 0x7f0340004e80 2021-03-25T14:16:43.330 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.320+0000 7f035ff4c700 1 -- 172.21.15.110:0/3201805633 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0340004e80 msgr2=0x7f034000b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:43.330 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.320+0000 7f035ff4c700 1 --2- 172.21.15.110:0/3201805633 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0340004e80 0x7f034000b760 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f0350002040 tx=0x7f0350007f40).stop 2021-03-25T14:16:43.330 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.321+0000 7f035ff4c700 1 -- 172.21.15.110:0/3201805633 shutdown_connections 2021-03-25T14:16:43.330 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.321+0000 7f035ff4c700 1 --2- 172.21.15.110:0/3201805633 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0340004e80 0x7f034000b760 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:43.330 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.321+0000 7f035ff4c700 1 -- 172.21.15.110:0/3201805633 >> 172.21.15.110:0/3201805633 conn(0x7f0358060c40 msgr2=0x7f0358061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:43.330 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.321+0000 7f035ff4c700 1 -- 172.21.15.110:0/3201805633 shutdown_connections 2021-03-25T14:16:43.330 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.321+0000 7f035ff4c700 1 -- 172.21.15.110:0/3201805633 wait complete. 2021-03-25T14:16:43.331 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.322+0000 7f035ff4c700 1 Processor -- start 2021-03-25T14:16:43.331 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.322+0000 7f035ff4c700 1 -- start start 2021-03-25T14:16:43.331 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.322+0000 7f035ff4c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0340004e80 0x7f0358147b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:43.331 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.322+0000 7f035ff4c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f035815bff0 0x7f03580a44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:43.331 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.322+0000 7f035ff4c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03580b9aa0 0x7f03580a49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:43.331 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.322+0000 7f035ff4c700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03580a3c20 con 0x7f035815bff0 2021-03-25T14:16:43.331 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.322+0000 7f035ff4c700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03580beaa0 con 0x7f0340004e80 2021-03-25T14:16:43.331 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.322+0000 7f035ff4c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03580b9500 con 0x7f03580b9aa0 2021-03-25T14:16:43.331 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.322+0000 7f035d4e7700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f035815bff0 0x7f03580a44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:43.331 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.322+0000 7f035d4e7700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f035815bff0 0x7f03580a44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48450/0 (socket says 172.21.15.110:48450) 2021-03-25T14:16:43.331 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.322+0000 7f035d4e7700 1 -- 172.21.15.110:0/3044330091 learned_addr learned my addr 172.21.15.110:0/3044330091 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:43.331 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.322+0000 7f035dce8700 1 --2- 172.21.15.110:0/3044330091 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0340004e80 0x7f0358147b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:43.332 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.322+0000 7f035e4e9700 1 --2- 172.21.15.110:0/3044330091 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03580b9aa0 0x7f03580a49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:43.332 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.323+0000 7f035d4e7700 1 -- 172.21.15.110:0/3044330091 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03580b9aa0 msgr2=0x7f03580a49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:43.332 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.323+0000 7f035d4e7700 1 --2- 172.21.15.110:0/3044330091 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03580b9aa0 0x7f03580a49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:43.332 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.323+0000 7f035d4e7700 1 -- 172.21.15.110:0/3044330091 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0340004e80 msgr2=0x7f0358147b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:43.332 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.323+0000 7f035d4e7700 1 --2- 172.21.15.110:0/3044330091 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0340004e80 0x7f0358147b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:43.332 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.323+0000 7f035d4e7700 1 -- 172.21.15.110:0/3044330091 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03580a3980 con 0x7f035815bff0 2021-03-25T14:16:43.332 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.323+0000 7f035dce8700 1 --2- 172.21.15.110:0/3044330091 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0340004e80 0x7f0358147b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:43.332 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.323+0000 7f035d4e7700 1 --2- 172.21.15.110:0/3044330091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f035815bff0 0x7f03580a44d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f03540014b0 tx=0x7f035814a200).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:43.332 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.323+0000 7f0345ffb700 1 -- 172.21.15.110:0/3044330091 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0354000c30 con 0x7f035815bff0 2021-03-25T14:16:43.332 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.323+0000 7f0345ffb700 1 -- 172.21.15.110:0/3044330091 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f035400f8a0 con 0x7f035815bff0 2021-03-25T14:16:43.332 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.323+0000 7f035ff4c700 1 -- 172.21.15.110:0/3044330091 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03580a4030 con 0x7f035815bff0 2021-03-25T14:16:43.332 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.323+0000 7f0345ffb700 1 -- 172.21.15.110:0/3044330091 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035400fc20 con 0x7f035815bff0 2021-03-25T14:16:43.333 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.323+0000 7f035ff4c700 1 -- 172.21.15.110:0/3044330091 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03580b8330 con 0x7f035815bff0 2021-03-25T14:16:43.333 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.324+0000 7f035ff4c700 1 -- 172.21.15.110:0/3044330091 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03580a3e90 con 0x7f035815bff0 2021-03-25T14:16:43.333 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.324+0000 7f0345ffb700 1 -- 172.21.15.110:0/3044330091 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f035401b030 con 0x7f035815bff0 2021-03-25T14:16:43.333 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.324+0000 7f0345ffb700 1 --2- 172.21.15.110:0/3044330091 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f033805a0e0 0x7f033805c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:43.333 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.324+0000 7f0345ffb700 1 -- 172.21.15.110:0/3044330091 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f0354073590 con 0x7f035815bff0 2021-03-25T14:16:43.333 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.324+0000 7f035dce8700 1 --2- 172.21.15.110:0/3044330091 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f033805a0e0 0x7f033805c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:43.333 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.325+0000 7f035dce8700 1 --2- 172.21.15.110:0/3044330091 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f033805a0e0 0x7f033805c5a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f0348006d30 tx=0x7f0348008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:43.333 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.328+0000 7f0345ffb700 1 -- 172.21.15.110:0/3044330091 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f03580a3e90 con 0x7f035815bff0 2021-03-25T14:16:43.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.478+0000 7f035ff4c700 1 -- 172.21.15.110:0/3044330091 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f03580a3e90 con 0x7f035815bff0 2021-03-25T14:16:43.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.478+0000 7f0345ffb700 1 -- 172.21.15.110:0/3044330091 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7f03580a3e90 con 0x7f035815bff0 2021-03-25T14:16:43.480 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:16:43.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.479+0000 7f035ff4c700 1 -- 172.21.15.110:0/3044330091 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f033805a0e0 msgr2=0x7f033805c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:43.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.479+0000 7f035ff4c700 1 --2- 172.21.15.110:0/3044330091 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f033805a0e0 0x7f033805c5a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f0348006d30 tx=0x7f0348008040).stop 2021-03-25T14:16:43.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.479+0000 7f035ff4c700 1 -- 172.21.15.110:0/3044330091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f035815bff0 msgr2=0x7f03580a44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:43.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.479+0000 7f035ff4c700 1 --2- 172.21.15.110:0/3044330091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f035815bff0 0x7f03580a44d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f03540014b0 tx=0x7f035814a200).stop 2021-03-25T14:16:43.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.480+0000 7f035ff4c700 1 -- 172.21.15.110:0/3044330091 shutdown_connections 2021-03-25T14:16:43.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.480+0000 7f035ff4c700 1 --2- 172.21.15.110:0/3044330091 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f033805a0e0 0x7f033805c5a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:43.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.480+0000 7f035ff4c700 1 --2- 172.21.15.110:0/3044330091 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0340004e80 0x7f0358147b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:43.483 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.480+0000 7f035ff4c700 1 --2- 172.21.15.110:0/3044330091 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03580b9aa0 0x7f03580a49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:43.483 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.480+0000 7f035ff4c700 1 --2- 172.21.15.110:0/3044330091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f035815bff0 0x7f03580a44d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:43.483 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.480+0000 7f035ff4c700 1 -- 172.21.15.110:0/3044330091 >> 172.21.15.110:0/3044330091 conn(0x7f0358060c40 msgr2=0x7f03581488a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:43.483 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.480+0000 7f035ff4c700 1 -- 172.21.15.110:0/3044330091 shutdown_connections 2021-03-25T14:16:43.483 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.480+0000 7f035ff4c700 1 -- 172.21.15.110:0/3044330091 wait complete. 2021-03-25T14:16:43.493 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-03-25T14:16:43.605 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.603+0000 7f430e99e700 1 Processor -- start 2021-03-25T14:16:43.605 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.603+0000 7f430e99e700 1 -- start start 2021-03-25T14:16:43.613 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.604+0000 7f430e99e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f43080bdda0 0x7f43080b7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:43.613 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.604+0000 7f430e99e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f430814cbe0 0x7f4308149d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:43.613 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.604+0000 7f430e99e700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43080b72b0 con 0x7f43080be810 2021-03-25T14:16:43.613 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.604+0000 7f430e99e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43080631f0 con 0x7f43080bdda0 2021-03-25T14:16:43.614 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.604+0000 7f430e99e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43080b74e0 con 0x7f430814cbe0 2021-03-25T14:16:43.614 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.604+0000 7f430e19d700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f43080be810 0x7f4308063ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41394/0 (socket says 172.21.15.110:41394) 2021-03-25T14:16:43.614 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.604+0000 7f430e19d700 1 -- 172.21.15.110:0/2444538003 learned_addr learned my addr 172.21.15.110:0/2444538003 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:43.614 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.604+0000 7f430d19b700 1 --2- 172.21.15.110:0/2444538003 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f430814cbe0 0x7f4308149d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:43.614 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.604+0000 7f430d99c700 1 --2- 172.21.15.110:0/2444538003 >> v2:172.21.15.174:3300/0 conn(0x7f43080bdda0 0x7f43080b7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:43.614 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.605+0000 7f430c99a700 1 -- 172.21.15.110:0/2444538003 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 889680641 0 0) 0x7f43080b72b0 con 0x7f43080be810 2021-03-25T14:16:43.614 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.605+0000 7f430c99a700 1 -- 172.21.15.110:0/2444538003 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42f0003270 con 0x7f43080be810 2021-03-25T14:16:43.614 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.605+0000 7f430c99a700 1 -- 172.21.15.110:0/2444538003 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1348442820 0 0) 0x7f42f0003270 con 0x7f43080be810 2021-03-25T14:16:43.614 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.605+0000 7f430c99a700 1 -- 172.21.15.110:0/2444538003 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f430814cbe0 msgr2=0x7f4308149d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:43.614 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.605+0000 7f430c99a700 1 --2- 172.21.15.110:0/2444538003 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f430814cbe0 0x7f4308149d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:43.614 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.605+0000 7f430c99a700 1 -- 172.21.15.110:0/2444538003 >> v2:172.21.15.174:3300/0 conn(0x7f43080bdda0 msgr2=0x7f43080b7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:43.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.605+0000 7f430c99a700 1 --2- 172.21.15.110:0/2444538003 >> v2:172.21.15.174:3300/0 conn(0x7f43080bdda0 0x7f43080b7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:43.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.605+0000 7f430c99a700 1 -- 172.21.15.110:0/2444538003 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43080b7780 con 0x7f43080be810 2021-03-25T14:16:43.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.605+0000 7f430c99a700 1 -- 172.21.15.110:0/2444538003 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f43000018a0 con 0x7f43080be810 2021-03-25T14:16:43.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.605+0000 7f430c99a700 1 -- 172.21.15.110:0/2444538003 >> v1:172.21.15.110:6789/0 conn(0x7f43080be810 legacy=0x7f4308063ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:43.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.605+0000 7f430c99a700 1 --2- 172.21.15.110:0/2444538003 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f430814cbe0 0x7f42f0003760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:43.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.605+0000 7f430c99a700 1 --2- 172.21.15.110:0/2444538003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42f0003c70 0x7f42f0004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:43.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.605+0000 7f430c99a700 1 --2- 172.21.15.110:0/2444538003 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f42f0004a00 0x7f42f0004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:43.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.605+0000 7f430c99a700 1 -- 172.21.15.110:0/2444538003 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43080631f0 con 0x7f42f0003c70 2021-03-25T14:16:43.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.605+0000 7f430c99a700 1 -- 172.21.15.110:0/2444538003 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43080b74e0 con 0x7f42f0004a00 2021-03-25T14:16:43.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.605+0000 7f430c99a700 1 -- 172.21.15.110:0/2444538003 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f0004230 con 0x7f430814cbe0 2021-03-25T14:16:43.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.605+0000 7f430d19b700 1 --2- 172.21.15.110:0/2444538003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42f0003c70 0x7f42f0004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:43.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.605+0000 7f430d99c700 1 --2- 172.21.15.110:0/2444538003 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f430814cbe0 0x7f42f0003760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:43.616 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.605+0000 7f430e19d700 1 --2- 172.21.15.110:0/2444538003 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f42f0004a00 0x7f42f0004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:43.616 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.605+0000 7f430d19b700 1 -- 172.21.15.110:0/2444538003 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f430814cbe0 msgr2=0x7f42f0003760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:43.616 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.605+0000 7f430d19b700 1 --2- 172.21.15.110:0/2444538003 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f430814cbe0 0x7f42f0003760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:43.616 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.605+0000 7f430d19b700 1 -- 172.21.15.110:0/2444538003 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f42f0004a00 msgr2=0x7f42f0004e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:43.616 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.605+0000 7f430d19b700 1 --2- 172.21.15.110:0/2444538003 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f42f0004a00 0x7f42f0004e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:43.616 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.605+0000 7f430d19b700 1 -- 172.21.15.110:0/2444538003 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f0003270 con 0x7f42f0003c70 2021-03-25T14:16:43.616 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.605+0000 7f430d19b700 1 --2- 172.21.15.110:0/2444538003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42f0003c70 0x7f42f0004510 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f42f800bc00 tx=0x7f42f8006e20).ready entity=mon.0 client_cookie=8701480b2e3eca34 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:43.616 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.605+0000 7f430c99a700 1 -- 172.21.15.110:0/2444538003 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f800b310 con 0x7f42f0003c70 2021-03-25T14:16:43.616 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.606+0000 7f430c99a700 1 -- 172.21.15.110:0/2444538003 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f800ea50 con 0x7f42f0003c70 2021-03-25T14:16:43.616 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.606+0000 7f430c99a700 1 -- 172.21.15.110:0/2444538003 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f800edd0 con 0x7f42f0003c70 2021-03-25T14:16:43.616 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.606+0000 7f430e99e700 1 -- 172.21.15.110:0/2444538003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42f0003c70 msgr2=0x7f42f0004510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:43.616 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.606+0000 7f430e99e700 1 --2- 172.21.15.110:0/2444538003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42f0003c70 0x7f42f0004510 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f42f800bc00 tx=0x7f42f8006e20).stop 2021-03-25T14:16:43.617 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.606+0000 7f430e19d700 1 -- 172.21.15.110:0/2444538003 reap_dead start 2021-03-25T14:16:43.617 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.606+0000 7f430e99e700 1 -- 172.21.15.110:0/2444538003 shutdown_connections 2021-03-25T14:16:43.617 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.606+0000 7f430e99e700 1 -- 172.21.15.110:0/2444538003 >> 172.21.15.110:0/2444538003 conn(0x7f4308065830 msgr2=0x7f43080685f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:43.617 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.606+0000 7f430e99e700 1 -- 172.21.15.110:0/2444538003 shutdown_connections 2021-03-25T14:16:43.617 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.606+0000 7f430e99e700 1 -- 172.21.15.110:0/2444538003 wait complete. 2021-03-25T14:16:43.617 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.607+0000 7f430e99e700 1 Processor -- start 2021-03-25T14:16:43.617 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.607+0000 7f430e99e700 1 -- start start 2021-03-25T14:16:43.617 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.608+0000 7f430e99e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42f0003c70 0x7f4308149e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:43.617 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.608+0000 7f430e99e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4308148100 0x7f43080a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:43.617 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.608+0000 7f430e99e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4308148580 0x7f43080a2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:43.617 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.608+0000 7f430e99e700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43081180a0 con 0x7f42f0003c70 2021-03-25T14:16:43.617 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.608+0000 7f430e99e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43081589e0 con 0x7f4308148580 2021-03-25T14:16:43.618 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.608+0000 7f430e99e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4308158c80 con 0x7f4308148100 2021-03-25T14:16:43.618 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.608+0000 7f430d99c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42f0003c70 0x7f4308149e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:43.618 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.608+0000 7f430d99c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42f0003c70 0x7f4308149e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48468/0 (socket says 172.21.15.110:48468) 2021-03-25T14:16:43.618 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.608+0000 7f430d99c700 1 -- 172.21.15.110:0/183783469 learned_addr learned my addr 172.21.15.110:0/183783469 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:43.618 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.608+0000 7f430e19d700 1 --2- 172.21.15.110:0/183783469 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4308148580 0x7f43080a2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:43.618 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.608+0000 7f430d19b700 1 --2- 172.21.15.110:0/183783469 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4308148100 0x7f43080a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:43.618 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.608+0000 7f430d99c700 1 -- 172.21.15.110:0/183783469 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4308148100 msgr2=0x7f43080a1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:43.618 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.608+0000 7f430d99c700 1 --2- 172.21.15.110:0/183783469 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4308148100 0x7f43080a1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:43.618 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.608+0000 7f430d99c700 1 -- 172.21.15.110:0/183783469 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4308148580 msgr2=0x7f43080a2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:43.618 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.608+0000 7f430d99c700 1 --2- 172.21.15.110:0/183783469 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4308148580 0x7f43080a2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:43.618 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.608+0000 7f430d99c700 1 -- 172.21.15.110:0/183783469 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4308158f20 con 0x7f42f0003c70 2021-03-25T14:16:43.618 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.608+0000 7f430d99c700 1 --2- 172.21.15.110:0/183783469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42f0003c70 0x7f4308149e00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f4304010c50 tx=0x7f4304008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:43.619 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.608+0000 7f42f5ffb700 1 -- 172.21.15.110:0/183783469 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430400e8d0 con 0x7f42f0003c70 2021-03-25T14:16:43.619 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.608+0000 7f42f5ffb700 1 -- 172.21.15.110:0/183783469 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f430400ea30 con 0x7f42f0003c70 2021-03-25T14:16:43.619 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.608+0000 7f430e99e700 1 -- 172.21.15.110:0/183783469 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43081591c0 con 0x7f42f0003c70 2021-03-25T14:16:43.619 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.609+0000 7f42f5ffb700 1 -- 172.21.15.110:0/183783469 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430400edf0 con 0x7f42f0003c70 2021-03-25T14:16:43.619 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.609+0000 7f430e99e700 1 -- 172.21.15.110:0/183783469 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4308159700 con 0x7f42f0003c70 2021-03-25T14:16:43.619 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.610+0000 7f430e99e700 1 -- 172.21.15.110:0/183783469 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43081598c0 con 0x7f42f0003c70 2021-03-25T14:16:43.619 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.610+0000 7f42f5ffb700 1 -- 172.21.15.110:0/183783469 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f4304014680 con 0x7f42f0003c70 2021-03-25T14:16:43.619 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.610+0000 7f42f5ffb700 1 --2- 172.21.15.110:0/183783469 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f42e805a0e0 0x7f42e805c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:43.619 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.610+0000 7f42f5ffb700 1 -- 172.21.15.110:0/183783469 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f43040743a0 con 0x7f42f0003c70 2021-03-25T14:16:43.619 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.610+0000 7f430d19b700 1 --2- 172.21.15.110:0/183783469 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f42e805a0e0 0x7f42e805c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:43.619 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.611+0000 7f430d19b700 1 --2- 172.21.15.110:0/183783469 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f42e805a0e0 0x7f42e805c5a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f42f8007fd0 tx=0x7f42f8019000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:43.620 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.614+0000 7f42f5ffb700 1 -- 172.21.15.110:0/183783469 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f4304047a50 con 0x7f42f0003c70 2021-03-25T14:16:43.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.763+0000 7f430e99e700 1 -- 172.21.15.110:0/183783469 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f430805d070 con 0x7f42f0003c70 2021-03-25T14:16:43.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.763+0000 7f42f5ffb700 1 -- 172.21.15.110:0/183783469 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7f430404b070 con 0x7f42f0003c70 2021-03-25T14:16:43.766 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:16:43.767 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.765+0000 7f430e99e700 1 -- 172.21.15.110:0/183783469 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f42e805a0e0 msgr2=0x7f42e805c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:43.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.765+0000 7f430e99e700 1 --2- 172.21.15.110:0/183783469 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f42e805a0e0 0x7f42e805c5a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f42f8007fd0 tx=0x7f42f8019000).stop 2021-03-25T14:16:43.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.765+0000 7f430e99e700 1 -- 172.21.15.110:0/183783469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42f0003c70 msgr2=0x7f4308149e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:43.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.765+0000 7f430e99e700 1 --2- 172.21.15.110:0/183783469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42f0003c70 0x7f4308149e00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f4304010c50 tx=0x7f4304008040).stop 2021-03-25T14:16:43.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.765+0000 7f430e99e700 1 -- 172.21.15.110:0/183783469 shutdown_connections 2021-03-25T14:16:43.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.765+0000 7f430e99e700 1 --2- 172.21.15.110:0/183783469 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f42e805a0e0 0x7f42e805c5a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:43.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.765+0000 7f430e99e700 1 --2- 172.21.15.110:0/183783469 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4308148580 0x7f43080a2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:43.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.765+0000 7f430e99e700 1 --2- 172.21.15.110:0/183783469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42f0003c70 0x7f4308149e00 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:43.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.765+0000 7f430e99e700 1 --2- 172.21.15.110:0/183783469 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4308148100 0x7f43080a1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:43.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.765+0000 7f430e99e700 1 -- 172.21.15.110:0/183783469 >> 172.21.15.110:0/183783469 conn(0x7f4308065830 msgr2=0x7f43080a3760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:43.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.765+0000 7f430e99e700 1 -- 172.21.15.110:0/183783469 shutdown_connections 2021-03-25T14:16:43.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.765+0000 7f430e99e700 1 -- 172.21.15.110:0/183783469 wait complete. 2021-03-25T14:16:43.779 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2021-03-25T14:16:43.891 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.889+0000 7f914f344700 1 Processor -- start 2021-03-25T14:16:43.926 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.889+0000 7f914f344700 1 -- start start 2021-03-25T14:16:43.932 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.890+0000 7f914f344700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f914814d470 0x7f914814d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:43.932 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.890+0000 7f914f344700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f914814cc90 0x7f91481493c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:43.932 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.890+0000 7f914f344700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91480691b0 con 0x7f91481498b0 2021-03-25T14:16:43.932 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.890+0000 7f914f344700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91480bc2b0 con 0x7f914814cc90 2021-03-25T14:16:43.932 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.890+0000 7f914f344700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9148149dd0 con 0x7f914814d470 2021-03-25T14:16:43.932 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.890+0000 7f914c8df700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f914814cc90 0x7f91481493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:43.932 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.890+0000 7f914d8e1700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f91481498b0 0x7f91480685d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41416/0 (socket says 172.21.15.110:41416) 2021-03-25T14:16:43.932 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.890+0000 7f914d8e1700 1 -- 172.21.15.110:0/633596047 learned_addr learned my addr 172.21.15.110:0/633596047 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:43.933 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.890+0000 7f914d0e0700 1 --2- 172.21.15.110:0/633596047 >> v2:172.21.15.174:3300/0 conn(0x7f914814d470 0x7f914814d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:43.933 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.890+0000 7f914c8df700 1 -- 172.21.15.110:0/633596047 >> v2:172.21.15.174:3300/0 conn(0x7f914814d470 msgr2=0x7f914814d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:43.933 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.890+0000 7f914c8df700 1 --2- 172.21.15.110:0/633596047 >> v2:172.21.15.174:3300/0 conn(0x7f914814d470 0x7f914814d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:43.933 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.890+0000 7f914c8df700 1 -- 172.21.15.110:0/633596047 >> v1:172.21.15.110:6789/0 conn(0x7f91481498b0 legacy=0x7f91480685d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:43.933 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.890+0000 7f9137fff700 1 -- 172.21.15.110:0/633596047 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3629240148 0 0) 0x7f91480691b0 con 0x7f91481498b0 2021-03-25T14:16:43.933 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.891+0000 7f914c8df700 1 -- 172.21.15.110:0/633596047 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f914814a070 con 0x7f914814cc90 2021-03-25T14:16:43.933 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.891+0000 7f914c8df700 1 --2- 172.21.15.110:0/633596047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f914814cc90 0x7f91481493c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f9148061fa0 tx=0x7f9138006e20).ready entity=mon.0 client_cookie=83da128a34884cae server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:43.933 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.891+0000 7f9137fff700 1 -- 172.21.15.110:0/633596047 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91380097e0 con 0x7f914814cc90 2021-03-25T14:16:43.933 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.891+0000 7f9137fff700 1 -- 172.21.15.110:0/633596047 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9138009940 con 0x7f914814cc90 2021-03-25T14:16:43.933 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.891+0000 7f9137fff700 1 -- 172.21.15.110:0/633596047 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9138009cc0 con 0x7f914814cc90 2021-03-25T14:16:43.934 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.891+0000 7f914f344700 1 -- 172.21.15.110:0/633596047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f914814cc90 msgr2=0x7f91481493c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:43.934 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.891+0000 7f914f344700 1 --2- 172.21.15.110:0/633596047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f914814cc90 0x7f91481493c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f9148061fa0 tx=0x7f9138006e20).stop 2021-03-25T14:16:43.934 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.891+0000 7f914f344700 1 -- 172.21.15.110:0/633596047 shutdown_connections 2021-03-25T14:16:43.934 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.891+0000 7f914f344700 1 --2- 172.21.15.110:0/633596047 >> v2:172.21.15.174:3300/0 conn(0x7f914814d470 0x7f914814d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:43.934 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.891+0000 7f914f344700 1 --2- 172.21.15.110:0/633596047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f914814cc90 0x7f91481493c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:43.934 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.891+0000 7f914f344700 1 -- 172.21.15.110:0/633596047 >> 172.21.15.110:0/633596047 conn(0x7f9148060c40 msgr2=0x7f9148061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:43.934 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.891+0000 7f914f344700 1 -- 172.21.15.110:0/633596047 shutdown_connections 2021-03-25T14:16:43.934 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.891+0000 7f914f344700 1 -- 172.21.15.110:0/633596047 wait complete. 2021-03-25T14:16:43.934 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.892+0000 7f914f344700 1 Processor -- start 2021-03-25T14:16:43.935 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.892+0000 7f914f344700 1 -- start start 2021-03-25T14:16:43.935 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.893+0000 7f914f344700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91481498b0 0x7f91480a2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:43.935 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.893+0000 7f914f344700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f914814cc90 0x7f91481467c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:43.935 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.893+0000 7f914f344700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f914814d470 0x7f91481589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:43.935 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.893+0000 7f914f344700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91480a3730 con 0x7f91481498b0 2021-03-25T14:16:43.935 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.893+0000 7f914f344700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91480a5550 con 0x7f914814cc90 2021-03-25T14:16:43.935 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.893+0000 7f914f344700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f914815bff0 con 0x7f914814d470 2021-03-25T14:16:43.935 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.893+0000 7f914d0e0700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91481498b0 0x7f91480a2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:43.935 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.893+0000 7f914d0e0700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91481498b0 0x7f91480a2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48482/0 (socket says 172.21.15.110:48482) 2021-03-25T14:16:43.935 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.893+0000 7f914d0e0700 1 -- 172.21.15.110:0/1982719843 learned_addr learned my addr 172.21.15.110:0/1982719843 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:43.936 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.894+0000 7f914c8df700 1 --2- 172.21.15.110:0/1982719843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f914814cc90 0x7f91481467c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:43.936 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.894+0000 7f914d8e1700 1 --2- 172.21.15.110:0/1982719843 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f914814d470 0x7f91481589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:43.936 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.894+0000 7f914d0e0700 1 -- 172.21.15.110:0/1982719843 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f914814d470 msgr2=0x7f91481589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:43.936 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.894+0000 7f914d0e0700 1 --2- 172.21.15.110:0/1982719843 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f914814d470 0x7f91481589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:43.936 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.894+0000 7f914d0e0700 1 -- 172.21.15.110:0/1982719843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f914814cc90 msgr2=0x7f91481467c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:43.936 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.894+0000 7f914d0e0700 1 --2- 172.21.15.110:0/1982719843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f914814cc90 0x7f91481467c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:43.936 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.894+0000 7f914d0e0700 1 -- 172.21.15.110:0/1982719843 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f914815cea0 con 0x7f91481498b0 2021-03-25T14:16:43.936 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.894+0000 7f914d0e0700 1 --2- 172.21.15.110:0/1982719843 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91481498b0 0x7f91480a2f40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f914400c950 tx=0x7f9144008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:43.936 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.894+0000 7f91357fa700 1 -- 172.21.15.110:0/1982719843 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914400ce90 con 0x7f91481498b0 2021-03-25T14:16:43.937 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.894+0000 7f91357fa700 1 -- 172.21.15.110:0/1982719843 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9144007740 con 0x7f91481498b0 2021-03-25T14:16:43.937 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.894+0000 7f914f344700 1 -- 172.21.15.110:0/1982719843 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f914815c220 con 0x7f91481498b0 2021-03-25T14:16:43.937 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.894+0000 7f91357fa700 1 -- 172.21.15.110:0/1982719843 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9144007ae0 con 0x7f91481498b0 2021-03-25T14:16:43.937 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.894+0000 7f914f344700 1 -- 172.21.15.110:0/1982719843 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f914815ca00 con 0x7f91481498b0 2021-03-25T14:16:43.937 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.895+0000 7f912effd700 1 -- 172.21.15.110:0/1982719843 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9124004fa0 con 0x7f91481498b0 2021-03-25T14:16:43.937 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.895+0000 7f91357fa700 1 -- 172.21.15.110:0/1982719843 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f914401b460 con 0x7f91481498b0 2021-03-25T14:16:43.937 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.895+0000 7f91357fa700 1 --2- 172.21.15.110:0/1982719843 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f912805a0b0 0x7f912805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:43.937 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.896+0000 7f91357fa700 1 -- 172.21.15.110:0/1982719843 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f9144074200 con 0x7f91481498b0 2021-03-25T14:16:43.937 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.896+0000 7f914c8df700 1 --2- 172.21.15.110:0/1982719843 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f912805a0b0 0x7f912805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:43.937 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.896+0000 7f914c8df700 1 --2- 172.21.15.110:0/1982719843 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f912805a0b0 0x7f912805c570 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f9138006e60 tx=0x7f9138016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:43.937 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:43.899+0000 7f91357fa700 1 -- 172.21.15.110:0/1982719843 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f9144047850 con 0x7f91481498b0 2021-03-25T14:16:44.051 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.049+0000 7f912effd700 1 -- 172.21.15.110:0/1982719843 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f91240057d0 con 0x7f91481498b0 2021-03-25T14:16:44.052 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.050+0000 7f91357fa700 1 -- 172.21.15.110:0/1982719843 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+10 (secure 0 0 0) 0x7f9144006c60 con 0x7f91481498b0 2021-03-25T14:16:44.052 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:16:44.053 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.051+0000 7f912effd700 1 -- 172.21.15.110:0/1982719843 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f912805a0b0 msgr2=0x7f912805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:44.053 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.051+0000 7f912effd700 1 --2- 172.21.15.110:0/1982719843 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f912805a0b0 0x7f912805c570 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f9138006e60 tx=0x7f9138016000).stop 2021-03-25T14:16:44.053 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.051+0000 7f912effd700 1 -- 172.21.15.110:0/1982719843 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91481498b0 msgr2=0x7f91480a2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:44.053 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.051+0000 7f912effd700 1 --2- 172.21.15.110:0/1982719843 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91481498b0 0x7f91480a2f40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f914400c950 tx=0x7f9144008040).stop 2021-03-25T14:16:44.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.051+0000 7f912effd700 1 -- 172.21.15.110:0/1982719843 shutdown_connections 2021-03-25T14:16:44.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.051+0000 7f912effd700 1 --2- 172.21.15.110:0/1982719843 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f912805a0b0 0x7f912805c570 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:44.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.051+0000 7f912effd700 1 --2- 172.21.15.110:0/1982719843 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f914814d470 0x7f91481589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:44.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.051+0000 7f912effd700 1 --2- 172.21.15.110:0/1982719843 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91481498b0 0x7f91480a2f40 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:44.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.051+0000 7f912effd700 1 --2- 172.21.15.110:0/1982719843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f914814cc90 0x7f91481467c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:44.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.051+0000 7f912effd700 1 -- 172.21.15.110:0/1982719843 >> 172.21.15.110:0/1982719843 conn(0x7f9148060c40 msgr2=0x7f9148148320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:44.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.051+0000 7f912effd700 1 -- 172.21.15.110:0/1982719843 shutdown_connections 2021-03-25T14:16:44.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.051+0000 7f912effd700 1 -- 172.21.15.110:0/1982719843 wait complete. 2021-03-25T14:16:44.065 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:16:44.174 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.173+0000 7f8b47dda700 1 Processor -- start 2021-03-25T14:16:44.175 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.173+0000 7f8b47dda700 1 -- start start 2021-03-25T14:16:44.181 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.173+0000 7f8b47dda700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8b400b99b0 0x7f8b400ba4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:44.181 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.173+0000 7f8b47dda700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8b40148fc0 0x7f8b400a3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:44.181 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.173+0000 7f8b47dda700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b40149430 con 0x7f8b4014a050 2021-03-25T14:16:44.181 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.173+0000 7f8b47dda700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b400ba9e0 con 0x7f8b400b99b0 2021-03-25T14:16:44.181 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.173+0000 7f8b47dda700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b400babc0 con 0x7f8b40148fc0 2021-03-25T14:16:44.182 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.174+0000 7f8b45b76700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8b400b99b0 0x7f8b400ba4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:44.182 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.174+0000 7f8b45b76700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8b400b99b0 0x7f8b400ba4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48490/0 (socket says 172.21.15.110:48490) 2021-03-25T14:16:44.182 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.174+0000 7f8b45b76700 1 -- 172.21.15.110:0/2110659996 learned_addr learned my addr 172.21.15.110:0/2110659996 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:44.182 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.174+0000 7f8b46377700 1 --2- 172.21.15.110:0/2110659996 >> v2:172.21.15.174:3300/0 conn(0x7f8b40148fc0 0x7f8b400a3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:44.182 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.174+0000 7f8b45b76700 1 -- 172.21.15.110:0/2110659996 >> v2:172.21.15.174:3300/0 conn(0x7f8b40148fc0 msgr2=0x7f8b400a3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:44.182 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.174+0000 7f8b45b76700 1 --2- 172.21.15.110:0/2110659996 >> v2:172.21.15.174:3300/0 conn(0x7f8b40148fc0 0x7f8b400a3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:44.182 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.174+0000 7f8b45b76700 1 -- 172.21.15.110:0/2110659996 >> v1:172.21.15.174:6789/0 conn(0x7f8b4014a050 legacy=0x7f8b401488b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:44.182 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.174+0000 7f8b45b76700 1 -- 172.21.15.110:0/2110659996 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b400bae60 con 0x7f8b400b99b0 2021-03-25T14:16:44.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.174+0000 7f8b46377700 1 --2- 172.21.15.110:0/2110659996 >> v2:172.21.15.174:3300/0 conn(0x7f8b40148fc0 0x7f8b400a3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:44.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.174+0000 7f8b45b76700 1 --2- 172.21.15.110:0/2110659996 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b400b99b0 0x7f8b400ba4f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f8b40068650 tx=0x7f8b3c006e80).ready entity=mon.0 client_cookie=797304ae76a66ac3 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:44.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.174+0000 7f8b44b74700 1 -- 172.21.15.110:0/2110659996 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c006030 con 0x7f8b400b99b0 2021-03-25T14:16:44.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.174+0000 7f8b44b74700 1 -- 172.21.15.110:0/2110659996 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3c006190 con 0x7f8b400b99b0 2021-03-25T14:16:44.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.174+0000 7f8b44b74700 1 -- 172.21.15.110:0/2110659996 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c006510 con 0x7f8b400b99b0 2021-03-25T14:16:44.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.175+0000 7f8b47dda700 1 -- 172.21.15.110:0/2110659996 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b400b99b0 msgr2=0x7f8b400ba4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:44.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.175+0000 7f8b47dda700 1 --2- 172.21.15.110:0/2110659996 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b400b99b0 0x7f8b400ba4f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f8b40068650 tx=0x7f8b3c006e80).stop 2021-03-25T14:16:44.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.175+0000 7f8b47dda700 1 -- 172.21.15.110:0/2110659996 shutdown_connections 2021-03-25T14:16:44.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.175+0000 7f8b47dda700 1 --2- 172.21.15.110:0/2110659996 >> v2:172.21.15.174:3300/0 conn(0x7f8b40148fc0 0x7f8b400a3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:44.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.175+0000 7f8b47dda700 1 --2- 172.21.15.110:0/2110659996 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b400b99b0 0x7f8b400ba4f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:44.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.175+0000 7f8b47dda700 1 -- 172.21.15.110:0/2110659996 >> 172.21.15.110:0/2110659996 conn(0x7f8b40060c40 msgr2=0x7f8b40061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:44.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.175+0000 7f8b47dda700 1 -- 172.21.15.110:0/2110659996 shutdown_connections 2021-03-25T14:16:44.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.175+0000 7f8b47dda700 1 -- 172.21.15.110:0/2110659996 wait complete. 2021-03-25T14:16:44.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.176+0000 7f8b47dda700 1 Processor -- start 2021-03-25T14:16:44.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.176+0000 7f8b47dda700 1 -- start start 2021-03-25T14:16:44.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.176+0000 7f8b47dda700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b400b99b0 0x7f8b40158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:44.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.176+0000 7f8b47dda700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b40148fc0 0x7f8b40142230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:44.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.176+0000 7f8b47dda700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b4014a050 0x7f8b4014e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:44.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.176+0000 7f8b47dda700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b400b3ca0 con 0x7f8b40148fc0 2021-03-25T14:16:44.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.176+0000 7f8b47dda700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b40159da0 con 0x7f8b4014a050 2021-03-25T14:16:44.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.176+0000 7f8b47dda700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b40159120 con 0x7f8b400b99b0 2021-03-25T14:16:44.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.176+0000 7f8b45375700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b40148fc0 0x7f8b40142230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:44.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.177+0000 7f8b45375700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b40148fc0 0x7f8b40142230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48498/0 (socket says 172.21.15.110:48498) 2021-03-25T14:16:44.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.177+0000 7f8b45375700 1 -- 172.21.15.110:0/403789235 learned_addr learned my addr 172.21.15.110:0/403789235 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:44.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.177+0000 7f8b45b76700 1 --2- 172.21.15.110:0/403789235 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b400b99b0 0x7f8b40158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:44.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.177+0000 7f8b46377700 1 --2- 172.21.15.110:0/403789235 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b4014a050 0x7f8b4014e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:44.185 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.177+0000 7f8b45375700 1 -- 172.21.15.110:0/403789235 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b400b99b0 msgr2=0x7f8b40158b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:44.185 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.177+0000 7f8b45375700 1 --2- 172.21.15.110:0/403789235 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b400b99b0 0x7f8b40158b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:44.185 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.177+0000 7f8b45375700 1 -- 172.21.15.110:0/403789235 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b4014a050 msgr2=0x7f8b4014e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:44.185 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.177+0000 7f8b45375700 1 --2- 172.21.15.110:0/403789235 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b4014a050 0x7f8b4014e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:44.185 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.177+0000 7f8b45375700 1 -- 172.21.15.110:0/403789235 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b401593c0 con 0x7f8b40148fc0 2021-03-25T14:16:44.185 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.177+0000 7f8b45375700 1 --2- 172.21.15.110:0/403789235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b40148fc0 0x7f8b40142230 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f8b3000c710 tx=0x7f8b30007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:44.185 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.177+0000 7f8b2dffb700 1 -- 172.21.15.110:0/403789235 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b30007020 con 0x7f8b40148fc0 2021-03-25T14:16:44.185 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.177+0000 7f8b2dffb700 1 -- 172.21.15.110:0/403789235 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b30007180 con 0x7f8b40148fc0 2021-03-25T14:16:44.185 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.177+0000 7f8b47dda700 1 -- 172.21.15.110:0/403789235 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b40159660 con 0x7f8b40148fc0 2021-03-25T14:16:44.185 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.177+0000 7f8b2dffb700 1 -- 172.21.15.110:0/403789235 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b30006520 con 0x7f8b40148fc0 2021-03-25T14:16:44.185 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.177+0000 7f8b47dda700 1 -- 172.21.15.110:0/403789235 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b400bd980 con 0x7f8b40148fc0 2021-03-25T14:16:44.185 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.178+0000 7f8b2dffb700 1 -- 172.21.15.110:0/403789235 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f8b3001a060 con 0x7f8b40148fc0 2021-03-25T14:16:44.186 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.178+0000 7f8b47dda700 1 -- 172.21.15.110:0/403789235 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b4005d7b0 con 0x7f8b40148fc0 2021-03-25T14:16:44.186 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.178+0000 7f8b2dffb700 1 --2- 172.21.15.110:0/403789235 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f8b2005a0e0 0x7f8b2005c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:44.186 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.179+0000 7f8b2dffb700 1 -- 172.21.15.110:0/403789235 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f8b300734e0 con 0x7f8b40148fc0 2021-03-25T14:16:44.186 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.179+0000 7f8b45b76700 1 --2- 172.21.15.110:0/403789235 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f8b2005a0e0 0x7f8b2005c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:44.186 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.179+0000 7f8b45b76700 1 --2- 172.21.15.110:0/403789235 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f8b2005a0e0 0x7f8b2005c5a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f8b3c006ec0 tx=0x7f8b3c015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:44.186 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.182+0000 7f8b2dffb700 1 -- 172.21.15.110:0/403789235 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f8b3004a5c0 con 0x7f8b40148fc0 2021-03-25T14:16:44.333 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.331+0000 7f8b47dda700 1 -- 172.21.15.110:0/403789235 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b400b9fd0 con 0x7f8b40148fc0 2021-03-25T14:16:44.334 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.332+0000 7f8b2dffb700 1 -- 172.21.15.110:0/403789235 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18685 (secure 0 0 0) 0x7f8b30018020 con 0x7f8b40148fc0 2021-03-25T14:16:44.335 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:16:44.335 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":25,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:16:15.446609+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-03-25T14:16:09.478442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-03-25T14:16:10.071152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2021-03-25T14:16:13.122119+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:16:44.337 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.334+0000 7f8b47dda700 1 -- 172.21.15.110:0/403789235 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f8b2005a0e0 msgr2=0x7f8b2005c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:44.337 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.334+0000 7f8b47dda700 1 --2- 172.21.15.110:0/403789235 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f8b2005a0e0 0x7f8b2005c5a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f8b3c006ec0 tx=0x7f8b3c015000).stop 2021-03-25T14:16:44.338 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.334+0000 7f8b47dda700 1 -- 172.21.15.110:0/403789235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b40148fc0 msgr2=0x7f8b40142230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:44.338 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.334+0000 7f8b47dda700 1 --2- 172.21.15.110:0/403789235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b40148fc0 0x7f8b40142230 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f8b3000c710 tx=0x7f8b30007c80).stop 2021-03-25T14:16:44.338 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.334+0000 7f8b47dda700 1 -- 172.21.15.110:0/403789235 shutdown_connections 2021-03-25T14:16:44.338 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.334+0000 7f8b47dda700 1 --2- 172.21.15.110:0/403789235 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f8b2005a0e0 0x7f8b2005c5a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:44.338 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.334+0000 7f8b47dda700 1 --2- 172.21.15.110:0/403789235 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b4014a050 0x7f8b4014e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:44.338 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.334+0000 7f8b47dda700 1 --2- 172.21.15.110:0/403789235 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b400b99b0 0x7f8b40158b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:44.338 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.334+0000 7f8b47dda700 1 --2- 172.21.15.110:0/403789235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b40148fc0 0x7f8b40142230 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:44.338 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.334+0000 7f8b47dda700 1 -- 172.21.15.110:0/403789235 >> 172.21.15.110:0/403789235 conn(0x7f8b40060c40 msgr2=0x7f8b401498b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:44.338 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.334+0000 7f8b47dda700 1 -- 172.21.15.110:0/403789235 shutdown_connections 2021-03-25T14:16:44.338 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.334+0000 7f8b47dda700 1 -- 172.21.15.110:0/403789235 wait complete. 2021-03-25T14:16:44.350 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-03-25T14:15:59.047299+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-03-25T14:16:00.537926+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-03-25T14:16:09.478442+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-03-25T14:16:10.071152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2021-03-25T14:16:13.122119+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-03-25T14:16:44.351 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-03-25T14:16:44.464 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.462+0000 7fec4f35d700 1 Processor -- start 2021-03-25T14:16:44.465 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.462+0000 7fec4f35d700 1 -- start start 2021-03-25T14:16:44.473 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.463+0000 7fec4f35d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fec480bcb10 0x7fec480bcef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:44.474 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.463+0000 7fec4f35d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec4814a140 0x7fec48131ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:44.474 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.463+0000 7fec4f35d700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec48068b60 con 0x7fec480671d0 2021-03-25T14:16:44.474 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.463+0000 7fec4f35d700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec4814a590 con 0x7fec480bcb10 2021-03-25T14:16:44.474 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.463+0000 7fec4f35d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec480a2ad0 con 0x7fec4814a140 2021-03-25T14:16:44.474 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.463+0000 7fec4e35b700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fec480bcb10 0x7fec480bcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:44.474 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.463+0000 7fec4db5a700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fec480671d0 0x7fec481317c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41444/0 (socket says 172.21.15.110:41444) 2021-03-25T14:16:44.474 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.463+0000 7fec4db5a700 1 -- 172.21.15.110:0/3959496787 learned_addr learned my addr 172.21.15.110:0/3959496787 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:44.474 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.464+0000 7fec4eb5c700 1 --2- 172.21.15.110:0/3959496787 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec4814a140 0x7fec48131ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:44.474 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.464+0000 7fec4e35b700 1 -- 172.21.15.110:0/3959496787 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec4814a140 msgr2=0x7fec48131ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:44.475 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.464+0000 7fec4e35b700 1 --2- 172.21.15.110:0/3959496787 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec4814a140 0x7fec48131ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:44.475 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.464+0000 7fec4e35b700 1 -- 172.21.15.110:0/3959496787 >> v1:172.21.15.110:6789/0 conn(0x7fec480671d0 legacy=0x7fec481317c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:44.475 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.464+0000 7fec4e35b700 1 -- 172.21.15.110:0/3959496787 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec480bd4f0 con 0x7fec480bcb10 2021-03-25T14:16:44.475 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.464+0000 7fec4d359700 1 -- 172.21.15.110:0/3959496787 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2084917311 0 0) 0x7fec48068b60 con 0x7fec480671d0 2021-03-25T14:16:44.475 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.464+0000 7fec4eb5c700 1 --2- 172.21.15.110:0/3959496787 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec4814a140 0x7fec48131ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:44.475 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.464+0000 7fec4e35b700 1 --2- 172.21.15.110:0/3959496787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec480bcb10 0x7fec480bcef0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fec4400b9c0 tx=0x7fec44006e20).ready entity=mon.0 client_cookie=62c3988ea39cb23e server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:44.475 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.464+0000 7fec4d359700 1 -- 172.21.15.110:0/3959496787 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec44009870 con 0x7fec480bcb10 2021-03-25T14:16:44.475 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.464+0000 7fec4d359700 1 -- 172.21.15.110:0/3959496787 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec440099d0 con 0x7fec480bcb10 2021-03-25T14:16:44.475 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.464+0000 7fec4d359700 1 -- 172.21.15.110:0/3959496787 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec44009d50 con 0x7fec480bcb10 2021-03-25T14:16:44.475 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.464+0000 7fec4f35d700 1 -- 172.21.15.110:0/3959496787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec480bcb10 msgr2=0x7fec480bcef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:44.475 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.464+0000 7fec4f35d700 1 --2- 172.21.15.110:0/3959496787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec480bcb10 0x7fec480bcef0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fec4400b9c0 tx=0x7fec44006e20).stop 2021-03-25T14:16:44.475 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.465+0000 7fec4f35d700 1 -- 172.21.15.110:0/3959496787 shutdown_connections 2021-03-25T14:16:44.475 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.465+0000 7fec4f35d700 1 --2- 172.21.15.110:0/3959496787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec480bcb10 0x7fec480bcef0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:44.476 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.465+0000 7fec4f35d700 1 --2- 172.21.15.110:0/3959496787 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec4814a140 0x7fec48131ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:44.476 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.465+0000 7fec4f35d700 1 -- 172.21.15.110:0/3959496787 >> 172.21.15.110:0/3959496787 conn(0x7fec48064860 msgr2=0x7fec480664d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:44.476 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.465+0000 7fec4f35d700 1 -- 172.21.15.110:0/3959496787 shutdown_connections 2021-03-25T14:16:44.476 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.465+0000 7fec4f35d700 1 -- 172.21.15.110:0/3959496787 wait complete. 2021-03-25T14:16:44.476 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.466+0000 7fec4f35d700 1 Processor -- start 2021-03-25T14:16:44.476 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.466+0000 7fec4f35d700 1 -- start start 2021-03-25T14:16:44.476 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.466+0000 7fec4f35d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec480671d0 0x7fec48158e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:44.476 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.466+0000 7fec4f35d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec480bcb10 0x7fec48150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:44.476 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.466+0000 7fec4f35d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec4814a140 0x7fec4814ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:44.476 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.466+0000 7fec4f35d700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec48148990 con 0x7fec480bcb10 2021-03-25T14:16:44.476 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.466+0000 7fec4f35d700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec48148c30 con 0x7fec4814a140 2021-03-25T14:16:44.476 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.466+0000 7fec4f35d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec48148ed0 con 0x7fec480671d0 2021-03-25T14:16:44.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.466+0000 7fec4db5a700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec480bcb10 0x7fec48150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:44.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.466+0000 7fec4db5a700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec480bcb10 0x7fec48150840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48512/0 (socket says 172.21.15.110:48512) 2021-03-25T14:16:44.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.466+0000 7fec4db5a700 1 -- 172.21.15.110:0/439198812 learned_addr learned my addr 172.21.15.110:0/439198812 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:44.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.467+0000 7fec4e35b700 1 --2- 172.21.15.110:0/439198812 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec480671d0 0x7fec48158e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:44.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.467+0000 7fec4eb5c700 1 --2- 172.21.15.110:0/439198812 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec4814a140 0x7fec4814ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:44.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.467+0000 7fec4db5a700 1 -- 172.21.15.110:0/439198812 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec480671d0 msgr2=0x7fec48158e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:44.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.467+0000 7fec4db5a700 1 --2- 172.21.15.110:0/439198812 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec480671d0 0x7fec48158e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:44.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.467+0000 7fec4db5a700 1 -- 172.21.15.110:0/439198812 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec4814a140 msgr2=0x7fec4814ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:44.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.467+0000 7fec4db5a700 1 --2- 172.21.15.110:0/439198812 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec4814a140 0x7fec4814ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:44.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.467+0000 7fec4db5a700 1 -- 172.21.15.110:0/439198812 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec48149170 con 0x7fec480bcb10 2021-03-25T14:16:44.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.467+0000 7fec4eb5c700 1 --2- 172.21.15.110:0/439198812 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec4814a140 0x7fec4814ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:44.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.467+0000 7fec4db5a700 1 --2- 172.21.15.110:0/439198812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec480bcb10 0x7fec48150840 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fec3800c730 tx=0x7fec38007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:44.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.467+0000 7fec367fc700 1 -- 172.21.15.110:0/439198812 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec380072e0 con 0x7fec480bcb10 2021-03-25T14:16:44.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.467+0000 7fec367fc700 1 -- 172.21.15.110:0/439198812 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec38007440 con 0x7fec480bcb10 2021-03-25T14:16:44.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.467+0000 7fec4f35d700 1 -- 172.21.15.110:0/439198812 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec48149410 con 0x7fec480bcb10 2021-03-25T14:16:44.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.467+0000 7fec4f35d700 1 -- 172.21.15.110:0/439198812 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec48150d30 con 0x7fec480bcb10 2021-03-25T14:16:44.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.467+0000 7fec367fc700 1 -- 172.21.15.110:0/439198812 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec38005870 con 0x7fec480bcb10 2021-03-25T14:16:44.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.468+0000 7fec4f35d700 1 -- 172.21.15.110:0/439198812 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec481495a0 con 0x7fec480bcb10 2021-03-25T14:16:44.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.468+0000 7fec367fc700 1 -- 172.21.15.110:0/439198812 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fec3801a060 con 0x7fec480bcb10 2021-03-25T14:16:44.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.468+0000 7fec367fc700 1 --2- 172.21.15.110:0/439198812 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fec2805a0e0 0x7fec2805c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:44.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.468+0000 7fec367fc700 1 -- 172.21.15.110:0/439198812 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fec38073750 con 0x7fec480bcb10 2021-03-25T14:16:44.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.469+0000 7fec4e35b700 1 --2- 172.21.15.110:0/439198812 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fec2805a0e0 0x7fec2805c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:44.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.469+0000 7fec4e35b700 1 --2- 172.21.15.110:0/439198812 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fec2805a0e0 0x7fec2805c5a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fec4400b170 tx=0x7fec44016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:44.479 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.472+0000 7fec367fc700 1 -- 172.21.15.110:0/439198812 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fec38046e00 con 0x7fec480bcb10 2021-03-25T14:16:44.623 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.620+0000 7fec4f35d700 1 -- 172.21.15.110:0/439198812 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fec48045ae0 con 0x7fec480bcb10 2021-03-25T14:16:44.623 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.621+0000 7fec367fc700 1 -- 172.21.15.110:0/439198812 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7fec38018070 con 0x7fec480bcb10 2021-03-25T14:16:44.623 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 1 2021-03-25T14:16:44.625 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.622+0000 7fec4f35d700 1 -- 172.21.15.110:0/439198812 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fec2805a0e0 msgr2=0x7fec2805c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:44.625 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.622+0000 7fec4f35d700 1 --2- 172.21.15.110:0/439198812 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fec2805a0e0 0x7fec2805c5a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fec4400b170 tx=0x7fec44016000).stop 2021-03-25T14:16:44.625 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.622+0000 7fec4f35d700 1 -- 172.21.15.110:0/439198812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec480bcb10 msgr2=0x7fec48150840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:44.625 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.622+0000 7fec4f35d700 1 --2- 172.21.15.110:0/439198812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec480bcb10 0x7fec48150840 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fec3800c730 tx=0x7fec38007c10).stop 2021-03-25T14:16:44.625 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.622+0000 7fec4f35d700 1 -- 172.21.15.110:0/439198812 shutdown_connections 2021-03-25T14:16:44.625 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.622+0000 7fec4f35d700 1 --2- 172.21.15.110:0/439198812 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fec2805a0e0 0x7fec2805c5a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:44.625 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.622+0000 7fec4f35d700 1 --2- 172.21.15.110:0/439198812 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec4814a140 0x7fec4814ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:44.626 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.622+0000 7fec4f35d700 1 --2- 172.21.15.110:0/439198812 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec480671d0 0x7fec48158e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:44.626 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.622+0000 7fec4f35d700 1 --2- 172.21.15.110:0/439198812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec480bcb10 0x7fec48150840 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:44.626 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.622+0000 7fec4f35d700 1 -- 172.21.15.110:0/439198812 >> 172.21.15.110:0/439198812 conn(0x7fec48064860 msgr2=0x7fec480bdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:44.626 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.623+0000 7fec4f35d700 1 -- 172.21.15.110:0/439198812 shutdown_connections 2021-03-25T14:16:44.626 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.623+0000 7fec4f35d700 1 -- 172.21.15.110:0/439198812 wait complete. 2021-03-25T14:16:44.636 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-03-25T14:16:44.748 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.746+0000 7f418bb80700 1 Processor -- start 2021-03-25T14:16:44.748 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.746+0000 7f418bb80700 1 -- start start 2021-03-25T14:16:44.751 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.747+0000 7f418bb80700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f41840be3a0 0x7f41840b4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:44.751 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.747+0000 7f418bb80700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4184149340 0x7f41840b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:44.751 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.747+0000 7f418bb80700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41840b4c20 con 0x7f41840b47a0 2021-03-25T14:16:44.751 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.747+0000 7f418bb80700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4184149960 con 0x7f41840be3a0 2021-03-25T14:16:44.751 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.747+0000 7f418bb80700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4184149c00 con 0x7f4184149340 2021-03-25T14:16:44.751 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.747+0000 7f418991c700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f41840be3a0 0x7f41840b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:44.751 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.747+0000 7f418911b700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f41840b47a0 0x7f4184148c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41458/0 (socket says 172.21.15.110:41458) 2021-03-25T14:16:44.752 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.747+0000 7f418991c700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f41840be3a0 0x7f41840b4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48518/0 (socket says 172.21.15.110:48518) 2021-03-25T14:16:44.752 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.747+0000 7f418911b700 1 -- 172.21.15.110:0/2521059616 learned_addr learned my addr 172.21.15.110:0/2521059616 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:44.752 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.747+0000 7f418a11d700 1 --2- 172.21.15.110:0/2521059616 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4184149340 0x7f41840b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:44.752 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.747+0000 7f418991c700 1 -- 172.21.15.110:0/2521059616 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4184149340 msgr2=0x7f41840b8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:44.752 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.747+0000 7f418991c700 1 --2- 172.21.15.110:0/2521059616 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4184149340 0x7f41840b8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:44.752 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.747+0000 7f418991c700 1 -- 172.21.15.110:0/2521059616 >> v1:172.21.15.110:6789/0 conn(0x7f41840b47a0 legacy=0x7f4184148c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:44.752 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.748+0000 7f418991c700 1 -- 172.21.15.110:0/2521059616 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4184149ea0 con 0x7f41840be3a0 2021-03-25T14:16:44.752 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.747+0000 7f418891a700 1 -- 172.21.15.110:0/2521059616 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 498989358 0 0) 0x7f41840b4c20 con 0x7f41840b47a0 2021-03-25T14:16:44.752 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.748+0000 7f418991c700 1 --2- 172.21.15.110:0/2521059616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41840be3a0 0x7f41840b4100 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f418000b9c0 tx=0x7f4180006e20).ready entity=mon.0 client_cookie=7eaf2dafc3060f11 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:44.752 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.748+0000 7f418891a700 1 -- 172.21.15.110:0/2521059616 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41800097e0 con 0x7f41840be3a0 2021-03-25T14:16:44.752 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.748+0000 7f418891a700 1 -- 172.21.15.110:0/2521059616 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4180009940 con 0x7f41840be3a0 2021-03-25T14:16:44.752 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.748+0000 7f418891a700 1 -- 172.21.15.110:0/2521059616 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4180009cc0 con 0x7f41840be3a0 2021-03-25T14:16:44.753 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.748+0000 7f418bb80700 1 -- 172.21.15.110:0/2521059616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41840be3a0 msgr2=0x7f41840b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:44.753 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.748+0000 7f418bb80700 1 --2- 172.21.15.110:0/2521059616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41840be3a0 0x7f41840b4100 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f418000b9c0 tx=0x7f4180006e20).stop 2021-03-25T14:16:44.753 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.748+0000 7f418bb80700 1 -- 172.21.15.110:0/2521059616 shutdown_connections 2021-03-25T14:16:44.753 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.748+0000 7f418bb80700 1 --2- 172.21.15.110:0/2521059616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41840be3a0 0x7f41840b4100 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:44.753 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.748+0000 7f418bb80700 1 --2- 172.21.15.110:0/2521059616 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4184149340 0x7f41840b8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:44.753 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.748+0000 7f418bb80700 1 -- 172.21.15.110:0/2521059616 >> 172.21.15.110:0/2521059616 conn(0x7f41840686f0 msgr2=0x7f4184068b00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:44.753 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.748+0000 7f418bb80700 1 -- 172.21.15.110:0/2521059616 shutdown_connections 2021-03-25T14:16:44.753 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.748+0000 7f418bb80700 1 -- 172.21.15.110:0/2521059616 wait complete. 2021-03-25T14:16:44.753 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.749+0000 7f418bb80700 1 Processor -- start 2021-03-25T14:16:44.753 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.749+0000 7f418bb80700 1 -- start start 2021-03-25T14:16:44.756 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.750+0000 7f418bb80700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41840b47a0 0x7f41840b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:44.756 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.750+0000 7f418bb80700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41840be3a0 0x7f41840b5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:44.756 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.750+0000 7f418bb80700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4184149340 0x7f4184158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:44.756 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.750+0000 7f418bb80700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41840b5be0 con 0x7f4184149340 2021-03-25T14:16:44.756 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.750+0000 7f418bb80700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41840a3750 con 0x7f41840b47a0 2021-03-25T14:16:44.756 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.750+0000 7f418bb80700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41840a39f0 con 0x7f41840be3a0 2021-03-25T14:16:44.757 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.750+0000 7f418a11d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4184149340 0x7f4184158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:44.757 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.750+0000 7f418a11d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4184149340 0x7f4184158970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48528/0 (socket says 172.21.15.110:48528) 2021-03-25T14:16:44.757 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.750+0000 7f418a11d700 1 -- 172.21.15.110:0/1952827361 learned_addr learned my addr 172.21.15.110:0/1952827361 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:44.757 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.750+0000 7f418991c700 1 --2- 172.21.15.110:0/1952827361 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41840b47a0 0x7f41840b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:44.757 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.750+0000 7f418911b700 1 --2- 172.21.15.110:0/1952827361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41840be3a0 0x7f41840b5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:44.757 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.750+0000 7f418a11d700 1 -- 172.21.15.110:0/1952827361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41840be3a0 msgr2=0x7f41840b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:44.757 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.750+0000 7f418a11d700 1 --2- 172.21.15.110:0/1952827361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41840be3a0 0x7f41840b5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:44.757 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.750+0000 7f418a11d700 1 -- 172.21.15.110:0/1952827361 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41840b47a0 msgr2=0x7f41840b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:44.757 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.750+0000 7f418a11d700 1 --2- 172.21.15.110:0/1952827361 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41840b47a0 0x7f41840b56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:44.757 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.750+0000 7f418a11d700 1 -- 172.21.15.110:0/1952827361 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41840b4fb0 con 0x7f4184149340 2021-03-25T14:16:44.757 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.750+0000 7f418991c700 1 --2- 172.21.15.110:0/1952827361 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41840b47a0 0x7f41840b56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:44.757 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.750+0000 7f418911b700 1 --2- 172.21.15.110:0/1952827361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41840be3a0 0x7f41840b5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:44.758 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.751+0000 7f418a11d700 1 --2- 172.21.15.110:0/1952827361 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4184149340 0x7f4184158970 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f417c00db60 tx=0x7f417c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:44.758 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.751+0000 7f4171ffb700 1 -- 172.21.15.110:0/1952827361 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417c017070 con 0x7f4184149340 2021-03-25T14:16:44.758 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.751+0000 7f4171ffb700 1 -- 172.21.15.110:0/1952827361 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417c00b8e0 con 0x7f4184149340 2021-03-25T14:16:44.758 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.751+0000 7f418bb80700 1 -- 172.21.15.110:0/1952827361 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41840b5250 con 0x7f4184149340 2021-03-25T14:16:44.758 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.751+0000 7f4171ffb700 1 -- 172.21.15.110:0/1952827361 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417c00bc80 con 0x7f4184149340 2021-03-25T14:16:44.758 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.751+0000 7f418bb80700 1 -- 172.21.15.110:0/1952827361 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41840b64b0 con 0x7f4184149340 2021-03-25T14:16:44.758 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.752+0000 7f418bb80700 1 -- 172.21.15.110:0/1952827361 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41840a3bb0 con 0x7f4184149340 2021-03-25T14:16:44.758 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.752+0000 7f4171ffb700 1 -- 172.21.15.110:0/1952827361 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f417c013690 con 0x7f4184149340 2021-03-25T14:16:44.758 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.752+0000 7f4171ffb700 1 --2- 172.21.15.110:0/1952827361 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f416405a0b0 0x7f416405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:44.758 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.752+0000 7f4171ffb700 1 -- 172.21.15.110:0/1952827361 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f417c074320 con 0x7f4184149340 2021-03-25T14:16:44.758 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.752+0000 7f418991c700 1 --2- 172.21.15.110:0/1952827361 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f416405a0b0 0x7f416405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:44.758 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.753+0000 7f418991c700 1 --2- 172.21.15.110:0/1952827361 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f416405a0b0 0x7f416405c570 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f4180006e60 tx=0x7f4180016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:44.759 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.757+0000 7f4171ffb700 1 -- 172.21.15.110:0/1952827361 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f417c0479d0 con 0x7f4184149340 2021-03-25T14:16:44.908 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.906+0000 7f418bb80700 1 -- 172.21.15.110:0/1952827361 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f418405d7b0 con 0x7f4184149340 2021-03-25T14:16:44.908 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.906+0000 7f4171ffb700 1 -- 172.21.15.110:0/1952827361 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f417c04aff0 con 0x7f4184149340 2021-03-25T14:16:44.908 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:16:44.910 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.908+0000 7f418bb80700 1 -- 172.21.15.110:0/1952827361 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f416405a0b0 msgr2=0x7f416405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:44.910 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.908+0000 7f418bb80700 1 --2- 172.21.15.110:0/1952827361 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f416405a0b0 0x7f416405c570 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f4180006e60 tx=0x7f4180016000).stop 2021-03-25T14:16:44.910 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.908+0000 7f418bb80700 1 -- 172.21.15.110:0/1952827361 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4184149340 msgr2=0x7f4184158970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:44.910 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.908+0000 7f418bb80700 1 --2- 172.21.15.110:0/1952827361 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4184149340 0x7f4184158970 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f417c00db60 tx=0x7f417c008040).stop 2021-03-25T14:16:44.910 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.908+0000 7f418bb80700 1 -- 172.21.15.110:0/1952827361 shutdown_connections 2021-03-25T14:16:44.910 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.908+0000 7f418bb80700 1 --2- 172.21.15.110:0/1952827361 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f416405a0b0 0x7f416405c570 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:44.911 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.908+0000 7f418bb80700 1 --2- 172.21.15.110:0/1952827361 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41840b47a0 0x7f41840b56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:44.911 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.908+0000 7f418bb80700 1 --2- 172.21.15.110:0/1952827361 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4184149340 0x7f4184158970 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:44.911 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.908+0000 7f418bb80700 1 --2- 172.21.15.110:0/1952827361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41840be3a0 0x7f41840b5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:44.911 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.908+0000 7f418bb80700 1 -- 172.21.15.110:0/1952827361 >> 172.21.15.110:0/1952827361 conn(0x7f41840686f0 msgr2=0x7f41840b95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:44.911 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.908+0000 7f418bb80700 1 -- 172.21.15.110:0/1952827361 shutdown_connections 2021-03-25T14:16:44.911 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:44.908+0000 7f418bb80700 1 -- 172.21.15.110:0/1952827361 wait complete. 2021-03-25T14:16:44.921 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-03-25T14:16:45.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.031+0000 7f8f2adbc700 1 Processor -- start 2021-03-25T14:16:45.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.031+0000 7f8f2adbc700 1 -- start start 2021-03-25T14:16:45.036 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.032+0000 7f8f2adbc700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8f240bb660 0x7f8f240ba9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:45.036 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.032+0000 7f8f2adbc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f2414cdc0 0x7f8f24148c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:45.036 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.032+0000 7f8f2adbc700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f240b1920 con 0x7f8f240bc110 2021-03-25T14:16:45.036 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.032+0000 7f8f2adbc700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f24068850 con 0x7f8f240bb660 2021-03-25T14:16:45.037 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.032+0000 7f8f2adbc700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f24067d30 con 0x7f8f2414cdc0 2021-03-25T14:16:45.037 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.033+0000 7f8f29dba700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8f240bb660 0x7f8f240ba9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:45.037 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.033+0000 7f8f2a5bb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f2414cdc0 0x7f8f24148c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:45.037 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.033+0000 7f8f295b9700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f8f240bc110 0x7f8f24067620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.110:49136/0 (socket says 172.21.15.110:49136) 2021-03-25T14:16:45.037 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.033+0000 7f8f29dba700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8f240bb660 0x7f8f240ba9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.110:47182/0 (socket says 172.21.15.110:47182) 2021-03-25T14:16:45.037 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.033+0000 7f8f295b9700 1 -- 172.21.15.110:0/792779921 learned_addr learned my addr 172.21.15.110:0/792779921 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:45.037 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.033+0000 7f8f2a5bb700 1 -- 172.21.15.110:0/792779921 >> v2:172.21.15.174:3300/0 conn(0x7f8f240bb660 msgr2=0x7f8f240ba9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:45.037 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.033+0000 7f8f2a5bb700 1 --2- 172.21.15.110:0/792779921 >> v2:172.21.15.174:3300/0 conn(0x7f8f240bb660 0x7f8f240ba9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:45.037 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.033+0000 7f8f2a5bb700 1 -- 172.21.15.110:0/792779921 >> v1:172.21.15.174:6789/0 conn(0x7f8f240bc110 legacy=0x7f8f24067620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:45.037 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.033+0000 7f8f2a5bb700 1 -- 172.21.15.110:0/792779921 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f240bc620 con 0x7f8f2414cdc0 2021-03-25T14:16:45.038 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.033+0000 7f8f29dba700 1 --2- 172.21.15.110:0/792779921 >> v2:172.21.15.174:3300/0 conn(0x7f8f240bb660 0x7f8f240ba9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:16:45.038 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.033+0000 7f8f2a5bb700 1 --2- 172.21.15.110:0/792779921 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f2414cdc0 0x7f8f24148c60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f8f1c009cc0 tx=0x7f8f1c009220).ready entity=mon.2 client_cookie=f1c8a845921ffebc server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:45.038 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.033+0000 7f8f28db8700 1 -- 172.21.15.110:0/792779921 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c00ba10 con 0x7f8f2414cdc0 2021-03-25T14:16:45.038 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.033+0000 7f8f28db8700 1 -- 172.21.15.110:0/792779921 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f1c00bb70 con 0x7f8f2414cdc0 2021-03-25T14:16:45.038 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.033+0000 7f8f28db8700 1 -- 172.21.15.110:0/792779921 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c011400 con 0x7f8f2414cdc0 2021-03-25T14:16:45.038 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.034+0000 7f8f2adbc700 1 -- 172.21.15.110:0/792779921 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f2414cdc0 msgr2=0x7f8f24148c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:45.038 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.034+0000 7f8f2adbc700 1 --2- 172.21.15.110:0/792779921 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f2414cdc0 0x7f8f24148c60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f8f1c009cc0 tx=0x7f8f1c009220).stop 2021-03-25T14:16:45.038 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.034+0000 7f8f2adbc700 1 -- 172.21.15.110:0/792779921 shutdown_connections 2021-03-25T14:16:45.038 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.034+0000 7f8f2adbc700 1 --2- 172.21.15.110:0/792779921 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f2414cdc0 0x7f8f24148c60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:45.038 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.034+0000 7f8f2adbc700 1 --2- 172.21.15.110:0/792779921 >> v2:172.21.15.174:3300/0 conn(0x7f8f240bb660 0x7f8f240ba9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:45.038 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.034+0000 7f8f2adbc700 1 -- 172.21.15.110:0/792779921 >> 172.21.15.110:0/792779921 conn(0x7f8f24063090 msgr2=0x7f8f240634a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:45.038 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.034+0000 7f8f2adbc700 1 -- 172.21.15.110:0/792779921 shutdown_connections 2021-03-25T14:16:45.039 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.034+0000 7f8f2adbc700 1 -- 172.21.15.110:0/792779921 wait complete. 2021-03-25T14:16:45.042 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.035+0000 7f8f2adbc700 1 Processor -- start 2021-03-25T14:16:45.042 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.035+0000 7f8f2adbc700 1 -- start start 2021-03-25T14:16:45.042 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.036+0000 7f8f2adbc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f240bb660 0x7f8f24141360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:45.042 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.036+0000 7f8f2adbc700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f240bc110 0x7f8f241471c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:45.042 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.036+0000 7f8f2adbc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f2414cdc0 0x7f8f24158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:45.042 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.036+0000 7f8f2adbc700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f240bde90 con 0x7f8f240bb660 2021-03-25T14:16:45.042 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.036+0000 7f8f2adbc700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f24148070 con 0x7f8f240bc110 2021-03-25T14:16:45.042 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.036+0000 7f8f2adbc700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f240be0c0 con 0x7f8f2414cdc0 2021-03-25T14:16:45.042 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.036+0000 7f8f29dba700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f240bb660 0x7f8f24141360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:45.042 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.036+0000 7f8f29dba700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f240bb660 0x7f8f24141360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48538/0 (socket says 172.21.15.110:48538) 2021-03-25T14:16:45.043 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.036+0000 7f8f29dba700 1 -- 172.21.15.110:0/2273075970 learned_addr learned my addr 172.21.15.110:0/2273075970 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:45.043 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.036+0000 7f8f295b9700 1 --2- 172.21.15.110:0/2273075970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f240bc110 0x7f8f241471c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:45.043 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.036+0000 7f8f2a5bb700 1 --2- 172.21.15.110:0/2273075970 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f2414cdc0 0x7f8f24158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:45.043 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.036+0000 7f8f29dba700 1 -- 172.21.15.110:0/2273075970 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f2414cdc0 msgr2=0x7f8f24158b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:45.043 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.036+0000 7f8f29dba700 1 --2- 172.21.15.110:0/2273075970 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f2414cdc0 0x7f8f24158b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:45.043 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.036+0000 7f8f29dba700 1 -- 172.21.15.110:0/2273075970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f240bc110 msgr2=0x7f8f241471c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:45.043 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.036+0000 7f8f29dba700 1 --2- 172.21.15.110:0/2273075970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f240bc110 0x7f8f241471c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:45.043 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.036+0000 7f8f29dba700 1 -- 172.21.15.110:0/2273075970 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f240be360 con 0x7f8f240bb660 2021-03-25T14:16:45.043 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.036+0000 7f8f295b9700 1 --2- 172.21.15.110:0/2273075970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f240bc110 0x7f8f241471c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:45.043 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.036+0000 7f8f29dba700 1 --2- 172.21.15.110:0/2273075970 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f240bb660 0x7f8f24141360 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f8f2000ef20 tx=0x7f8f20006e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:45.043 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.036+0000 7f8f11ffb700 1 -- 172.21.15.110:0/2273075970 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2000cbc0 con 0x7f8f240bb660 2021-03-25T14:16:45.043 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.037+0000 7f8f11ffb700 1 -- 172.21.15.110:0/2273075970 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2000cd20 con 0x7f8f240bb660 2021-03-25T14:16:45.044 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.037+0000 7f8f2adbc700 1 -- 172.21.15.110:0/2273075970 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f24146d30 con 0x7f8f240bb660 2021-03-25T14:16:45.044 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.037+0000 7f8f11ffb700 1 -- 172.21.15.110:0/2273075970 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f20012600 con 0x7f8f240bb660 2021-03-25T14:16:45.044 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.037+0000 7f8f2adbc700 1 -- 172.21.15.110:0/2273075970 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f24144c90 con 0x7f8f240bb660 2021-03-25T14:16:45.044 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.038+0000 7f8f2adbc700 1 -- 172.21.15.110:0/2273075970 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f24045ae0 con 0x7f8f240bb660 2021-03-25T14:16:45.044 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.038+0000 7f8f11ffb700 1 -- 172.21.15.110:0/2273075970 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f8f20012970 con 0x7f8f240bb660 2021-03-25T14:16:45.044 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.038+0000 7f8f11ffb700 1 --2- 172.21.15.110:0/2273075970 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f8f0405a0b0 0x7f8f0405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:45.044 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.038+0000 7f8f11ffb700 1 -- 172.21.15.110:0/2273075970 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f8f20074700 con 0x7f8f240bb660 2021-03-25T14:16:45.044 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.038+0000 7f8f295b9700 1 --2- 172.21.15.110:0/2273075970 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f8f0405a0b0 0x7f8f0405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:45.044 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.038+0000 7f8f295b9700 1 --2- 172.21.15.110:0/2273075970 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f8f0405a0b0 0x7f8f0405c570 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f8f24145090 tx=0x7f8f14009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:45.045 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.042+0000 7f8f11ffb700 1 -- 172.21.15.110:0/2273075970 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f8f20047db0 con 0x7f8f240bb660 2021-03-25T14:16:45.192 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.190+0000 7f8f2adbc700 1 -- 172.21.15.110:0/2273075970 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8f24061c50 con 0x7f8f240bb660 2021-03-25T14:16:45.193 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.191+0000 7f8f11ffb700 1 -- 172.21.15.110:0/2273075970 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7f8f2004b3d0 con 0x7f8f240bb660 2021-03-25T14:16:45.193 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:16:45.194 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.192+0000 7f8f2adbc700 1 -- 172.21.15.110:0/2273075970 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f8f0405a0b0 msgr2=0x7f8f0405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:45.194 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.192+0000 7f8f2adbc700 1 --2- 172.21.15.110:0/2273075970 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f8f0405a0b0 0x7f8f0405c570 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f8f24145090 tx=0x7f8f14009040).stop 2021-03-25T14:16:45.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.192+0000 7f8f2adbc700 1 -- 172.21.15.110:0/2273075970 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f240bb660 msgr2=0x7f8f24141360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:45.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.192+0000 7f8f2adbc700 1 --2- 172.21.15.110:0/2273075970 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f240bb660 0x7f8f24141360 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f8f2000ef20 tx=0x7f8f20006e20).stop 2021-03-25T14:16:45.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.192+0000 7f8f2adbc700 1 -- 172.21.15.110:0/2273075970 shutdown_connections 2021-03-25T14:16:45.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.192+0000 7f8f2adbc700 1 --2- 172.21.15.110:0/2273075970 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f8f0405a0b0 0x7f8f0405c570 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:45.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.192+0000 7f8f2adbc700 1 --2- 172.21.15.110:0/2273075970 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f2414cdc0 0x7f8f24158b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:45.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.192+0000 7f8f2adbc700 1 --2- 172.21.15.110:0/2273075970 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f240bb660 0x7f8f24141360 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:45.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.192+0000 7f8f2adbc700 1 --2- 172.21.15.110:0/2273075970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f240bc110 0x7f8f241471c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:45.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.192+0000 7f8f2adbc700 1 -- 172.21.15.110:0/2273075970 >> 172.21.15.110:0/2273075970 conn(0x7f8f24063090 msgr2=0x7f8f2414c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:45.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.192+0000 7f8f2adbc700 1 -- 172.21.15.110:0/2273075970 shutdown_connections 2021-03-25T14:16:45.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.192+0000 7f8f2adbc700 1 -- 172.21.15.110:0/2273075970 wait complete. 2021-03-25T14:16:45.205 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-03-25T14:16:45.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.315+0000 7f0df786d700 1 Processor -- start 2021-03-25T14:16:45.318 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.316+0000 7f0df786d700 1 -- start start 2021-03-25T14:16:45.320 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.316+0000 7f0df786d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0df00be3a0 0x7f0df00b4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:45.320 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.316+0000 7f0df786d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0df00b47a0 0x7f0df0148c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:45.321 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.316+0000 7f0df786d700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df00b4c20 con 0x7f0df0149120 2021-03-25T14:16:45.321 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.316+0000 7f0df786d700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df0149960 con 0x7f0df00be3a0 2021-03-25T14:16:45.321 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.316+0000 7f0df786d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df0149c00 con 0x7f0df00b47a0 2021-03-25T14:16:45.321 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.316+0000 7f0df5609700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0df00be3a0 0x7f0df00b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:45.321 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.316+0000 7f0df5e0a700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f0df0149120 0x7f0df00b8cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41484/0 (socket says 172.21.15.110:41484) 2021-03-25T14:16:45.321 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.316+0000 7f0df5e0a700 1 -- 172.21.15.110:0/3855303774 learned_addr learned my addr 172.21.15.110:0/3855303774 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:45.321 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.317+0000 7f0df4e08700 1 --2- 172.21.15.110:0/3855303774 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0df00b47a0 0x7f0df0148c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:45.321 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.317+0000 7f0df5609700 1 -- 172.21.15.110:0/3855303774 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0df00b47a0 msgr2=0x7f0df0148c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:45.321 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.317+0000 7f0df5609700 1 --2- 172.21.15.110:0/3855303774 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0df00b47a0 0x7f0df0148c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:45.321 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.317+0000 7f0df5609700 1 -- 172.21.15.110:0/3855303774 >> v1:172.21.15.110:6789/0 conn(0x7f0df0149120 legacy=0x7f0df00b8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:45.321 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.317+0000 7f0df5609700 1 -- 172.21.15.110:0/3855303774 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df0149ea0 con 0x7f0df00be3a0 2021-03-25T14:16:45.321 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.317+0000 7f0ddffff700 1 -- 172.21.15.110:0/3855303774 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 493092865 0 0) 0x7f0df00b4c20 con 0x7f0df0149120 2021-03-25T14:16:45.321 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.317+0000 7f0df4e08700 1 --2- 172.21.15.110:0/3855303774 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0df00b47a0 0x7f0df0148c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:45.322 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.317+0000 7f0df5609700 1 --2- 172.21.15.110:0/3855303774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0df00be3a0 0x7f0df00b4100 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f0dec00b9c0 tx=0x7f0dec006e20).ready entity=mon.0 client_cookie=37e29249185a60b9 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:45.322 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.317+0000 7f0ddffff700 1 -- 172.21.15.110:0/3855303774 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec0097e0 con 0x7f0df00be3a0 2021-03-25T14:16:45.322 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.317+0000 7f0ddffff700 1 -- 172.21.15.110:0/3855303774 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dec009940 con 0x7f0df00be3a0 2021-03-25T14:16:45.322 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.317+0000 7f0ddffff700 1 -- 172.21.15.110:0/3855303774 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec009cc0 con 0x7f0df00be3a0 2021-03-25T14:16:45.322 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.317+0000 7f0df786d700 1 -- 172.21.15.110:0/3855303774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0df00be3a0 msgr2=0x7f0df00b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:45.322 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.317+0000 7f0df786d700 1 --2- 172.21.15.110:0/3855303774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0df00be3a0 0x7f0df00b4100 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f0dec00b9c0 tx=0x7f0dec006e20).stop 2021-03-25T14:16:45.322 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.317+0000 7f0df786d700 1 -- 172.21.15.110:0/3855303774 shutdown_connections 2021-03-25T14:16:45.322 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.317+0000 7f0df786d700 1 --2- 172.21.15.110:0/3855303774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0df00be3a0 0x7f0df00b4100 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:45.322 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.317+0000 7f0df786d700 1 --2- 172.21.15.110:0/3855303774 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0df00b47a0 0x7f0df0148c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:45.322 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.318+0000 7f0df786d700 1 -- 172.21.15.110:0/3855303774 >> 172.21.15.110:0/3855303774 conn(0x7f0df00686f0 msgr2=0x7f0df0068b00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:45.322 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.318+0000 7f0df786d700 1 -- 172.21.15.110:0/3855303774 shutdown_connections 2021-03-25T14:16:45.323 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.318+0000 7f0df786d700 1 -- 172.21.15.110:0/3855303774 wait complete. 2021-03-25T14:16:45.323 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.319+0000 7f0df786d700 1 Processor -- start 2021-03-25T14:16:45.323 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.319+0000 7f0df786d700 1 -- start start 2021-03-25T14:16:45.325 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.319+0000 7f0df786d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0df00b47a0 0x7f0df00a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:45.326 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.319+0000 7f0df786d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0df00be3a0 0x7f0df00a2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:45.326 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.319+0000 7f0df786d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0df0149120 0x7f0df00b6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:45.326 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.319+0000 7f0df786d700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df00b7750 con 0x7f0df00be3a0 2021-03-25T14:16:45.326 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.319+0000 7f0df786d700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df00a3280 con 0x7f0df00b47a0 2021-03-25T14:16:45.326 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.319+0000 7f0df786d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df0158ca0 con 0x7f0df0149120 2021-03-25T14:16:45.326 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.320+0000 7f0df4e08700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0df00be3a0 0x7f0df00a2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:45.326 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.320+0000 7f0df4e08700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0df00be3a0 0x7f0df00a2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48552/0 (socket says 172.21.15.110:48552) 2021-03-25T14:16:45.326 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.320+0000 7f0df4e08700 1 -- 172.21.15.110:0/1569848378 learned_addr learned my addr 172.21.15.110:0/1569848378 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:45.326 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.320+0000 7f0df5e0a700 1 --2- 172.21.15.110:0/1569848378 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0df0149120 0x7f0df00b6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:45.327 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.320+0000 7f0df5609700 1 --2- 172.21.15.110:0/1569848378 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0df00b47a0 0x7f0df00a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:45.327 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.320+0000 7f0df4e08700 1 -- 172.21.15.110:0/1569848378 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0df0149120 msgr2=0x7f0df00b6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:45.327 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.320+0000 7f0df4e08700 1 --2- 172.21.15.110:0/1569848378 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0df0149120 0x7f0df00b6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:45.327 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.320+0000 7f0df4e08700 1 -- 172.21.15.110:0/1569848378 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0df00b47a0 msgr2=0x7f0df00a3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:45.327 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.320+0000 7f0df4e08700 1 --2- 172.21.15.110:0/1569848378 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0df00b47a0 0x7f0df00a3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:45.327 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.320+0000 7f0df4e08700 1 -- 172.21.15.110:0/1569848378 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df0158f40 con 0x7f0df00be3a0 2021-03-25T14:16:45.327 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.320+0000 7f0df5609700 1 --2- 172.21.15.110:0/1569848378 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0df00b47a0 0x7f0df00a3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:45.327 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.320+0000 7f0df4e08700 1 --2- 172.21.15.110:0/1569848378 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0df00be3a0 0x7f0df00a2c50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f0de000cb50 tx=0x7f0de0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:45.327 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.320+0000 7f0ddd7fa700 1 -- 172.21.15.110:0/1569848378 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de0015070 con 0x7f0df00be3a0 2021-03-25T14:16:45.328 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.320+0000 7f0ddd7fa700 1 -- 172.21.15.110:0/1569848378 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de0007740 con 0x7f0df00be3a0 2021-03-25T14:16:45.328 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.320+0000 7f0ddd7fa700 1 -- 172.21.15.110:0/1569848378 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de0007ac0 con 0x7f0df00be3a0 2021-03-25T14:16:45.328 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.320+0000 7f0df786d700 1 -- 172.21.15.110:0/1569848378 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df01591e0 con 0x7f0df00be3a0 2021-03-25T14:16:45.328 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.320+0000 7f0df786d700 1 -- 172.21.15.110:0/1569848378 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0df00b6960 con 0x7f0df00be3a0 2021-03-25T14:16:45.328 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.321+0000 7f0df786d700 1 -- 172.21.15.110:0/1569848378 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0df0159640 con 0x7f0df00be3a0 2021-03-25T14:16:45.328 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.321+0000 7f0ddd7fa700 1 -- 172.21.15.110:0/1569848378 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f0de001a410 con 0x7f0df00be3a0 2021-03-25T14:16:45.328 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.322+0000 7f0ddd7fa700 1 --2- 172.21.15.110:0/1569848378 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f0dd005a0e0 0x7f0dd005c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:45.328 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.322+0000 7f0ddd7fa700 1 -- 172.21.15.110:0/1569848378 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f0de0073d60 con 0x7f0df00be3a0 2021-03-25T14:16:45.328 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.322+0000 7f0df5609700 1 --2- 172.21.15.110:0/1569848378 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f0dd005a0e0 0x7f0dd005c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:45.328 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.322+0000 7f0df5609700 1 --2- 172.21.15.110:0/1569848378 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f0dd005a0e0 0x7f0dd005c5a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f0dec007fd0 tx=0x7f0dec016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:45.329 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.325+0000 7f0ddd7fa700 1 -- 172.21.15.110:0/1569848378 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f0de00473b0 con 0x7f0df00be3a0 2021-03-25T14:16:45.475 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.473+0000 7f0df786d700 1 -- 172.21.15.110:0/1569848378 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0df005d7b0 con 0x7f0df00be3a0 2021-03-25T14:16:45.475 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.473+0000 7f0ddd7fa700 1 -- 172.21.15.110:0/1569848378 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7f0de004a9d0 con 0x7f0df00be3a0 2021-03-25T14:16:45.475 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:16:45.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.475+0000 7f0df786d700 1 -- 172.21.15.110:0/1569848378 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f0dd005a0e0 msgr2=0x7f0dd005c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:45.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.475+0000 7f0df786d700 1 --2- 172.21.15.110:0/1569848378 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f0dd005a0e0 0x7f0dd005c5a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f0dec007fd0 tx=0x7f0dec016000).stop 2021-03-25T14:16:45.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.475+0000 7f0df786d700 1 -- 172.21.15.110:0/1569848378 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0df00be3a0 msgr2=0x7f0df00a2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:45.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.475+0000 7f0df786d700 1 --2- 172.21.15.110:0/1569848378 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0df00be3a0 0x7f0df00a2c50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f0de000cb50 tx=0x7f0de0008040).stop 2021-03-25T14:16:45.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.475+0000 7f0df786d700 1 -- 172.21.15.110:0/1569848378 shutdown_connections 2021-03-25T14:16:45.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.475+0000 7f0df786d700 1 --2- 172.21.15.110:0/1569848378 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f0dd005a0e0 0x7f0dd005c5a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:45.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.475+0000 7f0df786d700 1 --2- 172.21.15.110:0/1569848378 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0df00b47a0 0x7f0df00a3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:45.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.475+0000 7f0df786d700 1 --2- 172.21.15.110:0/1569848378 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0df0149120 0x7f0df00b6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:45.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.475+0000 7f0df786d700 1 --2- 172.21.15.110:0/1569848378 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0df00be3a0 0x7f0df00a2c50 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:45.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.475+0000 7f0df786d700 1 -- 172.21.15.110:0/1569848378 >> 172.21.15.110:0/1569848378 conn(0x7f0df00686f0 msgr2=0x7f0df0147050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:45.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.475+0000 7f0df786d700 1 -- 172.21.15.110:0/1569848378 shutdown_connections 2021-03-25T14:16:45.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.475+0000 7f0df786d700 1 -- 172.21.15.110:0/1569848378 wait complete. 2021-03-25T14:16:45.488 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2021-03-25T14:16:45.600 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.598+0000 7f15db6d8700 1 Processor -- start 2021-03-25T14:16:45.600 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.598+0000 7f15db6d8700 1 -- start start 2021-03-25T14:16:45.607 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.599+0000 7f15db6d8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f15d4148ab0 0x7f15d4148f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:45.607 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.599+0000 7f15db6d8700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15d40a1f40 con 0x7f15d40b8060 2021-03-25T14:16:45.607 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.599+0000 7f15db6d8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15d4149920 con 0x7f15d4149400 2021-03-25T14:16:45.607 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.599+0000 7f15db6d8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15d4149bc0 con 0x7f15d4148ab0 2021-03-25T14:16:45.607 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.599+0000 7f15d9474700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f15d40b8060 0x7f15d4063180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41496/0 (socket says 172.21.15.110:41496) 2021-03-25T14:16:45.607 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.599+0000 7f15d9474700 1 -- 172.21.15.110:0/974270629 learned_addr learned my addr 172.21.15.110:0/974270629 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:45.607 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.599+0000 7f15d8c73700 1 --2- 172.21.15.110:0/974270629 >> v2:172.21.15.174:3300/0 conn(0x7f15d4148ab0 0x7f15d4148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:45.607 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.599+0000 7f15c3fff700 1 -- 172.21.15.110:0/974270629 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1523341318 0 0) 0x7f15d40a1f40 con 0x7f15d40b8060 2021-03-25T14:16:45.607 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.599+0000 7f15c3fff700 1 -- 172.21.15.110:0/974270629 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15bc003270 con 0x7f15d40b8060 2021-03-25T14:16:45.607 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.599+0000 7f15c3fff700 1 -- 172.21.15.110:0/974270629 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2891867248 0 0) 0x7f15bc003270 con 0x7f15d40b8060 2021-03-25T14:16:45.607 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.599+0000 7f15c3fff700 1 -- 172.21.15.110:0/974270629 >> v2:172.21.15.174:3300/0 conn(0x7f15d4148ab0 msgr2=0x7f15d4148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:45.607 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.599+0000 7f15c3fff700 1 --2- 172.21.15.110:0/974270629 >> v2:172.21.15.174:3300/0 conn(0x7f15d4148ab0 0x7f15d4148f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:45.608 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.599+0000 7f15c3fff700 1 -- 172.21.15.110:0/974270629 >> v1:172.21.15.174:6789/0 conn(0x7f15d4149400 legacy=0x7f15d4154110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:45.608 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.599+0000 7f15c3fff700 1 -- 172.21.15.110:0/974270629 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d4149e60 con 0x7f15d40b8060 2021-03-25T14:16:45.608 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.599+0000 7f15c3fff700 1 -- 172.21.15.110:0/974270629 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f15c4001520 con 0x7f15d40b8060 2021-03-25T14:16:45.608 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.599+0000 7f15c3fff700 1 -- 172.21.15.110:0/974270629 >> v1:172.21.15.110:6789/0 conn(0x7f15d40b8060 legacy=0x7f15d4063180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:45.608 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.599+0000 7f15c3fff700 1 --2- 172.21.15.110:0/974270629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15bc003760 0x7f15bc003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:45.608 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.599+0000 7f15c3fff700 1 --2- 172.21.15.110:0/974270629 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15bc004510 0x7f15bc004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:45.608 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.599+0000 7f15c3fff700 1 --2- 172.21.15.110:0/974270629 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f15bc004e80 0x7f15bc00b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:45.608 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.599+0000 7f15c3fff700 1 -- 172.21.15.110:0/974270629 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d4149bc0 con 0x7f15bc003760 2021-03-25T14:16:45.608 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.599+0000 7f15c3fff700 1 -- 172.21.15.110:0/974270629 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc004290 con 0x7f15bc004510 2021-03-25T14:16:45.608 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.599+0000 7f15c3fff700 1 -- 172.21.15.110:0/974270629 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc00bc50 con 0x7f15bc004e80 2021-03-25T14:16:45.608 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.600+0000 7f15d9474700 1 --2- 172.21.15.110:0/974270629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15bc003760 0x7f15bc003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:45.608 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.600+0000 7f15d8c73700 1 --2- 172.21.15.110:0/974270629 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15bc004510 0x7f15bc004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:45.608 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.600+0000 7f15d9c75700 1 --2- 172.21.15.110:0/974270629 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f15bc004e80 0x7f15bc00b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:45.609 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.600+0000 7f15d9474700 1 -- 172.21.15.110:0/974270629 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f15bc004e80 msgr2=0x7f15bc00b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:45.609 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.600+0000 7f15d9474700 1 --2- 172.21.15.110:0/974270629 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f15bc004e80 0x7f15bc00b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:45.609 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.600+0000 7f15d9474700 1 -- 172.21.15.110:0/974270629 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15bc004510 msgr2=0x7f15bc004990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:45.609 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.600+0000 7f15d9474700 1 --2- 172.21.15.110:0/974270629 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15bc004510 0x7f15bc004990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:45.609 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.600+0000 7f15d9474700 1 -- 172.21.15.110:0/974270629 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15bc003270 con 0x7f15bc003760 2021-03-25T14:16:45.609 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.600+0000 7f15d8c73700 1 --2- 172.21.15.110:0/974270629 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15bc004510 0x7f15bc004990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:45.609 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.600+0000 7f15d9c75700 1 -- 172.21.15.110:0/974270629 reap_dead start 2021-03-25T14:16:45.609 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.600+0000 7f15d9474700 1 --2- 172.21.15.110:0/974270629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15bc003760 0x7f15bc003b80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f15c400c440 tx=0x7f15d4149ff0).ready entity=mon.0 client_cookie=1d7acd3e5c8732d server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:45.609 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.600+0000 7f15c3fff700 1 -- 172.21.15.110:0/974270629 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c400ce20 con 0x7f15bc003760 2021-03-25T14:16:45.609 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.600+0000 7f15c3fff700 1 -- 172.21.15.110:0/974270629 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c40072e0 con 0x7f15bc003760 2021-03-25T14:16:45.609 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.600+0000 7f15c3fff700 1 -- 172.21.15.110:0/974270629 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c4005870 con 0x7f15bc003760 2021-03-25T14:16:45.609 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.600+0000 7f15db6d8700 1 -- 172.21.15.110:0/974270629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15bc003760 msgr2=0x7f15bc003b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:45.610 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.600+0000 7f15db6d8700 1 --2- 172.21.15.110:0/974270629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15bc003760 0x7f15bc003b80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f15c400c440 tx=0x7f15d4149ff0).stop 2021-03-25T14:16:45.610 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.600+0000 7f15db6d8700 1 -- 172.21.15.110:0/974270629 shutdown_connections 2021-03-25T14:16:45.610 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.600+0000 7f15db6d8700 1 --2- 172.21.15.110:0/974270629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15bc003760 0x7f15bc003b80 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:45.610 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.600+0000 7f15db6d8700 1 -- 172.21.15.110:0/974270629 >> 172.21.15.110:0/974270629 conn(0x7f15d4060c40 msgr2=0x7f15d4061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:45.610 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.601+0000 7f15db6d8700 1 -- 172.21.15.110:0/974270629 shutdown_connections 2021-03-25T14:16:45.610 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.601+0000 7f15db6d8700 1 -- 172.21.15.110:0/974270629 wait complete. 2021-03-25T14:16:45.610 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.602+0000 7f15db6d8700 1 Processor -- start 2021-03-25T14:16:45.610 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.602+0000 7f15db6d8700 1 -- start start 2021-03-25T14:16:45.610 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.602+0000 7f15db6d8700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15bc003760 0x7f15d40bc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:45.610 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.602+0000 7f15db6d8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f15d414a6c0 0x7f15d414ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:45.610 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.602+0000 7f15db6d8700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15d414b030 0x7f15d415c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:45.611 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.602+0000 7f15db6d8700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d4158fd0 con 0x7f15d414b030 2021-03-25T14:16:45.611 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.602+0000 7f15db6d8700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d40b6060 con 0x7f15bc003760 2021-03-25T14:16:45.611 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.602+0000 7f15db6d8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d414d140 con 0x7f15d414a6c0 2021-03-25T14:16:45.611 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.603+0000 7f15d9c75700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15d414b030 0x7f15d415c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:45.611 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.603+0000 7f15d9c75700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15d414b030 0x7f15d415c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48576/0 (socket says 172.21.15.110:48576) 2021-03-25T14:16:45.611 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.603+0000 7f15d9c75700 1 -- 172.21.15.110:0/2617877355 learned_addr learned my addr 172.21.15.110:0/2617877355 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:45.611 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.603+0000 7f15d9474700 1 --2- 172.21.15.110:0/2617877355 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15bc003760 0x7f15d40bc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:45.611 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.603+0000 7f15d8c73700 1 --2- 172.21.15.110:0/2617877355 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f15d414a6c0 0x7f15d414ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:45.611 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.603+0000 7f15d9c75700 1 -- 172.21.15.110:0/2617877355 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f15d414a6c0 msgr2=0x7f15d414ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:45.611 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.603+0000 7f15d9c75700 1 --2- 172.21.15.110:0/2617877355 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f15d414a6c0 0x7f15d414ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:45.612 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.603+0000 7f15d9c75700 1 -- 172.21.15.110:0/2617877355 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15bc003760 msgr2=0x7f15d40bc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:45.612 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.603+0000 7f15d9c75700 1 --2- 172.21.15.110:0/2617877355 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15bc003760 0x7f15d40bc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:45.612 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.603+0000 7f15d9c75700 1 -- 172.21.15.110:0/2617877355 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d40b4b70 con 0x7f15d414b030 2021-03-25T14:16:45.612 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.603+0000 7f15d9c75700 1 --2- 172.21.15.110:0/2617877355 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15d414b030 0x7f15d415c520 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f15d4066210 tx=0x7f15cc009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:45.612 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.603+0000 7f15c17fa700 1 -- 172.21.15.110:0/2617877355 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15cc003280 con 0x7f15d414b030 2021-03-25T14:16:45.612 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.603+0000 7f15c17fa700 1 -- 172.21.15.110:0/2617877355 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15cc0033e0 con 0x7f15d414b030 2021-03-25T14:16:45.612 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.603+0000 7f15c17fa700 1 -- 172.21.15.110:0/2617877355 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15cc006ad0 con 0x7f15d414b030 2021-03-25T14:16:45.612 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.603+0000 7f15db6d8700 1 -- 172.21.15.110:0/2617877355 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15d40b6290 con 0x7f15d414b030 2021-03-25T14:16:45.612 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.603+0000 7f15db6d8700 1 -- 172.21.15.110:0/2617877355 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15d40b4e10 con 0x7f15d414b030 2021-03-25T14:16:45.612 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.604+0000 7f15db6d8700 1 -- 172.21.15.110:0/2617877355 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15d405d7b0 con 0x7f15d414b030 2021-03-25T14:16:45.612 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.604+0000 7f15c17fa700 1 -- 172.21.15.110:0/2617877355 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f15cc01e070 con 0x7f15d414b030 2021-03-25T14:16:45.612 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.605+0000 7f15c17fa700 1 --2- 172.21.15.110:0/2617877355 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f15b405a0b0 0x7f15b405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:45.612 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.605+0000 7f15c17fa700 1 -- 172.21.15.110:0/2617877355 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f15cc073430 con 0x7f15d414b030 2021-03-25T14:16:45.613 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.605+0000 7f15d9474700 1 --2- 172.21.15.110:0/2617877355 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f15b405a0b0 0x7f15b405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:45.613 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.605+0000 7f15d9474700 1 --2- 172.21.15.110:0/2617877355 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f15b405a0b0 0x7f15b405c570 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f15c40078d0 tx=0x7f15c4015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:45.613 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.608+0000 7f15c17fa700 1 -- 172.21.15.110:0/2617877355 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f15cc046ae0 con 0x7f15d414b030 2021-03-25T14:16:45.759 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.757+0000 7f15db6d8700 1 -- 172.21.15.110:0/2617877355 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f15d4061fe0 con 0x7f15d414b030 2021-03-25T14:16:45.759 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.757+0000 7f15c17fa700 1 -- 172.21.15.110:0/2617877355 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+10 (secure 0 0 0) 0x7f15cc04a100 con 0x7f15d414b030 2021-03-25T14:16:45.759 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:16:45.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.759+0000 7f15db6d8700 1 -- 172.21.15.110:0/2617877355 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f15b405a0b0 msgr2=0x7f15b405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:45.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.759+0000 7f15db6d8700 1 --2- 172.21.15.110:0/2617877355 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f15b405a0b0 0x7f15b405c570 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f15c40078d0 tx=0x7f15c4015000).stop 2021-03-25T14:16:45.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.759+0000 7f15db6d8700 1 -- 172.21.15.110:0/2617877355 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15d414b030 msgr2=0x7f15d415c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:45.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.759+0000 7f15db6d8700 1 --2- 172.21.15.110:0/2617877355 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15d414b030 0x7f15d415c520 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f15d4066210 tx=0x7f15cc009040).stop 2021-03-25T14:16:45.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.759+0000 7f15db6d8700 1 -- 172.21.15.110:0/2617877355 shutdown_connections 2021-03-25T14:16:45.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.759+0000 7f15db6d8700 1 --2- 172.21.15.110:0/2617877355 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f15b405a0b0 0x7f15b405c570 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:45.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.759+0000 7f15db6d8700 1 --2- 172.21.15.110:0/2617877355 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15bc003760 0x7f15d40bc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:45.762 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.759+0000 7f15db6d8700 1 --2- 172.21.15.110:0/2617877355 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15d414b030 0x7f15d415c520 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:45.762 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.759+0000 7f15db6d8700 1 --2- 172.21.15.110:0/2617877355 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f15d414a6c0 0x7f15d414ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:45.762 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.759+0000 7f15db6d8700 1 -- 172.21.15.110:0/2617877355 >> 172.21.15.110:0/2617877355 conn(0x7f15d4060c40 msgr2=0x7f15d4148050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:45.762 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.759+0000 7f15db6d8700 1 -- 172.21.15.110:0/2617877355 shutdown_connections 2021-03-25T14:16:45.762 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.759+0000 7f15db6d8700 1 -- 172.21.15.110:0/2617877355 wait complete. 2021-03-25T14:16:45.774 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:16:45.884 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.882+0000 7f5bae972700 1 Processor -- start 2021-03-25T14:16:45.884 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.882+0000 7f5bae972700 1 -- start start 2021-03-25T14:16:45.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.882+0000 7f5bae972700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ba80b0b60 0x7f5ba8146650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:45.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.882+0000 7f5bae972700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5ba8063410 0x7f5ba80638c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:45.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.882+0000 7f5bae972700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ba8067050 con 0x7f5ba8068940 2021-03-25T14:16:45.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.882+0000 7f5bae972700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ba80694b0 con 0x7f5ba8063410 2021-03-25T14:16:45.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.882+0000 7f5bae972700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba8146b40 con 0x7f5ba80b0b60 2021-03-25T14:16:45.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.883+0000 7f5bad970700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ba80b0b60 0x7f5ba8146650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:45.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.883+0000 7f5bae171700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5ba8063410 0x7f5ba80638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:45.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.883+0000 7f5bad16f700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f5ba8068940 0x7f5ba8068da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.110:49182/0 (socket says 172.21.15.110:49182) 2021-03-25T14:16:45.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.883+0000 7f5bad16f700 1 -- 172.21.15.110:0/2615866327 learned_addr learned my addr 172.21.15.110:0/2615866327 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:45.888 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.883+0000 7f5bad970700 1 -- 172.21.15.110:0/2615866327 >> v2:172.21.15.174:3300/0 conn(0x7f5ba8063410 msgr2=0x7f5ba80638c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:45.888 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.883+0000 7f5bad970700 1 --2- 172.21.15.110:0/2615866327 >> v2:172.21.15.174:3300/0 conn(0x7f5ba8063410 0x7f5ba80638c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:45.888 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.883+0000 7f5bad970700 1 -- 172.21.15.110:0/2615866327 >> v1:172.21.15.174:6789/0 conn(0x7f5ba8068940 legacy=0x7f5ba8068da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:45.888 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.883+0000 7f5bac96e700 1 -- 172.21.15.110:0/2615866327 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 291305070 0 0) 0x7f5ba8067050 con 0x7f5ba8068940 2021-03-25T14:16:45.888 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.883+0000 7f5bad970700 1 -- 172.21.15.110:0/2615866327 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba80b7490 con 0x7f5ba80b0b60 2021-03-25T14:16:45.888 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.883+0000 7f5bae171700 1 --2- 172.21.15.110:0/2615866327 >> v2:172.21.15.174:3300/0 conn(0x7f5ba8063410 0x7f5ba80638c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:16:45.888 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.883+0000 7f5bad970700 1 --2- 172.21.15.110:0/2615866327 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ba80b0b60 0x7f5ba8146650 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f5ba400b9c0 tx=0x7f5ba4006e20).ready entity=mon.2 client_cookie=29dbbf438c65823f server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:45.888 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.884+0000 7f5bac96e700 1 -- 172.21.15.110:0/2615866327 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4009870 con 0x7f5ba80b0b60 2021-03-25T14:16:45.888 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.884+0000 7f5bac96e700 1 -- 172.21.15.110:0/2615866327 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba40099d0 con 0x7f5ba80b0b60 2021-03-25T14:16:45.888 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.884+0000 7f5bac96e700 1 -- 172.21.15.110:0/2615866327 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4009d50 con 0x7f5ba80b0b60 2021-03-25T14:16:45.888 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.884+0000 7f5bae972700 1 -- 172.21.15.110:0/2615866327 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ba80b0b60 msgr2=0x7f5ba8146650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:45.888 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.884+0000 7f5bae972700 1 --2- 172.21.15.110:0/2615866327 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ba80b0b60 0x7f5ba8146650 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f5ba400b9c0 tx=0x7f5ba4006e20).stop 2021-03-25T14:16:45.889 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.884+0000 7f5bae972700 1 -- 172.21.15.110:0/2615866327 shutdown_connections 2021-03-25T14:16:45.889 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.884+0000 7f5bae972700 1 --2- 172.21.15.110:0/2615866327 >> v2:172.21.15.174:3300/0 conn(0x7f5ba8063410 0x7f5ba80638c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:45.889 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.884+0000 7f5bae972700 1 --2- 172.21.15.110:0/2615866327 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ba80b0b60 0x7f5ba8146650 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:45.889 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.884+0000 7f5bae972700 1 -- 172.21.15.110:0/2615866327 >> 172.21.15.110:0/2615866327 conn(0x7f5ba8066350 msgr2=0x7f5ba8066760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:45.889 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.884+0000 7f5bae972700 1 -- 172.21.15.110:0/2615866327 shutdown_connections 2021-03-25T14:16:45.889 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.884+0000 7f5bae972700 1 -- 172.21.15.110:0/2615866327 wait complete. 2021-03-25T14:16:45.892 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.885+0000 7f5bae972700 1 Processor -- start 2021-03-25T14:16:45.892 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.885+0000 7f5bae972700 1 -- start start 2021-03-25T14:16:45.892 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.886+0000 7f5bae972700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ba8063410 0x7f5ba8145ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:45.892 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.886+0000 7f5bae972700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ba8068940 0x7f5ba80b47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:45.892 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.886+0000 7f5bae972700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ba80b0b60 0x7f5ba80b4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:45.893 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.886+0000 7f5bae972700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba8147eb0 con 0x7f5ba8068940 2021-03-25T14:16:45.893 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.886+0000 7f5bae972700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba8148ba0 con 0x7f5ba8063410 2021-03-25T14:16:45.893 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.886+0000 7f5bae972700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba8149c90 con 0x7f5ba80b0b60 2021-03-25T14:16:45.893 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.886+0000 7f5bad16f700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ba8068940 0x7f5ba80b47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:45.893 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.886+0000 7f5bad970700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ba8063410 0x7f5ba8145ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:45.893 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.886+0000 7f5bad16f700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ba8068940 0x7f5ba80b47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48588/0 (socket says 172.21.15.110:48588) 2021-03-25T14:16:45.893 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.886+0000 7f5bad16f700 1 -- 172.21.15.110:0/3885983037 learned_addr learned my addr 172.21.15.110:0/3885983037 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:45.894 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.886+0000 7f5bae171700 1 --2- 172.21.15.110:0/3885983037 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ba80b0b60 0x7f5ba80b4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:45.894 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.887+0000 7f5bad16f700 1 -- 172.21.15.110:0/3885983037 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ba80b0b60 msgr2=0x7f5ba80b4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:45.894 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.887+0000 7f5bad16f700 1 --2- 172.21.15.110:0/3885983037 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ba80b0b60 0x7f5ba80b4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:45.894 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.887+0000 7f5bad16f700 1 -- 172.21.15.110:0/3885983037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ba8063410 msgr2=0x7f5ba8145ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:45.894 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.887+0000 7f5bad16f700 1 --2- 172.21.15.110:0/3885983037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ba8063410 0x7f5ba8145ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:45.894 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.887+0000 7f5bad16f700 1 -- 172.21.15.110:0/3885983037 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba8149f30 con 0x7f5ba8068940 2021-03-25T14:16:45.894 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.887+0000 7f5bad16f700 1 --2- 172.21.15.110:0/3885983037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ba8068940 0x7f5ba80b47a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f5b9800c710 tx=0x7f5b98007ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:45.894 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.887+0000 7f5b95ffb700 1 -- 172.21.15.110:0/3885983037 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b980072e0 con 0x7f5ba8068940 2021-03-25T14:16:45.894 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.887+0000 7f5bae972700 1 -- 172.21.15.110:0/3885983037 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ba81483c0 con 0x7f5ba8068940 2021-03-25T14:16:45.894 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.887+0000 7f5b95ffb700 1 -- 172.21.15.110:0/3885983037 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b98007440 con 0x7f5ba8068940 2021-03-25T14:16:45.894 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.887+0000 7f5b95ffb700 1 -- 172.21.15.110:0/3885983037 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b98005830 con 0x7f5ba8068940 2021-03-25T14:16:45.895 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.887+0000 7f5bae972700 1 -- 172.21.15.110:0/3885983037 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ba8148900 con 0x7f5ba8068940 2021-03-25T14:16:45.895 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.888+0000 7f5bae972700 1 -- 172.21.15.110:0/3885983037 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ba8045ae0 con 0x7f5ba8068940 2021-03-25T14:16:45.895 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.888+0000 7f5b95ffb700 1 -- 172.21.15.110:0/3885983037 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f5b9801a060 con 0x7f5ba8068940 2021-03-25T14:16:45.895 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.889+0000 7f5b95ffb700 1 --2- 172.21.15.110:0/3885983037 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5b8805a0b0 0x7f5b8805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:45.895 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.889+0000 7f5b95ffb700 1 -- 172.21.15.110:0/3885983037 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f5b98073a30 con 0x7f5ba8068940 2021-03-25T14:16:45.895 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.889+0000 7f5bad970700 1 --2- 172.21.15.110:0/3885983037 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5b8805a0b0 0x7f5b8805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:45.895 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.889+0000 7f5bad970700 1 --2- 172.21.15.110:0/3885983037 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5b8805a0b0 0x7f5b8805c570 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f5ba4007fd0 tx=0x7f5ba4016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:45.896 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:45.892+0000 7f5b95ffb700 1 -- 172.21.15.110:0/3885983037 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f5b98046fd0 con 0x7f5ba8068940 2021-03-25T14:16:46.042 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.041+0000 7f5bae972700 1 -- 172.21.15.110:0/3885983037 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ba8061c50 con 0x7f5ba8068940 2021-03-25T14:16:46.043 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.041+0000 7f5b95ffb700 1 -- 172.21.15.110:0/3885983037 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18685 (secure 0 0 0) 0x7f5b98018070 con 0x7f5ba8068940 2021-03-25T14:16:46.044 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:16:46.044 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":25,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:16:15.446609+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-03-25T14:16:09.478442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-03-25T14:16:10.071152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2021-03-25T14:16:13.122119+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:16:46.045 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.043+0000 7f5bae972700 1 -- 172.21.15.110:0/3885983037 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5b8805a0b0 msgr2=0x7f5b8805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:46.045 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.043+0000 7f5bae972700 1 --2- 172.21.15.110:0/3885983037 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5b8805a0b0 0x7f5b8805c570 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f5ba4007fd0 tx=0x7f5ba4016000).stop 2021-03-25T14:16:46.046 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.043+0000 7f5bae972700 1 -- 172.21.15.110:0/3885983037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ba8068940 msgr2=0x7f5ba80b47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:46.046 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.043+0000 7f5bae972700 1 --2- 172.21.15.110:0/3885983037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ba8068940 0x7f5ba80b47a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f5b9800c710 tx=0x7f5b98007ab0).stop 2021-03-25T14:16:46.046 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.043+0000 7f5bae972700 1 -- 172.21.15.110:0/3885983037 shutdown_connections 2021-03-25T14:16:46.046 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.043+0000 7f5bae972700 1 --2- 172.21.15.110:0/3885983037 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5b8805a0b0 0x7f5b8805c570 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:46.046 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.043+0000 7f5bae972700 1 --2- 172.21.15.110:0/3885983037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ba8063410 0x7f5ba8145ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:46.046 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.043+0000 7f5bae972700 1 --2- 172.21.15.110:0/3885983037 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ba80b0b60 0x7f5ba80b4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:46.046 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.043+0000 7f5bae972700 1 --2- 172.21.15.110:0/3885983037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ba8068940 0x7f5ba80b47a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:46.046 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.043+0000 7f5bae972700 1 -- 172.21.15.110:0/3885983037 >> 172.21.15.110:0/3885983037 conn(0x7f5ba8066350 msgr2=0x7f5ba8067b70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:46.047 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.043+0000 7f5bae972700 1 -- 172.21.15.110:0/3885983037 shutdown_connections 2021-03-25T14:16:46.047 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.043+0000 7f5bae972700 1 -- 172.21.15.110:0/3885983037 wait complete. 2021-03-25T14:16:46.057 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-03-25T14:15:59.047299+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-03-25T14:16:00.537926+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-03-25T14:16:09.478442+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-03-25T14:16:10.071152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2021-03-25T14:16:13.122119+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-03-25T14:16:46.058 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-03-25T14:16:46.171 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.169+0000 7fa4ed23e700 1 Processor -- start 2021-03-25T14:16:46.171 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.169+0000 7fa4ed23e700 1 -- start start 2021-03-25T14:16:46.178 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.170+0000 7fa4ed23e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4e8060e00 0x7fa4e80a2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:46.178 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.170+0000 7fa4ed23e700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4e80b6c90 con 0x7fa4e8068440 2021-03-25T14:16:46.178 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.170+0000 7fa4ed23e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4e814a080 con 0x7fa4e814da00 2021-03-25T14:16:46.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.170+0000 7fa4ed23e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e814deb0 con 0x7fa4e8060e00 2021-03-25T14:16:46.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.170+0000 7fa4e659c700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fa4e8068440 0x7fa4e8149970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41530/0 (socket says 172.21.15.110:41530) 2021-03-25T14:16:46.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.170+0000 7fa4e659c700 1 -- 172.21.15.110:0/91303393 learned_addr learned my addr 172.21.15.110:0/91303393 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:46.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.170+0000 7fa4e5d9b700 1 -- 172.21.15.110:0/91303393 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2412680924 0 0) 0x7fa4d0001110 con 0x7fa4e8068440 2021-03-25T14:16:46.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.170+0000 7fa4e5d9b700 1 -- 172.21.15.110:0/91303393 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4c8003270 con 0x7fa4e8068440 2021-03-25T14:16:46.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.170+0000 7fa4e6d9d700 1 --2- 172.21.15.110:0/91303393 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4e8060e00 0x7fa4e80a2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:46.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.170+0000 7fa4e5d9b700 1 -- 172.21.15.110:0/91303393 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2135539856 0 0) 0x7fa4c8003270 con 0x7fa4e8068440 2021-03-25T14:16:46.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.170+0000 7fa4e5d9b700 1 -- 172.21.15.110:0/91303393 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4e8060e00 msgr2=0x7fa4e80a2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:46.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.170+0000 7fa4e5d9b700 1 --2- 172.21.15.110:0/91303393 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4e8060e00 0x7fa4e80a2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:46.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.170+0000 7fa4e5d9b700 1 -- 172.21.15.110:0/91303393 >> v1:172.21.15.174:6789/0 conn(0x7fa4e814da00 legacy=0x7fa4e81434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:46.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.170+0000 7fa4e5d9b700 1 -- 172.21.15.110:0/91303393 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e8068ca0 con 0x7fa4e8068440 2021-03-25T14:16:46.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.170+0000 7fa4e5d9b700 1 -- 172.21.15.110:0/91303393 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7fa4d00016b0 con 0x7fa4e8068440 2021-03-25T14:16:46.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.171+0000 7fa4e5d9b700 1 -- 172.21.15.110:0/91303393 >> v1:172.21.15.110:6789/0 conn(0x7fa4e8068440 legacy=0x7fa4e8149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:46.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.171+0000 7fa4e5d9b700 1 --2- 172.21.15.110:0/91303393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4c8003790 0x7fa4c8003bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:46.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.171+0000 7fa4e5d9b700 1 --2- 172.21.15.110:0/91303393 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4c8004510 0x7fa4c8004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:46.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.171+0000 7fa4e5d9b700 1 --2- 172.21.15.110:0/91303393 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4e8060e00 0x7fa4c8004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:46.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.171+0000 7fa4e5d9b700 1 -- 172.21.15.110:0/91303393 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e814deb0 con 0x7fa4c8003790 2021-03-25T14:16:46.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.171+0000 7fa4e5d9b700 1 -- 172.21.15.110:0/91303393 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c80053c0 con 0x7fa4c8004510 2021-03-25T14:16:46.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.171+0000 7fa4e5d9b700 1 -- 172.21.15.110:0/91303393 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c8004350 con 0x7fa4e8060e00 2021-03-25T14:16:46.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.171+0000 7fa4e6d9d700 1 --2- 172.21.15.110:0/91303393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4c8003790 0x7fa4c8003bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:46.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.171+0000 7fa4e659c700 1 --2- 172.21.15.110:0/91303393 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4c8004510 0x7fa4c8004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:46.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.171+0000 7fa4e759e700 1 --2- 172.21.15.110:0/91303393 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4e8060e00 0x7fa4c8004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:46.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.171+0000 7fa4e6d9d700 1 -- 172.21.15.110:0/91303393 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4e8060e00 msgr2=0x7fa4c8004e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:46.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.171+0000 7fa4e6d9d700 1 --2- 172.21.15.110:0/91303393 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4e8060e00 0x7fa4c8004e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:46.181 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.171+0000 7fa4e6d9d700 1 -- 172.21.15.110:0/91303393 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4c8004510 msgr2=0x7fa4c8004990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:46.181 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.171+0000 7fa4e6d9d700 1 --2- 172.21.15.110:0/91303393 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4c8004510 0x7fa4c8004990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:46.181 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.171+0000 7fa4e6d9d700 1 -- 172.21.15.110:0/91303393 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c8003270 con 0x7fa4c8003790 2021-03-25T14:16:46.181 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.171+0000 7fa4e759e700 1 --2- 172.21.15.110:0/91303393 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4e8060e00 0x7fa4c8004e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:46.181 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.171+0000 7fa4e659c700 1 --2- 172.21.15.110:0/91303393 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4c8004510 0x7fa4c8004990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:46.181 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.171+0000 7fa4e6d9d700 1 --2- 172.21.15.110:0/91303393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4c8003790 0x7fa4c8003bb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fa4d800bab0 tx=0x7fa4d8008040).ready entity=mon.0 client_cookie=85a5479db56ea0a8 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:46.181 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.171+0000 7fa4e5d9b700 1 -- 172.21.15.110:0/91303393 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d800d930 con 0x7fa4c8003790 2021-03-25T14:16:46.181 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.171+0000 7fa4e5d9b700 1 -- 172.21.15.110:0/91303393 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d800da90 con 0x7fa4c8003790 2021-03-25T14:16:46.181 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.171+0000 7fa4e5d9b700 1 -- 172.21.15.110:0/91303393 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d800de10 con 0x7fa4c8003790 2021-03-25T14:16:46.181 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.172+0000 7fa4ed23e700 1 -- 172.21.15.110:0/91303393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4c8003790 msgr2=0x7fa4c8003bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:46.181 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.172+0000 7fa4ed23e700 1 --2- 172.21.15.110:0/91303393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4c8003790 0x7fa4c8003bb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fa4d800bab0 tx=0x7fa4d8008040).stop 2021-03-25T14:16:46.181 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.172+0000 7fa4e759e700 1 -- 172.21.15.110:0/91303393 reap_dead start 2021-03-25T14:16:46.182 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.172+0000 7fa4ed23e700 1 -- 172.21.15.110:0/91303393 shutdown_connections 2021-03-25T14:16:46.182 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.172+0000 7fa4ed23e700 1 -- 172.21.15.110:0/91303393 >> 172.21.15.110:0/91303393 conn(0x7fa4e8061d50 msgr2=0x7fa4e8062160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:46.182 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.172+0000 7fa4ed23e700 1 -- 172.21.15.110:0/91303393 shutdown_connections 2021-03-25T14:16:46.182 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.172+0000 7fa4ed23e700 1 -- 172.21.15.110:0/91303393 wait complete. 2021-03-25T14:16:46.182 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.173+0000 7fa4ed23e700 1 Processor -- start 2021-03-25T14:16:46.182 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.173+0000 7fa4ed23e700 1 -- start start 2021-03-25T14:16:46.182 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.174+0000 7fa4ed23e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4e81505e0 0x7fa4e815c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:46.182 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.174+0000 7fa4ed23e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4e80bd090 0x7fa4e81509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:46.182 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.174+0000 7fa4ed23e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4e80a1c30 0x7fa4e8145700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:46.182 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.174+0000 7fa4ed23e700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e80a13d0 con 0x7fa4e80bd090 2021-03-25T14:16:46.182 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.174+0000 7fa4ed23e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e8150eb0 con 0x7fa4e81505e0 2021-03-25T14:16:46.182 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.174+0000 7fa4ed23e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e80bc110 con 0x7fa4e80a1c30 2021-03-25T14:16:46.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.174+0000 7fa4e659c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4e80bd090 0x7fa4e81509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:46.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.174+0000 7fa4e659c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4e80bd090 0x7fa4e81509c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48608/0 (socket says 172.21.15.110:48608) 2021-03-25T14:16:46.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.174+0000 7fa4e659c700 1 -- 172.21.15.110:0/273364394 learned_addr learned my addr 172.21.15.110:0/273364394 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:46.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.174+0000 7fa4e6d9d700 1 --2- 172.21.15.110:0/273364394 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4e81505e0 0x7fa4e815c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:46.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.174+0000 7fa4e759e700 1 --2- 172.21.15.110:0/273364394 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4e80a1c30 0x7fa4e8145700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:46.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.174+0000 7fa4e659c700 1 -- 172.21.15.110:0/273364394 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4e80a1c30 msgr2=0x7fa4e8145700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:46.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.174+0000 7fa4e659c700 1 --2- 172.21.15.110:0/273364394 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4e80a1c30 0x7fa4e8145700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:46.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.174+0000 7fa4e659c700 1 -- 172.21.15.110:0/273364394 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4e81505e0 msgr2=0x7fa4e815c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:46.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.174+0000 7fa4e659c700 1 --2- 172.21.15.110:0/273364394 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4e81505e0 0x7fa4e815c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:46.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.174+0000 7fa4e659c700 1 -- 172.21.15.110:0/273364394 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e80bc3b0 con 0x7fa4e80bd090 2021-03-25T14:16:46.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.174+0000 7fa4e6d9d700 1 --2- 172.21.15.110:0/273364394 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4e81505e0 0x7fa4e815c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:46.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.174+0000 7fa4e759e700 1 --2- 172.21.15.110:0/273364394 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4e80a1c30 0x7fa4e8145700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:46.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.174+0000 7fa4e659c700 1 --2- 172.21.15.110:0/273364394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4e80bd090 0x7fa4e81509c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fa4d0005bb0 tx=0x7fa4d0001760).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:46.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.174+0000 7fa4deffd700 1 -- 172.21.15.110:0/273364394 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d000e9e0 con 0x7fa4e80bd090 2021-03-25T14:16:46.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.174+0000 7fa4deffd700 1 -- 172.21.15.110:0/273364394 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d000eb40 con 0x7fa4e80bd090 2021-03-25T14:16:46.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.174+0000 7fa4deffd700 1 -- 172.21.15.110:0/273364394 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0014430 con 0x7fa4e80bd090 2021-03-25T14:16:46.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.174+0000 7fa4ed23e700 1 -- 172.21.15.110:0/273364394 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4e80bc650 con 0x7fa4e80bd090 2021-03-25T14:16:46.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.174+0000 7fa4ed23e700 1 -- 172.21.15.110:0/273364394 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4e80bdb40 con 0x7fa4e80bd090 2021-03-25T14:16:46.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.175+0000 7fa4ed23e700 1 -- 172.21.15.110:0/273364394 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4e80a15f0 con 0x7fa4e80bd090 2021-03-25T14:16:46.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.175+0000 7fa4deffd700 1 -- 172.21.15.110:0/273364394 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fa4d00147a0 con 0x7fa4e80bd090 2021-03-25T14:16:46.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.176+0000 7fa4deffd700 1 --2- 172.21.15.110:0/273364394 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa4cc05a0b0 0x7fa4cc05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:46.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.176+0000 7fa4deffd700 1 -- 172.21.15.110:0/273364394 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fa4d0073eb0 con 0x7fa4e80bd090 2021-03-25T14:16:46.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.176+0000 7fa4e6d9d700 1 --2- 172.21.15.110:0/273364394 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa4cc05a0b0 0x7fa4cc05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:46.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.176+0000 7fa4e6d9d700 1 --2- 172.21.15.110:0/273364394 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa4cc05a0b0 0x7fa4cc05c570 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fa4e8061d00 tx=0x7fa4d8008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:46.185 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.179+0000 7fa4deffd700 1 -- 172.21.15.110:0/273364394 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fa4d0046620 con 0x7fa4e80bd090 2021-03-25T14:16:46.332 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.330+0000 7fa4ed23e700 1 -- 172.21.15.110:0/273364394 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fa4e80b6c90 con 0x7fa4e80bd090 2021-03-25T14:16:46.332 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.330+0000 7fa4deffd700 1 -- 172.21.15.110:0/273364394 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7fa4d0022020 con 0x7fa4e80bd090 2021-03-25T14:16:46.332 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 1 2021-03-25T14:16:46.334 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.331+0000 7fa4ed23e700 1 -- 172.21.15.110:0/273364394 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa4cc05a0b0 msgr2=0x7fa4cc05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:46.334 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.331+0000 7fa4ed23e700 1 --2- 172.21.15.110:0/273364394 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa4cc05a0b0 0x7fa4cc05c570 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fa4e8061d00 tx=0x7fa4d8008040).stop 2021-03-25T14:16:46.334 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.331+0000 7fa4ed23e700 1 -- 172.21.15.110:0/273364394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4e80bd090 msgr2=0x7fa4e81509c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:46.334 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.331+0000 7fa4ed23e700 1 --2- 172.21.15.110:0/273364394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4e80bd090 0x7fa4e81509c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fa4d0005bb0 tx=0x7fa4d0001760).stop 2021-03-25T14:16:46.334 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.332+0000 7fa4ed23e700 1 -- 172.21.15.110:0/273364394 shutdown_connections 2021-03-25T14:16:46.334 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.332+0000 7fa4ed23e700 1 --2- 172.21.15.110:0/273364394 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa4cc05a0b0 0x7fa4cc05c570 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:46.334 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.332+0000 7fa4ed23e700 1 --2- 172.21.15.110:0/273364394 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4e81505e0 0x7fa4e815c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:46.334 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.332+0000 7fa4ed23e700 1 --2- 172.21.15.110:0/273364394 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4e80a1c30 0x7fa4e8145700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:46.335 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.332+0000 7fa4ed23e700 1 --2- 172.21.15.110:0/273364394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4e80bd090 0x7fa4e81509c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:46.335 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.332+0000 7fa4ed23e700 1 -- 172.21.15.110:0/273364394 >> 172.21.15.110:0/273364394 conn(0x7fa4e8061d50 msgr2=0x7fa4e8149590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:46.335 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.332+0000 7fa4ed23e700 1 -- 172.21.15.110:0/273364394 shutdown_connections 2021-03-25T14:16:46.335 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.332+0000 7fa4ed23e700 1 -- 172.21.15.110:0/273364394 wait complete. 2021-03-25T14:16:46.345 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-03-25T14:16:46.457 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.455+0000 7f6dc25d4700 1 Processor -- start 2021-03-25T14:16:46.457 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.456+0000 7f6dc25d4700 1 -- start start 2021-03-25T14:16:46.461 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.456+0000 7f6dc25d4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6dbc0bb660 0x7f6dbc0ba9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:46.461 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.456+0000 7f6dc25d4700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dbc0b1920 con 0x7f6dbc0bc110 2021-03-25T14:16:46.461 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.456+0000 7f6dc25d4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dbc0bc620 con 0x7f6dbc14cdc0 2021-03-25T14:16:46.462 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.456+0000 7f6dc25d4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc068850 con 0x7f6dbc0bb660 2021-03-25T14:16:46.462 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.456+0000 7f6dc0dd1700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f6dbc0bc110 0x7f6dbc067620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41550/0 (socket says 172.21.15.110:41550) 2021-03-25T14:16:46.462 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.456+0000 7f6dc0dd1700 1 -- 172.21.15.110:0/4201387220 learned_addr learned my addr 172.21.15.110:0/4201387220 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:46.462 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.457+0000 7f6dabfff700 1 -- 172.21.15.110:0/4201387220 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 326102416 0 0) 0x7f6dbc0b1920 con 0x7f6dbc0bc110 2021-03-25T14:16:46.462 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.457+0000 7f6dc15d2700 1 --2- 172.21.15.110:0/4201387220 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6dbc0bb660 0x7f6dbc0ba9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:46.462 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.457+0000 7f6dabfff700 1 -- 172.21.15.110:0/4201387220 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6da4003270 con 0x7f6dbc0bc110 2021-03-25T14:16:46.462 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.457+0000 7f6dabfff700 1 -- 172.21.15.110:0/4201387220 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 6547084 0 0) 0x7f6da4003270 con 0x7f6dbc0bc110 2021-03-25T14:16:46.462 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.457+0000 7f6dabfff700 1 -- 172.21.15.110:0/4201387220 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6dbc0bb660 msgr2=0x7f6dbc0ba9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:46.462 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.457+0000 7f6dabfff700 1 --2- 172.21.15.110:0/4201387220 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6dbc0bb660 0x7f6dbc0ba9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:46.462 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.457+0000 7f6dabfff700 1 -- 172.21.15.110:0/4201387220 >> v1:172.21.15.174:6789/0 conn(0x7f6dbc14cdc0 legacy=0x7f6dbc148c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:46.462 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.457+0000 7f6dabfff700 1 -- 172.21.15.110:0/4201387220 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dbc0b13e0 con 0x7f6dbc0bc110 2021-03-25T14:16:46.462 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.457+0000 7f6dabfff700 1 -- 172.21.15.110:0/4201387220 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f6dac001520 con 0x7f6dbc0bc110 2021-03-25T14:16:46.463 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.457+0000 7f6dabfff700 1 -- 172.21.15.110:0/4201387220 >> v1:172.21.15.110:6789/0 conn(0x7f6dbc0bc110 legacy=0x7f6dbc067620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:46.463 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.457+0000 7f6dabfff700 1 --2- 172.21.15.110:0/4201387220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6da4003790 0x7f6da4003bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:46.463 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.457+0000 7f6dabfff700 1 --2- 172.21.15.110:0/4201387220 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6dbc0bb660 0x7f6da4004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:46.463 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.457+0000 7f6dabfff700 1 --2- 172.21.15.110:0/4201387220 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6da4004a00 0x7f6da4004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:46.463 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.457+0000 7f6dabfff700 1 -- 172.21.15.110:0/4201387220 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc068850 con 0x7f6da4003790 2021-03-25T14:16:46.463 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.457+0000 7f6dabfff700 1 -- 172.21.15.110:0/4201387220 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da4004230 con 0x7f6da4004a00 2021-03-25T14:16:46.463 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.457+0000 7f6dabfff700 1 -- 172.21.15.110:0/4201387220 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da400b760 con 0x7f6dbc0bb660 2021-03-25T14:16:46.463 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.457+0000 7f6dc15d2700 1 --2- 172.21.15.110:0/4201387220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6da4003790 0x7f6da4003bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:46.463 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.457+0000 7f6dc0dd1700 1 --2- 172.21.15.110:0/4201387220 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6dbc0bb660 0x7f6da4004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:46.463 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.457+0000 7f6dc1dd3700 1 --2- 172.21.15.110:0/4201387220 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6da4004a00 0x7f6da4004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:46.463 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.457+0000 7f6dc15d2700 1 -- 172.21.15.110:0/4201387220 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6dbc0bb660 msgr2=0x7f6da4004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:46.463 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.457+0000 7f6dc15d2700 1 --2- 172.21.15.110:0/4201387220 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6dbc0bb660 0x7f6da4004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:46.463 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.457+0000 7f6dc15d2700 1 -- 172.21.15.110:0/4201387220 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6da4004a00 msgr2=0x7f6da4004e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:46.464 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.457+0000 7f6dc15d2700 1 --2- 172.21.15.110:0/4201387220 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6da4004a00 0x7f6da4004e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:46.464 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.457+0000 7f6dc15d2700 1 -- 172.21.15.110:0/4201387220 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da4003270 con 0x7f6da4003790 2021-03-25T14:16:46.464 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.457+0000 7f6dc1dd3700 1 --2- 172.21.15.110:0/4201387220 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6da4004a00 0x7f6da4004e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:46.464 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.457+0000 7f6dc0dd1700 1 --2- 172.21.15.110:0/4201387220 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6dbc0bb660 0x7f6da4004510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:46.464 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.458+0000 7f6dc15d2700 1 --2- 172.21.15.110:0/4201387220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6da4003790 0x7f6da4003bb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f6db800bc30 tx=0x7f6db8006e20).ready entity=mon.0 client_cookie=ac86bb61d0d80e7d server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:46.464 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.458+0000 7f6dabfff700 1 -- 172.21.15.110:0/4201387220 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db800b310 con 0x7f6da4003790 2021-03-25T14:16:46.464 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.458+0000 7f6dabfff700 1 -- 172.21.15.110:0/4201387220 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db800eab0 con 0x7f6da4003790 2021-03-25T14:16:46.464 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.458+0000 7f6dabfff700 1 -- 172.21.15.110:0/4201387220 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db800ee30 con 0x7f6da4003790 2021-03-25T14:16:46.464 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.458+0000 7f6dc25d4700 1 -- 172.21.15.110:0/4201387220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6da4003790 msgr2=0x7f6da4003bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:46.464 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.458+0000 7f6dc25d4700 1 --2- 172.21.15.110:0/4201387220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6da4003790 0x7f6da4003bb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f6db800bc30 tx=0x7f6db8006e20).stop 2021-03-25T14:16:46.464 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.458+0000 7f6dc1dd3700 1 -- 172.21.15.110:0/4201387220 reap_dead start 2021-03-25T14:16:46.464 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.458+0000 7f6dc25d4700 1 -- 172.21.15.110:0/4201387220 shutdown_connections 2021-03-25T14:16:46.465 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.458+0000 7f6dc25d4700 1 -- 172.21.15.110:0/4201387220 >> 172.21.15.110:0/4201387220 conn(0x7f6dbc063090 msgr2=0x7f6dbc0634a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:46.465 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.458+0000 7f6dc25d4700 1 -- 172.21.15.110:0/4201387220 shutdown_connections 2021-03-25T14:16:46.465 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.458+0000 7f6dc25d4700 1 -- 172.21.15.110:0/4201387220 wait complete. 2021-03-25T14:16:46.465 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.459+0000 7f6dc25d4700 1 Processor -- start 2021-03-25T14:16:46.465 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.459+0000 7f6dc25d4700 1 -- start start 2021-03-25T14:16:46.467 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.460+0000 7f6dc25d4700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6dbc14bef0 0x7f6dbc1427d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:46.467 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.460+0000 7f6dc25d4700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dbc0bddf0 0x7f6dbc142cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:46.468 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.460+0000 7f6dc25d4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6dbc0be210 0x7f6dbc15c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:46.468 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.460+0000 7f6dc25d4700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc0b35e0 con 0x7f6dbc0bddf0 2021-03-25T14:16:46.468 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.460+0000 7f6dc25d4700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc0beef0 con 0x7f6dbc14bef0 2021-03-25T14:16:46.468 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.460+0000 7f6dc25d4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc0c0530 con 0x7f6dbc0be210 2021-03-25T14:16:46.468 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.460+0000 7f6dc0dd1700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dbc0bddf0 0x7f6dbc142cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:46.468 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.460+0000 7f6dc0dd1700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dbc0bddf0 0x7f6dbc142cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48628/0 (socket says 172.21.15.110:48628) 2021-03-25T14:16:46.468 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.460+0000 7f6dc0dd1700 1 -- 172.21.15.110:0/1503485775 learned_addr learned my addr 172.21.15.110:0/1503485775 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:46.468 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.461+0000 7f6dc0dd1700 1 -- 172.21.15.110:0/1503485775 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6dbc0be210 msgr2=0x7f6dbc15c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:46.468 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.461+0000 7f6dc0dd1700 1 --2- 172.21.15.110:0/1503485775 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6dbc0be210 0x7f6dbc15c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:16:46.468 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.461+0000 7f6dc0dd1700 1 -- 172.21.15.110:0/1503485775 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6dbc14bef0 msgr2=0x7f6dbc1427d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:46.468 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.461+0000 7f6dc0dd1700 1 --2- 172.21.15.110:0/1503485775 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6dbc14bef0 0x7f6dbc1427d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:16:46.468 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.461+0000 7f6dc0dd1700 1 -- 172.21.15.110:0/1503485775 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dbc0c0790 con 0x7f6dbc0bddf0 2021-03-25T14:16:46.469 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.461+0000 7f6dc0dd1700 1 --2- 172.21.15.110:0/1503485775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dbc0bddf0 0x7f6dbc142cc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f6dac005c00 tx=0x7f6dac000d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:46.469 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.461+0000 7f6da97fa700 1 -- 172.21.15.110:0/1503485775 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac00ea20 con 0x7f6dbc0bddf0 2021-03-25T14:16:46.469 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.461+0000 7f6da97fa700 1 -- 172.21.15.110:0/1503485775 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dac00eb80 con 0x7f6dbc0bddf0 2021-03-25T14:16:46.469 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.461+0000 7f6dc25d4700 1 -- 172.21.15.110:0/1503485775 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dbc0c0a30 con 0x7f6dbc0bddf0 2021-03-25T14:16:46.469 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.461+0000 7f6da97fa700 1 -- 172.21.15.110:0/1503485775 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac014430 con 0x7f6dbc0bddf0 2021-03-25T14:16:46.469 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.461+0000 7f6dc25d4700 1 -- 172.21.15.110:0/1503485775 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dbc1431b0 con 0x7f6dbc0bddf0 2021-03-25T14:16:46.469 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.462+0000 7f6dc25d4700 1 -- 172.21.15.110:0/1503485775 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dbc045ae0 con 0x7f6dbc0bddf0 2021-03-25T14:16:46.469 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.462+0000 7f6da97fa700 1 -- 172.21.15.110:0/1503485775 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f6dac0011d0 con 0x7f6dbc0bddf0 2021-03-25T14:16:46.469 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.463+0000 7f6da97fa700 1 --2- 172.21.15.110:0/1503485775 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6d9c05a0e0 0x7f6d9c05c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:46.469 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.463+0000 7f6da97fa700 1 -- 172.21.15.110:0/1503485775 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f6dac073fe0 con 0x7f6dbc0bddf0 2021-03-25T14:16:46.469 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.463+0000 7f6dc15d2700 1 --2- 172.21.15.110:0/1503485775 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6d9c05a0e0 0x7f6d9c05c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:46.469 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.463+0000 7f6dc15d2700 1 --2- 172.21.15.110:0/1503485775 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6d9c05a0e0 0x7f6d9c05c5a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f6dbc061f60 tx=0x7f6db8019000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:46.470 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.466+0000 7f6da97fa700 1 -- 172.21.15.110:0/1503485775 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f6dac046620 con 0x7f6dbc0bddf0 2021-03-25T14:16:46.617 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.615+0000 7f6dc25d4700 1 -- 172.21.15.110:0/1503485775 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6dbc05d070 con 0x7f6dbc0bddf0 2021-03-25T14:16:46.618 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.616+0000 7f6da97fa700 1 -- 172.21.15.110:0/1503485775 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6dac047690 con 0x7f6dbc0bddf0 2021-03-25T14:16:46.618 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:16:46.620 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.617+0000 7f6dc25d4700 1 -- 172.21.15.110:0/1503485775 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6d9c05a0e0 msgr2=0x7f6d9c05c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:46.620 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.617+0000 7f6dc25d4700 1 --2- 172.21.15.110:0/1503485775 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6d9c05a0e0 0x7f6d9c05c5a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f6dbc061f60 tx=0x7f6db8019000).stop 2021-03-25T14:16:46.620 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.617+0000 7f6dc25d4700 1 -- 172.21.15.110:0/1503485775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dbc0bddf0 msgr2=0x7f6dbc142cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:46.620 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.617+0000 7f6dc25d4700 1 --2- 172.21.15.110:0/1503485775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dbc0bddf0 0x7f6dbc142cc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f6dac005c00 tx=0x7f6dac000d70).stop 2021-03-25T14:16:46.620 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.617+0000 7f6dc25d4700 1 -- 172.21.15.110:0/1503485775 shutdown_connections 2021-03-25T14:16:46.620 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.617+0000 7f6dc25d4700 1 --2- 172.21.15.110:0/1503485775 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6d9c05a0e0 0x7f6d9c05c5a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:46.620 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.617+0000 7f6dc25d4700 1 --2- 172.21.15.110:0/1503485775 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6dbc14bef0 0x7f6dbc1427d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:16:46.620 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.617+0000 7f6dc25d4700 1 --2- 172.21.15.110:0/1503485775 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6dbc0be210 0x7f6dbc15c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:16:46.621 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.617+0000 7f6dc25d4700 1 --2- 172.21.15.110:0/1503485775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dbc0bddf0 0x7f6dbc142cc0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:46.621 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.617+0000 7f6dc25d4700 1 -- 172.21.15.110:0/1503485775 >> 172.21.15.110:0/1503485775 conn(0x7f6dbc063090 msgr2=0x7f6dbc146e60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:46.621 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.618+0000 7f6dc25d4700 1 -- 172.21.15.110:0/1503485775 shutdown_connections 2021-03-25T14:16:46.621 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.618+0000 7f6dc25d4700 1 -- 172.21.15.110:0/1503485775 wait complete. 2021-03-25T14:16:46.631 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-03-25T14:16:46.743 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.741+0000 7f70192c7700 1 Processor -- start 2021-03-25T14:16:46.744 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.742+0000 7f70192c7700 1 -- start start 2021-03-25T14:16:46.750 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.742+0000 7f70192c7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7014064850 0x7f70140a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:46.750 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.742+0000 7f70192c7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f701414a150 0x7f7014148750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:46.750 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.742+0000 7f70192c7700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70140a1fe0 con 0x7f70140b5450 2021-03-25T14:16:46.750 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.742+0000 7f70192c7700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7014067be0 con 0x7f7014064850 2021-03-25T14:16:46.750 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.742+0000 7f70192c7700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7014067dd0 con 0x7f701414a150 2021-03-25T14:16:46.750 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.742+0000 7f7013fff700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f70140b5450 0x7f7014149a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41570/0 (socket says 172.21.15.110:41570) 2021-03-25T14:16:46.750 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.742+0000 7f7013fff700 1 -- 172.21.15.110:0/223487568 learned_addr learned my addr 172.21.15.110:0/223487568 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:46.751 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.743+0000 7f7012ffd700 1 -- 172.21.15.110:0/223487568 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3782415600 0 0) 0x7f70140a1fe0 con 0x7f70140b5450 2021-03-25T14:16:46.751 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.743+0000 7f70137fe700 1 --2- 172.21.15.110:0/223487568 >> v2:172.21.15.174:3300/0 conn(0x7f7014064850 0x7f70140a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:46.751 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.743+0000 7f7012ffd700 1 -- 172.21.15.110:0/223487568 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ff4003270 con 0x7f70140b5450 2021-03-25T14:16:46.751 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.743+0000 7f7018ac6700 1 --2- 172.21.15.110:0/223487568 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f701414a150 0x7f7014148750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:46.751 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.743+0000 7f7012ffd700 1 -- 172.21.15.110:0/223487568 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1873190784 0 0) 0x7f6ff4003270 con 0x7f70140b5450 2021-03-25T14:16:46.751 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.743+0000 7f7012ffd700 1 -- 172.21.15.110:0/223487568 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f701414a150 msgr2=0x7f7014148750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:46.751 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.743+0000 7f7012ffd700 1 --2- 172.21.15.110:0/223487568 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f701414a150 0x7f7014148750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:46.751 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.743+0000 7f7012ffd700 1 -- 172.21.15.110:0/223487568 >> v2:172.21.15.174:3300/0 conn(0x7f7014064850 msgr2=0x7f70140a1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:46.751 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.743+0000 7f7012ffd700 1 --2- 172.21.15.110:0/223487568 >> v2:172.21.15.174:3300/0 conn(0x7f7014064850 0x7f70140a1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:46.751 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.743+0000 7f7012ffd700 1 -- 172.21.15.110:0/223487568 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7014068070 con 0x7f70140b5450 2021-03-25T14:16:46.751 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.743+0000 7f7012ffd700 1 -- 172.21.15.110:0/223487568 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f7004001520 con 0x7f70140b5450 2021-03-25T14:16:46.752 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.743+0000 7f7012ffd700 1 -- 172.21.15.110:0/223487568 >> v1:172.21.15.110:6789/0 conn(0x7f70140b5450 legacy=0x7f7014149a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:46.752 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.743+0000 7f7012ffd700 1 --2- 172.21.15.110:0/223487568 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f701414a150 0x7f6ff4003760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:46.752 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.743+0000 7f7012ffd700 1 --2- 172.21.15.110:0/223487568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ff4003c70 0x7f6ff4004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:46.752 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.743+0000 7f7012ffd700 1 --2- 172.21.15.110:0/223487568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ff4004a00 0x7f6ff4004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:46.752 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.743+0000 7f7012ffd700 1 -- 172.21.15.110:0/223487568 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7014067dd0 con 0x7f6ff4003c70 2021-03-25T14:16:46.752 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.743+0000 7f7012ffd700 1 -- 172.21.15.110:0/223487568 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff4004200 con 0x7f6ff4004a00 2021-03-25T14:16:46.752 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.743+0000 7f7012ffd700 1 -- 172.21.15.110:0/223487568 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff400b760 con 0x7f701414a150 2021-03-25T14:16:46.752 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.743+0000 7f70137fe700 1 --2- 172.21.15.110:0/223487568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ff4003c70 0x7f6ff4004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:46.752 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.743+0000 7f7013fff700 1 --2- 172.21.15.110:0/223487568 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f701414a150 0x7f6ff4003760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:46.752 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.743+0000 7f7018ac6700 1 --2- 172.21.15.110:0/223487568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ff4004a00 0x7f6ff4004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:46.752 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.743+0000 7f70137fe700 1 -- 172.21.15.110:0/223487568 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f701414a150 msgr2=0x7f6ff4003760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:46.752 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.743+0000 7f70137fe700 1 --2- 172.21.15.110:0/223487568 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f701414a150 0x7f6ff4003760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:46.753 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.743+0000 7f70137fe700 1 -- 172.21.15.110:0/223487568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ff4004a00 msgr2=0x7f6ff4004e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:46.753 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.743+0000 7f70137fe700 1 --2- 172.21.15.110:0/223487568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ff4004a00 0x7f6ff4004e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:46.753 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.743+0000 7f70137fe700 1 -- 172.21.15.110:0/223487568 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff4003270 con 0x7f6ff4003c70 2021-03-25T14:16:46.753 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.744+0000 7f70137fe700 1 --2- 172.21.15.110:0/223487568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ff4003c70 0x7f6ff4004510 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f6ffc00bc00 tx=0x7f6ffc006e20).ready entity=mon.0 client_cookie=dc30a96d8cc77480 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:46.753 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.744+0000 7f7012ffd700 1 -- 172.21.15.110:0/223487568 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc00b310 con 0x7f6ff4003c70 2021-03-25T14:16:46.753 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.744+0000 7f7012ffd700 1 -- 172.21.15.110:0/223487568 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ffc00e940 con 0x7f6ff4003c70 2021-03-25T14:16:46.753 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.744+0000 7f7012ffd700 1 -- 172.21.15.110:0/223487568 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc00ecc0 con 0x7f6ff4003c70 2021-03-25T14:16:46.753 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.744+0000 7f70192c7700 1 -- 172.21.15.110:0/223487568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ff4003c70 msgr2=0x7f6ff4004510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:46.753 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.744+0000 7f70192c7700 1 --2- 172.21.15.110:0/223487568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ff4003c70 0x7f6ff4004510 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f6ffc00bc00 tx=0x7f6ffc006e20).stop 2021-03-25T14:16:46.753 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.744+0000 7f7018ac6700 1 -- 172.21.15.110:0/223487568 reap_dead start 2021-03-25T14:16:46.754 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.744+0000 7f70192c7700 1 -- 172.21.15.110:0/223487568 shutdown_connections 2021-03-25T14:16:46.754 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.744+0000 7f70192c7700 1 -- 172.21.15.110:0/223487568 >> 172.21.15.110:0/223487568 conn(0x7f701405c700 msgr2=0x7f70140664d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:46.754 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.744+0000 7f70192c7700 1 -- 172.21.15.110:0/223487568 shutdown_connections 2021-03-25T14:16:46.754 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.744+0000 7f70192c7700 1 -- 172.21.15.110:0/223487568 wait complete. 2021-03-25T14:16:46.754 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.745+0000 7f70192c7700 1 Processor -- start 2021-03-25T14:16:46.754 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.745+0000 7f70192c7700 1 -- start start 2021-03-25T14:16:46.754 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.746+0000 7f70192c7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ff4003c70 0x7f70141439a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:46.754 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.746+0000 7f70192c7700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70140b9940 0x7f70141589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:46.754 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.746+0000 7f70192c7700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f701414afb0 0x7f7014158ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:46.754 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.746+0000 7f70192c7700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70140bc8d0 con 0x7f701414afb0 2021-03-25T14:16:46.754 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.746+0000 7f70192c7700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70140bbd20 con 0x7f70140b9940 2021-03-25T14:16:46.754 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.746+0000 7f70192c7700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f701414b600 con 0x7f6ff4003c70 2021-03-25T14:16:46.754 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.746+0000 7f7018ac6700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f701414afb0 0x7f7014158ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:46.755 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.746+0000 7f7018ac6700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f701414afb0 0x7f7014158ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48650/0 (socket says 172.21.15.110:48650) 2021-03-25T14:16:46.755 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.746+0000 7f7018ac6700 1 -- 172.21.15.110:0/626190052 learned_addr learned my addr 172.21.15.110:0/626190052 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:46.755 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.746+0000 7f7013fff700 1 --2- 172.21.15.110:0/626190052 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ff4003c70 0x7f70141439a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:46.755 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.746+0000 7f70137fe700 1 --2- 172.21.15.110:0/626190052 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70140b9940 0x7f70141589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:46.755 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.746+0000 7f7018ac6700 1 -- 172.21.15.110:0/626190052 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ff4003c70 msgr2=0x7f70141439a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:46.755 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.746+0000 7f7018ac6700 1 --2- 172.21.15.110:0/626190052 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ff4003c70 0x7f70141439a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:46.755 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.746+0000 7f7018ac6700 1 -- 172.21.15.110:0/626190052 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70140b9940 msgr2=0x7f70141589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:46.755 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.746+0000 7f7018ac6700 1 --2- 172.21.15.110:0/626190052 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70140b9940 0x7f70141589e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:46.755 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.746+0000 7f7018ac6700 1 -- 172.21.15.110:0/626190052 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f701414b8a0 con 0x7f701414afb0 2021-03-25T14:16:46.755 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.747+0000 7f7013fff700 1 --2- 172.21.15.110:0/626190052 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ff4003c70 0x7f70141439a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:46.755 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.747+0000 7f70137fe700 1 --2- 172.21.15.110:0/626190052 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70140b9940 0x7f70141589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:46.756 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.747+0000 7f7018ac6700 1 --2- 172.21.15.110:0/626190052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f701414afb0 0x7f7014158ed0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f7014069b60 tx=0x7f700c009220).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:46.756 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.747+0000 7f700bfff700 1 -- 172.21.15.110:0/626190052 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c006d10 con 0x7f701414afb0 2021-03-25T14:16:46.756 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.747+0000 7f700bfff700 1 -- 172.21.15.110:0/626190052 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700c00fa90 con 0x7f701414afb0 2021-03-25T14:16:46.756 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.747+0000 7f70192c7700 1 -- 172.21.15.110:0/626190052 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70140bbfa0 con 0x7f701414afb0 2021-03-25T14:16:46.756 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.747+0000 7f700bfff700 1 -- 172.21.15.110:0/626190052 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c00fe30 con 0x7f701414afb0 2021-03-25T14:16:46.756 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.747+0000 7f70192c7700 1 -- 172.21.15.110:0/626190052 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70140bc550 con 0x7f701414afb0 2021-03-25T14:16:46.756 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.748+0000 7f70192c7700 1 -- 172.21.15.110:0/626190052 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70140bc130 con 0x7f701414afb0 2021-03-25T14:16:46.756 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.748+0000 7f700bfff700 1 -- 172.21.15.110:0/626190052 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f700c014650 con 0x7f701414afb0 2021-03-25T14:16:46.756 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.748+0000 7f700bfff700 1 --2- 172.21.15.110:0/626190052 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6ff805a0e0 0x7f6ff805c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:46.756 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.748+0000 7f700bfff700 1 -- 172.21.15.110:0/626190052 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f700c074d20 con 0x7f701414afb0 2021-03-25T14:16:46.757 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.748+0000 7f7013fff700 1 --2- 172.21.15.110:0/626190052 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6ff805a0e0 0x7f6ff805c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:46.757 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.749+0000 7f7013fff700 1 --2- 172.21.15.110:0/626190052 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6ff805a0e0 0x7f6ff805c5a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f7004004590 tx=0x7f7004009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:46.757 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.752+0000 7f700bfff700 1 -- 172.21.15.110:0/626190052 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f700c04bcf0 con 0x7f701414afb0 2021-03-25T14:16:46.903 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.901+0000 7f70192c7700 1 -- 172.21.15.110:0/626190052 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7014045ae0 con 0x7f701414afb0 2021-03-25T14:16:46.903 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.901+0000 7f700bfff700 1 -- 172.21.15.110:0/626190052 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7f700c04b8e0 con 0x7f701414afb0 2021-03-25T14:16:46.904 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:16:46.906 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.903+0000 7f70192c7700 1 -- 172.21.15.110:0/626190052 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6ff805a0e0 msgr2=0x7f6ff805c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:46.906 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.903+0000 7f70192c7700 1 --2- 172.21.15.110:0/626190052 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6ff805a0e0 0x7f6ff805c5a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f7004004590 tx=0x7f7004009040).stop 2021-03-25T14:16:46.906 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.903+0000 7f70192c7700 1 -- 172.21.15.110:0/626190052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f701414afb0 msgr2=0x7f7014158ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:46.906 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.903+0000 7f70192c7700 1 --2- 172.21.15.110:0/626190052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f701414afb0 0x7f7014158ed0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f7014069b60 tx=0x7f700c009220).stop 2021-03-25T14:16:46.906 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.903+0000 7f70192c7700 1 -- 172.21.15.110:0/626190052 shutdown_connections 2021-03-25T14:16:46.906 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.903+0000 7f70192c7700 1 --2- 172.21.15.110:0/626190052 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6ff805a0e0 0x7f6ff805c5a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:46.906 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.903+0000 7f70192c7700 1 --2- 172.21.15.110:0/626190052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f701414afb0 0x7f7014158ed0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:46.906 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.903+0000 7f70192c7700 1 --2- 172.21.15.110:0/626190052 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ff4003c70 0x7f70141439a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:46.906 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.903+0000 7f70192c7700 1 --2- 172.21.15.110:0/626190052 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70140b9940 0x7f70141589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:46.906 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.903+0000 7f70192c7700 1 -- 172.21.15.110:0/626190052 >> 172.21.15.110:0/626190052 conn(0x7f701405c700 msgr2=0x7f70140b8f50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:46.907 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.903+0000 7f70192c7700 1 -- 172.21.15.110:0/626190052 shutdown_connections 2021-03-25T14:16:46.907 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:46.904+0000 7f70192c7700 1 -- 172.21.15.110:0/626190052 wait complete. 2021-03-25T14:16:46.917 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-03-25T14:16:47.030 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.028+0000 7ff23db9e700 1 Processor -- start 2021-03-25T14:16:47.030 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.028+0000 7ff23db9e700 1 -- start start 2021-03-25T14:16:47.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.029+0000 7ff23db9e700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff238064800 0x7ff238064be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:47.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.029+0000 7ff23db9e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff238065d30 0x7ff238149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:47.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.029+0000 7ff23db9e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff23814cf60 con 0x7ff238066c30 2021-03-25T14:16:47.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.029+0000 7ff23db9e700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff23814d200 con 0x7ff238064800 2021-03-25T14:16:47.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.029+0000 7ff23db9e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff23814d4a0 con 0x7ff238065d30 2021-03-25T14:16:47.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.029+0000 7ff2377fe700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff238064800 0x7ff238064be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:47.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.029+0000 7ff2377fe700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff238064800 0x7ff238064be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48654/0 (socket says 172.21.15.110:48654) 2021-03-25T14:16:47.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.029+0000 7ff2377fe700 1 -- 172.21.15.110:0/4183894225 learned_addr learned my addr 172.21.15.110:0/4183894225 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:47.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.029+0000 7ff237fff700 1 --2- 172.21.15.110:0/4183894225 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff238065d30 0x7ff238149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:47.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.029+0000 7ff2377fe700 1 -- 172.21.15.110:0/4183894225 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff238065d30 msgr2=0x7ff238149dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:47.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.029+0000 7ff2377fe700 1 --2- 172.21.15.110:0/4183894225 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff238065d30 0x7ff238149dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:47.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.029+0000 7ff2377fe700 1 -- 172.21.15.110:0/4183894225 >> v1:172.21.15.174:6789/0 conn(0x7ff238066c30 legacy=0x7ff238065620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:47.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.029+0000 7ff2377fe700 1 -- 172.21.15.110:0/4183894225 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff23814d740 con 0x7ff238064800 2021-03-25T14:16:47.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.029+0000 7ff237fff700 1 --2- 172.21.15.110:0/4183894225 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff238065d30 0x7ff238149dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:47.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.029+0000 7ff2377fe700 1 --2- 172.21.15.110:0/4183894225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff238064800 0x7ff238064be0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7ff22800ba20 tx=0x7ff228006ee0).ready entity=mon.0 client_cookie=f37ae619c5499d67 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:47.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.030+0000 7ff2367fc700 1 -- 172.21.15.110:0/4183894225 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff228009840 con 0x7ff238064800 2021-03-25T14:16:47.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.030+0000 7ff2367fc700 1 -- 172.21.15.110:0/4183894225 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2280099a0 con 0x7ff238064800 2021-03-25T14:16:47.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.030+0000 7ff2367fc700 1 -- 172.21.15.110:0/4183894225 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff228009d20 con 0x7ff238064800 2021-03-25T14:16:47.035 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.030+0000 7ff23db9e700 1 -- 172.21.15.110:0/4183894225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff238064800 msgr2=0x7ff238064be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:47.035 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.030+0000 7ff23db9e700 1 --2- 172.21.15.110:0/4183894225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff238064800 0x7ff238064be0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7ff22800ba20 tx=0x7ff228006ee0).stop 2021-03-25T14:16:47.035 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.030+0000 7ff23db9e700 1 -- 172.21.15.110:0/4183894225 shutdown_connections 2021-03-25T14:16:47.035 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.030+0000 7ff23db9e700 1 --2- 172.21.15.110:0/4183894225 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff238065d30 0x7ff238149dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:47.035 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.030+0000 7ff23db9e700 1 --2- 172.21.15.110:0/4183894225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff238064800 0x7ff238064be0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:47.035 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.030+0000 7ff23db9e700 1 -- 172.21.15.110:0/4183894225 >> 172.21.15.110:0/4183894225 conn(0x7ff238060c40 msgr2=0x7ff238061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:47.035 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.030+0000 7ff23db9e700 1 -- 172.21.15.110:0/4183894225 shutdown_connections 2021-03-25T14:16:47.035 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.030+0000 7ff23db9e700 1 -- 172.21.15.110:0/4183894225 wait complete. 2021-03-25T14:16:47.035 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.031+0000 7ff23db9e700 1 Processor -- start 2021-03-25T14:16:47.035 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.031+0000 7ff23db9e700 1 -- start start 2021-03-25T14:16:47.038 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.032+0000 7ff23db9e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff238064800 0x7ff2380bc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:47.038 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.032+0000 7ff23db9e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff238065d30 0x7ff2380b66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:47.038 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.032+0000 7ff23db9e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff238066c30 0x7ff2380a1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:47.038 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.032+0000 7ff23db9e700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff238148140 con 0x7ff238064800 2021-03-25T14:16:47.039 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.032+0000 7ff23db9e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2380b6ff0 con 0x7ff238066c30 2021-03-25T14:16:47.039 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.032+0000 7ff23db9e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2380b7560 con 0x7ff238065d30 2021-03-25T14:16:47.039 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.032+0000 7ff2377fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff238064800 0x7ff2380bc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:47.039 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.032+0000 7ff2377fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff238064800 0x7ff2380bc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48660/0 (socket says 172.21.15.110:48660) 2021-03-25T14:16:47.039 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.032+0000 7ff2377fe700 1 -- 172.21.15.110:0/1322508160 learned_addr learned my addr 172.21.15.110:0/1322508160 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:47.039 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.032+0000 7ff237fff700 1 --2- 172.21.15.110:0/1322508160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff238066c30 0x7ff2380a1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:47.039 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.032+0000 7ff236ffd700 1 --2- 172.21.15.110:0/1322508160 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff238065d30 0x7ff2380b66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:47.039 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.032+0000 7ff2377fe700 1 -- 172.21.15.110:0/1322508160 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff238065d30 msgr2=0x7ff2380b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:47.039 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.032+0000 7ff2377fe700 1 --2- 172.21.15.110:0/1322508160 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff238065d30 0x7ff2380b66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:47.039 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.032+0000 7ff2377fe700 1 -- 172.21.15.110:0/1322508160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff238066c30 msgr2=0x7ff2380a1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:47.039 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.032+0000 7ff2377fe700 1 --2- 172.21.15.110:0/1322508160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff238066c30 0x7ff2380a1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:47.040 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.032+0000 7ff2377fe700 1 -- 172.21.15.110:0/1322508160 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2380b7800 con 0x7ff238064800 2021-03-25T14:16:47.040 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.032+0000 7ff237fff700 1 --2- 172.21.15.110:0/1322508160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff238066c30 0x7ff2380a1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:47.040 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.033+0000 7ff2377fe700 1 --2- 172.21.15.110:0/1322508160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff238064800 0x7ff2380bc290 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7ff2280093a0 tx=0x7ff228016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:47.040 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.033+0000 7ff21f7fe700 1 -- 172.21.15.110:0/1322508160 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff228009840 con 0x7ff238064800 2021-03-25T14:16:47.040 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.033+0000 7ff21f7fe700 1 -- 172.21.15.110:0/1322508160 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff228002f50 con 0x7ff238064800 2021-03-25T14:16:47.040 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.033+0000 7ff23db9e700 1 -- 172.21.15.110:0/1322508160 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2380b7aa0 con 0x7ff238064800 2021-03-25T14:16:47.040 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.033+0000 7ff21f7fe700 1 -- 172.21.15.110:0/1322508160 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22801c650 con 0x7ff238064800 2021-03-25T14:16:47.040 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.033+0000 7ff23db9e700 1 -- 172.21.15.110:0/1322508160 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2380bc780 con 0x7ff238064800 2021-03-25T14:16:47.040 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.034+0000 7ff23db9e700 1 -- 172.21.15.110:0/1322508160 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff23814ccc0 con 0x7ff238064800 2021-03-25T14:16:47.040 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.034+0000 7ff21f7fe700 1 -- 172.21.15.110:0/1322508160 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7ff22800f070 con 0x7ff238064800 2021-03-25T14:16:47.040 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.034+0000 7ff21f7fe700 1 --2- 172.21.15.110:0/1322508160 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff21805a0b0 0x7ff21805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:47.040 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.034+0000 7ff21f7fe700 1 -- 172.21.15.110:0/1322508160 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7ff228075590 con 0x7ff238064800 2021-03-25T14:16:47.040 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.034+0000 7ff236ffd700 1 --2- 172.21.15.110:0/1322508160 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff21805a0b0 0x7ff21805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:47.041 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.035+0000 7ff236ffd700 1 --2- 172.21.15.110:0/1322508160 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff21805a0b0 0x7ff21805c570 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7ff2380a0240 tx=0x7ff22c007bc0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:47.041 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.038+0000 7ff21f7fe700 1 -- 172.21.15.110:0/1322508160 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7ff228048c40 con 0x7ff238064800 2021-03-25T14:16:47.190 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.188+0000 7ff23db9e700 1 -- 172.21.15.110:0/1322508160 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff23805d7b0 con 0x7ff238064800 2021-03-25T14:16:47.191 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.189+0000 7ff21f7fe700 1 -- 172.21.15.110:0/1322508160 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7ff22804c260 con 0x7ff238064800 2021-03-25T14:16:47.191 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:16:47.192 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.190+0000 7ff23db9e700 1 -- 172.21.15.110:0/1322508160 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff21805a0b0 msgr2=0x7ff21805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:47.193 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.190+0000 7ff23db9e700 1 --2- 172.21.15.110:0/1322508160 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff21805a0b0 0x7ff21805c570 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7ff2380a0240 tx=0x7ff22c007bc0).stop 2021-03-25T14:16:47.193 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.190+0000 7ff23db9e700 1 -- 172.21.15.110:0/1322508160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff238064800 msgr2=0x7ff2380bc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:47.193 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.190+0000 7ff23db9e700 1 --2- 172.21.15.110:0/1322508160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff238064800 0x7ff2380bc290 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7ff2280093a0 tx=0x7ff228016000).stop 2021-03-25T14:16:47.193 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.190+0000 7ff23db9e700 1 -- 172.21.15.110:0/1322508160 shutdown_connections 2021-03-25T14:16:47.193 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.190+0000 7ff23db9e700 1 --2- 172.21.15.110:0/1322508160 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff21805a0b0 0x7ff21805c570 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:47.193 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.190+0000 7ff23db9e700 1 --2- 172.21.15.110:0/1322508160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff238066c30 0x7ff2380a1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:47.193 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.190+0000 7ff23db9e700 1 --2- 172.21.15.110:0/1322508160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff238064800 0x7ff2380bc290 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:47.193 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.190+0000 7ff23db9e700 1 --2- 172.21.15.110:0/1322508160 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff238065d30 0x7ff2380b66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:47.193 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.190+0000 7ff23db9e700 1 -- 172.21.15.110:0/1322508160 >> 172.21.15.110:0/1322508160 conn(0x7ff238060c40 msgr2=0x7ff2380b9670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:47.193 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.190+0000 7ff23db9e700 1 -- 172.21.15.110:0/1322508160 shutdown_connections 2021-03-25T14:16:47.193 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.190+0000 7ff23db9e700 1 -- 172.21.15.110:0/1322508160 wait complete. 2021-03-25T14:16:47.204 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2021-03-25T14:16:47.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.315+0000 7f29a07cd700 1 Processor -- start 2021-03-25T14:16:47.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.315+0000 7f29a07cd700 1 -- start start 2021-03-25T14:16:47.319 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.316+0000 7f29a07cd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f29980be3a0 0x7f29980b4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:47.320 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.316+0000 7f29a07cd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f29980b47a0 0x7f2998148c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:47.320 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.316+0000 7f29a07cd700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29980b4c20 con 0x7f2998149120 2021-03-25T14:16:47.320 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.316+0000 7f29a07cd700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2998149960 con 0x7f29980be3a0 2021-03-25T14:16:47.320 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.316+0000 7f29a07cd700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2998149c00 con 0x7f29980b47a0 2021-03-25T14:16:47.320 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.316+0000 7f299e569700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f29980be3a0 0x7f29980b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:47.320 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.316+0000 7f299ed6a700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f2998149120 0x7f29980b8cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.110:49274/0 (socket says 172.21.15.110:49274) 2021-03-25T14:16:47.320 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.316+0000 7f299ed6a700 1 -- 172.21.15.110:0/1376023705 learned_addr learned my addr 172.21.15.110:0/1376023705 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:47.320 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.316+0000 7f299dd68700 1 --2- 172.21.15.110:0/1376023705 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f29980b47a0 0x7f2998148c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:47.320 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.316+0000 7f299d567700 1 -- 172.21.15.110:0/1376023705 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1706503028 0 0) 0x7f29980b4c20 con 0x7f2998149120 2021-03-25T14:16:47.320 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.316+0000 7f299d567700 1 -- 172.21.15.110:0/1376023705 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2980003270 con 0x7f2998149120 2021-03-25T14:16:47.320 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.316+0000 7f299dd68700 1 -- 172.21.15.110:0/1376023705 >> v2:172.21.15.174:3300/0 conn(0x7f29980be3a0 msgr2=0x7f29980b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:47.321 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.316+0000 7f299dd68700 1 --2- 172.21.15.110:0/1376023705 >> v2:172.21.15.174:3300/0 conn(0x7f29980be3a0 0x7f29980b4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:47.321 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.316+0000 7f299dd68700 1 -- 172.21.15.110:0/1376023705 >> v1:172.21.15.174:6789/0 conn(0x7f2998149120 legacy=0x7f29980b8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:47.321 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.316+0000 7f299dd68700 1 -- 172.21.15.110:0/1376023705 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2998149ea0 con 0x7f29980b47a0 2021-03-25T14:16:47.321 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.316+0000 7f299dd68700 1 --2- 172.21.15.110:0/1376023705 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f29980b47a0 0x7f2998148c30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f299400b9c0 tx=0x7f2994006e20).ready entity=mon.2 client_cookie=1ca70beb4363539e server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:47.321 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.317+0000 7f299d567700 1 -- 172.21.15.110:0/1376023705 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2994009600 con 0x7f29980b47a0 2021-03-25T14:16:47.321 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.317+0000 7f299d567700 1 -- 172.21.15.110:0/1376023705 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2994009760 con 0x7f29980b47a0 2021-03-25T14:16:47.321 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.317+0000 7f299d567700 1 -- 172.21.15.110:0/1376023705 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2994009ae0 con 0x7f29980b47a0 2021-03-25T14:16:47.321 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.317+0000 7f29a07cd700 1 -- 172.21.15.110:0/1376023705 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f29980b47a0 msgr2=0x7f2998148c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:47.321 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.317+0000 7f29a07cd700 1 --2- 172.21.15.110:0/1376023705 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f29980b47a0 0x7f2998148c30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f299400b9c0 tx=0x7f2994006e20).stop 2021-03-25T14:16:47.321 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.317+0000 7f29a07cd700 1 -- 172.21.15.110:0/1376023705 shutdown_connections 2021-03-25T14:16:47.321 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.317+0000 7f29a07cd700 1 --2- 172.21.15.110:0/1376023705 >> v2:172.21.15.174:3300/0 conn(0x7f29980be3a0 0x7f29980b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:47.321 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.317+0000 7f29a07cd700 1 --2- 172.21.15.110:0/1376023705 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f29980b47a0 0x7f2998148c30 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:47.322 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.317+0000 7f29a07cd700 1 -- 172.21.15.110:0/1376023705 >> 172.21.15.110:0/1376023705 conn(0x7f29980686f0 msgr2=0x7f2998068b00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:47.322 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.317+0000 7f29a07cd700 1 -- 172.21.15.110:0/1376023705 shutdown_connections 2021-03-25T14:16:47.322 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.317+0000 7f29a07cd700 1 -- 172.21.15.110:0/1376023705 wait complete. 2021-03-25T14:16:47.325 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.318+0000 7f29a07cd700 1 Processor -- start 2021-03-25T14:16:47.325 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.318+0000 7f29a07cd700 1 -- start start 2021-03-25T14:16:47.325 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.319+0000 7f29a07cd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f29980b47a0 0x7f29980a3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:47.325 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.319+0000 7f29a07cd700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29980be3a0 0x7f2998147bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:47.325 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.319+0000 7f29a07cd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2998149120 0x7f2998146e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:47.325 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.319+0000 7f29a07cd700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29980b6ab0 con 0x7f2998149120 2021-03-25T14:16:47.325 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.319+0000 7f29a07cd700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29980bcba0 con 0x7f29980be3a0 2021-03-25T14:16:47.325 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.319+0000 7f29a07cd700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29980b7130 con 0x7f29980b47a0 2021-03-25T14:16:47.325 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.319+0000 7f299ed6a700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2998149120 0x7f2998146e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:47.325 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.319+0000 7f299ed6a700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2998149120 0x7f2998146e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48676/0 (socket says 172.21.15.110:48676) 2021-03-25T14:16:47.326 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.319+0000 7f299ed6a700 1 -- 172.21.15.110:0/2289363807 learned_addr learned my addr 172.21.15.110:0/2289363807 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:47.326 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.319+0000 7f299dd68700 1 --2- 172.21.15.110:0/2289363807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29980be3a0 0x7f2998147bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:47.326 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.319+0000 7f299e569700 1 --2- 172.21.15.110:0/2289363807 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f29980b47a0 0x7f29980a3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:47.326 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.319+0000 7f299ed6a700 1 -- 172.21.15.110:0/2289363807 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f29980b47a0 msgr2=0x7f29980a3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:47.326 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.319+0000 7f299ed6a700 1 --2- 172.21.15.110:0/2289363807 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f29980b47a0 0x7f29980a3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:47.326 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.319+0000 7f299ed6a700 1 -- 172.21.15.110:0/2289363807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29980be3a0 msgr2=0x7f2998147bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:47.326 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.319+0000 7f299ed6a700 1 --2- 172.21.15.110:0/2289363807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29980be3a0 0x7f2998147bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:47.326 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.319+0000 7f299ed6a700 1 -- 172.21.15.110:0/2289363807 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29980b73d0 con 0x7f2998149120 2021-03-25T14:16:47.326 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.319+0000 7f299e569700 1 --2- 172.21.15.110:0/2289363807 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f29980b47a0 0x7f29980a3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:47.326 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.319+0000 7f299ed6a700 1 --2- 172.21.15.110:0/2289363807 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2998149120 0x7f2998146e40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f299000ca90 tx=0x7f2990007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:47.326 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.320+0000 7f29867fc700 1 -- 172.21.15.110:0/2289363807 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2990005bb0 con 0x7f2998149120 2021-03-25T14:16:47.327 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.320+0000 7f29867fc700 1 -- 172.21.15.110:0/2289363807 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2990005d10 con 0x7f2998149120 2021-03-25T14:16:47.327 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.320+0000 7f29a07cd700 1 -- 172.21.15.110:0/2289363807 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29980b7670 con 0x7f2998149120 2021-03-25T14:16:47.327 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.320+0000 7f29867fc700 1 -- 172.21.15.110:0/2289363807 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2990007360 con 0x7f2998149120 2021-03-25T14:16:47.327 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.320+0000 7f29a07cd700 1 -- 172.21.15.110:0/2289363807 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29981587b0 con 0x7f2998149120 2021-03-25T14:16:47.327 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.321+0000 7f29a07cd700 1 -- 172.21.15.110:0/2289363807 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29980b7ad0 con 0x7f2998149120 2021-03-25T14:16:47.327 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.321+0000 7f29867fc700 1 -- 172.21.15.110:0/2289363807 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f2990010030 con 0x7f2998149120 2021-03-25T14:16:47.327 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.321+0000 7f29867fc700 1 --2- 172.21.15.110:0/2289363807 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f297805a0b0 0x7f297805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:47.327 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.321+0000 7f29867fc700 1 -- 172.21.15.110:0/2289363807 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f2990073f40 con 0x7f2998149120 2021-03-25T14:16:47.327 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.321+0000 7f299e569700 1 --2- 172.21.15.110:0/2289363807 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f297805a0b0 0x7f297805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:47.327 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.322+0000 7f299e569700 1 --2- 172.21.15.110:0/2289363807 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f297805a0b0 0x7f297805c570 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f2988006c00 tx=0x7f2988008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:47.328 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.325+0000 7f29867fc700 1 -- 172.21.15.110:0/2289363807 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f2990047590 con 0x7f2998149120 2021-03-25T14:16:47.475 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.473+0000 7f29a07cd700 1 -- 172.21.15.110:0/2289363807 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f299805d7b0 con 0x7f2998149120 2021-03-25T14:16:47.475 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.473+0000 7f29867fc700 1 -- 172.21.15.110:0/2289363807 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+10 (secure 0 0 0) 0x7f299004abb0 con 0x7f2998149120 2021-03-25T14:16:47.476 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:16:47.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.475+0000 7f29a07cd700 1 -- 172.21.15.110:0/2289363807 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f297805a0b0 msgr2=0x7f297805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:47.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.475+0000 7f29a07cd700 1 --2- 172.21.15.110:0/2289363807 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f297805a0b0 0x7f297805c570 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f2988006c00 tx=0x7f2988008040).stop 2021-03-25T14:16:47.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.475+0000 7f29a07cd700 1 -- 172.21.15.110:0/2289363807 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2998149120 msgr2=0x7f2998146e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:47.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.475+0000 7f29a07cd700 1 --2- 172.21.15.110:0/2289363807 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2998149120 0x7f2998146e40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f299000ca90 tx=0x7f2990007dd0).stop 2021-03-25T14:16:47.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.475+0000 7f29a07cd700 1 -- 172.21.15.110:0/2289363807 shutdown_connections 2021-03-25T14:16:47.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.475+0000 7f29a07cd700 1 --2- 172.21.15.110:0/2289363807 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f297805a0b0 0x7f297805c570 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:47.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.475+0000 7f29a07cd700 1 --2- 172.21.15.110:0/2289363807 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2998149120 0x7f2998146e40 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:47.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.475+0000 7f29a07cd700 1 --2- 172.21.15.110:0/2289363807 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f29980b47a0 0x7f29980a3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:47.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.475+0000 7f29a07cd700 1 --2- 172.21.15.110:0/2289363807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29980be3a0 0x7f2998147bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:47.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.475+0000 7f29a07cd700 1 -- 172.21.15.110:0/2289363807 >> 172.21.15.110:0/2289363807 conn(0x7f29980686f0 msgr2=0x7f2998150150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:47.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.475+0000 7f29a07cd700 1 -- 172.21.15.110:0/2289363807 shutdown_connections 2021-03-25T14:16:47.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.475+0000 7f29a07cd700 1 -- 172.21.15.110:0/2289363807 wait complete. 2021-03-25T14:16:47.499 INFO:tasks.cephfs_test_runner:Starting test: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2021-03-25T14:16:47.500 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2021-03-25T14:16:47.611 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.609+0000 7f2259772700 1 Processor -- start 2021-03-25T14:16:47.611 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.609+0000 7f2259772700 1 -- start start 2021-03-25T14:16:47.613 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.610+0000 7f2259772700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f22540bcd90 0x7f225414d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:47.613 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.610+0000 7f2259772700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f22540b1340 0x7f2254060c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:47.613 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.610+0000 7f2259772700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22540b9140 con 0x7f22540b7620 2021-03-25T14:16:47.614 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.610+0000 7f2259772700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22540692a0 con 0x7f22540b1340 2021-03-25T14:16:47.614 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.610+0000 7f2259772700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22540b93e0 con 0x7f22540bcd90 2021-03-25T14:16:47.614 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.610+0000 7f22527fc700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f22540b1340 0x7f2254060c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:47.614 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.610+0000 7f22527fc700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f22540b1340 0x7f2254060c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48682/0 (socket says 172.21.15.110:48682) 2021-03-25T14:16:47.614 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.610+0000 7f22527fc700 1 -- 172.21.15.110:0/3630798250 learned_addr learned my addr 172.21.15.110:0/3630798250 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:47.614 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.610+0000 7f22537fe700 1 --1- 172.21.15.110:0/3630798250 >> v1:172.21.15.110:6789/0 conn(0x7f22540b7620 0x7f2254148ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41622/0 (socket says 172.21.15.110:41622) 2021-03-25T14:16:47.614 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.610+0000 7f2252ffd700 1 --2- 172.21.15.110:0/3630798250 >> v2:172.21.15.174:3300/0 conn(0x7f22540bcd90 0x7f225414d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:47.614 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.610+0000 7f22527fc700 1 -- 172.21.15.110:0/3630798250 >> v2:172.21.15.174:3300/0 conn(0x7f22540bcd90 msgr2=0x7f225414d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:47.614 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.610+0000 7f22527fc700 1 --2- 172.21.15.110:0/3630798250 >> v2:172.21.15.174:3300/0 conn(0x7f22540bcd90 0x7f225414d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:47.614 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.610+0000 7f22527fc700 1 -- 172.21.15.110:0/3630798250 >> v1:172.21.15.110:6789/0 conn(0x7f22540b7620 legacy=0x7f2254148ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:47.614 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.610+0000 7f22527fc700 1 -- 172.21.15.110:0/3630798250 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225414cda0 con 0x7f22540b1340 2021-03-25T14:16:47.614 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.610+0000 7f2251ffb700 1 -- 172.21.15.110:0/3630798250 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3698466019 0 0) 0x7f22540b9140 con 0x7f22540b7620 2021-03-25T14:16:47.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.610+0000 7f2252ffd700 1 --2- 172.21.15.110:0/3630798250 >> v2:172.21.15.174:3300/0 conn(0x7f22540bcd90 0x7f225414d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:47.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.610+0000 7f22527fc700 1 --2- 172.21.15.110:0/3630798250 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22540b1340 0x7f2254060c40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f2254065280 tx=0x7f2244006ee0).ready entity=mon.0 client_cookie=dc5eba5facc47249 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:47.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.610+0000 7f2251ffb700 1 -- 172.21.15.110:0/3630798250 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2244009840 con 0x7f22540b1340 2021-03-25T14:16:47.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.610+0000 7f2251ffb700 1 -- 172.21.15.110:0/3630798250 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22440099a0 con 0x7f22540b1340 2021-03-25T14:16:47.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.610+0000 7f2251ffb700 1 -- 172.21.15.110:0/3630798250 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2244009d20 con 0x7f22540b1340 2021-03-25T14:16:47.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.611+0000 7f2259772700 1 -- 172.21.15.110:0/3630798250 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22540b1340 msgr2=0x7f2254060c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:47.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.611+0000 7f2259772700 1 --2- 172.21.15.110:0/3630798250 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22540b1340 0x7f2254060c40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f2254065280 tx=0x7f2244006ee0).stop 2021-03-25T14:16:47.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.611+0000 7f2259772700 1 -- 172.21.15.110:0/3630798250 shutdown_connections 2021-03-25T14:16:47.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.611+0000 7f2259772700 1 --2- 172.21.15.110:0/3630798250 >> v2:172.21.15.174:3300/0 conn(0x7f22540bcd90 0x7f225414d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:47.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.611+0000 7f2259772700 1 --2- 172.21.15.110:0/3630798250 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22540b1340 0x7f2254060c40 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:47.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.611+0000 7f2259772700 1 -- 172.21.15.110:0/3630798250 >> 172.21.15.110:0/3630798250 conn(0x7f2254063720 msgr2=0x7f2254063b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:47.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.611+0000 7f2259772700 1 -- 172.21.15.110:0/3630798250 shutdown_connections 2021-03-25T14:16:47.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.611+0000 7f2259772700 1 -- 172.21.15.110:0/3630798250 wait complete. 2021-03-25T14:16:47.618 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.612+0000 7f2259772700 1 Processor -- start 2021-03-25T14:16:47.618 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.612+0000 7f2259772700 1 -- start start 2021-03-25T14:16:47.618 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.613+0000 7f2259772700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22540b1340 0x7f2254158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:47.618 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.613+0000 7f2259772700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22540b7620 0x7f2254149d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:47.619 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.613+0000 7f2259772700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22540bcd90 0x7f225414e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:47.619 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.613+0000 7f2259772700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2254148cc0 con 0x7f22540b7620 2021-03-25T14:16:47.619 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.613+0000 7f2259772700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2254149430 con 0x7f22540bcd90 2021-03-25T14:16:47.619 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.613+0000 7f2259772700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2254159250 con 0x7f22540b1340 2021-03-25T14:16:47.619 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.613+0000 7f22527fc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22540b7620 0x7f2254149d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:47.619 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.613+0000 7f22527fc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22540b7620 0x7f2254149d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48690/0 (socket says 172.21.15.110:48690) 2021-03-25T14:16:47.619 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.613+0000 7f22527fc700 1 -- 172.21.15.110:0/2158655206 learned_addr learned my addr 172.21.15.110:0/2158655206 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:47.619 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.613+0000 7f22527fc700 1 -- 172.21.15.110:0/2158655206 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22540b1340 msgr2=0x7f2254158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:47.619 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.613+0000 7f22527fc700 1 --2- 172.21.15.110:0/2158655206 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22540b1340 0x7f2254158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:16:47.619 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.613+0000 7f22527fc700 1 -- 172.21.15.110:0/2158655206 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22540bcd90 msgr2=0x7f225414e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:47.619 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.613+0000 7f22527fc700 1 --2- 172.21.15.110:0/2158655206 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22540bcd90 0x7f225414e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:16:47.619 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.613+0000 7f22527fc700 1 -- 172.21.15.110:0/2158655206 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2254148ef0 con 0x7f22540b7620 2021-03-25T14:16:47.619 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.613+0000 7f22527fc700 1 --2- 172.21.15.110:0/2158655206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22540b7620 0x7f2254149d50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f2244006f20 tx=0x7f2244016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:47.620 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.613+0000 7f223affd700 1 -- 172.21.15.110:0/2158655206 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2244012e60 con 0x7f22540b7620 2021-03-25T14:16:47.620 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.613+0000 7f223affd700 1 -- 172.21.15.110:0/2158655206 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224401b410 con 0x7f22540b7620 2021-03-25T14:16:47.620 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.613+0000 7f2259772700 1 -- 172.21.15.110:0/2158655206 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2254149190 con 0x7f22540b7620 2021-03-25T14:16:47.620 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.613+0000 7f223affd700 1 -- 172.21.15.110:0/2158655206 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224401b7b0 con 0x7f22540b7620 2021-03-25T14:16:47.620 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.613+0000 7f2259772700 1 -- 172.21.15.110:0/2158655206 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f225414a240 con 0x7f22540b7620 2021-03-25T14:16:47.620 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.614+0000 7f2259772700 1 -- 172.21.15.110:0/2158655206 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22540b66f0 con 0x7f22540b7620 2021-03-25T14:16:47.620 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.614+0000 7f223affd700 1 -- 172.21.15.110:0/2158655206 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f224400f070 con 0x7f22540b7620 2021-03-25T14:16:47.620 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.615+0000 7f223affd700 1 --2- 172.21.15.110:0/2158655206 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f223405a0b0 0x7f223405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:47.620 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.615+0000 7f223affd700 1 -- 172.21.15.110:0/2158655206 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f22440751c0 con 0x7f22540b7620 2021-03-25T14:16:47.620 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.615+0000 7f2252ffd700 1 --2- 172.21.15.110:0/2158655206 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f223405a0b0 0x7f223405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:47.620 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.615+0000 7f2252ffd700 1 --2- 172.21.15.110:0/2158655206 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f223405a0b0 0x7f223405c570 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f2248006c00 tx=0x7f2248008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:47.621 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.619+0000 7f223affd700 1 -- 172.21.15.110:0/2158655206 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f2244048870 con 0x7f22540b7620 2021-03-25T14:16:47.828 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:47.826+0000 7f2259772700 1 -- 172.21.15.110:0/2158655206 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7f225405d7b0 con 0x7f22540b7620 2021-03-25T14:16:48.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.766+0000 7f223affd700 1 -- 172.21.15.110:0/2158655206 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v52) v1 ==== 162+0+0 (secure 0 0 0) 0x7f224404be90 con 0x7f22540b7620 2021-03-25T14:16:48.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.768+0000 7f2259772700 1 -- 172.21.15.110:0/2158655206 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f223405a0b0 msgr2=0x7f223405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:48.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.768+0000 7f2259772700 1 --2- 172.21.15.110:0/2158655206 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f223405a0b0 0x7f223405c570 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f2248006c00 tx=0x7f2248008040).stop 2021-03-25T14:16:48.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.768+0000 7f2259772700 1 -- 172.21.15.110:0/2158655206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22540b7620 msgr2=0x7f2254149d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:48.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.768+0000 7f2259772700 1 --2- 172.21.15.110:0/2158655206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22540b7620 0x7f2254149d50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f2244006f20 tx=0x7f2244016000).stop 2021-03-25T14:16:48.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.768+0000 7f2259772700 1 -- 172.21.15.110:0/2158655206 shutdown_connections 2021-03-25T14:16:48.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.768+0000 7f2259772700 1 --2- 172.21.15.110:0/2158655206 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f223405a0b0 0x7f223405c570 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:48.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.768+0000 7f2259772700 1 --2- 172.21.15.110:0/2158655206 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22540bcd90 0x7f225414e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:16:48.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.768+0000 7f2259772700 1 --2- 172.21.15.110:0/2158655206 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22540b1340 0x7f2254158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:16:48.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.768+0000 7f2259772700 1 --2- 172.21.15.110:0/2158655206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22540b7620 0x7f2254149d50 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:48.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.768+0000 7f2259772700 1 -- 172.21.15.110:0/2158655206 >> 172.21.15.110:0/2158655206 conn(0x7f2254063720 msgr2=0x7f2254062040 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:48.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.769+0000 7f2259772700 1 -- 172.21.15.110:0/2158655206 shutdown_connections 2021-03-25T14:16:48.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.769+0000 7f2259772700 1 -- 172.21.15.110:0/2158655206 wait complete. 2021-03-25T14:16:48.783 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-03-25T14:16:48.899 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.897+0000 7f3277b88700 1 Processor -- start 2021-03-25T14:16:48.900 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.898+0000 7f3277b88700 1 -- start start 2021-03-25T14:16:48.903 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.898+0000 7f3277b88700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f327014d470 0x7f327014d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:48.903 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.898+0000 7f3277b88700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f327014cc90 0x7f32701493c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:48.903 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.898+0000 7f3277b88700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32700691b0 con 0x7f32701498b0 2021-03-25T14:16:48.903 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.898+0000 7f3277b88700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32700bc2b0 con 0x7f327014d470 2021-03-25T14:16:48.903 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.898+0000 7f3277b88700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3270149dd0 con 0x7f327014cc90 2021-03-25T14:16:48.903 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.899+0000 7f3275924700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f327014d470 0x7f327014d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:48.903 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.899+0000 7f3275924700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f327014d470 0x7f327014d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48696/0 (socket says 172.21.15.110:48696) 2021-03-25T14:16:48.903 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.899+0000 7f3275924700 1 -- 172.21.15.110:0/2557078670 learned_addr learned my addr 172.21.15.110:0/2557078670 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:48.903 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.899+0000 7f3275924700 1 -- 172.21.15.110:0/2557078670 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f327014cc90 msgr2=0x7f32701493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:48.903 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.899+0000 7f3275123700 1 --2- 172.21.15.110:0/2557078670 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f327014cc90 0x7f32701493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:48.903 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.899+0000 7f3275924700 1 --2- 172.21.15.110:0/2557078670 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f327014cc90 0x7f32701493c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:48.904 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.899+0000 7f3275924700 1 -- 172.21.15.110:0/2557078670 >> v1:172.21.15.174:6789/0 conn(0x7f32701498b0 legacy=0x7f32700685d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:48.904 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.899+0000 7f3275924700 1 -- 172.21.15.110:0/2557078670 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327014a070 con 0x7f327014d470 2021-03-25T14:16:48.904 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.899+0000 7f3275123700 1 --2- 172.21.15.110:0/2557078670 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f327014cc90 0x7f32701493c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:48.904 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.899+0000 7f3275924700 1 --2- 172.21.15.110:0/2557078670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f327014d470 0x7f327014d850 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f326c00ba20 tx=0x7f326c006ee0).ready entity=mon.0 client_cookie=445945edf0984d81 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:48.904 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.899+0000 7f3274922700 1 -- 172.21.15.110:0/2557078670 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c009800 con 0x7f327014d470 2021-03-25T14:16:48.904 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.899+0000 7f3274922700 1 -- 172.21.15.110:0/2557078670 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f326c009960 con 0x7f327014d470 2021-03-25T14:16:48.904 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.899+0000 7f3274922700 1 -- 172.21.15.110:0/2557078670 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c009ce0 con 0x7f327014d470 2021-03-25T14:16:48.904 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.900+0000 7f3277b88700 1 -- 172.21.15.110:0/2557078670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f327014d470 msgr2=0x7f327014d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:48.904 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.900+0000 7f3277b88700 1 --2- 172.21.15.110:0/2557078670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f327014d470 0x7f327014d850 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f326c00ba20 tx=0x7f326c006ee0).stop 2021-03-25T14:16:48.904 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.900+0000 7f3277b88700 1 -- 172.21.15.110:0/2557078670 shutdown_connections 2021-03-25T14:16:48.904 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.900+0000 7f3277b88700 1 --2- 172.21.15.110:0/2557078670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f327014d470 0x7f327014d850 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:48.904 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.900+0000 7f3277b88700 1 --2- 172.21.15.110:0/2557078670 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f327014cc90 0x7f32701493c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:48.905 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.900+0000 7f3277b88700 1 -- 172.21.15.110:0/2557078670 >> 172.21.15.110:0/2557078670 conn(0x7f3270060c40 msgr2=0x7f3270061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:48.905 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.900+0000 7f3277b88700 1 -- 172.21.15.110:0/2557078670 shutdown_connections 2021-03-25T14:16:48.905 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.900+0000 7f3277b88700 1 -- 172.21.15.110:0/2557078670 wait complete. 2021-03-25T14:16:48.905 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.901+0000 7f3277b88700 1 Processor -- start 2021-03-25T14:16:48.905 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.901+0000 7f3277b88700 1 -- start start 2021-03-25T14:16:48.908 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.901+0000 7f3277b88700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32701498b0 0x7f327015c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:48.908 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.901+0000 7f3277b88700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f327014cc90 0x7f32701593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:48.908 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.901+0000 7f3277b88700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f327014d470 0x7f32700a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:48.908 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.901+0000 7f3277b88700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327014bdd0 con 0x7f32701498b0 2021-03-25T14:16:48.908 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.901+0000 7f3277b88700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327014c070 con 0x7f327014cc90 2021-03-25T14:16:48.908 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.901+0000 7f3277b88700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f327014c310 con 0x7f327014d470 2021-03-25T14:16:48.908 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.901+0000 7f3275924700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32701498b0 0x7f327015c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:48.909 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.901+0000 7f3275924700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32701498b0 0x7f327015c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48702/0 (socket says 172.21.15.110:48702) 2021-03-25T14:16:48.909 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.901+0000 7f3275924700 1 -- 172.21.15.110:0/1647858322 learned_addr learned my addr 172.21.15.110:0/1647858322 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:48.909 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.902+0000 7f3275123700 1 --2- 172.21.15.110:0/1647858322 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f327014cc90 0x7f32701593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:48.909 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.902+0000 7f3276125700 1 --2- 172.21.15.110:0/1647858322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f327014d470 0x7f32700a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:48.909 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.902+0000 7f3275924700 1 -- 172.21.15.110:0/1647858322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f327014d470 msgr2=0x7f32700a5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:48.909 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.902+0000 7f3275924700 1 --2- 172.21.15.110:0/1647858322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f327014d470 0x7f32700a5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:48.909 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.902+0000 7f3275924700 1 -- 172.21.15.110:0/1647858322 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f327014cc90 msgr2=0x7f32701593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:48.909 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.902+0000 7f3275924700 1 --2- 172.21.15.110:0/1647858322 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f327014cc90 0x7f32701593d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:48.909 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.902+0000 7f3275924700 1 -- 172.21.15.110:0/1647858322 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3270158c90 con 0x7f32701498b0 2021-03-25T14:16:48.909 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.902+0000 7f3275123700 1 --2- 172.21.15.110:0/1647858322 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f327014cc90 0x7f32701593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:48.909 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.902+0000 7f3275924700 1 --2- 172.21.15.110:0/1647858322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32701498b0 0x7f327015c130 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f326c00b1d0 tx=0x7f326c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:48.910 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.902+0000 7f325dffb700 1 -- 172.21.15.110:0/1647858322 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c011dc0 con 0x7f32701498b0 2021-03-25T14:16:48.910 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.902+0000 7f325dffb700 1 -- 172.21.15.110:0/1647858322 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f326c01c420 con 0x7f32701498b0 2021-03-25T14:16:48.910 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.902+0000 7f325dffb700 1 -- 172.21.15.110:0/1647858322 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c01c7c0 con 0x7f32701498b0 2021-03-25T14:16:48.910 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.902+0000 7f3277b88700 1 -- 172.21.15.110:0/1647858322 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3270158f30 con 0x7f32701498b0 2021-03-25T14:16:48.910 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.902+0000 7f3277b88700 1 -- 172.21.15.110:0/1647858322 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f327014af00 con 0x7f32701498b0 2021-03-25T14:16:48.910 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.903+0000 7f3277b88700 1 -- 172.21.15.110:0/1647858322 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f327005d7b0 con 0x7f32701498b0 2021-03-25T14:16:48.910 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.903+0000 7f325dffb700 1 -- 172.21.15.110:0/1647858322 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f326c00f070 con 0x7f32701498b0 2021-03-25T14:16:48.910 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.904+0000 7f325dffb700 1 --2- 172.21.15.110:0/1647858322 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f325005a0b0 0x7f325005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:48.910 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.904+0000 7f325dffb700 1 -- 172.21.15.110:0/1647858322 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f326c0756d0 con 0x7f32701498b0 2021-03-25T14:16:48.910 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.904+0000 7f3275123700 1 --2- 172.21.15.110:0/1647858322 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f325005a0b0 0x7f325005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:48.911 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.904+0000 7f3275123700 1 --2- 172.21.15.110:0/1647858322 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f325005a0b0 0x7f325005c570 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f326000c880 tx=0x7f3260008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:48.911 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:48.908+0000 7f325dffb700 1 -- 172.21.15.110:0/1647858322 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f326c04c7b0 con 0x7f32701498b0 2021-03-25T14:16:49.061 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.059+0000 7f3277b88700 1 -- 172.21.15.110:0/1647858322 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3270061c50 con 0x7f32701498b0 2021-03-25T14:16:49.064 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.062+0000 7f325dffb700 1 -- 172.21.15.110:0/1647858322 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7f326c04c3a0 con 0x7f32701498b0 2021-03-25T14:16:49.066 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.064+0000 7f3277b88700 1 -- 172.21.15.110:0/1647858322 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f325005a0b0 msgr2=0x7f325005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:49.066 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.064+0000 7f3277b88700 1 --2- 172.21.15.110:0/1647858322 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f325005a0b0 0x7f325005c570 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f326000c880 tx=0x7f3260008040).stop 2021-03-25T14:16:49.066 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.064+0000 7f3277b88700 1 -- 172.21.15.110:0/1647858322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32701498b0 msgr2=0x7f327015c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:49.066 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.064+0000 7f3277b88700 1 --2- 172.21.15.110:0/1647858322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32701498b0 0x7f327015c130 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f326c00b1d0 tx=0x7f326c016000).stop 2021-03-25T14:16:49.067 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.064+0000 7f3277b88700 1 -- 172.21.15.110:0/1647858322 shutdown_connections 2021-03-25T14:16:49.067 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.064+0000 7f3277b88700 1 --2- 172.21.15.110:0/1647858322 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f325005a0b0 0x7f325005c570 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:49.067 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.064+0000 7f3277b88700 1 --2- 172.21.15.110:0/1647858322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f327014d470 0x7f32700a5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:49.067 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.064+0000 7f3277b88700 1 --2- 172.21.15.110:0/1647858322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32701498b0 0x7f327015c130 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:49.067 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.064+0000 7f3277b88700 1 --2- 172.21.15.110:0/1647858322 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f327014cc90 0x7f32701593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:49.067 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.064+0000 7f3277b88700 1 -- 172.21.15.110:0/1647858322 >> 172.21.15.110:0/1647858322 conn(0x7f3270060c40 msgr2=0x7f3270147b50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:49.067 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.064+0000 7f3277b88700 1 -- 172.21.15.110:0/1647858322 shutdown_connections 2021-03-25T14:16:49.067 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.064+0000 7f3277b88700 1 -- 172.21.15.110:0/1647858322 wait complete. 2021-03-25T14:16:49.077 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-03-25T14:16:49.077 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-03-25T14:16:49.104 DEBUG:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-03-25T14:16:49.136 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-03-25T14:16:49.136 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2021-03-25T14:16:49.136 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-03-25T14:16:49.136 DEBUG:teuthology.orchestra.run.smithi110:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2021-03-25T14:16:49.176 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi110.front.sepia.ceph.com 2021-03-25T14:16:49.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:49.176 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-03-25T14:16:49.231 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2021-03-25T14:16:49.231 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-03-25T14:16:49.231 DEBUG:teuthology.orchestra.run.smithi174:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2021-03-25T14:16:49.271 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi174.front.sepia.ceph.com 2021-03-25T14:16:49.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:16:49.272 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-03-25T14:16:49.328 INFO:tasks.cephfs.cephfs_test_case:[, ] 2021-03-25T14:16:49.328 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-03-25T14:16:49.437 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.436+0000 7f84012ce700 1 Processor -- start 2021-03-25T14:16:49.438 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.436+0000 7f84012ce700 1 -- start start 2021-03-25T14:16:49.443 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.436+0000 7f84012ce700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f83fc0ba680 0x7f83fc0baa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:49.444 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.436+0000 7f84012ce700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83fc148d00 0x7f83fc149190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:49.444 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.436+0000 7f84012ce700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83fc0bbcd0 con 0x7f83fc0b86d0 2021-03-25T14:16:49.444 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.436+0000 7f84012ce700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83fc0bbf70 con 0x7f83fc0ba680 2021-03-25T14:16:49.444 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.436+0000 7f84012ce700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83fc0bc210 con 0x7f83fc148d00 2021-03-25T14:16:49.444 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.436+0000 7f83fbfff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f83fc0ba680 0x7f83fc0baa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:49.444 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.436+0000 7f83fbfff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f83fc0ba680 0x7f83fc0baa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48710/0 (socket says 172.21.15.110:48710) 2021-03-25T14:16:49.444 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.436+0000 7f83fb7fe700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f83fc0b86d0 0x7f83fc0bcc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41648/0 (socket says 172.21.15.110:41648) 2021-03-25T14:16:49.444 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.436+0000 7f83fbfff700 1 -- 172.21.15.110:0/881798356 learned_addr learned my addr 172.21.15.110:0/881798356 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:49.444 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.437+0000 7f8400acd700 1 --2- 172.21.15.110:0/881798356 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83fc148d00 0x7f83fc149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:49.444 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.437+0000 7f83fbfff700 1 -- 172.21.15.110:0/881798356 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83fc148d00 msgr2=0x7f83fc149190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:49.444 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.437+0000 7f83fbfff700 1 --2- 172.21.15.110:0/881798356 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83fc148d00 0x7f83fc149190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:49.444 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.437+0000 7f83fbfff700 1 -- 172.21.15.110:0/881798356 >> v1:172.21.15.110:6789/0 conn(0x7f83fc0b86d0 legacy=0x7f83fc0bcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:49.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.437+0000 7f83fbfff700 1 -- 172.21.15.110:0/881798356 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83fc0bc4b0 con 0x7f83fc0ba680 2021-03-25T14:16:49.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.437+0000 7f83faffd700 1 -- 172.21.15.110:0/881798356 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2060937231 0 0) 0x7f83fc0bbcd0 con 0x7f83fc0b86d0 2021-03-25T14:16:49.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.437+0000 7f8400acd700 1 --2- 172.21.15.110:0/881798356 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83fc148d00 0x7f83fc149190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:49.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.437+0000 7f83fbfff700 1 --2- 172.21.15.110:0/881798356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83fc0ba680 0x7f83fc0baa60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f83ec00ba20 tx=0x7f83ec006ee0).ready entity=mon.0 client_cookie=80c3ca4d692030e1 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:49.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.437+0000 7f83faffd700 1 -- 172.21.15.110:0/881798356 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec0098d0 con 0x7f83fc0ba680 2021-03-25T14:16:49.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.437+0000 7f83faffd700 1 -- 172.21.15.110:0/881798356 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ec009a30 con 0x7f83fc0ba680 2021-03-25T14:16:49.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.437+0000 7f83faffd700 1 -- 172.21.15.110:0/881798356 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec009db0 con 0x7f83fc0ba680 2021-03-25T14:16:49.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.438+0000 7f84012ce700 1 -- 172.21.15.110:0/881798356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83fc0ba680 msgr2=0x7f83fc0baa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:49.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.438+0000 7f84012ce700 1 --2- 172.21.15.110:0/881798356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83fc0ba680 0x7f83fc0baa60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f83ec00ba20 tx=0x7f83ec006ee0).stop 2021-03-25T14:16:49.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.438+0000 7f84012ce700 1 -- 172.21.15.110:0/881798356 shutdown_connections 2021-03-25T14:16:49.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.438+0000 7f84012ce700 1 --2- 172.21.15.110:0/881798356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83fc0ba680 0x7f83fc0baa60 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:49.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.438+0000 7f84012ce700 1 --2- 172.21.15.110:0/881798356 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83fc148d00 0x7f83fc149190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:49.446 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.438+0000 7f84012ce700 1 -- 172.21.15.110:0/881798356 >> 172.21.15.110:0/881798356 conn(0x7f83fc060c40 msgr2=0x7f83fc061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:49.446 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.438+0000 7f84012ce700 1 -- 172.21.15.110:0/881798356 shutdown_connections 2021-03-25T14:16:49.446 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.438+0000 7f84012ce700 1 -- 172.21.15.110:0/881798356 wait complete. 2021-03-25T14:16:49.446 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.439+0000 7f84012ce700 1 Processor -- start 2021-03-25T14:16:49.446 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.439+0000 7f84012ce700 1 -- start start 2021-03-25T14:16:49.446 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.439+0000 7f84012ce700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83fc0b86d0 0x7f83fc0b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:49.446 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.439+0000 7f84012ce700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83fc0ba680 0x7f83fc065910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:49.446 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.439+0000 7f84012ce700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83fc148d00 0x7f83fc1597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:49.446 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.439+0000 7f84012ce700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83fc0b8f70 con 0x7f83fc148d00 2021-03-25T14:16:49.446 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.439+0000 7f84012ce700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83fc0b9210 con 0x7f83fc0ba680 2021-03-25T14:16:49.446 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.439+0000 7f84012ce700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83fc0b94b0 con 0x7f83fc0b86d0 2021-03-25T14:16:49.446 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.440+0000 7f8400acd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83fc148d00 0x7f83fc1597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:49.447 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.440+0000 7f8400acd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83fc148d00 0x7f83fc1597c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48720/0 (socket says 172.21.15.110:48720) 2021-03-25T14:16:49.447 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.440+0000 7f8400acd700 1 -- 172.21.15.110:0/730954883 learned_addr learned my addr 172.21.15.110:0/730954883 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:49.447 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.440+0000 7f83fb7fe700 1 --2- 172.21.15.110:0/730954883 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83fc0ba680 0x7f83fc065910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:49.447 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.440+0000 7f8400acd700 1 -- 172.21.15.110:0/730954883 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83fc0b86d0 msgr2=0x7f83fc0b4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:49.447 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.440+0000 7f83fbfff700 1 --2- 172.21.15.110:0/730954883 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83fc0b86d0 0x7f83fc0b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:49.447 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.440+0000 7f8400acd700 1 --2- 172.21.15.110:0/730954883 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83fc0b86d0 0x7f83fc0b4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:49.447 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.440+0000 7f8400acd700 1 -- 172.21.15.110:0/730954883 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83fc0ba680 msgr2=0x7f83fc065910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:49.447 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.440+0000 7f8400acd700 1 --2- 172.21.15.110:0/730954883 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83fc0ba680 0x7f83fc065910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:49.447 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.440+0000 7f8400acd700 1 -- 172.21.15.110:0/730954883 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83fc159080 con 0x7f83fc148d00 2021-03-25T14:16:49.447 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.440+0000 7f8400acd700 1 --2- 172.21.15.110:0/730954883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83fc148d00 0x7f83fc1597c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f83f400cb00 tx=0x7f83f4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:49.448 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.440+0000 7f83e3fff700 1 -- 172.21.15.110:0/730954883 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f4005ad0 con 0x7f83fc148d00 2021-03-25T14:16:49.448 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.440+0000 7f83e3fff700 1 -- 172.21.15.110:0/730954883 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f4005c30 con 0x7f83fc148d00 2021-03-25T14:16:49.448 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.440+0000 7f84012ce700 1 -- 172.21.15.110:0/730954883 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83fc159320 con 0x7f83fc148d00 2021-03-25T14:16:49.448 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.440+0000 7f83e3fff700 1 -- 172.21.15.110:0/730954883 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f40078b0 con 0x7f83fc148d00 2021-03-25T14:16:49.448 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.440+0000 7f84012ce700 1 -- 172.21.15.110:0/730954883 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83fc0b6540 con 0x7f83fc148d00 2021-03-25T14:16:49.448 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.441+0000 7f84012ce700 1 -- 172.21.15.110:0/730954883 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83fc1594b0 con 0x7f83fc148d00 2021-03-25T14:16:49.448 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.441+0000 7f83e3fff700 1 -- 172.21.15.110:0/730954883 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f83f4017020 con 0x7f83fc148d00 2021-03-25T14:16:49.448 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.442+0000 7f83e3fff700 1 --2- 172.21.15.110:0/730954883 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f83dc05a0b0 0x7f83dc05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:49.448 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.442+0000 7f83e3fff700 1 -- 172.21.15.110:0/730954883 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f83f4073dd0 con 0x7f83fc148d00 2021-03-25T14:16:49.448 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.442+0000 7f83fbfff700 1 --2- 172.21.15.110:0/730954883 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f83dc05a0b0 0x7f83dc05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:49.449 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.442+0000 7f83fbfff700 1 --2- 172.21.15.110:0/730954883 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f83dc05a0b0 0x7f83dc05c570 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f83ec00b1d0 tx=0x7f83ec016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:49.449 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.445+0000 7f83e3fff700 1 -- 172.21.15.110:0/730954883 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f83f4047480 con 0x7f83fc148d00 2021-03-25T14:16:49.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.631+0000 7f84012ce700 1 -- 172.21.15.110:0/730954883 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83fc045ae0 con 0x7f83fc148d00 2021-03-25T14:16:49.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.632+0000 7f83e3fff700 1 -- 172.21.15.110:0/730954883 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+2846 (secure 0 0 0) 0x7f83f404aaa0 con 0x7f83fc148d00 2021-03-25T14:16:49.634 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:16:49.635 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1177985428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6833","nonce":1177985428},{"type":"v1","addr":"172.21.15.174:6835","nonce":1177985428}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.110:6836/3814723779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3814723779},{"type":"v1","addr":"172.21.15.110:6836","nonce":3814723779}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":4},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1613822797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1613822797},{"type":"v1","addr":"172.21.15.110:6837","nonce":1613822797}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-03-25T14:16:11.090720+0000","modified":"2021-03-25T14:16:25.750002+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"b","rank":0,"incarnation":5,"state":"up:active","state_seq":4,"addr":"172.21.15.174:6834/1564441351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1564441351},{"type":"v1","addr":"172.21.15.174:6834","nonce":1564441351}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-03-25T14:16:49.636 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.634+0000 7f84012ce700 1 -- 172.21.15.110:0/730954883 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f83dc05a0b0 msgr2=0x7f83dc05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:49.636 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.634+0000 7f84012ce700 1 --2- 172.21.15.110:0/730954883 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f83dc05a0b0 0x7f83dc05c570 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f83ec00b1d0 tx=0x7f83ec016000).stop 2021-03-25T14:16:49.636 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.634+0000 7f84012ce700 1 -- 172.21.15.110:0/730954883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83fc148d00 msgr2=0x7f83fc1597c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:49.636 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.634+0000 7f84012ce700 1 --2- 172.21.15.110:0/730954883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83fc148d00 0x7f83fc1597c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f83f400cb00 tx=0x7f83f4008040).stop 2021-03-25T14:16:49.636 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.634+0000 7f84012ce700 1 -- 172.21.15.110:0/730954883 shutdown_connections 2021-03-25T14:16:49.637 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.634+0000 7f84012ce700 1 --2- 172.21.15.110:0/730954883 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f83dc05a0b0 0x7f83dc05c570 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:49.637 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.634+0000 7f84012ce700 1 --2- 172.21.15.110:0/730954883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83fc148d00 0x7f83fc1597c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:49.637 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.634+0000 7f84012ce700 1 --2- 172.21.15.110:0/730954883 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83fc0b86d0 0x7f83fc0b4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:49.637 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.634+0000 7f84012ce700 1 --2- 172.21.15.110:0/730954883 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83fc0ba680 0x7f83fc065910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:49.637 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.634+0000 7f84012ce700 1 -- 172.21.15.110:0/730954883 >> 172.21.15.110:0/730954883 conn(0x7f83fc060c40 msgr2=0x7f83fc0baa60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:49.637 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.634+0000 7f84012ce700 1 -- 172.21.15.110:0/730954883 shutdown_connections 2021-03-25T14:16:49.637 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.634+0000 7f84012ce700 1 -- 172.21.15.110:0/730954883 wait complete. 2021-03-25T14:16:49.637 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 9 2021-03-25T14:16:49.647 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:16:49.757 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.755+0000 7fa2e7fff700 1 Processor -- start 2021-03-25T14:16:49.757 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.755+0000 7fa2e7fff700 1 -- start start 2021-03-25T14:16:49.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.755+0000 7fa2e7fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa2e80a2070 0x7fa2e8147ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:49.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.755+0000 7fa2e7fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2e80b8660 0x7fa2e8064f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:49.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.755+0000 7fa2e7fff700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e805ca10 con 0x7fa2e80a1c90 2021-03-25T14:16:49.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.755+0000 7fa2e7fff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2e805ccb0 con 0x7fa2e80a2070 2021-03-25T14:16:49.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.755+0000 7fa2e7fff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e81477a0 con 0x7fa2e80b8660 2021-03-25T14:16:49.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.756+0000 7fa2e6ffd700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fa2e80a1c90 0x7fa2e80b6f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41660/0 (socket says 172.21.15.110:41660) 2021-03-25T14:16:49.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.756+0000 7fa2e6ffd700 1 -- 172.21.15.110:0/350554221 learned_addr learned my addr 172.21.15.110:0/350554221 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:49.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.756+0000 7fa2e5ffb700 1 -- 172.21.15.110:0/350554221 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1853273094 0 0) 0x7fa2e805ca10 con 0x7fa2e80a1c90 2021-03-25T14:16:49.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.756+0000 7fa2e5ffb700 1 -- 172.21.15.110:0/350554221 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2d4003270 con 0x7fa2e80a1c90 2021-03-25T14:16:49.766 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.756+0000 7fa2e67fc700 1 --2- 172.21.15.110:0/350554221 >> v2:172.21.15.174:3300/0 conn(0x7fa2e80a2070 0x7fa2e8147ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:49.766 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.756+0000 7fa2e77fe700 1 --2- 172.21.15.110:0/350554221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2e80b8660 0x7fa2e8064f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:49.766 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.756+0000 7fa2e5ffb700 1 -- 172.21.15.110:0/350554221 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2341189462 0 0) 0x7fa2d4003270 con 0x7fa2e80a1c90 2021-03-25T14:16:49.766 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.756+0000 7fa2e5ffb700 1 -- 172.21.15.110:0/350554221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2e80b8660 msgr2=0x7fa2e8064f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:49.766 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.756+0000 7fa2e5ffb700 1 --2- 172.21.15.110:0/350554221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2e80b8660 0x7fa2e8064f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:49.766 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.756+0000 7fa2e5ffb700 1 -- 172.21.15.110:0/350554221 >> v2:172.21.15.174:3300/0 conn(0x7fa2e80a2070 msgr2=0x7fa2e8147ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:49.766 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.756+0000 7fa2e5ffb700 1 --2- 172.21.15.110:0/350554221 >> v2:172.21.15.174:3300/0 conn(0x7fa2e80a2070 0x7fa2e8147ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:49.766 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.756+0000 7fa2e5ffb700 1 -- 172.21.15.110:0/350554221 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e8147a40 con 0x7fa2e80a1c90 2021-03-25T14:16:49.766 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.756+0000 7fa2e5ffb700 1 -- 172.21.15.110:0/350554221 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7fa2dc001520 con 0x7fa2e80a1c90 2021-03-25T14:16:49.766 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.756+0000 7fa2e5ffb700 1 -- 172.21.15.110:0/350554221 >> v1:172.21.15.110:6789/0 conn(0x7fa2e80a1c90 legacy=0x7fa2e80b6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:49.767 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.756+0000 7fa2e5ffb700 1 --2- 172.21.15.110:0/350554221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2e80b8660 0x7fa2d4003760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:49.767 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.756+0000 7fa2e5ffb700 1 --2- 172.21.15.110:0/350554221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2d4003c70 0x7fa2d4004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:49.767 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.756+0000 7fa2e5ffb700 1 --2- 172.21.15.110:0/350554221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2d4004a00 0x7fa2d4004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:49.767 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.756+0000 7fa2e5ffb700 1 -- 172.21.15.110:0/350554221 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e805ccb0 con 0x7fa2d4003c70 2021-03-25T14:16:49.767 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.756+0000 7fa2e5ffb700 1 -- 172.21.15.110:0/350554221 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e81477a0 con 0x7fa2d4004a00 2021-03-25T14:16:49.767 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.756+0000 7fa2e5ffb700 1 -- 172.21.15.110:0/350554221 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d4004230 con 0x7fa2e80b8660 2021-03-25T14:16:49.767 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.756+0000 7fa2e67fc700 1 --2- 172.21.15.110:0/350554221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2d4003c70 0x7fa2d4004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:49.767 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.756+0000 7fa2e6ffd700 1 --2- 172.21.15.110:0/350554221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2e80b8660 0x7fa2d4003760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:49.767 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.756+0000 7fa2e77fe700 1 --2- 172.21.15.110:0/350554221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2d4004a00 0x7fa2d4004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:49.767 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.757+0000 7fa2e67fc700 1 -- 172.21.15.110:0/350554221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2e80b8660 msgr2=0x7fa2d4003760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:49.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.757+0000 7fa2e67fc700 1 --2- 172.21.15.110:0/350554221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2e80b8660 0x7fa2d4003760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:49.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.757+0000 7fa2e67fc700 1 -- 172.21.15.110:0/350554221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2d4004a00 msgr2=0x7fa2d4004e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:49.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.757+0000 7fa2e67fc700 1 --2- 172.21.15.110:0/350554221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2d4004a00 0x7fa2d4004e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:49.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.757+0000 7fa2e67fc700 1 -- 172.21.15.110:0/350554221 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d4003270 con 0x7fa2d4003c70 2021-03-25T14:16:49.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.757+0000 7fa2e67fc700 1 --2- 172.21.15.110:0/350554221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2d4003c70 0x7fa2d4004510 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7fa2d800fb10 tx=0x7fa2d8011040).ready entity=mon.0 client_cookie=ddf0e72f6df39660 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:49.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.757+0000 7fa2e5ffb700 1 -- 172.21.15.110:0/350554221 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d8014040 con 0x7fa2d4003c70 2021-03-25T14:16:49.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.757+0000 7fa2e5ffb700 1 -- 172.21.15.110:0/350554221 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d800f130 con 0x7fa2d4003c70 2021-03-25T14:16:49.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.757+0000 7fa2e5ffb700 1 -- 172.21.15.110:0/350554221 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d800ee40 con 0x7fa2d4003c70 2021-03-25T14:16:49.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.757+0000 7fa2e7fff700 1 -- 172.21.15.110:0/350554221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2d4003c70 msgr2=0x7fa2d4004510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:49.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.757+0000 7fa2e7fff700 1 --2- 172.21.15.110:0/350554221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2d4003c70 0x7fa2d4004510 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7fa2d800fb10 tx=0x7fa2d8011040).stop 2021-03-25T14:16:49.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.757+0000 7fa2e77fe700 1 -- 172.21.15.110:0/350554221 reap_dead start 2021-03-25T14:16:49.769 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.757+0000 7fa2e7fff700 1 -- 172.21.15.110:0/350554221 shutdown_connections 2021-03-25T14:16:49.769 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.757+0000 7fa2e7fff700 1 -- 172.21.15.110:0/350554221 >> 172.21.15.110:0/350554221 conn(0x7fa2e80bc2e0 msgr2=0x7fa2e80bc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:49.769 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.757+0000 7fa2e7fff700 1 -- 172.21.15.110:0/350554221 shutdown_connections 2021-03-25T14:16:49.770 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.757+0000 7fa2e7fff700 1 -- 172.21.15.110:0/350554221 wait complete. 2021-03-25T14:16:49.770 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.759+0000 7fa2e7fff700 1 Processor -- start 2021-03-25T14:16:49.770 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.759+0000 7fa2e7fff700 1 -- start start 2021-03-25T14:16:49.770 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.759+0000 7fa2e7fff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2e80b4820 0x7fa2e814b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:49.770 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.759+0000 7fa2e7fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2e8148790 0x7fa2e813db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:49.770 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.759+0000 7fa2e7fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2e813e030 0x7fa2e809fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:49.770 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.759+0000 7fa2e7fff700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e809f4b0 con 0x7fa2e8148790 2021-03-25T14:16:49.770 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.759+0000 7fa2e7fff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e80b5ef0 con 0x7fa2e80b4820 2021-03-25T14:16:49.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.759+0000 7fa2e7fff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e80b6190 con 0x7fa2e813e030 2021-03-25T14:16:49.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.759+0000 7fa2e67fc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2e8148790 0x7fa2e813db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:49.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.759+0000 7fa2e67fc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2e8148790 0x7fa2e813db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48738/0 (socket says 172.21.15.110:48738) 2021-03-25T14:16:49.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.759+0000 7fa2e67fc700 1 -- 172.21.15.110:0/1801133025 learned_addr learned my addr 172.21.15.110:0/1801133025 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:49.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.759+0000 7fa2e77fe700 1 --2- 172.21.15.110:0/1801133025 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2e813e030 0x7fa2e809fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:49.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.760+0000 7fa2e6ffd700 1 --2- 172.21.15.110:0/1801133025 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2e80b4820 0x7fa2e814b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:49.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.760+0000 7fa2e67fc700 1 -- 172.21.15.110:0/1801133025 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2e813e030 msgr2=0x7fa2e809fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:49.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.760+0000 7fa2e67fc700 1 --2- 172.21.15.110:0/1801133025 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2e813e030 0x7fa2e809fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:49.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.760+0000 7fa2e67fc700 1 -- 172.21.15.110:0/1801133025 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2e80b4820 msgr2=0x7fa2e814b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:49.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.760+0000 7fa2e67fc700 1 --2- 172.21.15.110:0/1801133025 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2e80b4820 0x7fa2e814b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:49.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.760+0000 7fa2e67fc700 1 -- 172.21.15.110:0/1801133025 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e80b6430 con 0x7fa2e8148790 2021-03-25T14:16:49.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.760+0000 7fa2e67fc700 1 --2- 172.21.15.110:0/1801133025 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2e8148790 0x7fa2e813db40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7fa2d4005490 tx=0x7fa2d801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:49.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.760+0000 7fa2ceffd700 1 -- 172.21.15.110:0/1801133025 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d8014030 con 0x7fa2e8148790 2021-03-25T14:16:49.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.760+0000 7fa2ceffd700 1 -- 172.21.15.110:0/1801133025 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d80185a0 con 0x7fa2e8148790 2021-03-25T14:16:49.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.760+0000 7fa2e7fff700 1 -- 172.21.15.110:0/1801133025 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2e809f710 con 0x7fa2e8148790 2021-03-25T14:16:49.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.760+0000 7fa2ceffd700 1 -- 172.21.15.110:0/1801133025 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d8018980 con 0x7fa2e8148790 2021-03-25T14:16:49.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.760+0000 7fa2e7fff700 1 -- 172.21.15.110:0/1801133025 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2e813e4b0 con 0x7fa2e8148790 2021-03-25T14:16:49.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.761+0000 7fa2e7fff700 1 -- 172.21.15.110:0/1801133025 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2e8064380 con 0x7fa2e8148790 2021-03-25T14:16:49.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.761+0000 7fa2ceffd700 1 -- 172.21.15.110:0/1801133025 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fa2d8028030 con 0x7fa2e8148790 2021-03-25T14:16:49.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.761+0000 7fa2ceffd700 1 --2- 172.21.15.110:0/1801133025 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa2c805a0e0 0x7fa2c805c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:49.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.761+0000 7fa2ceffd700 1 -- 172.21.15.110:0/1801133025 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fa2d8078bd0 con 0x7fa2e8148790 2021-03-25T14:16:49.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.762+0000 7fa2e6ffd700 1 --2- 172.21.15.110:0/1801133025 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa2c805a0e0 0x7fa2c805c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:49.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.762+0000 7fa2e6ffd700 1 --2- 172.21.15.110:0/1801133025 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa2c805a0e0 0x7fa2c805c5a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fa2dc000c00 tx=0x7fa2dc007040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:49.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.765+0000 7fa2ceffd700 1 -- 172.21.15.110:0/1801133025 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fa2d8075620 con 0x7fa2e8148790 2021-03-25T14:16:49.917 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.915+0000 7fa2e7fff700 1 -- 172.21.15.110:0/1801133025 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2e8045ae0 con 0x7fa2e8148790 2021-03-25T14:16:49.918 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.916+0000 7fa2ceffd700 1 -- 172.21.15.110:0/1801133025 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18685 (secure 0 0 0) 0x7fa2d8026090 con 0x7fa2e8148790 2021-03-25T14:16:49.919 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:16:49.920 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":25,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:16:15.446609+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-03-25T14:16:09.478442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-03-25T14:16:10.071152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2021-03-25T14:16:13.122119+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:16:49.922 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.917+0000 7fa2e7fff700 1 -- 172.21.15.110:0/1801133025 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa2c805a0e0 msgr2=0x7fa2c805c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:49.922 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.917+0000 7fa2e7fff700 1 --2- 172.21.15.110:0/1801133025 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa2c805a0e0 0x7fa2c805c5a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fa2dc000c00 tx=0x7fa2dc007040).stop 2021-03-25T14:16:49.922 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.917+0000 7fa2e7fff700 1 -- 172.21.15.110:0/1801133025 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2e8148790 msgr2=0x7fa2e813db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:49.922 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.917+0000 7fa2e7fff700 1 --2- 172.21.15.110:0/1801133025 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2e8148790 0x7fa2e813db40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7fa2d4005490 tx=0x7fa2d801a000).stop 2021-03-25T14:16:49.922 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.917+0000 7fa2e7fff700 1 -- 172.21.15.110:0/1801133025 shutdown_connections 2021-03-25T14:16:49.922 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.917+0000 7fa2e7fff700 1 --2- 172.21.15.110:0/1801133025 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa2c805a0e0 0x7fa2c805c5a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:49.922 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.917+0000 7fa2e7fff700 1 --2- 172.21.15.110:0/1801133025 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2e80b4820 0x7fa2e814b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:49.922 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.917+0000 7fa2e7fff700 1 --2- 172.21.15.110:0/1801133025 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2e813e030 0x7fa2e809fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:49.922 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.917+0000 7fa2e7fff700 1 --2- 172.21.15.110:0/1801133025 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2e8148790 0x7fa2e813db40 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:49.923 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.917+0000 7fa2e7fff700 1 -- 172.21.15.110:0/1801133025 >> 172.21.15.110:0/1801133025 conn(0x7fa2e80bc2e0 msgr2=0x7fa2e8064ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:49.923 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.918+0000 7fa2e7fff700 1 -- 172.21.15.110:0/1801133025 shutdown_connections 2021-03-25T14:16:49.923 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:49.918+0000 7fa2e7fff700 1 -- 172.21.15.110:0/1801133025 wait complete. 2021-03-25T14:16:49.931 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-03-25T14:15:59.047299+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-03-25T14:16:00.537926+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-03-25T14:16:09.478442+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-03-25T14:16:10.071152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2021-03-25T14:16:13.122119+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-03-25T14:16:49.932 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-03-25T14:16:50.045 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.043+0000 7f5eb78cb700 1 Processor -- start 2021-03-25T14:16:50.045 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.043+0000 7f5eb78cb700 1 -- start start 2021-03-25T14:16:50.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.044+0000 7f5eb78cb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5eb00b0cc0 0x7f5eb0145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:50.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.044+0000 7f5eb78cb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5eb00b5d00 0x7f5eb0067250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:50.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.044+0000 7f5eb78cb700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eb0149c50 con 0x7f5eb00648a0 2021-03-25T14:16:50.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.044+0000 7f5eb78cb700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eb01461b0 con 0x7f5eb00b5d00 2021-03-25T14:16:50.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.044+0000 7f5eb78cb700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb0149e80 con 0x7f5eb00b0cc0 2021-03-25T14:16:50.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.044+0000 7f5eb5e68700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f5eb00648a0 0x7f5eb009db40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41684/0 (socket says 172.21.15.110:41684) 2021-03-25T14:16:50.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.044+0000 7f5eb5e68700 1 -- 172.21.15.110:0/3129532611 learned_addr learned my addr 172.21.15.110:0/3129532611 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:50.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.044+0000 7f5eb4e66700 1 --2- 172.21.15.110:0/3129532611 >> v2:172.21.15.174:3300/0 conn(0x7f5eb00b5d00 0x7f5eb0067250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:50.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.044+0000 7f5eb5667700 1 --2- 172.21.15.110:0/3129532611 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5eb00b0cc0 0x7f5eb0145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:50.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.044+0000 7f5e9ffff700 1 -- 172.21.15.110:0/3129532611 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3536729970 0 0) 0x7f5eb0149c50 con 0x7f5eb00648a0 2021-03-25T14:16:50.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.045+0000 7f5e9ffff700 1 -- 172.21.15.110:0/3129532611 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e98003270 con 0x7f5eb00648a0 2021-03-25T14:16:50.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.045+0000 7f5e9ffff700 1 -- 172.21.15.110:0/3129532611 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1852102443 0 0) 0x7f5e98003270 con 0x7f5eb00648a0 2021-03-25T14:16:50.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.045+0000 7f5e9ffff700 1 -- 172.21.15.110:0/3129532611 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5eb00b0cc0 msgr2=0x7f5eb0145cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:50.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.045+0000 7f5e9ffff700 1 --2- 172.21.15.110:0/3129532611 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5eb00b0cc0 0x7f5eb0145cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:50.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.045+0000 7f5e9ffff700 1 -- 172.21.15.110:0/3129532611 >> v2:172.21.15.174:3300/0 conn(0x7f5eb00b5d00 msgr2=0x7f5eb0067250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:50.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.045+0000 7f5e9ffff700 1 --2- 172.21.15.110:0/3129532611 >> v2:172.21.15.174:3300/0 conn(0x7f5eb00b5d00 0x7f5eb0067250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:50.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.045+0000 7f5e9ffff700 1 -- 172.21.15.110:0/3129532611 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb00b6650 con 0x7f5eb00648a0 2021-03-25T14:16:50.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.045+0000 7f5e9ffff700 1 -- 172.21.15.110:0/3129532611 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f5ea80018a0 con 0x7f5eb00648a0 2021-03-25T14:16:50.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.045+0000 7f5e9ffff700 1 -- 172.21.15.110:0/3129532611 >> v1:172.21.15.110:6789/0 conn(0x7f5eb00648a0 legacy=0x7f5eb009db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:50.051 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.045+0000 7f5e9ffff700 1 --2- 172.21.15.110:0/3129532611 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5eb00b0cc0 0x7f5e98003760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:50.051 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.045+0000 7f5e9ffff700 1 --2- 172.21.15.110:0/3129532611 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e98003c70 0x7f5e98004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:50.051 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.045+0000 7f5e9ffff700 1 --2- 172.21.15.110:0/3129532611 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5e98004a00 0x7f5e98004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:50.051 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.045+0000 7f5e9ffff700 1 -- 172.21.15.110:0/3129532611 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb01461b0 con 0x7f5e98003c70 2021-03-25T14:16:50.051 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.045+0000 7f5e9ffff700 1 -- 172.21.15.110:0/3129532611 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb0149e80 con 0x7f5e98004a00 2021-03-25T14:16:50.051 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.045+0000 7f5e9ffff700 1 -- 172.21.15.110:0/3129532611 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e98004230 con 0x7f5eb00b0cc0 2021-03-25T14:16:50.051 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.045+0000 7f5eb4e66700 1 --2- 172.21.15.110:0/3129532611 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e98003c70 0x7f5e98004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:50.051 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.045+0000 7f5eb5667700 1 --2- 172.21.15.110:0/3129532611 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5eb00b0cc0 0x7f5e98003760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:50.051 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.045+0000 7f5eb5e68700 1 --2- 172.21.15.110:0/3129532611 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5e98004a00 0x7f5e98004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:50.051 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.045+0000 7f5eb4e66700 1 -- 172.21.15.110:0/3129532611 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5eb00b0cc0 msgr2=0x7f5e98003760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:50.051 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.045+0000 7f5eb4e66700 1 --2- 172.21.15.110:0/3129532611 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5eb00b0cc0 0x7f5e98003760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:50.051 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.045+0000 7f5eb4e66700 1 -- 172.21.15.110:0/3129532611 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5e98004a00 msgr2=0x7f5e98004e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:50.051 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.045+0000 7f5eb4e66700 1 --2- 172.21.15.110:0/3129532611 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5e98004a00 0x7f5e98004e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:50.052 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.045+0000 7f5eb4e66700 1 -- 172.21.15.110:0/3129532611 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e98003270 con 0x7f5e98003c70 2021-03-25T14:16:50.052 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.045+0000 7f5eb5e68700 1 --2- 172.21.15.110:0/3129532611 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5e98004a00 0x7f5e98004e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:50.052 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.045+0000 7f5eb4e66700 1 --2- 172.21.15.110:0/3129532611 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e98003c70 0x7f5e98004510 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f5eb00b9680 tx=0x7f5ea0006e20).ready entity=mon.0 client_cookie=869bac7b924563d1 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:50.052 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.045+0000 7f5e9ffff700 1 -- 172.21.15.110:0/3129532611 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea000b330 con 0x7f5e98003c70 2021-03-25T14:16:50.052 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.046+0000 7f5e9ffff700 1 -- 172.21.15.110:0/3129532611 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea000e910 con 0x7f5e98003c70 2021-03-25T14:16:50.052 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.046+0000 7f5e9ffff700 1 -- 172.21.15.110:0/3129532611 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea000ec90 con 0x7f5e98003c70 2021-03-25T14:16:50.052 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.046+0000 7f5eb78cb700 1 -- 172.21.15.110:0/3129532611 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e98003c70 msgr2=0x7f5e98004510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:50.052 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.046+0000 7f5eb78cb700 1 --2- 172.21.15.110:0/3129532611 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e98003c70 0x7f5e98004510 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f5eb00b9680 tx=0x7f5ea0006e20).stop 2021-03-25T14:16:50.052 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.046+0000 7f5eb5e68700 1 -- 172.21.15.110:0/3129532611 reap_dead start 2021-03-25T14:16:50.052 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.046+0000 7f5eb78cb700 1 -- 172.21.15.110:0/3129532611 shutdown_connections 2021-03-25T14:16:50.052 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.046+0000 7f5eb78cb700 1 -- 172.21.15.110:0/3129532611 >> 172.21.15.110:0/3129532611 conn(0x7f5eb00664e0 msgr2=0x7f5eb00668f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:50.052 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.046+0000 7f5eb78cb700 1 -- 172.21.15.110:0/3129532611 shutdown_connections 2021-03-25T14:16:50.053 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.046+0000 7f5eb78cb700 1 -- 172.21.15.110:0/3129532611 wait complete. 2021-03-25T14:16:50.053 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.047+0000 7f5eb78cb700 1 Processor -- start 2021-03-25T14:16:50.053 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.047+0000 7f5eb78cb700 1 -- start start 2021-03-25T14:16:50.055 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.048+0000 7f5eb78cb700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5eb00b7a30 0x7f5eb00b7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:50.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.048+0000 7f5eb78cb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5eb015a910 0x7f5eb00b3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:50.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.048+0000 7f5eb78cb700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5eb0156a50 0x7f5eb009ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:50.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.048+0000 7f5eb78cb700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb013ecc0 con 0x7f5eb00b7a30 2021-03-25T14:16:50.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.048+0000 7f5eb78cb700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb0159fa0 con 0x7f5eb0156a50 2021-03-25T14:16:50.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.048+0000 7f5eb78cb700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb00b3b20 con 0x7f5eb015a910 2021-03-25T14:16:50.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.048+0000 7f5eb5667700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5eb00b7a30 0x7f5eb00b7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:50.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.048+0000 7f5eb5667700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5eb00b7a30 0x7f5eb00b7e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48760/0 (socket says 172.21.15.110:48760) 2021-03-25T14:16:50.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.048+0000 7f5eb5667700 1 -- 172.21.15.110:0/3265117376 learned_addr learned my addr 172.21.15.110:0/3265117376 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:50.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.048+0000 7f5eb5e68700 1 --2- 172.21.15.110:0/3265117376 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5eb0156a50 0x7f5eb009ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:50.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.048+0000 7f5eb4e66700 1 --2- 172.21.15.110:0/3265117376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5eb015a910 0x7f5eb00b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:50.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.049+0000 7f5eb5667700 1 -- 172.21.15.110:0/3265117376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5eb015a910 msgr2=0x7f5eb00b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:50.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.049+0000 7f5eb5667700 1 --2- 172.21.15.110:0/3265117376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5eb015a910 0x7f5eb00b3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:50.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.049+0000 7f5eb5667700 1 -- 172.21.15.110:0/3265117376 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5eb0156a50 msgr2=0x7f5eb009ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:50.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.049+0000 7f5eb5667700 1 --2- 172.21.15.110:0/3265117376 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5eb0156a50 0x7f5eb009ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:50.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.049+0000 7f5eb5667700 1 -- 172.21.15.110:0/3265117376 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb00b3db0 con 0x7f5eb00b7a30 2021-03-25T14:16:50.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.049+0000 7f5eb5e68700 1 --2- 172.21.15.110:0/3265117376 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5eb0156a50 0x7f5eb009ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:50.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.049+0000 7f5eb5667700 1 --2- 172.21.15.110:0/3265117376 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5eb00b7a30 0x7f5eb00b7e10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f5eac011cf0 tx=0x7f5eac006e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:50.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.049+0000 7f5e9d7fa700 1 -- 172.21.15.110:0/3265117376 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eac00fb00 con 0x7f5eb00b7a30 2021-03-25T14:16:50.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.049+0000 7f5e9d7fa700 1 -- 172.21.15.110:0/3265117376 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eac00fc60 con 0x7f5eb00b7a30 2021-03-25T14:16:50.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.049+0000 7f5eb78cb700 1 -- 172.21.15.110:0/3265117376 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eb00b4050 con 0x7f5eb00b7a30 2021-03-25T14:16:50.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.049+0000 7f5e9d7fa700 1 -- 172.21.15.110:0/3265117376 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eac014440 con 0x7f5eb00b7a30 2021-03-25T14:16:50.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.049+0000 7f5eb78cb700 1 -- 172.21.15.110:0/3265117376 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eb015a470 con 0x7f5eb00b7a30 2021-03-25T14:16:50.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.050+0000 7f5eb78cb700 1 -- 172.21.15.110:0/3265117376 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eb005d7b0 con 0x7f5eb00b7a30 2021-03-25T14:16:50.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.050+0000 7f5e9d7fa700 1 -- 172.21.15.110:0/3265117376 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f5eac024070 con 0x7f5eb00b7a30 2021-03-25T14:16:50.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.050+0000 7f5e9d7fa700 1 --2- 172.21.15.110:0/3265117376 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5e9005a0e0 0x7f5e9005c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:50.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.051+0000 7f5e9d7fa700 1 -- 172.21.15.110:0/3265117376 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f5eac074ac0 con 0x7f5eb00b7a30 2021-03-25T14:16:50.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.051+0000 7f5eb4e66700 1 --2- 172.21.15.110:0/3265117376 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5e9005a0e0 0x7f5e9005c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:50.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.051+0000 7f5eb4e66700 1 --2- 172.21.15.110:0/3265117376 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5e9005a0e0 0x7f5e9005c5a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f5eb00b9680 tx=0x7f5ea0016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:50.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.054+0000 7f5e9d7fa700 1 -- 172.21.15.110:0/3265117376 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f5eac048170 con 0x7f5eb00b7a30 2021-03-25T14:16:50.208 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.206+0000 7f5eb78cb700 1 -- 172.21.15.110:0/3265117376 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f5eb00b7810 con 0x7f5eb00b7a30 2021-03-25T14:16:50.208 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.206+0000 7f5e9d7fa700 1 -- 172.21.15.110:0/3265117376 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7f5eac04b790 con 0x7f5eb00b7a30 2021-03-25T14:16:50.208 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 1 2021-03-25T14:16:50.210 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.208+0000 7f5eb78cb700 1 -- 172.21.15.110:0/3265117376 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5e9005a0e0 msgr2=0x7f5e9005c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:50.210 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.208+0000 7f5eb78cb700 1 --2- 172.21.15.110:0/3265117376 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5e9005a0e0 0x7f5e9005c5a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f5eb00b9680 tx=0x7f5ea0016000).stop 2021-03-25T14:16:50.210 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.208+0000 7f5eb78cb700 1 -- 172.21.15.110:0/3265117376 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5eb00b7a30 msgr2=0x7f5eb00b7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:50.210 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.208+0000 7f5eb78cb700 1 --2- 172.21.15.110:0/3265117376 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5eb00b7a30 0x7f5eb00b7e10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f5eac011cf0 tx=0x7f5eac006e20).stop 2021-03-25T14:16:50.210 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.208+0000 7f5eb78cb700 1 -- 172.21.15.110:0/3265117376 shutdown_connections 2021-03-25T14:16:50.210 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.208+0000 7f5eb78cb700 1 --2- 172.21.15.110:0/3265117376 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5e9005a0e0 0x7f5e9005c5a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:50.211 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.208+0000 7f5eb78cb700 1 --2- 172.21.15.110:0/3265117376 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5eb0156a50 0x7f5eb009ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:50.211 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.208+0000 7f5eb78cb700 1 --2- 172.21.15.110:0/3265117376 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5eb00b7a30 0x7f5eb00b7e10 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:50.211 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.208+0000 7f5eb78cb700 1 --2- 172.21.15.110:0/3265117376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5eb015a910 0x7f5eb00b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:50.211 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.208+0000 7f5eb78cb700 1 -- 172.21.15.110:0/3265117376 >> 172.21.15.110:0/3265117376 conn(0x7f5eb00664e0 msgr2=0x7f5eb00688e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:50.211 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.208+0000 7f5eb78cb700 1 -- 172.21.15.110:0/3265117376 shutdown_connections 2021-03-25T14:16:50.211 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.208+0000 7f5eb78cb700 1 -- 172.21.15.110:0/3265117376 wait complete. 2021-03-25T14:16:50.221 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-03-25T14:16:50.334 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.332+0000 7fd5cedcf700 1 Processor -- start 2021-03-25T14:16:50.334 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.332+0000 7fd5cedcf700 1 -- start start 2021-03-25T14:16:50.336 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.333+0000 7fd5cedcf700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd5c814d470 0x7fd5c814d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:50.337 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.333+0000 7fd5cedcf700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5c814cc90 0x7fd5c81493c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:50.337 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.333+0000 7fd5cedcf700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c80691b0 con 0x7fd5c81498b0 2021-03-25T14:16:50.337 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.333+0000 7fd5cedcf700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5c80bc2b0 con 0x7fd5c814d470 2021-03-25T14:16:50.337 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.333+0000 7fd5cedcf700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c8149dd0 con 0x7fd5c814cc90 2021-03-25T14:16:50.337 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.333+0000 7fd5c7fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5c814cc90 0x7fd5c81493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:50.337 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.333+0000 7fd5ccb6b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd5c814d470 0x7fd5c814d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:50.337 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.333+0000 7fd5c7fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5c814cc90 0x7fd5c81493c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.110:41168/0 (socket says 172.21.15.110:41168) 2021-03-25T14:16:50.337 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.333+0000 7fd5c7fff700 1 -- 172.21.15.110:0/2828838697 learned_addr learned my addr 172.21.15.110:0/2828838697 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:50.337 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.333+0000 7fd5cd36c700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fd5c81498b0 0x7fd5c80685d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.110:49368/0 (socket says 172.21.15.110:49368) 2021-03-25T14:16:50.337 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.333+0000 7fd5c7fff700 1 -- 172.21.15.110:0/2828838697 >> v2:172.21.15.174:3300/0 conn(0x7fd5c814d470 msgr2=0x7fd5c814d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:50.337 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.333+0000 7fd5c7fff700 1 --2- 172.21.15.110:0/2828838697 >> v2:172.21.15.174:3300/0 conn(0x7fd5c814d470 0x7fd5c814d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:50.338 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.333+0000 7fd5c7fff700 1 -- 172.21.15.110:0/2828838697 >> v1:172.21.15.174:6789/0 conn(0x7fd5c81498b0 legacy=0x7fd5c80685d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:50.338 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.333+0000 7fd5c7fff700 1 -- 172.21.15.110:0/2828838697 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c814a070 con 0x7fd5c814cc90 2021-03-25T14:16:50.338 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.333+0000 7fd5c7fff700 1 --2- 172.21.15.110:0/2828838697 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5c814cc90 0x7fd5c81493c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fd5b400ba20 tx=0x7fd5b4006ee0).ready entity=mon.2 client_cookie=2bb9e151c2088635 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:50.338 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.334+0000 7fd5c77fe700 1 -- 172.21.15.110:0/2828838697 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b4009840 con 0x7fd5c814cc90 2021-03-25T14:16:50.338 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.334+0000 7fd5c77fe700 1 -- 172.21.15.110:0/2828838697 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b40099a0 con 0x7fd5c814cc90 2021-03-25T14:16:50.338 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.334+0000 7fd5c77fe700 1 -- 172.21.15.110:0/2828838697 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b4009d20 con 0x7fd5c814cc90 2021-03-25T14:16:50.338 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.334+0000 7fd5cedcf700 1 -- 172.21.15.110:0/2828838697 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5c814cc90 msgr2=0x7fd5c81493c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:50.338 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.334+0000 7fd5cedcf700 1 --2- 172.21.15.110:0/2828838697 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5c814cc90 0x7fd5c81493c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fd5b400ba20 tx=0x7fd5b4006ee0).stop 2021-03-25T14:16:50.338 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.334+0000 7fd5cedcf700 1 -- 172.21.15.110:0/2828838697 shutdown_connections 2021-03-25T14:16:50.338 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.334+0000 7fd5cedcf700 1 --2- 172.21.15.110:0/2828838697 >> v2:172.21.15.174:3300/0 conn(0x7fd5c814d470 0x7fd5c814d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:50.338 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.334+0000 7fd5cedcf700 1 --2- 172.21.15.110:0/2828838697 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5c814cc90 0x7fd5c81493c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:50.338 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.334+0000 7fd5cedcf700 1 -- 172.21.15.110:0/2828838697 >> 172.21.15.110:0/2828838697 conn(0x7fd5c8060c40 msgr2=0x7fd5c8061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:50.339 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.334+0000 7fd5cedcf700 1 -- 172.21.15.110:0/2828838697 shutdown_connections 2021-03-25T14:16:50.339 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.334+0000 7fd5cedcf700 1 -- 172.21.15.110:0/2828838697 wait complete. 2021-03-25T14:16:50.341 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.335+0000 7fd5cedcf700 1 Processor -- start 2021-03-25T14:16:50.341 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.336+0000 7fd5cedcf700 1 -- start start 2021-03-25T14:16:50.341 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.336+0000 7fd5cedcf700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5c81498b0 0x7fd5c8145de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:50.341 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.336+0000 7fd5cedcf700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd5c814cc90 0x7fd5c80a5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:50.342 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.336+0000 7fd5cedcf700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5c814d470 0x7fd5c80a5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:50.342 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.336+0000 7fd5cedcf700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c8159640 con 0x7fd5c81498b0 2021-03-25T14:16:50.342 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.336+0000 7fd5cedcf700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c81598e0 con 0x7fd5c814cc90 2021-03-25T14:16:50.342 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.336+0000 7fd5cedcf700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c814be70 con 0x7fd5c814d470 2021-03-25T14:16:50.342 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.336+0000 7fd5ccb6b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5c81498b0 0x7fd5c8145de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:50.342 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.336+0000 7fd5ccb6b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5c81498b0 0x7fd5c8145de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48772/0 (socket says 172.21.15.110:48772) 2021-03-25T14:16:50.342 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.336+0000 7fd5ccb6b700 1 -- 172.21.15.110:0/3378533663 learned_addr learned my addr 172.21.15.110:0/3378533663 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:50.342 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.336+0000 7fd5c7fff700 1 --2- 172.21.15.110:0/3378533663 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd5c814cc90 0x7fd5c80a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:50.342 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.336+0000 7fd5cd36c700 1 --2- 172.21.15.110:0/3378533663 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5c814d470 0x7fd5c80a5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:50.342 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.337+0000 7fd5ccb6b700 1 -- 172.21.15.110:0/3378533663 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5c814d470 msgr2=0x7fd5c80a5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:50.342 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.337+0000 7fd5ccb6b700 1 --2- 172.21.15.110:0/3378533663 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5c814d470 0x7fd5c80a5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:50.343 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.337+0000 7fd5ccb6b700 1 -- 172.21.15.110:0/3378533663 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd5c814cc90 msgr2=0x7fd5c80a5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:50.343 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.337+0000 7fd5ccb6b700 1 --2- 172.21.15.110:0/3378533663 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd5c814cc90 0x7fd5c80a5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:50.343 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.337+0000 7fd5ccb6b700 1 -- 172.21.15.110:0/3378533663 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c814c110 con 0x7fd5c81498b0 2021-03-25T14:16:50.343 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.337+0000 7fd5ccb6b700 1 --2- 172.21.15.110:0/3378533663 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5c81498b0 0x7fd5c8145de0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7fd5bc00ebd0 tx=0x7fd5bc006e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:50.343 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.337+0000 7fd5c4ff9700 1 -- 172.21.15.110:0/3378533663 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc00c8e0 con 0x7fd5c81498b0 2021-03-25T14:16:50.343 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.337+0000 7fd5c4ff9700 1 -- 172.21.15.110:0/3378533663 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5bc00ca40 con 0x7fd5c81498b0 2021-03-25T14:16:50.343 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.337+0000 7fd5cedcf700 1 -- 172.21.15.110:0/3378533663 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5c8159370 con 0x7fd5c81498b0 2021-03-25T14:16:50.343 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.337+0000 7fd5c4ff9700 1 -- 172.21.15.110:0/3378533663 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc00cdc0 con 0x7fd5c81498b0 2021-03-25T14:16:50.343 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.337+0000 7fd5cedcf700 1 -- 172.21.15.110:0/3378533663 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c81462d0 con 0x7fd5c81498b0 2021-03-25T14:16:50.343 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.338+0000 7fd5cedcf700 1 -- 172.21.15.110:0/3378533663 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5c805d350 con 0x7fd5c81498b0 2021-03-25T14:16:50.343 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.338+0000 7fd5c4ff9700 1 -- 172.21.15.110:0/3378533663 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fd5bc012600 con 0x7fd5c81498b0 2021-03-25T14:16:50.343 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.338+0000 7fd5c4ff9700 1 --2- 172.21.15.110:0/3378533663 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd5a805a0b0 0x7fd5a805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:50.343 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.338+0000 7fd5c4ff9700 1 -- 172.21.15.110:0/3378533663 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fd5bc074440 con 0x7fd5c81498b0 2021-03-25T14:16:50.344 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.339+0000 7fd5c7fff700 1 --2- 172.21.15.110:0/3378533663 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd5a805a0b0 0x7fd5a805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:50.344 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.339+0000 7fd5c7fff700 1 --2- 172.21.15.110:0/3378533663 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd5a805a0b0 0x7fd5a805c570 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fd5b4006f20 tx=0x7fd5b4016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:50.344 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.342+0000 7fd5c4ff9700 1 -- 172.21.15.110:0/3378533663 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fd5c805d350 con 0x7fd5c81498b0 2021-03-25T14:16:50.493 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.491+0000 7fd5cedcf700 1 -- 172.21.15.110:0/3378533663 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd5c8146580 con 0x7fd5c81498b0 2021-03-25T14:16:50.493 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.492+0000 7fd5c4ff9700 1 -- 172.21.15.110:0/3378533663 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd5c8146580 con 0x7fd5c81498b0 2021-03-25T14:16:50.494 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:16:50.495 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.493+0000 7fd5cedcf700 1 -- 172.21.15.110:0/3378533663 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd5a805a0b0 msgr2=0x7fd5a805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:50.495 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.493+0000 7fd5cedcf700 1 --2- 172.21.15.110:0/3378533663 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd5a805a0b0 0x7fd5a805c570 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fd5b4006f20 tx=0x7fd5b4016000).stop 2021-03-25T14:16:50.495 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.493+0000 7fd5cedcf700 1 -- 172.21.15.110:0/3378533663 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5c81498b0 msgr2=0x7fd5c8145de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:50.496 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.493+0000 7fd5cedcf700 1 --2- 172.21.15.110:0/3378533663 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5c81498b0 0x7fd5c8145de0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7fd5bc00ebd0 tx=0x7fd5bc006e20).stop 2021-03-25T14:16:50.496 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.493+0000 7fd5cedcf700 1 -- 172.21.15.110:0/3378533663 shutdown_connections 2021-03-25T14:16:50.496 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.493+0000 7fd5cedcf700 1 --2- 172.21.15.110:0/3378533663 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd5a805a0b0 0x7fd5a805c570 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:50.496 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.493+0000 7fd5cedcf700 1 --2- 172.21.15.110:0/3378533663 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5c814d470 0x7fd5c80a5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:50.496 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.493+0000 7fd5cedcf700 1 --2- 172.21.15.110:0/3378533663 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5c81498b0 0x7fd5c8145de0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:50.496 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.493+0000 7fd5cedcf700 1 --2- 172.21.15.110:0/3378533663 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd5c814cc90 0x7fd5c80a5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:50.496 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.493+0000 7fd5cedcf700 1 -- 172.21.15.110:0/3378533663 >> 172.21.15.110:0/3378533663 conn(0x7fd5c8060c40 msgr2=0x7fd5c80b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:50.496 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.493+0000 7fd5cedcf700 1 -- 172.21.15.110:0/3378533663 shutdown_connections 2021-03-25T14:16:50.496 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.493+0000 7fd5cedcf700 1 -- 172.21.15.110:0/3378533663 wait complete. 2021-03-25T14:16:50.506 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-03-25T14:16:50.618 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.616+0000 7efc6a8c2700 1 Processor -- start 2021-03-25T14:16:50.618 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.616+0000 7efc6a8c2700 1 -- start start 2021-03-25T14:16:50.625 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.617+0000 7efc6a8c2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efc6414d470 0x7efc6414d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:50.625 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.617+0000 7efc6a8c2700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc640691b0 con 0x7efc640685d0 2021-03-25T14:16:50.625 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.617+0000 7efc6a8c2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc640bc2b0 con 0x7efc6414cc90 2021-03-25T14:16:50.625 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.617+0000 7efc6a8c2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc64149dd0 con 0x7efc6414d470 2021-03-25T14:16:50.625 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.617+0000 7efc68e5f700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7efc640685d0 0x7efc640bc710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41716/0 (socket says 172.21.15.110:41716) 2021-03-25T14:16:50.625 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.617+0000 7efc68e5f700 1 -- 172.21.15.110:0/237417610 learned_addr learned my addr 172.21.15.110:0/237417610 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:50.625 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.617+0000 7efc62ffd700 1 -- 172.21.15.110:0/237417610 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 303591036 0 0) 0x7efc640691b0 con 0x7efc640685d0 2021-03-25T14:16:50.625 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.617+0000 7efc62ffd700 1 -- 172.21.15.110:0/237417610 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc50003270 con 0x7efc640685d0 2021-03-25T14:16:50.626 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.617+0000 7efc63fff700 1 --2- 172.21.15.110:0/237417610 >> v2:172.21.15.174:3300/0 conn(0x7efc6414d470 0x7efc6414d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:50.626 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.617+0000 7efc62ffd700 1 -- 172.21.15.110:0/237417610 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1407010120 0 0) 0x7efc50003270 con 0x7efc640685d0 2021-03-25T14:16:50.626 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.617+0000 7efc62ffd700 1 -- 172.21.15.110:0/237417610 >> v2:172.21.15.174:3300/0 conn(0x7efc6414d470 msgr2=0x7efc6414d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:50.626 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.617+0000 7efc62ffd700 1 --2- 172.21.15.110:0/237417610 >> v2:172.21.15.174:3300/0 conn(0x7efc6414d470 0x7efc6414d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:50.626 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.617+0000 7efc62ffd700 1 -- 172.21.15.110:0/237417610 >> v1:172.21.15.174:6789/0 conn(0x7efc6414cc90 legacy=0x7efc641493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:50.626 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.617+0000 7efc62ffd700 1 -- 172.21.15.110:0/237417610 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6414a070 con 0x7efc640685d0 2021-03-25T14:16:50.626 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.617+0000 7efc62ffd700 1 -- 172.21.15.110:0/237417610 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7efc5c0018a0 con 0x7efc640685d0 2021-03-25T14:16:50.626 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.618+0000 7efc62ffd700 1 -- 172.21.15.110:0/237417610 >> v1:172.21.15.110:6789/0 conn(0x7efc640685d0 legacy=0x7efc640bc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:50.626 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.618+0000 7efc62ffd700 1 --2- 172.21.15.110:0/237417610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc50003760 0x7efc50003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:50.626 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.618+0000 7efc62ffd700 1 --2- 172.21.15.110:0/237417610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc50004510 0x7efc50004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:50.626 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.618+0000 7efc62ffd700 1 --2- 172.21.15.110:0/237417610 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc50004e80 0x7efc5000b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:50.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.618+0000 7efc62ffd700 1 -- 172.21.15.110:0/237417610 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc64149dd0 con 0x7efc50003760 2021-03-25T14:16:50.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.618+0000 7efc62ffd700 1 -- 172.21.15.110:0/237417610 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc50004290 con 0x7efc50004510 2021-03-25T14:16:50.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.618+0000 7efc62ffd700 1 -- 172.21.15.110:0/237417610 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc5000bc50 con 0x7efc50004e80 2021-03-25T14:16:50.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.618+0000 7efc63fff700 1 --2- 172.21.15.110:0/237417610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc50003760 0x7efc50003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:50.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.618+0000 7efc637fe700 1 --2- 172.21.15.110:0/237417610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc50004510 0x7efc50004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:50.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.618+0000 7efc68e5f700 1 --2- 172.21.15.110:0/237417610 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc50004e80 0x7efc5000b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:50.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.618+0000 7efc63fff700 1 -- 172.21.15.110:0/237417610 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc50004e80 msgr2=0x7efc5000b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:50.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.618+0000 7efc63fff700 1 --2- 172.21.15.110:0/237417610 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc50004e80 0x7efc5000b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:50.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.618+0000 7efc63fff700 1 -- 172.21.15.110:0/237417610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc50004510 msgr2=0x7efc50004990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:50.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.618+0000 7efc63fff700 1 --2- 172.21.15.110:0/237417610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc50004510 0x7efc50004990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:50.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.618+0000 7efc63fff700 1 -- 172.21.15.110:0/237417610 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc50003270 con 0x7efc50003760 2021-03-25T14:16:50.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.618+0000 7efc68e5f700 1 --2- 172.21.15.110:0/237417610 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc50004e80 0x7efc5000b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:50.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.618+0000 7efc68e5f700 1 -- 172.21.15.110:0/237417610 reap_dead start 2021-03-25T14:16:50.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.618+0000 7efc63fff700 1 --2- 172.21.15.110:0/237417610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc50003760 0x7efc50003b80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7efc5400bc30 tx=0x7efc54006e20).ready entity=mon.0 client_cookie=1e7ee6a440b539fc server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:50.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.618+0000 7efc62ffd700 1 -- 172.21.15.110:0/237417610 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5400b310 con 0x7efc50003760 2021-03-25T14:16:50.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.618+0000 7efc62ffd700 1 -- 172.21.15.110:0/237417610 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5400eab0 con 0x7efc50003760 2021-03-25T14:16:50.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.618+0000 7efc62ffd700 1 -- 172.21.15.110:0/237417610 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5400ee30 con 0x7efc50003760 2021-03-25T14:16:50.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.619+0000 7efc6a8c2700 1 -- 172.21.15.110:0/237417610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc50003760 msgr2=0x7efc50003b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:50.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.619+0000 7efc6a8c2700 1 --2- 172.21.15.110:0/237417610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc50003760 0x7efc50003b80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7efc5400bc30 tx=0x7efc54006e20).stop 2021-03-25T14:16:50.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.619+0000 7efc6a8c2700 1 -- 172.21.15.110:0/237417610 shutdown_connections 2021-03-25T14:16:50.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.619+0000 7efc6a8c2700 1 --2- 172.21.15.110:0/237417610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc50003760 0x7efc50003b80 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:50.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.619+0000 7efc6a8c2700 1 -- 172.21.15.110:0/237417610 >> 172.21.15.110:0/237417610 conn(0x7efc64060c40 msgr2=0x7efc64061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:50.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.619+0000 7efc6a8c2700 1 -- 172.21.15.110:0/237417610 shutdown_connections 2021-03-25T14:16:50.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.619+0000 7efc6a8c2700 1 -- 172.21.15.110:0/237417610 wait complete. 2021-03-25T14:16:50.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.620+0000 7efc6a8c2700 1 Processor -- start 2021-03-25T14:16:50.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.620+0000 7efc6a8c2700 1 -- start start 2021-03-25T14:16:50.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.621+0000 7efc6a8c2700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc50003760 0x7efc640a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:50.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.621+0000 7efc6a8c2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc640bf290 0x7efc64144fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:50.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.621+0000 7efc6a8c2700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc64145490 0x7efc6414af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:50.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.621+0000 7efc6a8c2700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc640a4de0 con 0x7efc64145490 2021-03-25T14:16:50.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.621+0000 7efc6a8c2700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6414c8c0 con 0x7efc50003760 2021-03-25T14:16:50.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.621+0000 7efc6a8c2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc640a3a30 con 0x7efc640bf290 2021-03-25T14:16:50.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.621+0000 7efc68e5f700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc64145490 0x7efc6414af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:50.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.621+0000 7efc68e5f700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc64145490 0x7efc6414af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48794/0 (socket says 172.21.15.110:48794) 2021-03-25T14:16:50.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.621+0000 7efc68e5f700 1 -- 172.21.15.110:0/3027066085 learned_addr learned my addr 172.21.15.110:0/3027066085 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:50.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.621+0000 7efc637fe700 1 --2- 172.21.15.110:0/3027066085 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc640bf290 0x7efc64144fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:50.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.621+0000 7efc63fff700 1 --2- 172.21.15.110:0/3027066085 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc50003760 0x7efc640a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:50.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.621+0000 7efc68e5f700 1 -- 172.21.15.110:0/3027066085 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc640bf290 msgr2=0x7efc64144fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:50.630 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.621+0000 7efc68e5f700 1 --2- 172.21.15.110:0/3027066085 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc640bf290 0x7efc64144fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:50.630 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.621+0000 7efc68e5f700 1 -- 172.21.15.110:0/3027066085 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc50003760 msgr2=0x7efc640a5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:50.630 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.621+0000 7efc68e5f700 1 --2- 172.21.15.110:0/3027066085 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc50003760 0x7efc640a5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:50.630 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.621+0000 7efc68e5f700 1 -- 172.21.15.110:0/3027066085 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc640a4fd0 con 0x7efc64145490 2021-03-25T14:16:50.630 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.621+0000 7efc68e5f700 1 --2- 172.21.15.110:0/3027066085 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc64145490 0x7efc6414af00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7efc5c001350 tx=0x7efc5c009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:50.630 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.621+0000 7efc4bfff700 1 -- 172.21.15.110:0/3027066085 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5c00de50 con 0x7efc64145490 2021-03-25T14:16:50.630 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.621+0000 7efc4bfff700 1 -- 172.21.15.110:0/3027066085 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5c00bb10 con 0x7efc64145490 2021-03-25T14:16:50.630 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.621+0000 7efc4bfff700 1 -- 172.21.15.110:0/3027066085 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5c00be90 con 0x7efc64145490 2021-03-25T14:16:50.630 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.621+0000 7efc6a8c2700 1 -- 172.21.15.110:0/3027066085 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc6414c620 con 0x7efc64145490 2021-03-25T14:16:50.630 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.621+0000 7efc6a8c2700 1 -- 172.21.15.110:0/3027066085 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc640a54d0 con 0x7efc64145490 2021-03-25T14:16:50.630 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.623+0000 7efc4bfff700 1 -- 172.21.15.110:0/3027066085 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7efc5c004ac0 con 0x7efc64145490 2021-03-25T14:16:50.630 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.623+0000 7efc6a8c2700 1 -- 172.21.15.110:0/3027066085 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc640a5690 con 0x7efc64145490 2021-03-25T14:16:50.631 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.623+0000 7efc4bfff700 1 --2- 172.21.15.110:0/3027066085 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7efc4405a0b0 0x7efc4405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:50.631 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.623+0000 7efc4bfff700 1 -- 172.21.15.110:0/3027066085 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7efc5c073370 con 0x7efc64145490 2021-03-25T14:16:50.631 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.623+0000 7efc63fff700 1 --2- 172.21.15.110:0/3027066085 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7efc4405a0b0 0x7efc4405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:50.631 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.623+0000 7efc63fff700 1 --2- 172.21.15.110:0/3027066085 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7efc4405a0b0 0x7efc4405c570 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7efc54006e60 tx=0x7efc54019000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:50.631 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.627+0000 7efc4bfff700 1 -- 172.21.15.110:0/3027066085 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7efc5c046a20 con 0x7efc64145490 2021-03-25T14:16:50.780 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.777+0000 7efc6a8c2700 1 -- 172.21.15.110:0/3027066085 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efc6405d7b0 con 0x7efc64145490 2021-03-25T14:16:50.780 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.778+0000 7efc4bfff700 1 -- 172.21.15.110:0/3027066085 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7efc5c04a040 con 0x7efc64145490 2021-03-25T14:16:50.780 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:16:50.782 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.779+0000 7efc6a8c2700 1 -- 172.21.15.110:0/3027066085 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7efc4405a0b0 msgr2=0x7efc4405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:50.782 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.779+0000 7efc6a8c2700 1 --2- 172.21.15.110:0/3027066085 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7efc4405a0b0 0x7efc4405c570 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7efc54006e60 tx=0x7efc54019000).stop 2021-03-25T14:16:50.782 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.779+0000 7efc6a8c2700 1 -- 172.21.15.110:0/3027066085 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc64145490 msgr2=0x7efc6414af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:50.782 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.779+0000 7efc6a8c2700 1 --2- 172.21.15.110:0/3027066085 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc64145490 0x7efc6414af00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7efc5c001350 tx=0x7efc5c009040).stop 2021-03-25T14:16:50.782 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.779+0000 7efc6a8c2700 1 -- 172.21.15.110:0/3027066085 shutdown_connections 2021-03-25T14:16:50.782 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.779+0000 7efc6a8c2700 1 --2- 172.21.15.110:0/3027066085 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7efc4405a0b0 0x7efc4405c570 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:50.782 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.779+0000 7efc6a8c2700 1 --2- 172.21.15.110:0/3027066085 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc50003760 0x7efc640a5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:50.782 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.779+0000 7efc6a8c2700 1 --2- 172.21.15.110:0/3027066085 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc64145490 0x7efc6414af00 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:50.782 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.779+0000 7efc6a8c2700 1 --2- 172.21.15.110:0/3027066085 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc640bf290 0x7efc64144fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:50.782 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.780+0000 7efc6a8c2700 1 -- 172.21.15.110:0/3027066085 >> 172.21.15.110:0/3027066085 conn(0x7efc64060c40 msgr2=0x7efc64145ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:50.782 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.780+0000 7efc6a8c2700 1 -- 172.21.15.110:0/3027066085 shutdown_connections 2021-03-25T14:16:50.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.780+0000 7efc6a8c2700 1 -- 172.21.15.110:0/3027066085 wait complete. 2021-03-25T14:16:50.794 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-03-25T14:16:50.906 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.905+0000 7f5c48c67700 1 Processor -- start 2021-03-25T14:16:50.907 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.905+0000 7f5c48c67700 1 -- start start 2021-03-25T14:16:50.909 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.905+0000 7f5c48c67700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5c4414cbe0 0x7f5c440b7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:50.909 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.905+0000 7f5c48c67700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c440be810 0x7f5c44063ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:50.909 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.905+0000 7f5c48c67700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c440b72b0 con 0x7f5c440bdda0 2021-03-25T14:16:50.909 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.905+0000 7f5c48c67700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c440631f0 con 0x7f5c4414cbe0 2021-03-25T14:16:50.909 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.905+0000 7f5c48c67700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c440b74e0 con 0x7f5c440be810 2021-03-25T14:16:50.910 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.906+0000 7f5c42ffd700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5c4414cbe0 0x7f5c440b7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:50.910 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.906+0000 7f5c42ffd700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5c4414cbe0 0x7f5c440b7f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48800/0 (socket says 172.21.15.110:48800) 2021-03-25T14:16:50.910 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.906+0000 7f5c42ffd700 1 -- 172.21.15.110:0/1270290527 learned_addr learned my addr 172.21.15.110:0/1270290527 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:50.910 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.906+0000 7f5c43fff700 1 --2- 172.21.15.110:0/1270290527 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c440be810 0x7f5c44063ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:50.910 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.906+0000 7f5c42ffd700 1 -- 172.21.15.110:0/1270290527 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c440be810 msgr2=0x7f5c44063ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:50.910 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.906+0000 7f5c42ffd700 1 --2- 172.21.15.110:0/1270290527 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c440be810 0x7f5c44063ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:50.910 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.906+0000 7f5c42ffd700 1 -- 172.21.15.110:0/1270290527 >> v1:172.21.15.174:6789/0 conn(0x7f5c440bdda0 legacy=0x7f5c44149d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:50.910 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.906+0000 7f5c42ffd700 1 -- 172.21.15.110:0/1270290527 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c440b7780 con 0x7f5c4414cbe0 2021-03-25T14:16:50.910 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.906+0000 7f5c42ffd700 1 --2- 172.21.15.110:0/1270290527 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c4414cbe0 0x7f5c440b7f00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f5c3800ba20 tx=0x7f5c38006ee0).ready entity=mon.0 client_cookie=11e278c18f42406e server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:50.910 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.906+0000 7f5c427fc700 1 -- 172.21.15.110:0/1270290527 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c38009840 con 0x7f5c4414cbe0 2021-03-25T14:16:50.910 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.906+0000 7f5c427fc700 1 -- 172.21.15.110:0/1270290527 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c380099a0 con 0x7f5c4414cbe0 2021-03-25T14:16:50.910 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.906+0000 7f5c427fc700 1 -- 172.21.15.110:0/1270290527 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c38009d20 con 0x7f5c4414cbe0 2021-03-25T14:16:50.911 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.907+0000 7f5c48c67700 1 -- 172.21.15.110:0/1270290527 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c4414cbe0 msgr2=0x7f5c440b7f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:50.911 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.907+0000 7f5c48c67700 1 --2- 172.21.15.110:0/1270290527 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c4414cbe0 0x7f5c440b7f00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f5c3800ba20 tx=0x7f5c38006ee0).stop 2021-03-25T14:16:50.911 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.907+0000 7f5c48c67700 1 -- 172.21.15.110:0/1270290527 shutdown_connections 2021-03-25T14:16:50.911 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.907+0000 7f5c48c67700 1 --2- 172.21.15.110:0/1270290527 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c440be810 0x7f5c44063ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:50.911 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.907+0000 7f5c48c67700 1 --2- 172.21.15.110:0/1270290527 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c4414cbe0 0x7f5c440b7f00 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:50.911 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.907+0000 7f5c48c67700 1 -- 172.21.15.110:0/1270290527 >> 172.21.15.110:0/1270290527 conn(0x7f5c44065830 msgr2=0x7f5c440685f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:50.911 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.907+0000 7f5c48c67700 1 -- 172.21.15.110:0/1270290527 shutdown_connections 2021-03-25T14:16:50.911 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.907+0000 7f5c48c67700 1 -- 172.21.15.110:0/1270290527 wait complete. 2021-03-25T14:16:50.914 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.908+0000 7f5c48c67700 1 Processor -- start 2021-03-25T14:16:50.914 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.908+0000 7f5c48c67700 1 -- start start 2021-03-25T14:16:50.914 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.909+0000 7f5c48c67700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c440bdda0 0x7f5c440a27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:50.914 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.909+0000 7f5c48c67700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c440be810 0x7f5c44117160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:50.914 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.909+0000 7f5c48c67700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c4414cbe0 0x7f5c44117650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:50.915 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.909+0000 7f5c48c67700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4415c140 con 0x7f5c440be810 2021-03-25T14:16:50.915 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.909+0000 7f5c48c67700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4415cff0 con 0x7f5c440bdda0 2021-03-25T14:16:50.915 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.909+0000 7f5c48c67700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4415c370 con 0x7f5c4414cbe0 2021-03-25T14:16:50.915 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.909+0000 7f5c42ffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c440be810 0x7f5c44117160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:50.915 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.909+0000 7f5c42ffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c440be810 0x7f5c44117160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48806/0 (socket says 172.21.15.110:48806) 2021-03-25T14:16:50.915 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.909+0000 7f5c42ffd700 1 -- 172.21.15.110:0/2539353196 learned_addr learned my addr 172.21.15.110:0/2539353196 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:50.915 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.909+0000 7f5c43fff700 1 --2- 172.21.15.110:0/2539353196 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c4414cbe0 0x7f5c44117650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:50.915 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.909+0000 7f5c437fe700 1 --2- 172.21.15.110:0/2539353196 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c440bdda0 0x7f5c440a27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:50.915 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.909+0000 7f5c42ffd700 1 -- 172.21.15.110:0/2539353196 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c4414cbe0 msgr2=0x7f5c44117650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:50.915 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.909+0000 7f5c42ffd700 1 --2- 172.21.15.110:0/2539353196 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c4414cbe0 0x7f5c44117650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:50.915 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.909+0000 7f5c42ffd700 1 -- 172.21.15.110:0/2539353196 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c440bdda0 msgr2=0x7f5c440a27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:50.915 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.909+0000 7f5c42ffd700 1 --2- 172.21.15.110:0/2539353196 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c440bdda0 0x7f5c440a27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:50.915 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.909+0000 7f5c42ffd700 1 -- 172.21.15.110:0/2539353196 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c4415c610 con 0x7f5c440be810 2021-03-25T14:16:50.916 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.909+0000 7f5c42ffd700 1 --2- 172.21.15.110:0/2539353196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c440be810 0x7f5c44117160 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f5c440692f0 tx=0x7f5c38016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:50.916 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.909+0000 7f5c2b7fe700 1 -- 172.21.15.110:0/2539353196 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c38009840 con 0x7f5c440be810 2021-03-25T14:16:50.916 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.909+0000 7f5c2b7fe700 1 -- 172.21.15.110:0/2539353196 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c38011e90 con 0x7f5c440be810 2021-03-25T14:16:50.916 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.909+0000 7f5c48c67700 1 -- 172.21.15.110:0/2539353196 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c4415c8b0 con 0x7f5c440be810 2021-03-25T14:16:50.916 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.909+0000 7f5c2b7fe700 1 -- 172.21.15.110:0/2539353196 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3801c630 con 0x7f5c440be810 2021-03-25T14:16:50.916 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.909+0000 7f5c48c67700 1 -- 172.21.15.110:0/2539353196 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c44117b40 con 0x7f5c440be810 2021-03-25T14:16:50.916 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.910+0000 7f5c48c67700 1 -- 172.21.15.110:0/2539353196 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c44045ae0 con 0x7f5c440be810 2021-03-25T14:16:50.916 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.911+0000 7f5c2b7fe700 1 -- 172.21.15.110:0/2539353196 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f5c3800f070 con 0x7f5c440be810 2021-03-25T14:16:50.916 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.911+0000 7f5c2b7fe700 1 --2- 172.21.15.110:0/2539353196 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5c2405a0b0 0x7f5c2405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:50.916 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.911+0000 7f5c2b7fe700 1 -- 172.21.15.110:0/2539353196 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f5c380756a0 con 0x7f5c440be810 2021-03-25T14:16:50.916 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.911+0000 7f5c437fe700 1 --2- 172.21.15.110:0/2539353196 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5c2405a0b0 0x7f5c2405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:50.916 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.911+0000 7f5c437fe700 1 --2- 172.21.15.110:0/2539353196 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5c2405a0b0 0x7f5c2405c570 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f5c34003550 tx=0x7f5c34009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:50.917 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:50.915+0000 7f5c2b7fe700 1 -- 172.21.15.110:0/2539353196 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f5c38048d50 con 0x7f5c440be810 2021-03-25T14:16:51.067 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.065+0000 7f5c48c67700 1 -- 172.21.15.110:0/2539353196 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5c44061c50 con 0x7f5c440be810 2021-03-25T14:16:51.067 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.065+0000 7f5c2b7fe700 1 -- 172.21.15.110:0/2539353196 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7f5c3804c370 con 0x7f5c440be810 2021-03-25T14:16:51.068 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:16:51.069 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.067+0000 7f5c48c67700 1 -- 172.21.15.110:0/2539353196 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5c2405a0b0 msgr2=0x7f5c2405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:51.069 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.067+0000 7f5c48c67700 1 --2- 172.21.15.110:0/2539353196 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5c2405a0b0 0x7f5c2405c570 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f5c34003550 tx=0x7f5c34009040).stop 2021-03-25T14:16:51.069 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.067+0000 7f5c48c67700 1 -- 172.21.15.110:0/2539353196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c440be810 msgr2=0x7f5c44117160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:51.069 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.067+0000 7f5c48c67700 1 --2- 172.21.15.110:0/2539353196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c440be810 0x7f5c44117160 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f5c440692f0 tx=0x7f5c38016000).stop 2021-03-25T14:16:51.069 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.067+0000 7f5c48c67700 1 -- 172.21.15.110:0/2539353196 shutdown_connections 2021-03-25T14:16:51.070 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.067+0000 7f5c48c67700 1 --2- 172.21.15.110:0/2539353196 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5c2405a0b0 0x7f5c2405c570 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:51.070 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.067+0000 7f5c48c67700 1 --2- 172.21.15.110:0/2539353196 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c440bdda0 0x7f5c440a27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:51.070 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.067+0000 7f5c48c67700 1 --2- 172.21.15.110:0/2539353196 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c4414cbe0 0x7f5c44117650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:51.070 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.067+0000 7f5c48c67700 1 --2- 172.21.15.110:0/2539353196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c440be810 0x7f5c44117160 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:51.070 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.067+0000 7f5c48c67700 1 -- 172.21.15.110:0/2539353196 >> 172.21.15.110:0/2539353196 conn(0x7f5c44065830 msgr2=0x7f5c440639c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:51.070 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.067+0000 7f5c48c67700 1 -- 172.21.15.110:0/2539353196 shutdown_connections 2021-03-25T14:16:51.070 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.067+0000 7f5c48c67700 1 -- 172.21.15.110:0/2539353196 wait complete. 2021-03-25T14:16:51.080 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2021-03-25T14:16:51.194 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.192+0000 7ff9ad6f2700 1 Processor -- start 2021-03-25T14:16:51.194 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.192+0000 7ff9ad6f2700 1 -- start start 2021-03-25T14:16:51.200 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.193+0000 7ff9ad6f2700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff9a80be3a0 0x7ff9a80b4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:51.200 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.193+0000 7ff9ad6f2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff9a80b47a0 0x7ff9a8148c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:51.200 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.193+0000 7ff9ad6f2700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a80b4c20 con 0x7ff9a8149120 2021-03-25T14:16:51.200 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.193+0000 7ff9ad6f2700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a8149960 con 0x7ff9a80be3a0 2021-03-25T14:16:51.200 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.193+0000 7ff9ad6f2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a8149c00 con 0x7ff9a80b47a0 2021-03-25T14:16:51.200 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.193+0000 7ff9a6ffd700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff9a80be3a0 0x7ff9a80b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:51.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.193+0000 7ff9a6ffd700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff9a80be3a0 0x7ff9a80b4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48812/0 (socket says 172.21.15.110:48812) 2021-03-25T14:16:51.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.193+0000 7ff9a77fe700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7ff9a8149120 0x7ff9a80b8cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41750/0 (socket says 172.21.15.110:41750) 2021-03-25T14:16:51.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.193+0000 7ff9a6ffd700 1 -- 172.21.15.110:0/3445019769 learned_addr learned my addr 172.21.15.110:0/3445019769 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:51.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.193+0000 7ff9a67fc700 1 --2- 172.21.15.110:0/3445019769 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff9a80b47a0 0x7ff9a8148c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:51.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.193+0000 7ff9a6ffd700 1 -- 172.21.15.110:0/3445019769 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff9a80b47a0 msgr2=0x7ff9a8148c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:51.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.193+0000 7ff9a6ffd700 1 --2- 172.21.15.110:0/3445019769 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff9a80b47a0 0x7ff9a8148c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:51.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.193+0000 7ff9a6ffd700 1 -- 172.21.15.110:0/3445019769 >> v1:172.21.15.110:6789/0 conn(0x7ff9a8149120 legacy=0x7ff9a80b8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:51.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.193+0000 7ff9a6ffd700 1 -- 172.21.15.110:0/3445019769 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a8149ea0 con 0x7ff9a80be3a0 2021-03-25T14:16:51.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.193+0000 7ff9a5ffb700 1 -- 172.21.15.110:0/3445019769 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 960142792 0 0) 0x7ff9a80b4c20 con 0x7ff9a8149120 2021-03-25T14:16:51.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.193+0000 7ff9a6ffd700 1 --2- 172.21.15.110:0/3445019769 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9a80be3a0 0x7ff9a80b4100 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7ff99800ba20 tx=0x7ff998006ee0).ready entity=mon.0 client_cookie=d0abfac4530c70d6 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:51.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.193+0000 7ff9a5ffb700 1 -- 172.21.15.110:0/3445019769 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff998009840 con 0x7ff9a80be3a0 2021-03-25T14:16:51.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.193+0000 7ff9a5ffb700 1 -- 172.21.15.110:0/3445019769 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9980099a0 con 0x7ff9a80be3a0 2021-03-25T14:16:51.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.194+0000 7ff9a5ffb700 1 -- 172.21.15.110:0/3445019769 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff998009d20 con 0x7ff9a80be3a0 2021-03-25T14:16:51.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.194+0000 7ff9ad6f2700 1 -- 172.21.15.110:0/3445019769 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9a80be3a0 msgr2=0x7ff9a80b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:51.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.194+0000 7ff9ad6f2700 1 --2- 172.21.15.110:0/3445019769 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9a80be3a0 0x7ff9a80b4100 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7ff99800ba20 tx=0x7ff998006ee0).stop 2021-03-25T14:16:51.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.194+0000 7ff9ad6f2700 1 -- 172.21.15.110:0/3445019769 shutdown_connections 2021-03-25T14:16:51.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.194+0000 7ff9ad6f2700 1 --2- 172.21.15.110:0/3445019769 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9a80be3a0 0x7ff9a80b4100 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:51.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.194+0000 7ff9ad6f2700 1 --2- 172.21.15.110:0/3445019769 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff9a80b47a0 0x7ff9a8148c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:51.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.194+0000 7ff9ad6f2700 1 -- 172.21.15.110:0/3445019769 >> 172.21.15.110:0/3445019769 conn(0x7ff9a80686f0 msgr2=0x7ff9a8068b00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:51.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.194+0000 7ff9ad6f2700 1 -- 172.21.15.110:0/3445019769 shutdown_connections 2021-03-25T14:16:51.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.194+0000 7ff9ad6f2700 1 -- 172.21.15.110:0/3445019769 wait complete. 2021-03-25T14:16:51.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.195+0000 7ff9ad6f2700 1 Processor -- start 2021-03-25T14:16:51.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.195+0000 7ff9ad6f2700 1 -- start start 2021-03-25T14:16:51.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.196+0000 7ff9ad6f2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff9a80b47a0 0x7ff9a81473a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:51.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.196+0000 7ff9ad6f2700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9a80be3a0 0x7ff9a80a2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:51.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.196+0000 7ff9ad6f2700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff9a8149120 0x7ff9a815be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:51.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.196+0000 7ff9ad6f2700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a80a2a00 con 0x7ff9a80be3a0 2021-03-25T14:16:51.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.196+0000 7ff9ad6f2700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a80a2f70 con 0x7ff9a8149120 2021-03-25T14:16:51.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.196+0000 7ff9ad6f2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a80a3210 con 0x7ff9a80b47a0 2021-03-25T14:16:51.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.196+0000 7ff9a67fc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9a80be3a0 0x7ff9a80a2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:51.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.196+0000 7ff9a67fc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9a80be3a0 0x7ff9a80a2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48818/0 (socket says 172.21.15.110:48818) 2021-03-25T14:16:51.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.196+0000 7ff9a67fc700 1 -- 172.21.15.110:0/3127251762 learned_addr learned my addr 172.21.15.110:0/3127251762 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:51.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.196+0000 7ff9a6ffd700 1 --2- 172.21.15.110:0/3127251762 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff9a80b47a0 0x7ff9a81473a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:51.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.196+0000 7ff9a77fe700 1 --2- 172.21.15.110:0/3127251762 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff9a8149120 0x7ff9a815be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:51.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.196+0000 7ff9a67fc700 1 -- 172.21.15.110:0/3127251762 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff9a80b47a0 msgr2=0x7ff9a81473a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:51.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.196+0000 7ff9a67fc700 1 --2- 172.21.15.110:0/3127251762 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff9a80b47a0 0x7ff9a81473a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:51.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.196+0000 7ff9a67fc700 1 -- 172.21.15.110:0/3127251762 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff9a8149120 msgr2=0x7ff9a815be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:51.204 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.196+0000 7ff9a67fc700 1 --2- 172.21.15.110:0/3127251762 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff9a8149120 0x7ff9a815be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:51.204 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.196+0000 7ff9a67fc700 1 -- 172.21.15.110:0/3127251762 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a80a34b0 con 0x7ff9a80be3a0 2021-03-25T14:16:51.204 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.196+0000 7ff9a77fe700 1 --2- 172.21.15.110:0/3127251762 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff9a8149120 0x7ff9a815be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:51.204 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.196+0000 7ff9a67fc700 1 --2- 172.21.15.110:0/3127251762 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9a80be3a0 0x7ff9a80a2080 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7ff99c00ebd0 tx=0x7ff99c006e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:51.204 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.197+0000 7ff98effd700 1 -- 172.21.15.110:0/3127251762 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99c00ca60 con 0x7ff9a80be3a0 2021-03-25T14:16:51.204 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.197+0000 7ff98effd700 1 -- 172.21.15.110:0/3127251762 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99c00cbc0 con 0x7ff9a80be3a0 2021-03-25T14:16:51.204 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.197+0000 7ff9ad6f2700 1 -- 172.21.15.110:0/3127251762 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a80a2ca0 con 0x7ff9a80be3a0 2021-03-25T14:16:51.204 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.197+0000 7ff98effd700 1 -- 172.21.15.110:0/3127251762 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99c0123f0 con 0x7ff9a80be3a0 2021-03-25T14:16:51.204 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.197+0000 7ff9ad6f2700 1 -- 172.21.15.110:0/3127251762 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a8147940 con 0x7ff9a80be3a0 2021-03-25T14:16:51.204 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.197+0000 7ff9ad6f2700 1 -- 172.21.15.110:0/3127251762 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a80a3640 con 0x7ff9a80be3a0 2021-03-25T14:16:51.204 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.198+0000 7ff98effd700 1 -- 172.21.15.110:0/3127251762 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7ff99c0127a0 con 0x7ff9a80be3a0 2021-03-25T14:16:51.204 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.198+0000 7ff98effd700 1 --2- 172.21.15.110:0/3127251762 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff98805a0b0 0x7ff98805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:51.204 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.198+0000 7ff98effd700 1 -- 172.21.15.110:0/3127251762 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7ff99c074510 con 0x7ff9a80be3a0 2021-03-25T14:16:51.204 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.198+0000 7ff9a6ffd700 1 --2- 172.21.15.110:0/3127251762 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff98805a0b0 0x7ff98805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:51.205 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.198+0000 7ff9a6ffd700 1 --2- 172.21.15.110:0/3127251762 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff98805a0b0 0x7ff98805c570 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7ff998006f20 tx=0x7ff998016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:51.205 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.202+0000 7ff98effd700 1 -- 172.21.15.110:0/3127251762 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7ff99c047bc0 con 0x7ff9a80be3a0 2021-03-25T14:16:51.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.350+0000 7ff9ad6f2700 1 -- 172.21.15.110:0/3127251762 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff9a805d7b0 con 0x7ff9a80be3a0 2021-03-25T14:16:51.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.351+0000 7ff98effd700 1 -- 172.21.15.110:0/3127251762 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+10 (secure 0 0 0) 0x7ff99c04b1e0 con 0x7ff9a80be3a0 2021-03-25T14:16:51.353 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:16:51.354 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.352+0000 7ff9ad6f2700 1 -- 172.21.15.110:0/3127251762 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff98805a0b0 msgr2=0x7ff98805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:51.355 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.352+0000 7ff9ad6f2700 1 --2- 172.21.15.110:0/3127251762 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff98805a0b0 0x7ff98805c570 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7ff998006f20 tx=0x7ff998016000).stop 2021-03-25T14:16:51.355 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.352+0000 7ff9ad6f2700 1 -- 172.21.15.110:0/3127251762 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9a80be3a0 msgr2=0x7ff9a80a2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:51.355 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.352+0000 7ff9ad6f2700 1 --2- 172.21.15.110:0/3127251762 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9a80be3a0 0x7ff9a80a2080 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7ff99c00ebd0 tx=0x7ff99c006e20).stop 2021-03-25T14:16:51.355 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.352+0000 7ff9ad6f2700 1 -- 172.21.15.110:0/3127251762 shutdown_connections 2021-03-25T14:16:51.355 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.352+0000 7ff9ad6f2700 1 --2- 172.21.15.110:0/3127251762 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff98805a0b0 0x7ff98805c570 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:51.355 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.352+0000 7ff9ad6f2700 1 --2- 172.21.15.110:0/3127251762 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff9a8149120 0x7ff9a815be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:51.355 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.352+0000 7ff9ad6f2700 1 --2- 172.21.15.110:0/3127251762 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff9a80b47a0 0x7ff9a81473a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:51.355 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.352+0000 7ff9ad6f2700 1 --2- 172.21.15.110:0/3127251762 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9a80be3a0 0x7ff9a80a2080 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:51.355 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.352+0000 7ff9ad6f2700 1 -- 172.21.15.110:0/3127251762 >> 172.21.15.110:0/3127251762 conn(0x7ff9a80686f0 msgr2=0x7ff9a8068ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:51.355 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.352+0000 7ff9ad6f2700 1 -- 172.21.15.110:0/3127251762 shutdown_connections 2021-03-25T14:16:51.355 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.352+0000 7ff9ad6f2700 1 -- 172.21.15.110:0/3127251762 wait complete. 2021-03-25T14:16:51.366 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-03-25T14:16:51.475 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.473+0000 7fb5834b4700 1 Processor -- start 2021-03-25T14:16:51.475 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.473+0000 7fb5834b4700 1 -- start start 2021-03-25T14:16:51.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.474+0000 7fb5834b4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb57c0675d0 0x7fb57c0b1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:51.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.474+0000 7fb5834b4700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb57c148970 0x7fb57c148e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:51.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.474+0000 7fb5834b4700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb57c0bafc0 con 0x7fb57c0bc220 2021-03-25T14:16:51.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.474+0000 7fb5834b4700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb57c0b1830 con 0x7fb57c148970 2021-03-25T14:16:51.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.474+0000 7fb5834b4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb57c0baa80 con 0x7fb57c0675d0 2021-03-25T14:16:51.479 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.474+0000 7fb581a51700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb57c148970 0x7fb57c148e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:51.479 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.474+0000 7fb580a4f700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fb57c0bc220 0x7fb57c14cbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41762/0 (socket says 172.21.15.110:41762) 2021-03-25T14:16:51.479 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.474+0000 7fb580a4f700 1 -- 172.21.15.110:0/1221933470 learned_addr learned my addr 172.21.15.110:0/1221933470 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:51.479 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.474+0000 7fb581250700 1 --2- 172.21.15.110:0/1221933470 >> v2:172.21.15.174:3300/0 conn(0x7fb57c0675d0 0x7fb57c0b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:51.479 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.475+0000 7fb581a51700 1 -- 172.21.15.110:0/1221933470 >> v2:172.21.15.174:3300/0 conn(0x7fb57c0675d0 msgr2=0x7fb57c0b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:51.479 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.475+0000 7fb581a51700 1 --2- 172.21.15.110:0/1221933470 >> v2:172.21.15.174:3300/0 conn(0x7fb57c0675d0 0x7fb57c0b1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:51.479 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.475+0000 7fb581a51700 1 -- 172.21.15.110:0/1221933470 >> v1:172.21.15.110:6789/0 conn(0x7fb57c0bc220 legacy=0x7fb57c14cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:51.479 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.475+0000 7fb581a51700 1 -- 172.21.15.110:0/1221933470 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57c0bad20 con 0x7fb57c148970 2021-03-25T14:16:51.479 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.475+0000 7fb581250700 1 --2- 172.21.15.110:0/1221933470 >> v2:172.21.15.174:3300/0 conn(0x7fb57c0675d0 0x7fb57c0b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:51.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.475+0000 7fb581a51700 1 --2- 172.21.15.110:0/1221933470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb57c148970 0x7fb57c148e20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7fb57c067110 tx=0x7fb574009220).ready entity=mon.0 client_cookie=62bb11ff444a5e3a server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:51.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.475+0000 7fb56bfff700 1 -- 172.21.15.110:0/1221933470 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb574009ea0 con 0x7fb57c148970 2021-03-25T14:16:51.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.475+0000 7fb56bfff700 1 -- 172.21.15.110:0/1221933470 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57400bc80 con 0x7fb57c148970 2021-03-25T14:16:51.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.475+0000 7fb56bfff700 1 -- 172.21.15.110:0/1221933470 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb574011400 con 0x7fb57c148970 2021-03-25T14:16:51.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.475+0000 7fb5834b4700 1 -- 172.21.15.110:0/1221933470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb57c148970 msgr2=0x7fb57c148e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:51.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.475+0000 7fb5834b4700 1 --2- 172.21.15.110:0/1221933470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb57c148970 0x7fb57c148e20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7fb57c067110 tx=0x7fb574009220).stop 2021-03-25T14:16:51.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.475+0000 7fb5834b4700 1 -- 172.21.15.110:0/1221933470 shutdown_connections 2021-03-25T14:16:51.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.475+0000 7fb5834b4700 1 --2- 172.21.15.110:0/1221933470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb57c148970 0x7fb57c148e20 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:51.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.475+0000 7fb5834b4700 1 --2- 172.21.15.110:0/1221933470 >> v2:172.21.15.174:3300/0 conn(0x7fb57c0675d0 0x7fb57c0b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:51.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.475+0000 7fb5834b4700 1 -- 172.21.15.110:0/1221933470 >> 172.21.15.110:0/1221933470 conn(0x7fb57c064a10 msgr2=0x7fb57c05c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:51.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.475+0000 7fb5834b4700 1 -- 172.21.15.110:0/1221933470 shutdown_connections 2021-03-25T14:16:51.481 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.475+0000 7fb5834b4700 1 -- 172.21.15.110:0/1221933470 wait complete. 2021-03-25T14:16:51.481 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.476+0000 7fb5834b4700 1 Processor -- start 2021-03-25T14:16:51.481 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.476+0000 7fb5834b4700 1 -- start start 2021-03-25T14:16:51.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.477+0000 7fb5834b4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb57c0675d0 0x7fb57c145b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:51.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.477+0000 7fb5834b4700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb57c0bc220 0x7fb57c0b9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:51.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.477+0000 7fb5834b4700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb57c148970 0x7fb57c158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:51.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.477+0000 7fb5834b4700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c0b40f0 con 0x7fb57c148970 2021-03-25T14:16:51.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.477+0000 7fb5834b4700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c15ca30 con 0x7fb57c0bc220 2021-03-25T14:16:51.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.477+0000 7fb5834b4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c15ccd0 con 0x7fb57c0675d0 2021-03-25T14:16:51.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.477+0000 7fb581a51700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb57c148970 0x7fb57c158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:51.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.477+0000 7fb581a51700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb57c148970 0x7fb57c158980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48834/0 (socket says 172.21.15.110:48834) 2021-03-25T14:16:51.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.477+0000 7fb581a51700 1 -- 172.21.15.110:0/3317088394 learned_addr learned my addr 172.21.15.110:0/3317088394 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:51.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.478+0000 7fb580a4f700 1 --2- 172.21.15.110:0/3317088394 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb57c0bc220 0x7fb57c0b9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:51.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.478+0000 7fb581250700 1 --2- 172.21.15.110:0/3317088394 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb57c0675d0 0x7fb57c145b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:51.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.478+0000 7fb581a51700 1 -- 172.21.15.110:0/3317088394 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb57c0675d0 msgr2=0x7fb57c145b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:51.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.478+0000 7fb581a51700 1 --2- 172.21.15.110:0/3317088394 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb57c0675d0 0x7fb57c145b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:51.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.478+0000 7fb581a51700 1 -- 172.21.15.110:0/3317088394 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb57c0bc220 msgr2=0x7fb57c0b9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:51.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.478+0000 7fb581a51700 1 --2- 172.21.15.110:0/3317088394 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb57c0bc220 0x7fb57c0b9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:51.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.478+0000 7fb581a51700 1 -- 172.21.15.110:0/3317088394 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57c0b4350 con 0x7fb57c148970 2021-03-25T14:16:51.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.478+0000 7fb580a4f700 1 --2- 172.21.15.110:0/3317088394 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb57c0bc220 0x7fb57c0b9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:51.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.478+0000 7fb581250700 1 --2- 172.21.15.110:0/3317088394 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb57c0675d0 0x7fb57c145b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:51.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.478+0000 7fb581a51700 1 --2- 172.21.15.110:0/3317088394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb57c148970 0x7fb57c158980 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7fb57c065140 tx=0x7fb574017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:51.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.478+0000 7fb5697fa700 1 -- 172.21.15.110:0/3317088394 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb574010830 con 0x7fb57c148970 2021-03-25T14:16:51.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.478+0000 7fb5697fa700 1 -- 172.21.15.110:0/3317088394 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb574010990 con 0x7fb57c148970 2021-03-25T14:16:51.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.478+0000 7fb5834b4700 1 -- 172.21.15.110:0/3317088394 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb57c0b45f0 con 0x7fb57c148970 2021-03-25T14:16:51.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.478+0000 7fb5697fa700 1 -- 172.21.15.110:0/3317088394 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb574010d50 con 0x7fb57c148970 2021-03-25T14:16:51.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.478+0000 7fb5834b4700 1 -- 172.21.15.110:0/3317088394 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb57c146060 con 0x7fb57c148970 2021-03-25T14:16:51.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.479+0000 7fb5834b4700 1 -- 172.21.15.110:0/3317088394 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb57c068850 con 0x7fb57c148970 2021-03-25T14:16:51.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.479+0000 7fb5697fa700 1 -- 172.21.15.110:0/3317088394 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fb57400f070 con 0x7fb57c148970 2021-03-25T14:16:51.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.479+0000 7fb5697fa700 1 --2- 172.21.15.110:0/3317088394 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb55c05a0b0 0x7fb55c05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:51.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.479+0000 7fb5697fa700 1 -- 172.21.15.110:0/3317088394 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fb5740760d0 con 0x7fb57c148970 2021-03-25T14:16:51.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.480+0000 7fb581250700 1 --2- 172.21.15.110:0/3317088394 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb55c05a0b0 0x7fb55c05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:51.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.480+0000 7fb581250700 1 --2- 172.21.15.110:0/3317088394 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb55c05a0b0 0x7fb55c05c570 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fb57c15c960 tx=0x7fb578008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:51.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.483+0000 7fb5697fa700 1 -- 172.21.15.110:0/3317088394 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fb574049780 con 0x7fb57c148970 2021-03-25T14:16:51.670 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.668+0000 7fb5834b4700 1 -- 172.21.15.110:0/3317088394 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb57c0b4780 con 0x7fb57c148970 2021-03-25T14:16:51.670 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.669+0000 7fb5697fa700 1 -- 172.21.15.110:0/3317088394 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+2846 (secure 0 0 0) 0x7fb57404cda0 con 0x7fb57c148970 2021-03-25T14:16:51.671 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:16:51.671 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1177985428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6833","nonce":1177985428},{"type":"v1","addr":"172.21.15.174:6835","nonce":1177985428}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.110:6836/3814723779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3814723779},{"type":"v1","addr":"172.21.15.110:6836","nonce":3814723779}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":4},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1613822797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1613822797},{"type":"v1","addr":"172.21.15.110:6837","nonce":1613822797}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-03-25T14:16:11.090720+0000","modified":"2021-03-25T14:16:25.750002+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"b","rank":0,"incarnation":5,"state":"up:active","state_seq":4,"addr":"172.21.15.174:6834/1564441351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1564441351},{"type":"v1","addr":"172.21.15.174:6834","nonce":1564441351}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-03-25T14:16:51.673 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.670+0000 7fb5834b4700 1 -- 172.21.15.110:0/3317088394 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb55c05a0b0 msgr2=0x7fb55c05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:51.673 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.670+0000 7fb5834b4700 1 --2- 172.21.15.110:0/3317088394 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb55c05a0b0 0x7fb55c05c570 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fb57c15c960 tx=0x7fb578008040).stop 2021-03-25T14:16:51.673 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.670+0000 7fb5834b4700 1 -- 172.21.15.110:0/3317088394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb57c148970 msgr2=0x7fb57c158980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:51.673 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.670+0000 7fb5834b4700 1 --2- 172.21.15.110:0/3317088394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb57c148970 0x7fb57c158980 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7fb57c065140 tx=0x7fb574017000).stop 2021-03-25T14:16:51.673 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.670+0000 7fb5834b4700 1 -- 172.21.15.110:0/3317088394 shutdown_connections 2021-03-25T14:16:51.673 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.670+0000 7fb5834b4700 1 --2- 172.21.15.110:0/3317088394 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb55c05a0b0 0x7fb55c05c570 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:51.673 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.670+0000 7fb5834b4700 1 --2- 172.21.15.110:0/3317088394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb57c148970 0x7fb57c158980 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:51.673 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.670+0000 7fb5834b4700 1 --2- 172.21.15.110:0/3317088394 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb57c0675d0 0x7fb57c145b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:51.673 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.670+0000 7fb5834b4700 1 --2- 172.21.15.110:0/3317088394 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb57c0bc220 0x7fb57c0b9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:51.674 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.670+0000 7fb5834b4700 1 -- 172.21.15.110:0/3317088394 >> 172.21.15.110:0/3317088394 conn(0x7fb57c064a10 msgr2=0x7fb57c0b9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:51.674 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.670+0000 7fb5834b4700 1 -- 172.21.15.110:0/3317088394 shutdown_connections 2021-03-25T14:16:51.674 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.670+0000 7fb5834b4700 1 -- 172.21.15.110:0/3317088394 wait complete. 2021-03-25T14:16:51.674 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 9 2021-03-25T14:16:51.684 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:16:51.795 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.793+0000 7ff400c79700 1 Processor -- start 2021-03-25T14:16:51.795 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.793+0000 7ff400c79700 1 -- start start 2021-03-25T14:16:51.798 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.793+0000 7ff400c79700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff3fc067870 0x7ff3fc14a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:51.798 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.793+0000 7ff400c79700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff3fc0b66c0 0x7ff3fc0641a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:51.798 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.793+0000 7ff400c79700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3fc1499a0 con 0x7ff3fc067c50 2021-03-25T14:16:51.798 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.793+0000 7ff400c79700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3fc143e40 con 0x7ff3fc0b66c0 2021-03-25T14:16:51.798 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.793+0000 7ff400c79700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3fc0b7040 con 0x7ff3fc067870 2021-03-25T14:16:51.798 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.794+0000 7ff3fbfff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff3fc0b66c0 0x7ff3fc0641a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:51.798 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.794+0000 7ff3faffd700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7ff3fc067c50 0x7ff3fc1463d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41774/0 (socket says 172.21.15.110:41774) 2021-03-25T14:16:51.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.794+0000 7ff3fbfff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff3fc0b66c0 0x7ff3fc0641a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48838/0 (socket says 172.21.15.110:48838) 2021-03-25T14:16:51.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.794+0000 7ff3faffd700 1 -- 172.21.15.110:0/4020882203 learned_addr learned my addr 172.21.15.110:0/4020882203 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:51.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.794+0000 7ff3fb7fe700 1 --2- 172.21.15.110:0/4020882203 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff3fc067870 0x7ff3fc14a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:51.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.794+0000 7ff3fbfff700 1 -- 172.21.15.110:0/4020882203 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff3fc067870 msgr2=0x7ff3fc14a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:51.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.794+0000 7ff3fbfff700 1 --2- 172.21.15.110:0/4020882203 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff3fc067870 0x7ff3fc14a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:51.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.794+0000 7ff3fbfff700 1 -- 172.21.15.110:0/4020882203 >> v1:172.21.15.110:6789/0 conn(0x7ff3fc067c50 legacy=0x7ff3fc1463d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:51.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.794+0000 7ff3fbfff700 1 -- 172.21.15.110:0/4020882203 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3fc0b72e0 con 0x7ff3fc0b66c0 2021-03-25T14:16:51.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.794+0000 7ff3fa7fc700 1 -- 172.21.15.110:0/4020882203 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2723666092 0 0) 0x7ff3fc1499a0 con 0x7ff3fc067c50 2021-03-25T14:16:51.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.794+0000 7ff3fb7fe700 1 --2- 172.21.15.110:0/4020882203 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff3fc067870 0x7ff3fc14a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:51.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.794+0000 7ff3fbfff700 1 --2- 172.21.15.110:0/4020882203 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3fc0b66c0 0x7ff3fc0641a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7ff3f400bf60 tx=0x7ff3f400b4c0).ready entity=mon.0 client_cookie=e3aa679d024b060c server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:51.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.794+0000 7ff3fa7fc700 1 -- 172.21.15.110:0/4020882203 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f400de00 con 0x7ff3fc0b66c0 2021-03-25T14:16:51.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.794+0000 7ff3fa7fc700 1 -- 172.21.15.110:0/4020882203 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f4010680 con 0x7ff3fc0b66c0 2021-03-25T14:16:51.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.794+0000 7ff3fa7fc700 1 -- 172.21.15.110:0/4020882203 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f4010a20 con 0x7ff3fc0b66c0 2021-03-25T14:16:51.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.795+0000 7ff400c79700 1 -- 172.21.15.110:0/4020882203 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3fc0b66c0 msgr2=0x7ff3fc0641a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:51.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.795+0000 7ff400c79700 1 --2- 172.21.15.110:0/4020882203 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3fc0b66c0 0x7ff3fc0641a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7ff3f400bf60 tx=0x7ff3f400b4c0).stop 2021-03-25T14:16:51.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.795+0000 7ff400c79700 1 -- 172.21.15.110:0/4020882203 shutdown_connections 2021-03-25T14:16:51.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.795+0000 7ff400c79700 1 --2- 172.21.15.110:0/4020882203 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3fc0b66c0 0x7ff3fc0641a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:51.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.795+0000 7ff400c79700 1 --2- 172.21.15.110:0/4020882203 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff3fc067870 0x7ff3fc14a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:51.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.795+0000 7ff400c79700 1 -- 172.21.15.110:0/4020882203 >> 172.21.15.110:0/4020882203 conn(0x7ff3fc066350 msgr2=0x7ff3fc066760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:51.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.795+0000 7ff400c79700 1 -- 172.21.15.110:0/4020882203 shutdown_connections 2021-03-25T14:16:51.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.795+0000 7ff400c79700 1 -- 172.21.15.110:0/4020882203 wait complete. 2021-03-25T14:16:51.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.796+0000 7ff400c79700 1 Processor -- start 2021-03-25T14:16:51.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.796+0000 7ff400c79700 1 -- start start 2021-03-25T14:16:51.804 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.797+0000 7ff400c79700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3fc067870 0x7ff3fc0b4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:51.804 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.797+0000 7ff400c79700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3fc067c50 0x7ff3fc0b4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:51.804 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.797+0000 7ff400c79700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff3fc0b66c0 0x7ff3fc1580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:51.804 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.797+0000 7ff400c79700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3fc09fad0 con 0x7ff3fc067870 2021-03-25T14:16:51.804 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.797+0000 7ff400c79700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3fc0b5d50 con 0x7ff3fc067c50 2021-03-25T14:16:51.804 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.797+0000 7ff400c79700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3fc09f380 con 0x7ff3fc0b66c0 2021-03-25T14:16:51.804 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.797+0000 7ff3fb7fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3fc067870 0x7ff3fc0b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:51.804 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.797+0000 7ff3fb7fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3fc067870 0x7ff3fc0b4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48844/0 (socket says 172.21.15.110:48844) 2021-03-25T14:16:51.804 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.797+0000 7ff3fb7fe700 1 -- 172.21.15.110:0/417538374 learned_addr learned my addr 172.21.15.110:0/417538374 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:51.805 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.797+0000 7ff3fbfff700 1 --2- 172.21.15.110:0/417538374 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff3fc0b66c0 0x7ff3fc1580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:51.805 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.797+0000 7ff3faffd700 1 --2- 172.21.15.110:0/417538374 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3fc067c50 0x7ff3fc0b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:51.805 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.797+0000 7ff3fb7fe700 1 -- 172.21.15.110:0/417538374 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff3fc0b66c0 msgr2=0x7ff3fc1580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:51.805 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.797+0000 7ff3fb7fe700 1 --2- 172.21.15.110:0/417538374 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff3fc0b66c0 0x7ff3fc1580e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:51.805 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.797+0000 7ff3fb7fe700 1 -- 172.21.15.110:0/417538374 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3fc067c50 msgr2=0x7ff3fc0b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:51.805 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.797+0000 7ff3fb7fe700 1 --2- 172.21.15.110:0/417538374 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3fc067c50 0x7ff3fc0b4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:51.805 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.797+0000 7ff3fb7fe700 1 -- 172.21.15.110:0/417538374 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3fc0b5ab0 con 0x7ff3fc067870 2021-03-25T14:16:51.805 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.797+0000 7ff3fb7fe700 1 --2- 172.21.15.110:0/417538374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3fc067870 0x7ff3fc0b4450 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7ff3ec00cb80 tx=0x7ff3ec008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:51.805 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.797+0000 7ff3e37fe700 1 -- 172.21.15.110:0/417538374 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec015070 con 0x7ff3fc067870 2021-03-25T14:16:51.805 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.797+0000 7ff3e37fe700 1 -- 172.21.15.110:0/417538374 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3ec0077d0 con 0x7ff3fc067870 2021-03-25T14:16:51.805 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.797+0000 7ff400c79700 1 -- 172.21.15.110:0/417538374 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3fc09f0e0 con 0x7ff3fc067870 2021-03-25T14:16:51.805 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.797+0000 7ff3e37fe700 1 -- 172.21.15.110:0/417538374 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec007b50 con 0x7ff3fc067870 2021-03-25T14:16:51.805 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.797+0000 7ff400c79700 1 -- 172.21.15.110:0/417538374 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3fc09f750 con 0x7ff3fc067870 2021-03-25T14:16:51.806 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.798+0000 7ff3e17fa700 1 -- 172.21.15.110:0/417538374 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3d8004fa0 con 0x7ff3fc067870 2021-03-25T14:16:51.806 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.798+0000 7ff3e37fe700 1 -- 172.21.15.110:0/417538374 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7ff3ec01a410 con 0x7ff3fc067870 2021-03-25T14:16:51.806 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.799+0000 7ff3e37fe700 1 --2- 172.21.15.110:0/417538374 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff3dc05a0b0 0x7ff3dc05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:51.806 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.799+0000 7ff3e37fe700 1 -- 172.21.15.110:0/417538374 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7ff3ec073ea0 con 0x7ff3fc067870 2021-03-25T14:16:51.806 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.799+0000 7ff3faffd700 1 --2- 172.21.15.110:0/417538374 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff3dc05a0b0 0x7ff3dc05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:51.806 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.799+0000 7ff3faffd700 1 --2- 172.21.15.110:0/417538374 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff3dc05a0b0 0x7ff3dc05c570 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7ff3fc09fef0 tx=0x7ff3f0009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:51.806 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.803+0000 7ff3e37fe700 1 -- 172.21.15.110:0/417538374 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7ff3ec0474f0 con 0x7ff3fc067870 2021-03-25T14:16:51.958 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.956+0000 7ff3e17fa700 1 -- 172.21.15.110:0/417538374 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3d8005250 con 0x7ff3fc067870 2021-03-25T14:16:51.959 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.957+0000 7ff3e37fe700 1 -- 172.21.15.110:0/417538374 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18685 (secure 0 0 0) 0x7ff3ec04ab10 con 0x7ff3fc067870 2021-03-25T14:16:51.959 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:16:51.959 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":25,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:16:15.446609+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-03-25T14:16:09.478442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-03-25T14:16:10.071152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2021-03-25T14:16:13.122119+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:16:51.961 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.959+0000 7ff3e17fa700 1 -- 172.21.15.110:0/417538374 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff3dc05a0b0 msgr2=0x7ff3dc05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:51.961 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.959+0000 7ff3e17fa700 1 --2- 172.21.15.110:0/417538374 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff3dc05a0b0 0x7ff3dc05c570 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7ff3fc09fef0 tx=0x7ff3f0009040).stop 2021-03-25T14:16:51.961 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.959+0000 7ff3e17fa700 1 -- 172.21.15.110:0/417538374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3fc067870 msgr2=0x7ff3fc0b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:51.961 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.959+0000 7ff3e17fa700 1 --2- 172.21.15.110:0/417538374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3fc067870 0x7ff3fc0b4450 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7ff3ec00cb80 tx=0x7ff3ec008040).stop 2021-03-25T14:16:51.962 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.959+0000 7ff3e17fa700 1 -- 172.21.15.110:0/417538374 shutdown_connections 2021-03-25T14:16:51.962 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.959+0000 7ff3e17fa700 1 --2- 172.21.15.110:0/417538374 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff3dc05a0b0 0x7ff3dc05c570 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:51.962 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.959+0000 7ff3e17fa700 1 --2- 172.21.15.110:0/417538374 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff3fc0b66c0 0x7ff3fc1580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:51.962 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.959+0000 7ff3e17fa700 1 --2- 172.21.15.110:0/417538374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3fc067870 0x7ff3fc0b4450 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:51.962 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.959+0000 7ff3e17fa700 1 --2- 172.21.15.110:0/417538374 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3fc067c50 0x7ff3fc0b4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:51.962 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.959+0000 7ff3e17fa700 1 -- 172.21.15.110:0/417538374 >> 172.21.15.110:0/417538374 conn(0x7ff3fc066350 msgr2=0x7ff3fc0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:51.962 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.959+0000 7ff3e17fa700 1 -- 172.21.15.110:0/417538374 shutdown_connections 2021-03-25T14:16:51.962 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:51.959+0000 7ff3e17fa700 1 -- 172.21.15.110:0/417538374 wait complete. 2021-03-25T14:16:51.972 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2021-03-25T14:16:51.973 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-03-25T14:16:52.082 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.080+0000 7efd95229700 1 Processor -- start 2021-03-25T14:16:52.082 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.080+0000 7efd95229700 1 -- start start 2021-03-25T14:16:52.085 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.081+0000 7efd95229700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efd900b1720 0x7efd90149cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:52.085 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.081+0000 7efd95229700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efd9014a1e0 0x7efd9014cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:52.085 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.081+0000 7efd95229700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd90067510 con 0x7efd900b1340 2021-03-25T14:16:52.085 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.081+0000 7efd95229700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd900677b0 con 0x7efd9014a1e0 2021-03-25T14:16:52.085 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.081+0000 7efd95229700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd90067a50 con 0x7efd900b1720 2021-03-25T14:16:52.085 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.081+0000 7efd8f59e700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efd9014a1e0 0x7efd9014cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:52.086 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.081+0000 7efd8f59e700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efd9014a1e0 0x7efd9014cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48856/0 (socket says 172.21.15.110:48856) 2021-03-25T14:16:52.086 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.081+0000 7efd8f59e700 1 -- 172.21.15.110:0/4025132005 learned_addr learned my addr 172.21.15.110:0/4025132005 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:52.086 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.082+0000 7efd8e59c700 1 --2- 172.21.15.110:0/4025132005 >> v2:172.21.15.174:3300/0 conn(0x7efd900b1720 0x7efd90149cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:52.086 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.082+0000 7efd8f59e700 1 -- 172.21.15.110:0/4025132005 >> v2:172.21.15.174:3300/0 conn(0x7efd900b1720 msgr2=0x7efd90149cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:52.086 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.082+0000 7efd8f59e700 1 --2- 172.21.15.110:0/4025132005 >> v2:172.21.15.174:3300/0 conn(0x7efd900b1720 0x7efd90149cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:52.086 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.082+0000 7efd8f59e700 1 -- 172.21.15.110:0/4025132005 >> v1:172.21.15.174:6789/0 conn(0x7efd900b1340 legacy=0x7efd90066420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:52.086 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.082+0000 7efd8f59e700 1 -- 172.21.15.110:0/4025132005 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd90067cf0 con 0x7efd9014a1e0 2021-03-25T14:16:52.086 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.082+0000 7efd8f59e700 1 --2- 172.21.15.110:0/4025132005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd9014a1e0 0x7efd9014cee0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7efd88009d90 tx=0x7efd880092d0).ready entity=mon.0 client_cookie=59a63b177a4b7dd9 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:52.086 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.082+0000 7efd8dd9b700 1 -- 172.21.15.110:0/4025132005 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8800bc00 con 0x7efd9014a1e0 2021-03-25T14:16:52.086 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.082+0000 7efd8dd9b700 1 -- 172.21.15.110:0/4025132005 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd8800bd60 con 0x7efd9014a1e0 2021-03-25T14:16:52.086 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.082+0000 7efd8dd9b700 1 -- 172.21.15.110:0/4025132005 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd88011610 con 0x7efd9014a1e0 2021-03-25T14:16:52.086 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.082+0000 7efd95229700 1 -- 172.21.15.110:0/4025132005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd9014a1e0 msgr2=0x7efd9014cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:52.086 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.082+0000 7efd95229700 1 --2- 172.21.15.110:0/4025132005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd9014a1e0 0x7efd9014cee0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7efd88009d90 tx=0x7efd880092d0).stop 2021-03-25T14:16:52.087 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.082+0000 7efd95229700 1 -- 172.21.15.110:0/4025132005 shutdown_connections 2021-03-25T14:16:52.087 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.082+0000 7efd95229700 1 --2- 172.21.15.110:0/4025132005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd9014a1e0 0x7efd9014cee0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:52.087 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.082+0000 7efd95229700 1 --2- 172.21.15.110:0/4025132005 >> v2:172.21.15.174:3300/0 conn(0x7efd900b1720 0x7efd90149cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:52.087 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.082+0000 7efd95229700 1 -- 172.21.15.110:0/4025132005 >> 172.21.15.110:0/4025132005 conn(0x7efd900649a0 msgr2=0x7efd9005c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:52.087 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.082+0000 7efd95229700 1 -- 172.21.15.110:0/4025132005 shutdown_connections 2021-03-25T14:16:52.087 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.082+0000 7efd95229700 1 -- 172.21.15.110:0/4025132005 wait complete. 2021-03-25T14:16:52.087 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.083+0000 7efd95229700 1 Processor -- start 2021-03-25T14:16:52.087 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.084+0000 7efd95229700 1 -- start start 2021-03-25T14:16:52.090 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.084+0000 7efd95229700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efd900b1340 0x7efd9014a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:52.090 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.084+0000 7efd95229700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd900b1720 0x7efd90159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:52.090 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.084+0000 7efd95229700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd9014a1e0 0x7efd900b2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:52.090 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.084+0000 7efd95229700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd900b4320 con 0x7efd900b1720 2021-03-25T14:16:52.090 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.084+0000 7efd95229700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd900b45c0 con 0x7efd9014a1e0 2021-03-25T14:16:52.090 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.084+0000 7efd95229700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd900b4860 con 0x7efd900b1340 2021-03-25T14:16:52.090 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.084+0000 7efd8e59c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd900b1720 0x7efd90159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:52.090 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.084+0000 7efd8e59c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd900b1720 0x7efd90159440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48860/0 (socket says 172.21.15.110:48860) 2021-03-25T14:16:52.090 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.084+0000 7efd8e59c700 1 -- 172.21.15.110:0/2585369636 learned_addr learned my addr 172.21.15.110:0/2585369636 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:52.090 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.085+0000 7efd8f59e700 1 --2- 172.21.15.110:0/2585369636 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd9014a1e0 0x7efd900b2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:52.091 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.085+0000 7efd8ed9d700 1 --2- 172.21.15.110:0/2585369636 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efd900b1340 0x7efd9014a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:52.091 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.085+0000 7efd8e59c700 1 -- 172.21.15.110:0/2585369636 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efd900b1340 msgr2=0x7efd9014a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:52.091 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.085+0000 7efd8e59c700 1 --2- 172.21.15.110:0/2585369636 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efd900b1340 0x7efd9014a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:52.091 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.085+0000 7efd8e59c700 1 -- 172.21.15.110:0/2585369636 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd9014a1e0 msgr2=0x7efd900b2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:52.091 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.085+0000 7efd8e59c700 1 --2- 172.21.15.110:0/2585369636 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd9014a1e0 0x7efd900b2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:52.091 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.085+0000 7efd8e59c700 1 -- 172.21.15.110:0/2585369636 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd90158d00 con 0x7efd900b1720 2021-03-25T14:16:52.091 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.085+0000 7efd8f59e700 1 --2- 172.21.15.110:0/2585369636 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd9014a1e0 0x7efd900b2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:52.091 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.085+0000 7efd8e59c700 1 --2- 172.21.15.110:0/2585369636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd900b1720 0x7efd90159440 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7efd8400db60 tx=0x7efd84008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:52.091 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.085+0000 7efd76ffd700 1 -- 172.21.15.110:0/2585369636 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd84009820 con 0x7efd900b1720 2021-03-25T14:16:52.091 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.085+0000 7efd76ffd700 1 -- 172.21.15.110:0/2585369636 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd84009980 con 0x7efd900b1720 2021-03-25T14:16:52.091 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.085+0000 7efd76ffd700 1 -- 172.21.15.110:0/2585369636 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd84009d00 con 0x7efd900b1720 2021-03-25T14:16:52.091 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.085+0000 7efd95229700 1 -- 172.21.15.110:0/2585369636 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd90158fa0 con 0x7efd900b1720 2021-03-25T14:16:52.091 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.085+0000 7efd95229700 1 -- 172.21.15.110:0/2585369636 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd9014c370 con 0x7efd900b1720 2021-03-25T14:16:52.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.086+0000 7efd95229700 1 -- 172.21.15.110:0/2585369636 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd9005d7b0 con 0x7efd900b1720 2021-03-25T14:16:52.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.086+0000 7efd76ffd700 1 -- 172.21.15.110:0/2585369636 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7efd84013690 con 0x7efd900b1720 2021-03-25T14:16:52.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.086+0000 7efd76ffd700 1 --2- 172.21.15.110:0/2585369636 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7efd7005a0b0 0x7efd7005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:52.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.086+0000 7efd76ffd700 1 -- 172.21.15.110:0/2585369636 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7efd84074440 con 0x7efd900b1720 2021-03-25T14:16:52.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.087+0000 7efd8ed9d700 1 --2- 172.21.15.110:0/2585369636 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7efd7005a0b0 0x7efd7005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:52.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.087+0000 7efd8ed9d700 1 --2- 172.21.15.110:0/2585369636 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7efd7005a0b0 0x7efd7005c570 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7efd80007fd0 tx=0x7efd80009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:52.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.090+0000 7efd76ffd700 1 -- 172.21.15.110:0/2585369636 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7efd84047af0 con 0x7efd900b1720 2021-03-25T14:16:52.279 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.276+0000 7efd95229700 1 -- 172.21.15.110:0/2585369636 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd900bbd70 con 0x7efd900b1720 2021-03-25T14:16:52.279 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.277+0000 7efd76ffd700 1 -- 172.21.15.110:0/2585369636 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+2846 (secure 0 0 0) 0x7efd84009e60 con 0x7efd900b1720 2021-03-25T14:16:52.279 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:16:52.280 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1177985428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6833","nonce":1177985428},{"type":"v1","addr":"172.21.15.174:6835","nonce":1177985428}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.110:6836/3814723779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3814723779},{"type":"v1","addr":"172.21.15.110:6836","nonce":3814723779}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":4},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1613822797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1613822797},{"type":"v1","addr":"172.21.15.110:6837","nonce":1613822797}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-03-25T14:16:11.090720+0000","modified":"2021-03-25T14:16:25.750002+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"b","rank":0,"incarnation":5,"state":"up:active","state_seq":4,"addr":"172.21.15.174:6834/1564441351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1564441351},{"type":"v1","addr":"172.21.15.174:6834","nonce":1564441351}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-03-25T14:16:52.281 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.278+0000 7efd95229700 1 -- 172.21.15.110:0/2585369636 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7efd7005a0b0 msgr2=0x7efd7005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:52.281 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.278+0000 7efd95229700 1 --2- 172.21.15.110:0/2585369636 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7efd7005a0b0 0x7efd7005c570 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7efd80007fd0 tx=0x7efd80009040).stop 2021-03-25T14:16:52.281 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.278+0000 7efd95229700 1 -- 172.21.15.110:0/2585369636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd900b1720 msgr2=0x7efd90159440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:52.281 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.278+0000 7efd95229700 1 --2- 172.21.15.110:0/2585369636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd900b1720 0x7efd90159440 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7efd8400db60 tx=0x7efd84008040).stop 2021-03-25T14:16:52.281 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.278+0000 7efd95229700 1 -- 172.21.15.110:0/2585369636 shutdown_connections 2021-03-25T14:16:52.282 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.278+0000 7efd95229700 1 --2- 172.21.15.110:0/2585369636 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7efd7005a0b0 0x7efd7005c570 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:52.282 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.278+0000 7efd95229700 1 --2- 172.21.15.110:0/2585369636 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd9014a1e0 0x7efd900b2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:52.282 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.278+0000 7efd95229700 1 --2- 172.21.15.110:0/2585369636 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efd900b1340 0x7efd9014a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:52.282 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.278+0000 7efd95229700 1 --2- 172.21.15.110:0/2585369636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd900b1720 0x7efd90159440 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:52.282 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.278+0000 7efd95229700 1 -- 172.21.15.110:0/2585369636 >> 172.21.15.110:0/2585369636 conn(0x7efd900649a0 msgr2=0x7efd90149a30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:52.282 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.279+0000 7efd95229700 1 -- 172.21.15.110:0/2585369636 shutdown_connections 2021-03-25T14:16:52.282 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.279+0000 7efd95229700 1 -- 172.21.15.110:0/2585369636 wait complete. 2021-03-25T14:16:52.282 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 9 2021-03-25T14:16:52.292 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-03-25T14:16:52.403 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.401+0000 7fcc55415700 1 Processor -- start 2021-03-25T14:16:52.403 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.401+0000 7fcc55415700 1 -- start start 2021-03-25T14:16:52.406 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.402+0000 7fcc55415700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcc500b8500 0x7fcc500b8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:52.406 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.402+0000 7fcc55415700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcc5012f1b0 0x7fcc5012f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:52.406 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.402+0000 7fcc55415700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc50068f50 con 0x7fcc500bbca0 2021-03-25T14:16:52.406 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.402+0000 7fcc55415700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc500b8e70 con 0x7fcc500b8500 2021-03-25T14:16:52.406 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.402+0000 7fcc55415700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc50149940 con 0x7fcc5012f1b0 2021-03-25T14:16:52.406 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.402+0000 7fcc4e7fc700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcc500b8500 0x7fcc500b8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:52.406 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.402+0000 7fcc4effd700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fcc500bbca0 0x7fcc500684f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41802/0 (socket says 172.21.15.110:41802) 2021-03-25T14:16:52.406 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.402+0000 7fcc4effd700 1 -- 172.21.15.110:0/4220906925 learned_addr learned my addr 172.21.15.110:0/4220906925 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:52.407 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.402+0000 7fcc4f7fe700 1 --2- 172.21.15.110:0/4220906925 >> v2:172.21.15.174:3300/0 conn(0x7fcc5012f1b0 0x7fcc5012f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:52.407 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.402+0000 7fcc4e7fc700 1 -- 172.21.15.110:0/4220906925 >> v2:172.21.15.174:3300/0 conn(0x7fcc5012f1b0 msgr2=0x7fcc5012f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:52.407 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.402+0000 7fcc4e7fc700 1 --2- 172.21.15.110:0/4220906925 >> v2:172.21.15.174:3300/0 conn(0x7fcc5012f1b0 0x7fcc5012f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:52.407 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.402+0000 7fcc4e7fc700 1 -- 172.21.15.110:0/4220906925 >> v1:172.21.15.110:6789/0 conn(0x7fcc500bbca0 legacy=0x7fcc500684f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:52.407 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.402+0000 7fcc4dffb700 1 -- 172.21.15.110:0/4220906925 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1367269259 0 0) 0x7fcc50068f50 con 0x7fcc500bbca0 2021-03-25T14:16:52.407 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.402+0000 7fcc4e7fc700 1 -- 172.21.15.110:0/4220906925 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc50149be0 con 0x7fcc500b8500 2021-03-25T14:16:52.407 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.403+0000 7fcc4e7fc700 1 --2- 172.21.15.110:0/4220906925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc500b8500 0x7fcc500b8980 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7fcc50066310 tx=0x7fcc38006e20).ready entity=mon.0 client_cookie=9917bda2e6e9a2b2 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:52.407 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.403+0000 7fcc4dffb700 1 -- 172.21.15.110:0/4220906925 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc380097e0 con 0x7fcc500b8500 2021-03-25T14:16:52.407 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.403+0000 7fcc4dffb700 1 -- 172.21.15.110:0/4220906925 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc38009940 con 0x7fcc500b8500 2021-03-25T14:16:52.407 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.403+0000 7fcc4dffb700 1 -- 172.21.15.110:0/4220906925 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc38009cc0 con 0x7fcc500b8500 2021-03-25T14:16:52.408 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.403+0000 7fcc55415700 1 -- 172.21.15.110:0/4220906925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc500b8500 msgr2=0x7fcc500b8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:52.408 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.403+0000 7fcc55415700 1 --2- 172.21.15.110:0/4220906925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc500b8500 0x7fcc500b8980 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7fcc50066310 tx=0x7fcc38006e20).stop 2021-03-25T14:16:52.408 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.403+0000 7fcc55415700 1 -- 172.21.15.110:0/4220906925 shutdown_connections 2021-03-25T14:16:52.408 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.403+0000 7fcc55415700 1 --2- 172.21.15.110:0/4220906925 >> v2:172.21.15.174:3300/0 conn(0x7fcc5012f1b0 0x7fcc5012f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:52.408 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.403+0000 7fcc55415700 1 --2- 172.21.15.110:0/4220906925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc500b8500 0x7fcc500b8980 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:52.408 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.403+0000 7fcc55415700 1 -- 172.21.15.110:0/4220906925 >> 172.21.15.110:0/4220906925 conn(0x7fcc50063850 msgr2=0x7fcc5005c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:52.408 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.403+0000 7fcc55415700 1 -- 172.21.15.110:0/4220906925 shutdown_connections 2021-03-25T14:16:52.408 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.403+0000 7fcc55415700 1 -- 172.21.15.110:0/4220906925 wait complete. 2021-03-25T14:16:52.412 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.404+0000 7fcc55415700 1 Processor -- start 2021-03-25T14:16:52.412 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.404+0000 7fcc55415700 1 -- start start 2021-03-25T14:16:52.412 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.405+0000 7fcc55415700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc500b8500 0x7fcc5015a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:52.412 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.405+0000 7fcc55415700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc500bbca0 0x7fcc5012dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:52.412 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.405+0000 7fcc55415700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc5012f1b0 0x7fcc5012e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:52.412 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.405+0000 7fcc55415700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5015b450 con 0x7fcc500b8500 2021-03-25T14:16:52.412 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.405+0000 7fcc55415700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5012e6d0 con 0x7fcc5012f1b0 2021-03-25T14:16:52.412 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.405+0000 7fcc55415700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5012c3b0 con 0x7fcc500bbca0 2021-03-25T14:16:52.412 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.405+0000 7fcc4effd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc500b8500 0x7fcc5015a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:52.412 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.405+0000 7fcc4effd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc500b8500 0x7fcc5015a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48870/0 (socket says 172.21.15.110:48870) 2021-03-25T14:16:52.412 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.405+0000 7fcc4effd700 1 -- 172.21.15.110:0/4193193934 learned_addr learned my addr 172.21.15.110:0/4193193934 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:52.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.405+0000 7fcc4e7fc700 1 --2- 172.21.15.110:0/4193193934 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc500bbca0 0x7fcc5012dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:52.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.405+0000 7fcc4f7fe700 1 --2- 172.21.15.110:0/4193193934 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc5012f1b0 0x7fcc5012e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:52.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.405+0000 7fcc4effd700 1 -- 172.21.15.110:0/4193193934 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc500bbca0 msgr2=0x7fcc5012dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:52.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.405+0000 7fcc4effd700 1 --2- 172.21.15.110:0/4193193934 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc500bbca0 0x7fcc5012dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:52.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.405+0000 7fcc4effd700 1 -- 172.21.15.110:0/4193193934 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc5012f1b0 msgr2=0x7fcc5012e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:52.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.405+0000 7fcc4effd700 1 --2- 172.21.15.110:0/4193193934 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc5012f1b0 0x7fcc5012e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:52.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.405+0000 7fcc4effd700 1 -- 172.21.15.110:0/4193193934 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc5015b1b0 con 0x7fcc500b8500 2021-03-25T14:16:52.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.405+0000 7fcc4e7fc700 1 --2- 172.21.15.110:0/4193193934 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc500bbca0 0x7fcc5012dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:52.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.405+0000 7fcc4f7fe700 1 --2- 172.21.15.110:0/4193193934 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc5012f1b0 0x7fcc5012e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:52.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.406+0000 7fcc4effd700 1 --2- 172.21.15.110:0/4193193934 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc500b8500 0x7fcc5015a8f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fcc4000ca90 tx=0x7fcc40007e70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:52.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.406+0000 7fcc46ffd700 1 -- 172.21.15.110:0/4193193934 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc40005bb0 con 0x7fcc500b8500 2021-03-25T14:16:52.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.406+0000 7fcc46ffd700 1 -- 172.21.15.110:0/4193193934 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc40005d10 con 0x7fcc500b8500 2021-03-25T14:16:52.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.406+0000 7fcc46ffd700 1 -- 172.21.15.110:0/4193193934 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc40007320 con 0x7fcc500b8500 2021-03-25T14:16:52.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.406+0000 7fcc55415700 1 -- 172.21.15.110:0/4193193934 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc5012c610 con 0x7fcc500b8500 2021-03-25T14:16:52.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.406+0000 7fcc55415700 1 -- 172.21.15.110:0/4193193934 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc5015ade0 con 0x7fcc500b8500 2021-03-25T14:16:52.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.407+0000 7fcc55415700 1 -- 172.21.15.110:0/4193193934 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc500ada50 con 0x7fcc500b8500 2021-03-25T14:16:52.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.407+0000 7fcc46ffd700 1 -- 172.21.15.110:0/4193193934 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fcc40010030 con 0x7fcc500b8500 2021-03-25T14:16:52.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.407+0000 7fcc46ffd700 1 --2- 172.21.15.110:0/4193193934 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fcc3405a0b0 0x7fcc3405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:52.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.407+0000 7fcc46ffd700 1 -- 172.21.15.110:0/4193193934 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fcc40074170 con 0x7fcc500b8500 2021-03-25T14:16:52.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.407+0000 7fcc4e7fc700 1 --2- 172.21.15.110:0/4193193934 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fcc3405a0b0 0x7fcc3405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:52.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.408+0000 7fcc4e7fc700 1 --2- 172.21.15.110:0/4193193934 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fcc3405a0b0 0x7fcc3405c570 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fcc5005ca40 tx=0x7fcc38016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:52.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.411+0000 7fcc46ffd700 1 -- 172.21.15.110:0/4193193934 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fcc40047820 con 0x7fcc500b8500 2021-03-25T14:16:52.597 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.595+0000 7fcc55415700 1 -- 172.21.15.110:0/4193193934 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc5005d7b0 con 0x7fcc500b8500 2021-03-25T14:16:52.631 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.596+0000 7fcc46ffd700 1 -- 172.21.15.110:0/4193193934 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+2846 (secure 0 0 0) 0x7fcc4004ae40 con 0x7fcc500b8500 2021-03-25T14:16:52.632 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:16:52.632 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1177985428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6833","nonce":1177985428},{"type":"v1","addr":"172.21.15.174:6835","nonce":1177985428}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.110:6836/3814723779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3814723779},{"type":"v1","addr":"172.21.15.110:6836","nonce":3814723779}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":4},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1613822797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1613822797},{"type":"v1","addr":"172.21.15.110:6837","nonce":1613822797}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-03-25T14:16:11.090720+0000","modified":"2021-03-25T14:16:25.750002+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"b","rank":0,"incarnation":5,"state":"up:active","state_seq":4,"addr":"172.21.15.174:6834/1564441351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1564441351},{"type":"v1","addr":"172.21.15.174:6834","nonce":1564441351}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-03-25T14:16:52.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.597+0000 7fcc55415700 1 -- 172.21.15.110:0/4193193934 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fcc3405a0b0 msgr2=0x7fcc3405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:52.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.597+0000 7fcc55415700 1 --2- 172.21.15.110:0/4193193934 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fcc3405a0b0 0x7fcc3405c570 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fcc5005ca40 tx=0x7fcc38016000).stop 2021-03-25T14:16:52.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.597+0000 7fcc55415700 1 -- 172.21.15.110:0/4193193934 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc500b8500 msgr2=0x7fcc5015a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:52.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.597+0000 7fcc55415700 1 --2- 172.21.15.110:0/4193193934 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc500b8500 0x7fcc5015a8f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fcc4000ca90 tx=0x7fcc40007e70).stop 2021-03-25T14:16:52.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.597+0000 7fcc55415700 1 -- 172.21.15.110:0/4193193934 shutdown_connections 2021-03-25T14:16:52.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.597+0000 7fcc55415700 1 --2- 172.21.15.110:0/4193193934 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fcc3405a0b0 0x7fcc3405c570 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:52.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.597+0000 7fcc55415700 1 --2- 172.21.15.110:0/4193193934 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc5012f1b0 0x7fcc5012e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:52.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.597+0000 7fcc55415700 1 --2- 172.21.15.110:0/4193193934 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc500b8500 0x7fcc5015a8f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:52.635 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.597+0000 7fcc55415700 1 --2- 172.21.15.110:0/4193193934 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc500bbca0 0x7fcc5012dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:52.635 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.597+0000 7fcc55415700 1 -- 172.21.15.110:0/4193193934 >> 172.21.15.110:0/4193193934 conn(0x7fcc50063850 msgr2=0x7fcc500adc10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:52.635 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.597+0000 7fcc55415700 1 -- 172.21.15.110:0/4193193934 shutdown_connections 2021-03-25T14:16:52.635 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.597+0000 7fcc55415700 1 -- 172.21.15.110:0/4193193934 wait complete. 2021-03-25T14:16:52.635 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 9 2021-03-25T14:16:52.635 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:16:52.745 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.743+0000 7ffb7a7dc700 1 Processor -- start 2021-03-25T14:16:52.745 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.743+0000 7ffb7a7dc700 1 -- start start 2021-03-25T14:16:52.747 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.744+0000 7ffb7a7dc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb740bdce0 0x7ffb740be0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:52.748 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.744+0000 7ffb7a7dc700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ffb740b7a40 0x7ffb74143200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:52.748 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.744+0000 7ffb7a7dc700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb7414cd00 con 0x7ffb740b7ec0 2021-03-25T14:16:52.748 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.744+0000 7ffb7a7dc700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb7414cfa0 con 0x7ffb740b7a40 2021-03-25T14:16:52.748 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.744+0000 7ffb7a7dc700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7414d240 con 0x7ffb740bdce0 2021-03-25T14:16:52.748 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.744+0000 7ffb73fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb740bdce0 0x7ffb740be0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:52.748 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.744+0000 7ffb737fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ffb740b7a40 0x7ffb74143200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:52.748 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.744+0000 7ffb78d79700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7ffb740b7ec0 0x7ffb741495b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.110:49480/0 (socket says 172.21.15.110:49480) 2021-03-25T14:16:52.748 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.744+0000 7ffb78d79700 1 -- 172.21.15.110:0/1831661426 learned_addr learned my addr 172.21.15.110:0/1831661426 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:52.748 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.744+0000 7ffb73fff700 1 -- 172.21.15.110:0/1831661426 >> v2:172.21.15.174:3300/0 conn(0x7ffb740b7a40 msgr2=0x7ffb74143200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:52.748 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.744+0000 7ffb73fff700 1 --2- 172.21.15.110:0/1831661426 >> v2:172.21.15.174:3300/0 conn(0x7ffb740b7a40 0x7ffb74143200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:52.749 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.744+0000 7ffb73fff700 1 -- 172.21.15.110:0/1831661426 >> v1:172.21.15.174:6789/0 conn(0x7ffb740b7ec0 legacy=0x7ffb741495b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:52.749 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.745+0000 7ffb73fff700 1 -- 172.21.15.110:0/1831661426 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7414d4e0 con 0x7ffb740bdce0 2021-03-25T14:16:52.749 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.745+0000 7ffb73fff700 1 --2- 172.21.15.110:0/1831661426 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb740bdce0 0x7ffb740be0c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7ffb6400b9c0 tx=0x7ffb64006e20).ready entity=mon.2 client_cookie=c360e8dd9130016d server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:52.749 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.745+0000 7ffb72ffd700 1 -- 172.21.15.110:0/1831661426 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb64009870 con 0x7ffb740bdce0 2021-03-25T14:16:52.749 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.745+0000 7ffb72ffd700 1 -- 172.21.15.110:0/1831661426 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb640099d0 con 0x7ffb740bdce0 2021-03-25T14:16:52.749 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.745+0000 7ffb72ffd700 1 -- 172.21.15.110:0/1831661426 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb64009d50 con 0x7ffb740bdce0 2021-03-25T14:16:52.749 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.745+0000 7ffb7a7dc700 1 -- 172.21.15.110:0/1831661426 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb740bdce0 msgr2=0x7ffb740be0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:52.749 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.745+0000 7ffb7a7dc700 1 --2- 172.21.15.110:0/1831661426 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb740bdce0 0x7ffb740be0c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7ffb6400b9c0 tx=0x7ffb64006e20).stop 2021-03-25T14:16:52.749 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.745+0000 7ffb7a7dc700 1 -- 172.21.15.110:0/1831661426 shutdown_connections 2021-03-25T14:16:52.749 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.745+0000 7ffb7a7dc700 1 --2- 172.21.15.110:0/1831661426 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb740bdce0 0x7ffb740be0c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:52.749 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.745+0000 7ffb7a7dc700 1 --2- 172.21.15.110:0/1831661426 >> v2:172.21.15.174:3300/0 conn(0x7ffb740b7a40 0x7ffb74143200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:52.750 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.745+0000 7ffb7a7dc700 1 -- 172.21.15.110:0/1831661426 >> 172.21.15.110:0/1831661426 conn(0x7ffb740686a0 msgr2=0x7ffb74068ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:52.750 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.745+0000 7ffb7a7dc700 1 -- 172.21.15.110:0/1831661426 shutdown_connections 2021-03-25T14:16:52.750 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.745+0000 7ffb7a7dc700 1 -- 172.21.15.110:0/1831661426 wait complete. 2021-03-25T14:16:52.753 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.746+0000 7ffb7a7dc700 1 Processor -- start 2021-03-25T14:16:52.753 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.747+0000 7ffb7a7dc700 1 -- start start 2021-03-25T14:16:52.753 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.747+0000 7ffb7a7dc700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb740b7a40 0x7ffb7414a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:52.753 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.747+0000 7ffb7a7dc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb740b7ec0 0x7ffb74142da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:52.753 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.747+0000 7ffb7a7dc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb740bdce0 0x7ffb7413ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:52.753 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.747+0000 7ffb7a7dc700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb740b8860 con 0x7ffb740b7ec0 2021-03-25T14:16:52.753 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.747+0000 7ffb7a7dc700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb740b8b00 con 0x7ffb740b7a40 2021-03-25T14:16:52.753 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.747+0000 7ffb7a7dc700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb740b8da0 con 0x7ffb740bdce0 2021-03-25T14:16:52.753 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.747+0000 7ffb737fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb740b7ec0 0x7ffb74142da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:52.753 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.747+0000 7ffb737fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb740b7ec0 0x7ffb74142da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48886/0 (socket says 172.21.15.110:48886) 2021-03-25T14:16:52.753 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.747+0000 7ffb737fe700 1 -- 172.21.15.110:0/1311820839 learned_addr learned my addr 172.21.15.110:0/1311820839 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:52.754 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.747+0000 7ffb73fff700 1 --2- 172.21.15.110:0/1311820839 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb740b7a40 0x7ffb7414a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:52.754 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.747+0000 7ffb78d79700 1 --2- 172.21.15.110:0/1311820839 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb740bdce0 0x7ffb7413ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:52.754 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.748+0000 7ffb737fe700 1 -- 172.21.15.110:0/1311820839 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb740bdce0 msgr2=0x7ffb7413ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:52.754 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.748+0000 7ffb737fe700 1 --2- 172.21.15.110:0/1311820839 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb740bdce0 0x7ffb7413ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:52.754 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.748+0000 7ffb737fe700 1 -- 172.21.15.110:0/1311820839 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb740b7a40 msgr2=0x7ffb7414a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:52.754 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.748+0000 7ffb737fe700 1 --2- 172.21.15.110:0/1311820839 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb740b7a40 0x7ffb7414a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:52.754 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.748+0000 7ffb737fe700 1 -- 172.21.15.110:0/1311820839 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7413e5b0 con 0x7ffb740b7ec0 2021-03-25T14:16:52.754 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.748+0000 7ffb737fe700 1 --2- 172.21.15.110:0/1311820839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb740b7ec0 0x7ffb74142da0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7ffb5c00eba0 tx=0x7ffb5c006e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:52.754 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.748+0000 7ffb6bfff700 1 -- 172.21.15.110:0/1311820839 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c00eeb0 con 0x7ffb740b7ec0 2021-03-25T14:16:52.754 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.748+0000 7ffb6bfff700 1 -- 172.21.15.110:0/1311820839 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb5c00c8e0 con 0x7ffb740b7ec0 2021-03-25T14:16:52.754 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.748+0000 7ffb7a7dc700 1 -- 172.21.15.110:0/1311820839 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb74143290 con 0x7ffb740b7ec0 2021-03-25T14:16:52.755 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.748+0000 7ffb6bfff700 1 -- 172.21.15.110:0/1311820839 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c00cc60 con 0x7ffb740b7ec0 2021-03-25T14:16:52.755 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.748+0000 7ffb7a7dc700 1 -- 172.21.15.110:0/1311820839 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb740b97e0 con 0x7ffb740b7ec0 2021-03-25T14:16:52.755 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.749+0000 7ffb7a7dc700 1 -- 172.21.15.110:0/1311820839 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb7413e740 con 0x7ffb740b7ec0 2021-03-25T14:16:52.755 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.749+0000 7ffb6bfff700 1 -- 172.21.15.110:0/1311820839 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7ffb5c01a030 con 0x7ffb740b7ec0 2021-03-25T14:16:52.755 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.749+0000 7ffb6bfff700 1 --2- 172.21.15.110:0/1311820839 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ffb5805a0e0 0x7ffb5805c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:52.755 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.749+0000 7ffb6bfff700 1 -- 172.21.15.110:0/1311820839 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7ffb5c073ae0 con 0x7ffb740b7ec0 2021-03-25T14:16:52.755 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.750+0000 7ffb73fff700 1 --2- 172.21.15.110:0/1311820839 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ffb5805a0e0 0x7ffb5805c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:52.755 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.750+0000 7ffb73fff700 1 --2- 172.21.15.110:0/1311820839 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ffb5805a0e0 0x7ffb5805c5a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7ffb64007fd0 tx=0x7ffb64016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:52.756 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.753+0000 7ffb6bfff700 1 -- 172.21.15.110:0/1311820839 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7ffb5c046620 con 0x7ffb740b7ec0 2021-03-25T14:16:52.909 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.907+0000 7ffb7a7dc700 1 -- 172.21.15.110:0/1311820839 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb7405d7b0 con 0x7ffb740b7ec0 2021-03-25T14:16:52.910 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.908+0000 7ffb6bfff700 1 -- 172.21.15.110:0/1311820839 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18685 (secure 0 0 0) 0x7ffb5c026910 con 0x7ffb740b7ec0 2021-03-25T14:16:52.910 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:16:52.911 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":25,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:16:15.446609+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-03-25T14:16:09.478442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-03-25T14:16:10.071152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2021-03-25T14:16:13.122119+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:16:52.912 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.909+0000 7ffb7a7dc700 1 -- 172.21.15.110:0/1311820839 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ffb5805a0e0 msgr2=0x7ffb5805c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:52.912 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.909+0000 7ffb7a7dc700 1 --2- 172.21.15.110:0/1311820839 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ffb5805a0e0 0x7ffb5805c5a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7ffb64007fd0 tx=0x7ffb64016000).stop 2021-03-25T14:16:52.912 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.909+0000 7ffb7a7dc700 1 -- 172.21.15.110:0/1311820839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb740b7ec0 msgr2=0x7ffb74142da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:52.912 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.909+0000 7ffb7a7dc700 1 --2- 172.21.15.110:0/1311820839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb740b7ec0 0x7ffb74142da0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7ffb5c00eba0 tx=0x7ffb5c006e20).stop 2021-03-25T14:16:52.913 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.909+0000 7ffb7a7dc700 1 -- 172.21.15.110:0/1311820839 shutdown_connections 2021-03-25T14:16:52.913 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.909+0000 7ffb7a7dc700 1 --2- 172.21.15.110:0/1311820839 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ffb5805a0e0 0x7ffb5805c5a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:52.913 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.909+0000 7ffb7a7dc700 1 --2- 172.21.15.110:0/1311820839 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb740b7a40 0x7ffb7414a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:52.913 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.909+0000 7ffb7a7dc700 1 --2- 172.21.15.110:0/1311820839 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb740bdce0 0x7ffb7413ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:52.913 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.909+0000 7ffb7a7dc700 1 --2- 172.21.15.110:0/1311820839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb740b7ec0 0x7ffb74142da0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:52.913 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.909+0000 7ffb7a7dc700 1 -- 172.21.15.110:0/1311820839 >> 172.21.15.110:0/1311820839 conn(0x7ffb740686a0 msgr2=0x7ffb74146090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:52.913 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.909+0000 7ffb7a7dc700 1 -- 172.21.15.110:0/1311820839 shutdown_connections 2021-03-25T14:16:52.913 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:52.909+0000 7ffb7a7dc700 1 -- 172.21.15.110:0/1311820839 wait complete. 2021-03-25T14:16:52.923 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-03-25T14:16:53.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.032+0000 7f7f7f158700 1 Processor -- start 2021-03-25T14:16:53.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.032+0000 7f7f7f158700 1 -- start start 2021-03-25T14:16:53.040 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.033+0000 7f7f7f158700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f780be5a0 0x7f7f7809d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:53.040 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.033+0000 7f7f7f158700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7f780b9ba0 0x7f7f78143270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:53.040 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.033+0000 7f7f7f158700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7f78143760 0x7f7f78149a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:53.040 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.033+0000 7f7f7f158700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f7814d0e0 con 0x7f7f780b9ba0 2021-03-25T14:16:53.040 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.033+0000 7f7f7f158700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f7814d380 con 0x7f7f78143760 2021-03-25T14:16:53.041 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.033+0000 7f7f7f158700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7814d620 con 0x7f7f780be5a0 2021-03-25T14:16:53.041 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.033+0000 7f7f77fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7f780b9ba0 0x7f7f78143270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:53.041 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.033+0000 7f7f77fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7f780b9ba0 0x7f7f78143270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48894/0 (socket says 172.21.15.110:48894) 2021-03-25T14:16:53.041 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.033+0000 7f7f77fff700 1 -- 172.21.15.110:0/2837449176 learned_addr learned my addr 172.21.15.110:0/2837449176 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:53.041 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.033+0000 7f7f7d6f5700 1 --2- 172.21.15.110:0/2837449176 >> v2:172.21.15.174:3300/0 conn(0x7f7f78143760 0x7f7f78149a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:53.041 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.033+0000 7f7f7cef4700 1 --2- 172.21.15.110:0/2837449176 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f780be5a0 0x7f7f7809d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:53.041 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.033+0000 7f7f77fff700 1 -- 172.21.15.110:0/2837449176 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f780be5a0 msgr2=0x7f7f7809d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:53.041 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.033+0000 7f7f77fff700 1 --2- 172.21.15.110:0/2837449176 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f780be5a0 0x7f7f7809d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:53.041 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.033+0000 7f7f77fff700 1 -- 172.21.15.110:0/2837449176 >> v2:172.21.15.174:3300/0 conn(0x7f7f78143760 msgr2=0x7f7f78149a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:53.041 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.033+0000 7f7f77fff700 1 --2- 172.21.15.110:0/2837449176 >> v2:172.21.15.174:3300/0 conn(0x7f7f78143760 0x7f7f78149a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:53.041 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.033+0000 7f7f77fff700 1 -- 172.21.15.110:0/2837449176 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f7814d8c0 con 0x7f7f780b9ba0 2021-03-25T14:16:53.042 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.033+0000 7f7f77fff700 1 --2- 172.21.15.110:0/2837449176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f780b9ba0 0x7f7f78143270 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f7f780ba560 tx=0x7f7f64006ee0).ready entity=mon.0 client_cookie=6b47faa75813e135 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:53.042 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.033+0000 7f7f777fe700 1 -- 172.21.15.110:0/2837449176 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f640098d0 con 0x7f7f780b9ba0 2021-03-25T14:16:53.042 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.033+0000 7f7f777fe700 1 -- 172.21.15.110:0/2837449176 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f64009a30 con 0x7f7f780b9ba0 2021-03-25T14:16:53.042 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.033+0000 7f7f777fe700 1 -- 172.21.15.110:0/2837449176 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f64009db0 con 0x7f7f780b9ba0 2021-03-25T14:16:53.042 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.034+0000 7f7f7f158700 1 -- 172.21.15.110:0/2837449176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f780b9ba0 msgr2=0x7f7f78143270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:53.042 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.034+0000 7f7f7f158700 1 --2- 172.21.15.110:0/2837449176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f780b9ba0 0x7f7f78143270 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f7f780ba560 tx=0x7f7f64006ee0).stop 2021-03-25T14:16:53.042 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.034+0000 7f7f7f158700 1 -- 172.21.15.110:0/2837449176 shutdown_connections 2021-03-25T14:16:53.043 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.034+0000 7f7f7f158700 1 --2- 172.21.15.110:0/2837449176 >> v2:172.21.15.174:3300/0 conn(0x7f7f78143760 0x7f7f78149a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:53.043 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.034+0000 7f7f7f158700 1 --2- 172.21.15.110:0/2837449176 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f780be5a0 0x7f7f7809d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:53.043 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.034+0000 7f7f7f158700 1 --2- 172.21.15.110:0/2837449176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f780b9ba0 0x7f7f78143270 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:53.043 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.034+0000 7f7f7f158700 1 -- 172.21.15.110:0/2837449176 >> 172.21.15.110:0/2837449176 conn(0x7f7f780616d0 msgr2=0x7f7f780bdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:53.043 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.034+0000 7f7f7f158700 1 -- 172.21.15.110:0/2837449176 shutdown_connections 2021-03-25T14:16:53.043 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.034+0000 7f7f7f158700 1 -- 172.21.15.110:0/2837449176 wait complete. 2021-03-25T14:16:53.043 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.035+0000 7f7f7f158700 1 Processor -- start 2021-03-25T14:16:53.044 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.035+0000 7f7f7f158700 1 -- start start 2021-03-25T14:16:53.044 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.036+0000 7f7f7f158700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f780b9ba0 0x7f7f780bc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:53.044 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.036+0000 7f7f7f158700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f780be5a0 0x7f7f78064a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:53.044 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.036+0000 7f7f7f158700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f78143760 0x7f7f78064f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:53.044 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.036+0000 7f7f7f158700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f78158d10 con 0x7f7f78143760 2021-03-25T14:16:53.044 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.036+0000 7f7f7f158700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f78066740 con 0x7f7f780b9ba0 2021-03-25T14:16:53.044 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.036+0000 7f7f7f158700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f780669e0 con 0x7f7f780be5a0 2021-03-25T14:16:53.044 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.036+0000 7f7f7d6f5700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f78143760 0x7f7f78064f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:53.044 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.036+0000 7f7f7d6f5700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f78143760 0x7f7f78064f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48900/0 (socket says 172.21.15.110:48900) 2021-03-25T14:16:53.044 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.036+0000 7f7f7d6f5700 1 -- 172.21.15.110:0/3241479927 learned_addr learned my addr 172.21.15.110:0/3241479927 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:53.045 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.036+0000 7f7f77fff700 1 --2- 172.21.15.110:0/3241479927 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f780be5a0 0x7f7f78064a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:53.045 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.036+0000 7f7f7cef4700 1 --2- 172.21.15.110:0/3241479927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f780b9ba0 0x7f7f780bc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:53.045 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.036+0000 7f7f7d6f5700 1 -- 172.21.15.110:0/3241479927 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f780be5a0 msgr2=0x7f7f78064a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:53.045 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.036+0000 7f7f7d6f5700 1 --2- 172.21.15.110:0/3241479927 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f780be5a0 0x7f7f78064a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:53.045 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.036+0000 7f7f7d6f5700 1 -- 172.21.15.110:0/3241479927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f780b9ba0 msgr2=0x7f7f780bc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:53.045 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.036+0000 7f7f7d6f5700 1 --2- 172.21.15.110:0/3241479927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f780b9ba0 0x7f7f780bc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:53.045 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.036+0000 7f7f7d6f5700 1 -- 172.21.15.110:0/3241479927 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f78066c80 con 0x7f7f78143760 2021-03-25T14:16:53.045 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.036+0000 7f7f7cef4700 1 --2- 172.21.15.110:0/3241479927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f780b9ba0 0x7f7f780bc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:53.045 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.036+0000 7f7f77fff700 1 --2- 172.21.15.110:0/3241479927 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f780be5a0 0x7f7f78064a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:53.046 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.036+0000 7f7f7d6f5700 1 --2- 172.21.15.110:0/3241479927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f78143760 0x7f7f78064f20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f7f7000ebf0 tx=0x7f7f70008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:53.046 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.036+0000 7f7f74ff9700 1 -- 172.21.15.110:0/3241479927 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7000c7c0 con 0x7f7f78143760 2021-03-25T14:16:53.046 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.036+0000 7f7f74ff9700 1 -- 172.21.15.110:0/3241479927 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7000c920 con 0x7f7f78143760 2021-03-25T14:16:53.046 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.036+0000 7f7f74ff9700 1 -- 172.21.15.110:0/3241479927 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7000ccc0 con 0x7f7f78143760 2021-03-25T14:16:53.046 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.036+0000 7f7f7f158700 1 -- 172.21.15.110:0/3241479927 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f78066f20 con 0x7f7f78143760 2021-03-25T14:16:53.046 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.037+0000 7f7f7f158700 1 -- 172.21.15.110:0/3241479927 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f780bcc50 con 0x7f7f78143760 2021-03-25T14:16:53.046 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.037+0000 7f7f7f158700 1 -- 172.21.15.110:0/3241479927 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f7805d7b0 con 0x7f7f78143760 2021-03-25T14:16:53.046 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.038+0000 7f7f74ff9700 1 -- 172.21.15.110:0/3241479927 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f7f70013640 con 0x7f7f78143760 2021-03-25T14:16:53.046 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.038+0000 7f7f74ff9700 1 --2- 172.21.15.110:0/3241479927 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f7f5805a0b0 0x7f7f5805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:53.046 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.038+0000 7f7f74ff9700 1 -- 172.21.15.110:0/3241479927 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f7f700740b0 con 0x7f7f78143760 2021-03-25T14:16:53.046 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.038+0000 7f7f7cef4700 1 --2- 172.21.15.110:0/3241479927 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f7f5805a0b0 0x7f7f5805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:53.047 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.038+0000 7f7f7cef4700 1 --2- 172.21.15.110:0/3241479927 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f7f5805a0b0 0x7f7f5805c570 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f7f6c00d950 tx=0x7f7f6c008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:53.047 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.042+0000 7f7f74ff9700 1 -- 172.21.15.110:0/3241479927 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f7f70047760 con 0x7f7f78143760 2021-03-25T14:16:53.228 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.226+0000 7f7f7f158700 1 -- 172.21.15.110:0/3241479927 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f7f78062cc0 con 0x7f7f78143760 2021-03-25T14:16:53.778 INFO:tasks.ceph.mon.a.smithi110.stderr:2021-03-25T14:16:53.776+0000 7f2dd9594700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-03-25T14:16:53.780 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.779+0000 7f7f74ff9700 1 -- 172.21.15.110:0/3241479927 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7f7004ad80 con 0x7f7f78143760 2021-03-25T14:16:53.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.781+0000 7f7f7f158700 1 -- 172.21.15.110:0/3241479927 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f7f5805a0b0 msgr2=0x7f7f5805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:53.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.781+0000 7f7f7f158700 1 --2- 172.21.15.110:0/3241479927 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f7f5805a0b0 0x7f7f5805c570 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f7f6c00d950 tx=0x7f7f6c008040).stop 2021-03-25T14:16:53.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.781+0000 7f7f7f158700 1 -- 172.21.15.110:0/3241479927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f78143760 msgr2=0x7f7f78064f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:53.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.781+0000 7f7f7f158700 1 --2- 172.21.15.110:0/3241479927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f78143760 0x7f7f78064f20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f7f7000ebf0 tx=0x7f7f70008040).stop 2021-03-25T14:16:53.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.781+0000 7f7f7f158700 1 -- 172.21.15.110:0/3241479927 shutdown_connections 2021-03-25T14:16:53.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.781+0000 7f7f7f158700 1 --2- 172.21.15.110:0/3241479927 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f7f5805a0b0 0x7f7f5805c570 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:53.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.781+0000 7f7f7f158700 1 --2- 172.21.15.110:0/3241479927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f780b9ba0 0x7f7f780bc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:53.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.781+0000 7f7f7f158700 1 --2- 172.21.15.110:0/3241479927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f78143760 0x7f7f78064f20 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:53.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.781+0000 7f7f7f158700 1 --2- 172.21.15.110:0/3241479927 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f780be5a0 0x7f7f78064a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:53.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.781+0000 7f7f7f158700 1 -- 172.21.15.110:0/3241479927 >> 172.21.15.110:0/3241479927 conn(0x7f7f780616d0 msgr2=0x7f7f7814bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:53.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.781+0000 7f7f7f158700 1 -- 172.21.15.110:0/3241479927 shutdown_connections 2021-03-25T14:16:53.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.781+0000 7f7f7f158700 1 -- 172.21.15.110:0/3241479927 wait complete. 2021-03-25T14:16:53.785 INFO:tasks.ceph.mds.b.smithi174.stderr: -1508> 2021-03-25T14:16:13.149+0000 7f5220b61700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2021-03-25T14:16:53.785 INFO:teuthology.orchestra.run.smithi110.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-03-25T14:16:53.796 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-03-25T14:16:53.806 INFO:tasks.ceph.mds.b.smithi174.stdout:starting mds.b at 2021-03-25T14:16:53.911 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.909+0000 7f87e60b2700 1 Processor -- start 2021-03-25T14:16:53.957 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.909+0000 7f87e60b2700 1 -- start start 2021-03-25T14:16:53.966 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.910+0000 7f87e60b2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f87e0064ad0 0x7f87e00bad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:53.967 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.910+0000 7f87e60b2700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e014d740 con 0x7f87e00bb260 2021-03-25T14:16:53.967 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.910+0000 7f87e60b2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e0149900 con 0x7f87e014d290 2021-03-25T14:16:53.967 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.910+0000 7f87e60b2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e0149ba0 con 0x7f87e0064ad0 2021-03-25T14:16:53.967 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.910+0000 7f87e48af700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f87e00bb260 0x7f87e014cb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41840/0 (socket says 172.21.15.110:41840) 2021-03-25T14:16:53.967 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.910+0000 7f87e48af700 1 -- 172.21.15.110:0/1807973139 learned_addr learned my addr 172.21.15.110:0/1807973139 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:53.967 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.910+0000 7f87cffff700 1 -- 172.21.15.110:0/1807973139 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4045688132 0 0) 0x7f87d0001110 con 0x7f87e00bb260 2021-03-25T14:16:53.967 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.910+0000 7f87cffff700 1 -- 172.21.15.110:0/1807973139 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87c8003270 con 0x7f87e00bb260 2021-03-25T14:16:53.967 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.910+0000 7f87e50b0700 1 --2- 172.21.15.110:0/1807973139 >> v2:172.21.15.174:3300/0 conn(0x7f87e0064ad0 0x7f87e00bad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:53.967 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.910+0000 7f87cffff700 1 -- 172.21.15.110:0/1807973139 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2308167938 0 0) 0x7f87c8003270 con 0x7f87e00bb260 2021-03-25T14:16:53.967 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.910+0000 7f87cffff700 1 -- 172.21.15.110:0/1807973139 >> v2:172.21.15.174:3300/0 conn(0x7f87e0064ad0 msgr2=0x7f87e00bad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:53.967 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.910+0000 7f87cffff700 1 --2- 172.21.15.110:0/1807973139 >> v2:172.21.15.174:3300/0 conn(0x7f87e0064ad0 0x7f87e00bad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:53.968 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.910+0000 7f87cffff700 1 -- 172.21.15.110:0/1807973139 >> v1:172.21.15.174:6789/0 conn(0x7f87e014d290 legacy=0x7f87e01485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:53.968 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.911+0000 7f87cffff700 1 -- 172.21.15.110:0/1807973139 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e0149e40 con 0x7f87e00bb260 2021-03-25T14:16:53.968 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.911+0000 7f87cffff700 1 -- 172.21.15.110:0/1807973139 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f87d00016b0 con 0x7f87e00bb260 2021-03-25T14:16:53.968 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.911+0000 7f87cffff700 1 -- 172.21.15.110:0/1807973139 >> v1:172.21.15.110:6789/0 conn(0x7f87e00bb260 legacy=0x7f87e014cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:53.968 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.911+0000 7f87cffff700 1 --2- 172.21.15.110:0/1807973139 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f87c8003760 0x7f87c8003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:53.968 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.911+0000 7f87cffff700 1 --2- 172.21.15.110:0/1807973139 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87c8004510 0x7f87c8004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:53.968 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.911+0000 7f87cffff700 1 --2- 172.21.15.110:0/1807973139 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87c8004e80 0x7f87c800b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:53.968 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.911+0000 7f87cffff700 1 -- 172.21.15.110:0/1807973139 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e0149ba0 con 0x7f87c8004510 2021-03-25T14:16:53.968 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.911+0000 7f87cffff700 1 -- 172.21.15.110:0/1807973139 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c8004290 con 0x7f87c8003760 2021-03-25T14:16:53.968 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.911+0000 7f87cffff700 1 -- 172.21.15.110:0/1807973139 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c800bc50 con 0x7f87c8004e80 2021-03-25T14:16:53.968 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.911+0000 7f87e48af700 1 --2- 172.21.15.110:0/1807973139 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87c8004510 0x7f87c8004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:53.968 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.911+0000 7f87e50b0700 1 --2- 172.21.15.110:0/1807973139 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f87c8003760 0x7f87c8003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:53.969 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.911+0000 7f87e58b1700 1 --2- 172.21.15.110:0/1807973139 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87c8004e80 0x7f87c800b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:53.969 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.911+0000 7f87e48af700 1 -- 172.21.15.110:0/1807973139 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87c8004e80 msgr2=0x7f87c800b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:53.969 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.911+0000 7f87e48af700 1 --2- 172.21.15.110:0/1807973139 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87c8004e80 0x7f87c800b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:53.969 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.911+0000 7f87e48af700 1 -- 172.21.15.110:0/1807973139 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f87c8003760 msgr2=0x7f87c8003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:53.969 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.911+0000 7f87e48af700 1 --2- 172.21.15.110:0/1807973139 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f87c8003760 0x7f87c8003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:53.969 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.911+0000 7f87e48af700 1 -- 172.21.15.110:0/1807973139 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c8003270 con 0x7f87c8004510 2021-03-25T14:16:53.969 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.911+0000 7f87e50b0700 1 --2- 172.21.15.110:0/1807973139 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f87c8003760 0x7f87c8003b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:53.969 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.911+0000 7f87e58b1700 1 --2- 172.21.15.110:0/1807973139 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87c8004e80 0x7f87c800b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:53.969 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.911+0000 7f87e58b1700 1 -- 172.21.15.110:0/1807973139 reap_dead start 2021-03-25T14:16:53.969 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.911+0000 7f87e48af700 1 --2- 172.21.15.110:0/1807973139 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87c8004510 0x7f87c8004990 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f87d000c490 tx=0x7f87e0149a90).ready entity=mon.0 client_cookie=774e4f4d0f3915e1 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:53.969 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.911+0000 7f87cffff700 1 -- 172.21.15.110:0/1807973139 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d00072e0 con 0x7f87c8004510 2021-03-25T14:16:53.969 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.911+0000 7f87cffff700 1 -- 172.21.15.110:0/1807973139 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d0007440 con 0x7f87c8004510 2021-03-25T14:16:53.969 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.911+0000 7f87cffff700 1 -- 172.21.15.110:0/1807973139 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d0005850 con 0x7f87c8004510 2021-03-25T14:16:53.970 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.912+0000 7f87e60b2700 1 -- 172.21.15.110:0/1807973139 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87c8004510 msgr2=0x7f87c8004990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:53.970 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.912+0000 7f87e60b2700 1 --2- 172.21.15.110:0/1807973139 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87c8004510 0x7f87c8004990 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f87d000c490 tx=0x7f87e0149a90).stop 2021-03-25T14:16:53.970 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.912+0000 7f87e60b2700 1 -- 172.21.15.110:0/1807973139 shutdown_connections 2021-03-25T14:16:53.970 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.912+0000 7f87e60b2700 1 --2- 172.21.15.110:0/1807973139 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87c8004510 0x7f87c8004990 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:53.970 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.912+0000 7f87e60b2700 1 -- 172.21.15.110:0/1807973139 >> 172.21.15.110:0/1807973139 conn(0x7f87e00622e0 msgr2=0x7f87e00626f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:53.970 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.912+0000 7f87e60b2700 1 -- 172.21.15.110:0/1807973139 shutdown_connections 2021-03-25T14:16:53.970 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.912+0000 7f87e60b2700 1 -- 172.21.15.110:0/1807973139 wait complete. 2021-03-25T14:16:53.970 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.913+0000 7f87e60b2700 1 Processor -- start 2021-03-25T14:16:53.970 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.913+0000 7f87e60b2700 1 -- start start 2021-03-25T14:16:53.970 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.914+0000 7f87e60b2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87c8004510 0x7f87e015c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:53.970 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.914+0000 7f87e60b2700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87e00b5b70 0x7f87e01459e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:53.971 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.914+0000 7f87e60b2700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f87e014c9b0 0x7f87e01595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:53.971 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.914+0000 7f87e60b2700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e00b6080 con 0x7f87e00b5b70 2021-03-25T14:16:53.971 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.914+0000 7f87e60b2700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e00b6320 con 0x7f87e014c9b0 2021-03-25T14:16:53.971 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.914+0000 7f87e60b2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e00b65c0 con 0x7f87c8004510 2021-03-25T14:16:53.971 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.914+0000 7f87e48af700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87e00b5b70 0x7f87e01459e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:53.971 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.914+0000 7f87e48af700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87e00b5b70 0x7f87e01459e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48916/0 (socket says 172.21.15.110:48916) 2021-03-25T14:16:53.971 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.914+0000 7f87e48af700 1 -- 172.21.15.110:0/1413060078 learned_addr learned my addr 172.21.15.110:0/1413060078 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:53.971 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.914+0000 7f87e50b0700 1 --2- 172.21.15.110:0/1413060078 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87c8004510 0x7f87e015c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:53.971 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.914+0000 7f87e58b1700 1 --2- 172.21.15.110:0/1413060078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f87e014c9b0 0x7f87e01595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:53.971 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.914+0000 7f87e48af700 1 -- 172.21.15.110:0/1413060078 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87c8004510 msgr2=0x7f87e015c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:53.971 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.914+0000 7f87e48af700 1 --2- 172.21.15.110:0/1413060078 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87c8004510 0x7f87e015c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:53.972 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.914+0000 7f87e48af700 1 -- 172.21.15.110:0/1413060078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f87e014c9b0 msgr2=0x7f87e01595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:53.972 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.914+0000 7f87e48af700 1 --2- 172.21.15.110:0/1413060078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f87e014c9b0 0x7f87e01595e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:53.972 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.914+0000 7f87e48af700 1 -- 172.21.15.110:0/1413060078 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e0159140 con 0x7f87e00b5b70 2021-03-25T14:16:53.972 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.914+0000 7f87e48af700 1 --2- 172.21.15.110:0/1413060078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87e00b5b70 0x7f87e01459e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f87d000cbe0 tx=0x7f87d0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:53.972 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.915+0000 7f87cd7fa700 1 -- 172.21.15.110:0/1413060078 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d0013660 con 0x7f87e00b5b70 2021-03-25T14:16:53.972 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.915+0000 7f87cd7fa700 1 -- 172.21.15.110:0/1413060078 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d00137c0 con 0x7f87e00b5b70 2021-03-25T14:16:53.972 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.915+0000 7f87cd7fa700 1 -- 172.21.15.110:0/1413060078 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d0013b60 con 0x7f87e00b5b70 2021-03-25T14:16:53.972 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.915+0000 7f87e60b2700 1 -- 172.21.15.110:0/1413060078 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e0158e30 con 0x7f87e00b5b70 2021-03-25T14:16:53.972 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.915+0000 7f87e60b2700 1 -- 172.21.15.110:0/1413060078 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e00b1420 con 0x7f87e00b5b70 2021-03-25T14:16:53.972 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.916+0000 7f87e60b2700 1 -- 172.21.15.110:0/1413060078 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e00b1610 con 0x7f87e00b5b70 2021-03-25T14:16:53.972 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.916+0000 7f87cd7fa700 1 -- 172.21.15.110:0/1413060078 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f87d001d070 con 0x7f87e00b5b70 2021-03-25T14:16:53.972 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.916+0000 7f87cd7fa700 1 --2- 172.21.15.110:0/1413060078 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f87c005a0b0 0x7f87c005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:53.973 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.916+0000 7f87cd7fa700 1 -- 172.21.15.110:0/1413060078 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6911+0+0 (secure 0 0 0) 0x7f87d0075130 con 0x7f87e00b5b70 2021-03-25T14:16:53.973 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.917+0000 7f87e50b0700 1 --2- 172.21.15.110:0/1413060078 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f87c005a0b0 0x7f87c005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:53.973 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.917+0000 7f87e50b0700 1 --2- 172.21.15.110:0/1413060078 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f87c005a0b0 0x7f87c005c570 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f87dc006c00 tx=0x7f87dc008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:53.973 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:53.920+0000 7f87cd7fa700 1 -- 172.21.15.110:0/1413060078 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f87e00b1610 con 0x7f87e00b5b70 2021-03-25T14:16:54.110 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.108+0000 7f87e60b2700 1 -- 172.21.15.110:0/1413060078 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f87e014d740 con 0x7f87e00b5b70 2021-03-25T14:16:54.792 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.789+0000 7f87cd7fa700 1 -- 172.21.15.110:0/1413060078 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f87e014d740 con 0x7f87e00b5b70 2021-03-25T14:16:54.794 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.792+0000 7f87e60b2700 1 -- 172.21.15.110:0/1413060078 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f87c005a0b0 msgr2=0x7f87c005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:54.794 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.792+0000 7f87e60b2700 1 --2- 172.21.15.110:0/1413060078 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f87c005a0b0 0x7f87c005c570 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f87dc006c00 tx=0x7f87dc008040).stop 2021-03-25T14:16:54.794 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.792+0000 7f87e60b2700 1 -- 172.21.15.110:0/1413060078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87e00b5b70 msgr2=0x7f87e01459e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:54.795 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.792+0000 7f87e60b2700 1 --2- 172.21.15.110:0/1413060078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87e00b5b70 0x7f87e01459e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f87d000cbe0 tx=0x7f87d0015000).stop 2021-03-25T14:16:54.795 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.792+0000 7f87e60b2700 1 -- 172.21.15.110:0/1413060078 shutdown_connections 2021-03-25T14:16:54.795 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.792+0000 7f87e60b2700 1 --2- 172.21.15.110:0/1413060078 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f87c005a0b0 0x7f87c005c570 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:54.795 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.792+0000 7f87e60b2700 1 --2- 172.21.15.110:0/1413060078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f87e014c9b0 0x7f87e01595e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:54.795 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.792+0000 7f87e60b2700 1 --2- 172.21.15.110:0/1413060078 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87c8004510 0x7f87e015c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:54.795 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.792+0000 7f87e60b2700 1 --2- 172.21.15.110:0/1413060078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87e00b5b70 0x7f87e01459e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:54.795 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.792+0000 7f87e60b2700 1 -- 172.21.15.110:0/1413060078 >> 172.21.15.110:0/1413060078 conn(0x7f87e00622e0 msgr2=0x7f87e00626c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:54.796 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.792+0000 7f87e60b2700 1 -- 172.21.15.110:0/1413060078 shutdown_connections 2021-03-25T14:16:54.796 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.792+0000 7f87e60b2700 1 -- 172.21.15.110:0/1413060078 wait complete. 2021-03-25T14:16:54.806 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-03-25T14:16:54.922 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.920+0000 7fe0af836700 1 Processor -- start 2021-03-25T14:16:54.922 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.920+0000 7fe0af836700 1 -- start start 2021-03-25T14:16:54.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.921+0000 7fe0af836700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe0a814a410 0x7fe0a8154510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:54.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.921+0000 7fe0af836700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a80a3090 con 0x7fe0a8065560 2021-03-25T14:16:54.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.921+0000 7fe0af836700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a80b3170 con 0x7fe0a8061400 2021-03-25T14:16:54.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.921+0000 7fe0af836700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a80b3410 con 0x7fe0a814a410 2021-03-25T14:16:54.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.921+0000 7fe0ad5d2700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fe0a8065560 0x7fe0a80a34f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41862/0 (socket says 172.21.15.110:41862) 2021-03-25T14:16:54.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.921+0000 7fe0ad5d2700 1 -- 172.21.15.110:0/3828860747 learned_addr learned my addr 172.21.15.110:0/3828860747 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:54.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.921+0000 7fe097fff700 1 -- 172.21.15.110:0/3828860747 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2425589227 0 0) 0x7fe0a80a3090 con 0x7fe0a8065560 2021-03-25T14:16:54.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.921+0000 7fe097fff700 1 -- 172.21.15.110:0/3828860747 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe090003270 con 0x7fe0a8065560 2021-03-25T14:16:54.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.921+0000 7fe0addd3700 1 --2- 172.21.15.110:0/3828860747 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe0a814a410 0x7fe0a8154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:54.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.922+0000 7fe097fff700 1 -- 172.21.15.110:0/3828860747 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3659776932 0 0) 0x7fe090003270 con 0x7fe0a8065560 2021-03-25T14:16:54.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.922+0000 7fe097fff700 1 -- 172.21.15.110:0/3828860747 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe0a814a410 msgr2=0x7fe0a8154510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:54.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.922+0000 7fe097fff700 1 --2- 172.21.15.110:0/3828860747 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe0a814a410 0x7fe0a8154510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:54.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.922+0000 7fe097fff700 1 -- 172.21.15.110:0/3828860747 >> v1:172.21.15.174:6789/0 conn(0x7fe0a8061400 legacy=0x7fe0a80a3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:54.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.922+0000 7fe097fff700 1 -- 172.21.15.110:0/3828860747 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a80b36b0 con 0x7fe0a8065560 2021-03-25T14:16:54.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.922+0000 7fe097fff700 1 -- 172.21.15.110:0/3828860747 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7fe0a4001540 con 0x7fe0a8065560 2021-03-25T14:16:54.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.922+0000 7fe0addd3700 1 --2- 172.21.15.110:0/3828860747 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe0a814a410 0x7fe0a8154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:54.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.922+0000 7fe097fff700 1 -- 172.21.15.110:0/3828860747 >> v1:172.21.15.110:6789/0 conn(0x7fe0a8065560 legacy=0x7fe0a80a34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:54.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.922+0000 7fe097fff700 1 --2- 172.21.15.110:0/3828860747 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe090003790 0x7fe090003bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:54.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.922+0000 7fe097fff700 1 --2- 172.21.15.110:0/3828860747 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe0a814a410 0x7fe090004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:54.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.922+0000 7fe097fff700 1 --2- 172.21.15.110:0/3828860747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe090004a00 0x7fe090004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:54.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.922+0000 7fe097fff700 1 -- 172.21.15.110:0/3828860747 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a80b3410 con 0x7fe090004a00 2021-03-25T14:16:54.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.922+0000 7fe097fff700 1 -- 172.21.15.110:0/3828860747 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0900041f0 con 0x7fe090003790 2021-03-25T14:16:54.931 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.922+0000 7fe097fff700 1 -- 172.21.15.110:0/3828860747 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09000b760 con 0x7fe0a814a410 2021-03-25T14:16:54.931 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.922+0000 7fe0addd3700 1 --2- 172.21.15.110:0/3828860747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe090004a00 0x7fe090004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:54.931 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.922+0000 7fe0ad5d2700 1 --2- 172.21.15.110:0/3828860747 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe090003790 0x7fe090003bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:54.931 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.922+0000 7fe0acdd1700 1 --2- 172.21.15.110:0/3828860747 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe0a814a410 0x7fe090004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:54.931 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.922+0000 7fe0addd3700 1 -- 172.21.15.110:0/3828860747 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe0a814a410 msgr2=0x7fe090004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:54.931 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.922+0000 7fe0addd3700 1 --2- 172.21.15.110:0/3828860747 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe0a814a410 0x7fe090004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:54.931 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.922+0000 7fe0addd3700 1 -- 172.21.15.110:0/3828860747 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe090003790 msgr2=0x7fe090003bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:54.931 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.922+0000 7fe0addd3700 1 --2- 172.21.15.110:0/3828860747 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe090003790 0x7fe090003bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:54.931 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.922+0000 7fe0addd3700 1 -- 172.21.15.110:0/3828860747 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe090003270 con 0x7fe090004a00 2021-03-25T14:16:54.931 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.922+0000 7fe0addd3700 1 --2- 172.21.15.110:0/3828860747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe090004a00 0x7fe090004e80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7fe0a0009eb0 tx=0x7fe0a0008040).ready entity=mon.0 client_cookie=9bc5f31b52a2472 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:54.931 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.922+0000 7fe097fff700 1 -- 172.21.15.110:0/3828860747 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a000c070 con 0x7fe090004a00 2021-03-25T14:16:54.931 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.922+0000 7fe097fff700 1 -- 172.21.15.110:0/3828860747 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a000ea10 con 0x7fe090004a00 2021-03-25T14:16:54.931 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.922+0000 7fe097fff700 1 -- 172.21.15.110:0/3828860747 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a000edd0 con 0x7fe090004a00 2021-03-25T14:16:54.931 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.923+0000 7fe0af836700 1 -- 172.21.15.110:0/3828860747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe090004a00 msgr2=0x7fe090004e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:54.932 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.923+0000 7fe0af836700 1 --2- 172.21.15.110:0/3828860747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe090004a00 0x7fe090004e80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7fe0a0009eb0 tx=0x7fe0a0008040).stop 2021-03-25T14:16:54.932 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.923+0000 7fe0addd3700 1 -- 172.21.15.110:0/3828860747 reap_dead start 2021-03-25T14:16:54.932 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.923+0000 7fe0af836700 1 -- 172.21.15.110:0/3828860747 shutdown_connections 2021-03-25T14:16:54.932 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.923+0000 7fe0af836700 1 -- 172.21.15.110:0/3828860747 >> 172.21.15.110:0/3828860747 conn(0x7fe0a8068930 msgr2=0x7fe0a8068d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:54.932 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.923+0000 7fe0af836700 1 -- 172.21.15.110:0/3828860747 shutdown_connections 2021-03-25T14:16:54.932 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.923+0000 7fe0af836700 1 -- 172.21.15.110:0/3828860747 wait complete. 2021-03-25T14:16:54.932 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.924+0000 7fe0af836700 1 Processor -- start 2021-03-25T14:16:54.932 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.924+0000 7fe0af836700 1 -- start start 2021-03-25T14:16:54.932 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.925+0000 7fe0af836700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a8142c30 0x7fe0a80b79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:54.932 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.925+0000 7fe0af836700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe0a80b6e90 0x7fe0a815c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:54.932 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.925+0000 7fe0af836700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe0a815cd60 0x7fe0a81405b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:54.932 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.925+0000 7fe0af836700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a815d1e0 con 0x7fe0a8142c30 2021-03-25T14:16:54.932 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.925+0000 7fe0af836700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a80b81a0 con 0x7fe0a815cd60 2021-03-25T14:16:54.932 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.925+0000 7fe0af836700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a815ba20 con 0x7fe0a80b6e90 2021-03-25T14:16:54.933 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.925+0000 7fe0ad5d2700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a8142c30 0x7fe0a80b79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:54.933 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.925+0000 7fe0ad5d2700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a8142c30 0x7fe0a80b79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48938/0 (socket says 172.21.15.110:48938) 2021-03-25T14:16:54.933 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.925+0000 7fe0ad5d2700 1 -- 172.21.15.110:0/2287482527 learned_addr learned my addr 172.21.15.110:0/2287482527 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:54.933 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.925+0000 7fe0acdd1700 1 --2- 172.21.15.110:0/2287482527 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe0a80b6e90 0x7fe0a815c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:54.933 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.925+0000 7fe0addd3700 1 --2- 172.21.15.110:0/2287482527 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe0a815cd60 0x7fe0a81405b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:54.933 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.925+0000 7fe0ad5d2700 1 -- 172.21.15.110:0/2287482527 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe0a80b6e90 msgr2=0x7fe0a815c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:54.933 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.925+0000 7fe0ad5d2700 1 --2- 172.21.15.110:0/2287482527 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe0a80b6e90 0x7fe0a815c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:54.933 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.925+0000 7fe0ad5d2700 1 -- 172.21.15.110:0/2287482527 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe0a815cd60 msgr2=0x7fe0a81405b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:54.933 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.925+0000 7fe0ad5d2700 1 --2- 172.21.15.110:0/2287482527 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe0a815cd60 0x7fe0a81405b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:54.933 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.925+0000 7fe0ad5d2700 1 -- 172.21.15.110:0/2287482527 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a815bcc0 con 0x7fe0a8142c30 2021-03-25T14:16:54.933 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.925+0000 7fe0acdd1700 1 --2- 172.21.15.110:0/2287482527 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe0a80b6e90 0x7fe0a815c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:54.933 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.925+0000 7fe0addd3700 1 --2- 172.21.15.110:0/2287482527 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe0a815cd60 0x7fe0a81405b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:54.933 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.925+0000 7fe0ad5d2700 1 --2- 172.21.15.110:0/2287482527 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a8142c30 0x7fe0a80b79b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7fe0a4004c20 tx=0x7fe0a80b4bf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:54.934 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.926+0000 7fe0957fa700 1 -- 172.21.15.110:0/2287482527 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a4000ce0 con 0x7fe0a8142c30 2021-03-25T14:16:54.934 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.926+0000 7fe0957fa700 1 -- 172.21.15.110:0/2287482527 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a400f9a0 con 0x7fe0a8142c30 2021-03-25T14:16:54.934 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.926+0000 7fe0af836700 1 -- 172.21.15.110:0/2287482527 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a815bf60 con 0x7fe0a8142c30 2021-03-25T14:16:54.934 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.926+0000 7fe0957fa700 1 -- 172.21.15.110:0/2287482527 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a400fd20 con 0x7fe0a8142c30 2021-03-25T14:16:54.934 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.926+0000 7fe0af836700 1 -- 172.21.15.110:0/2287482527 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a815c400 con 0x7fe0a8142c30 2021-03-25T14:16:54.934 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.927+0000 7fe0af836700 1 -- 172.21.15.110:0/2287482527 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a8149460 con 0x7fe0a8142c30 2021-03-25T14:16:54.934 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.927+0000 7fe0957fa700 1 -- 172.21.15.110:0/2287482527 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fe0a401b030 con 0x7fe0a8142c30 2021-03-25T14:16:54.934 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.927+0000 7fe0957fa700 1 --2- 172.21.15.110:0/2287482527 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe08805a0b0 0x7fe08805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:54.934 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.927+0000 7fe0957fa700 1 -- 172.21.15.110:0/2287482527 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6911+0+0 (secure 0 0 0) 0x7fe0a4073980 con 0x7fe0a8142c30 2021-03-25T14:16:54.934 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.927+0000 7fe0acdd1700 1 --2- 172.21.15.110:0/2287482527 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe08805a0b0 0x7fe08805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:54.935 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.927+0000 7fe0acdd1700 1 --2- 172.21.15.110:0/2287482527 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe08805a0b0 0x7fe08805c570 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fe098000f60 tx=0x7fe098009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:54.935 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:54.931+0000 7fe0957fa700 1 -- 172.21.15.110:0/2287482527 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fe0a4046fe0 con 0x7fe0a8142c30 2021-03-25T14:16:55.084 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.082+0000 7fe0af836700 1 -- 172.21.15.110:0/2287482527 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe0a815c0f0 con 0x7fe0a8142c30 2021-03-25T14:16:55.796 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.794+0000 7fe0957fa700 1 -- 172.21.15.110:0/2287482527 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v27) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe0a404a600 con 0x7fe0a8142c30 2021-03-25T14:16:55.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.797+0000 7fe0af836700 1 -- 172.21.15.110:0/2287482527 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe08805a0b0 msgr2=0x7fe08805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:55.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.797+0000 7fe0af836700 1 --2- 172.21.15.110:0/2287482527 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe08805a0b0 0x7fe08805c570 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fe098000f60 tx=0x7fe098009040).stop 2021-03-25T14:16:55.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.797+0000 7fe0af836700 1 -- 172.21.15.110:0/2287482527 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a8142c30 msgr2=0x7fe0a80b79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:55.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.797+0000 7fe0af836700 1 --2- 172.21.15.110:0/2287482527 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a8142c30 0x7fe0a80b79b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7fe0a4004c20 tx=0x7fe0a80b4bf0).stop 2021-03-25T14:16:55.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.797+0000 7fe0af836700 1 -- 172.21.15.110:0/2287482527 shutdown_connections 2021-03-25T14:16:55.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.797+0000 7fe0af836700 1 --2- 172.21.15.110:0/2287482527 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe08805a0b0 0x7fe08805c570 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:55.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.797+0000 7fe0af836700 1 --2- 172.21.15.110:0/2287482527 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe0a815cd60 0x7fe0a81405b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:55.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.797+0000 7fe0af836700 1 --2- 172.21.15.110:0/2287482527 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a8142c30 0x7fe0a80b79b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:55.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.797+0000 7fe0af836700 1 --2- 172.21.15.110:0/2287482527 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe0a80b6e90 0x7fe0a815c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:55.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.797+0000 7fe0af836700 1 -- 172.21.15.110:0/2287482527 >> 172.21.15.110:0/2287482527 conn(0x7fe0a8068930 msgr2=0x7fe0a814d650 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:55.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.797+0000 7fe0af836700 1 -- 172.21.15.110:0/2287482527 shutdown_connections 2021-03-25T14:16:55.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.797+0000 7fe0af836700 1 -- 172.21.15.110:0/2287482527 wait complete. 2021-03-25T14:16:55.801 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs_metadata' removed 2021-03-25T14:16:55.811 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-03-25T14:16:55.926 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.924+0000 7fc7192db700 1 Processor -- start 2021-03-25T14:16:55.926 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.924+0000 7fc7192db700 1 -- start start 2021-03-25T14:16:55.928 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.925+0000 7fc7192db700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc7140b7ad0 0x7fc714146460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:55.928 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.925+0000 7fc7192db700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc714068130 0x7fc714149a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:55.928 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.925+0000 7fc7192db700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc714146b00 con 0x7fc7140bc390 2021-03-25T14:16:55.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.925+0000 7fc7192db700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc714146da0 con 0x7fc7140b7ad0 2021-03-25T14:16:55.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.925+0000 7fc7192db700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc714147040 con 0x7fc714068130 2021-03-25T14:16:55.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.925+0000 7fc7127fc700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc7140b7ad0 0x7fc714146460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:55.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.925+0000 7fc712ffd700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fc7140bc390 0x7fc714067a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41882/0 (socket says 172.21.15.110:41882) 2021-03-25T14:16:55.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.925+0000 7fc7127fc700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc7140b7ad0 0x7fc714146460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48948/0 (socket says 172.21.15.110:48948) 2021-03-25T14:16:55.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.925+0000 7fc712ffd700 1 -- 172.21.15.110:0/2546309137 learned_addr learned my addr 172.21.15.110:0/2546309137 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:55.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.925+0000 7fc7127fc700 1 -- 172.21.15.110:0/2546309137 >> v2:172.21.15.174:3300/0 conn(0x7fc714068130 msgr2=0x7fc714149a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:55.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.925+0000 7fc7127fc700 1 --2- 172.21.15.110:0/2546309137 >> v2:172.21.15.174:3300/0 conn(0x7fc714068130 0x7fc714149a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-03-25T14:16:55.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.925+0000 7fc7127fc700 1 -- 172.21.15.110:0/2546309137 >> v1:172.21.15.110:6789/0 conn(0x7fc7140bc390 legacy=0x7fc714067a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:55.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.925+0000 7fc711ffb700 1 -- 172.21.15.110:0/2546309137 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3088110785 0 0) 0x7fc714146b00 con 0x7fc7140bc390 2021-03-25T14:16:55.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.925+0000 7fc7127fc700 1 -- 172.21.15.110:0/2546309137 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7141472e0 con 0x7fc7140b7ad0 2021-03-25T14:16:55.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.925+0000 7fc7127fc700 1 --2- 172.21.15.110:0/2546309137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7140b7ad0 0x7fc714146460 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7fc714067160 tx=0x7fc708006e20).ready entity=mon.0 client_cookie=6b82a552ee5ef984 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:55.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.925+0000 7fc711ffb700 1 -- 172.21.15.110:0/2546309137 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc708009870 con 0x7fc7140b7ad0 2021-03-25T14:16:55.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.925+0000 7fc711ffb700 1 -- 172.21.15.110:0/2546309137 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7080099d0 con 0x7fc7140b7ad0 2021-03-25T14:16:55.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.925+0000 7fc711ffb700 1 -- 172.21.15.110:0/2546309137 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc708009d50 con 0x7fc7140b7ad0 2021-03-25T14:16:55.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.926+0000 7fc7192db700 1 -- 172.21.15.110:0/2546309137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7140b7ad0 msgr2=0x7fc714146460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:55.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.926+0000 7fc7192db700 1 --2- 172.21.15.110:0/2546309137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7140b7ad0 0x7fc714146460 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7fc714067160 tx=0x7fc708006e20).stop 2021-03-25T14:16:55.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.926+0000 7fc7192db700 1 -- 172.21.15.110:0/2546309137 shutdown_connections 2021-03-25T14:16:55.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.926+0000 7fc7192db700 1 --2- 172.21.15.110:0/2546309137 >> v2:172.21.15.174:3300/0 conn(0x7fc714068130 0x7fc714149a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-03-25T14:16:55.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.926+0000 7fc7192db700 1 --2- 172.21.15.110:0/2546309137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7140b7ad0 0x7fc714146460 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:55.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.926+0000 7fc7192db700 1 -- 172.21.15.110:0/2546309137 >> 172.21.15.110:0/2546309137 conn(0x7fc714061710 msgr2=0x7fc7140bbac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:55.931 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.926+0000 7fc7192db700 1 -- 172.21.15.110:0/2546309137 shutdown_connections 2021-03-25T14:16:55.931 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.926+0000 7fc7192db700 1 -- 172.21.15.110:0/2546309137 wait complete. 2021-03-25T14:16:55.933 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.927+0000 7fc7192db700 1 Processor -- start 2021-03-25T14:16:55.933 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.927+0000 7fc7192db700 1 -- start start 2021-03-25T14:16:55.934 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.928+0000 7fc7192db700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc714068130 0x7fc7141439e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:55.934 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.928+0000 7fc7192db700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc7140b7ad0 0x7fc7140b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:55.934 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.928+0000 7fc7192db700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc7140bc390 0x7fc71413ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:55.934 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.928+0000 7fc7192db700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc714141540 con 0x7fc714068130 2021-03-25T14:16:55.934 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.928+0000 7fc7192db700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc714140b30 con 0x7fc7140b7ad0 2021-03-25T14:16:55.934 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.928+0000 7fc7192db700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7140a14e0 con 0x7fc7140bc390 2021-03-25T14:16:55.934 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.928+0000 7fc712ffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc714068130 0x7fc7141439e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:55.934 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.928+0000 7fc712ffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc714068130 0x7fc7141439e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48952/0 (socket says 172.21.15.110:48952) 2021-03-25T14:16:55.934 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.928+0000 7fc712ffd700 1 -- 172.21.15.110:0/1409640729 learned_addr learned my addr 172.21.15.110:0/1409640729 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:55.934 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.928+0000 7fc712ffd700 1 -- 172.21.15.110:0/1409640729 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc7140bc390 msgr2=0x7fc71413ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:55.934 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.928+0000 7fc7137fe700 1 --2- 172.21.15.110:0/1409640729 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc7140bc390 0x7fc71413ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:55.935 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.928+0000 7fc712ffd700 1 --2- 172.21.15.110:0/1409640729 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc7140bc390 0x7fc71413ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:55.935 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.928+0000 7fc712ffd700 1 -- 172.21.15.110:0/1409640729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc7140b7ad0 msgr2=0x7fc7140b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:55.935 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.928+0000 7fc712ffd700 1 --2- 172.21.15.110:0/1409640729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc7140b7ad0 0x7fc7140b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:16:55.935 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.928+0000 7fc712ffd700 1 -- 172.21.15.110:0/1409640729 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc714141770 con 0x7fc714068130 2021-03-25T14:16:55.935 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.928+0000 7fc712ffd700 1 --2- 172.21.15.110:0/1409640729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc714068130 0x7fc7141439e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7fc70400c7c0 tx=0x7fc704007af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:55.935 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.928+0000 7fc6faffd700 1 -- 172.21.15.110:0/1409640729 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc704007320 con 0x7fc714068130 2021-03-25T14:16:55.935 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.928+0000 7fc6faffd700 1 -- 172.21.15.110:0/1409640729 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc704007480 con 0x7fc714068130 2021-03-25T14:16:55.935 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.928+0000 7fc7192db700 1 -- 172.21.15.110:0/1409640729 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7140a1740 con 0x7fc714068130 2021-03-25T14:16:55.935 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.928+0000 7fc6faffd700 1 -- 172.21.15.110:0/1409640729 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc704005830 con 0x7fc714068130 2021-03-25T14:16:55.935 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.928+0000 7fc7192db700 1 -- 172.21.15.110:0/1409640729 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc714141200 con 0x7fc714068130 2021-03-25T14:16:55.935 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.929+0000 7fc6f8ff9700 1 -- 172.21.15.110:0/1409640729 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6f0004fa0 con 0x7fc714068130 2021-03-25T14:16:55.935 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.930+0000 7fc6faffd700 1 -- 172.21.15.110:0/1409640729 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fc704010030 con 0x7fc714068130 2021-03-25T14:16:55.936 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.930+0000 7fc6faffd700 1 --2- 172.21.15.110:0/1409640729 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc6f405a0b0 0x7fc6f405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:55.936 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.930+0000 7fc6faffd700 1 -- 172.21.15.110:0/1409640729 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6473+0+0 (secure 0 0 0) 0x7fc704073c50 con 0x7fc714068130 2021-03-25T14:16:55.936 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.930+0000 7fc7127fc700 1 --2- 172.21.15.110:0/1409640729 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc6f405a0b0 0x7fc6f405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:55.936 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.930+0000 7fc7127fc700 1 --2- 172.21.15.110:0/1409640729 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc6f405a0b0 0x7fc6f405c570 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fc714067160 tx=0x7fc708018000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:55.936 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:55.934+0000 7fc6faffd700 1 -- 172.21.15.110:0/1409640729 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fc704047460 con 0x7fc714068130 2021-03-25T14:16:56.086 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.084+0000 7fc6f8ff9700 1 -- 172.21.15.110:0/1409640729 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc6f0005250 con 0x7fc714068130 2021-03-25T14:16:56.801 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.799+0000 7fc6faffd700 1 -- 172.21.15.110:0/1409640729 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v28) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc70404aa80 con 0x7fc714068130 2021-03-25T14:16:56.803 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.801+0000 7fc6f8ff9700 1 -- 172.21.15.110:0/1409640729 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc6f405a0b0 msgr2=0x7fc6f405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:56.803 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.801+0000 7fc6f8ff9700 1 --2- 172.21.15.110:0/1409640729 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc6f405a0b0 0x7fc6f405c570 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fc714067160 tx=0x7fc708018000).stop 2021-03-25T14:16:56.803 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.801+0000 7fc6f8ff9700 1 -- 172.21.15.110:0/1409640729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc714068130 msgr2=0x7fc7141439e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:56.804 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.801+0000 7fc6f8ff9700 1 --2- 172.21.15.110:0/1409640729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc714068130 0x7fc7141439e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7fc70400c7c0 tx=0x7fc704007af0).stop 2021-03-25T14:16:56.804 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.801+0000 7fc6f8ff9700 1 -- 172.21.15.110:0/1409640729 shutdown_connections 2021-03-25T14:16:56.804 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.801+0000 7fc6f8ff9700 1 --2- 172.21.15.110:0/1409640729 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc6f405a0b0 0x7fc6f405c570 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:56.804 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.801+0000 7fc6f8ff9700 1 --2- 172.21.15.110:0/1409640729 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc7140bc390 0x7fc71413ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:56.804 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.801+0000 7fc6f8ff9700 1 --2- 172.21.15.110:0/1409640729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc714068130 0x7fc7141439e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:56.804 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.801+0000 7fc6f8ff9700 1 --2- 172.21.15.110:0/1409640729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc7140b7ad0 0x7fc7140b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:16:56.804 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.801+0000 7fc6f8ff9700 1 -- 172.21.15.110:0/1409640729 >> 172.21.15.110:0/1409640729 conn(0x7fc714061710 msgr2=0x7fc7140b1350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:56.804 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.801+0000 7fc6f8ff9700 1 -- 172.21.15.110:0/1409640729 shutdown_connections 2021-03-25T14:16:56.804 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.801+0000 7fc6f8ff9700 1 -- 172.21.15.110:0/1409640729 wait complete. 2021-03-25T14:16:56.805 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs_data' removed 2021-03-25T14:16:56.816 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2021-03-25T14:16:56.932 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.930+0000 7f730c789700 1 Processor -- start 2021-03-25T14:16:56.932 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.930+0000 7f730c789700 1 -- start start 2021-03-25T14:16:56.935 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.931+0000 7f730c789700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f73040bd490 0x7f730414d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:56.935 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.931+0000 7f730c789700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7304149390 0x7f73041498b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:56.935 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.931+0000 7f730c789700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7304068830 con 0x7f7304068ac0 2021-03-25T14:16:56.935 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.931+0000 7f730c789700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f730414dbf0 con 0x7f73040bd490 2021-03-25T14:16:56.935 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.931+0000 7f730c789700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73040b2e60 con 0x7f7304149390 2021-03-25T14:16:56.935 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.931+0000 7f730a525700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f73040bd490 0x7f730414d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:56.935 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.931+0000 7f7309d24700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f7304068ac0 0x7f7304148c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41896/0 (socket says 172.21.15.110:41896) 2021-03-25T14:16:56.936 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.931+0000 7f730a525700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f73040bd490 0x7f730414d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48960/0 (socket says 172.21.15.110:48960) 2021-03-25T14:16:56.936 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.931+0000 7f7309d24700 1 -- 172.21.15.110:0/2604742898 learned_addr learned my addr 172.21.15.110:0/2604742898 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:56.936 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.931+0000 7f730a525700 1 -- 172.21.15.110:0/2604742898 >> v2:172.21.15.174:3300/0 conn(0x7f7304149390 msgr2=0x7f73041498b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:56.936 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.931+0000 7f730a525700 1 --2- 172.21.15.110:0/2604742898 >> v2:172.21.15.174:3300/0 conn(0x7f7304149390 0x7f73041498b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-03-25T14:16:56.936 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.931+0000 7f730a525700 1 -- 172.21.15.110:0/2604742898 >> v1:172.21.15.110:6789/0 conn(0x7f7304068ac0 legacy=0x7f7304148c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:56.936 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.931+0000 7f730a525700 1 -- 172.21.15.110:0/2604742898 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73040b3100 con 0x7f73040bd490 2021-03-25T14:16:56.936 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.931+0000 7f7309523700 1 -- 172.21.15.110:0/2604742898 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 27421928 0 0) 0x7f7304068830 con 0x7f7304068ac0 2021-03-25T14:16:56.936 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.932+0000 7f730a525700 1 --2- 172.21.15.110:0/2604742898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73040bd490 0x7f730414d700 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f73040658a0 tx=0x7f7300006e20).ready entity=mon.0 client_cookie=fab86fc15a8425bf server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:56.936 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.932+0000 7f7309523700 1 -- 172.21.15.110:0/2604742898 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7300009870 con 0x7f73040bd490 2021-03-25T14:16:56.936 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.932+0000 7f7309523700 1 -- 172.21.15.110:0/2604742898 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73000099d0 con 0x7f73040bd490 2021-03-25T14:16:56.936 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.932+0000 7f7309523700 1 -- 172.21.15.110:0/2604742898 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7300009d50 con 0x7f73040bd490 2021-03-25T14:16:56.937 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.932+0000 7f730c789700 1 -- 172.21.15.110:0/2604742898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73040bd490 msgr2=0x7f730414d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:56.937 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.932+0000 7f730c789700 1 --2- 172.21.15.110:0/2604742898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73040bd490 0x7f730414d700 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f73040658a0 tx=0x7f7300006e20).stop 2021-03-25T14:16:56.937 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.932+0000 7f730c789700 1 -- 172.21.15.110:0/2604742898 shutdown_connections 2021-03-25T14:16:56.937 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.932+0000 7f730c789700 1 --2- 172.21.15.110:0/2604742898 >> v2:172.21.15.174:3300/0 conn(0x7f7304149390 0x7f73041498b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-03-25T14:16:56.937 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.932+0000 7f730c789700 1 --2- 172.21.15.110:0/2604742898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73040bd490 0x7f730414d700 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:56.937 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.932+0000 7f730c789700 1 -- 172.21.15.110:0/2604742898 >> 172.21.15.110:0/2604742898 conn(0x7f7304062820 msgr2=0x7f73040bcbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:56.938 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.932+0000 7f730c789700 1 -- 172.21.15.110:0/2604742898 shutdown_connections 2021-03-25T14:16:56.938 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.932+0000 7f730c789700 1 -- 172.21.15.110:0/2604742898 wait complete. 2021-03-25T14:16:56.938 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.933+0000 7f730c789700 1 Processor -- start 2021-03-25T14:16:56.938 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.933+0000 7f730c789700 1 -- start start 2021-03-25T14:16:56.941 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.934+0000 7f730c789700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7304068ac0 0x7f73040b4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:56.941 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.934+0000 7f730c789700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73040bd490 0x7f730415c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:56.941 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.934+0000 7f730c789700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7304149390 0x7f730415cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:56.941 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.934+0000 7f730c789700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730415d230 con 0x7f73040bd490 2021-03-25T14:16:56.941 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.934+0000 7f730c789700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73040a1cb0 con 0x7f7304068ac0 2021-03-25T14:16:56.941 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.934+0000 7f730c789700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73040a1f50 con 0x7f7304149390 2021-03-25T14:16:56.941 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.934+0000 7f7309d24700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73040bd490 0x7f730415c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:56.941 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.934+0000 7f7309d24700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73040bd490 0x7f730415c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48970/0 (socket says 172.21.15.110:48970) 2021-03-25T14:16:56.941 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.934+0000 7f7309d24700 1 -- 172.21.15.110:0/2410467400 learned_addr learned my addr 172.21.15.110:0/2410467400 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:56.941 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.934+0000 7f730ad26700 1 --2- 172.21.15.110:0/2410467400 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7304149390 0x7f730415cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:56.941 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.934+0000 7f730a525700 1 --2- 172.21.15.110:0/2410467400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7304068ac0 0x7f73040b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:56.942 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.934+0000 7f7309d24700 1 -- 172.21.15.110:0/2410467400 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7304149390 msgr2=0x7f730415cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:56.942 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.934+0000 7f7309d24700 1 --2- 172.21.15.110:0/2410467400 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7304149390 0x7f730415cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:56.942 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.934+0000 7f7309d24700 1 -- 172.21.15.110:0/2410467400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7304068ac0 msgr2=0x7f73040b4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:56.942 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.934+0000 7f7309d24700 1 --2- 172.21.15.110:0/2410467400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7304068ac0 0x7f73040b4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:56.942 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.935+0000 7f7309d24700 1 -- 172.21.15.110:0/2410467400 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73040a21f0 con 0x7f73040bd490 2021-03-25T14:16:56.942 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.935+0000 7f7309d24700 1 --2- 172.21.15.110:0/2410467400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73040bd490 0x7f730415c850 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f72f400c7c0 tx=0x7f72f4007af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:56.942 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.935+0000 7f72f27fc700 1 -- 172.21.15.110:0/2410467400 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f4007320 con 0x7f73040bd490 2021-03-25T14:16:56.942 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.935+0000 7f72f27fc700 1 -- 172.21.15.110:0/2410467400 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f4007480 con 0x7f73040bd490 2021-03-25T14:16:56.942 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.935+0000 7f730c789700 1 -- 172.21.15.110:0/2410467400 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73040b5bc0 con 0x7f73040bd490 2021-03-25T14:16:56.942 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.935+0000 7f72f27fc700 1 -- 172.21.15.110:0/2410467400 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f4005830 con 0x7f73040bd490 2021-03-25T14:16:56.942 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.935+0000 7f730c789700 1 -- 172.21.15.110:0/2410467400 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73040b4150 con 0x7f73040bd490 2021-03-25T14:16:56.942 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.936+0000 7f730c789700 1 -- 172.21.15.110:0/2410467400 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73040b32e0 con 0x7f73040bd490 2021-03-25T14:16:56.943 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.936+0000 7f72f27fc700 1 -- 172.21.15.110:0/2410467400 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f72f4010030 con 0x7f73040bd490 2021-03-25T14:16:56.943 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.936+0000 7f72f27fc700 1 --2- 172.21.15.110:0/2410467400 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f72e405a0b0 0x7f72e405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:56.943 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.936+0000 7f72f27fc700 1 -- 172.21.15.110:0/2410467400 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f72f4073c80 con 0x7f73040bd490 2021-03-25T14:16:56.943 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.936+0000 7f730a525700 1 --2- 172.21.15.110:0/2410467400 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f72e405a0b0 0x7f72e405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:56.943 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.937+0000 7f730a525700 1 --2- 172.21.15.110:0/2410467400 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f72e405a0b0 0x7f72e405c570 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f7300006e60 tx=0x7f7300016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:56.943 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:56.940+0000 7f72f27fc700 1 -- 172.21.15.110:0/2410467400 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f72f4047500 con 0x7f73040bd490 2021-03-25T14:16:57.096 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:57.094+0000 7f730c789700 1 -- 172.21.15.110:0/2410467400 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f73040b5d50 con 0x7f73040bd490 2021-03-25T14:16:57.807 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:57.805+0000 7f72f27fc700 1 -- 172.21.15.110:0/2410467400 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v29) v1 ==== 178+0+0 (secure 0 0 0) 0x7f72f404ab20 con 0x7f73040bd490 2021-03-25T14:16:57.810 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:57.808+0000 7f730c789700 1 -- 172.21.15.110:0/2410467400 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f72e405a0b0 msgr2=0x7f72e405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:57.810 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:57.808+0000 7f730c789700 1 --2- 172.21.15.110:0/2410467400 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f72e405a0b0 0x7f72e405c570 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f7300006e60 tx=0x7f7300016000).stop 2021-03-25T14:16:57.810 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:57.808+0000 7f730c789700 1 -- 172.21.15.110:0/2410467400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73040bd490 msgr2=0x7f730415c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:57.811 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:57.808+0000 7f730c789700 1 --2- 172.21.15.110:0/2410467400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73040bd490 0x7f730415c850 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f72f400c7c0 tx=0x7f72f4007af0).stop 2021-03-25T14:16:57.811 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:57.808+0000 7f730c789700 1 -- 172.21.15.110:0/2410467400 shutdown_connections 2021-03-25T14:16:57.811 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:57.808+0000 7f730c789700 1 --2- 172.21.15.110:0/2410467400 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f72e405a0b0 0x7f72e405c570 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:57.811 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:57.808+0000 7f730c789700 1 --2- 172.21.15.110:0/2410467400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7304068ac0 0x7f73040b4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:57.811 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:57.808+0000 7f730c789700 1 --2- 172.21.15.110:0/2410467400 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7304149390 0x7f730415cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:57.811 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:57.808+0000 7f730c789700 1 --2- 172.21.15.110:0/2410467400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73040bd490 0x7f730415c850 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:57.811 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:57.808+0000 7f730c789700 1 -- 172.21.15.110:0/2410467400 >> 172.21.15.110:0/2410467400 conn(0x7f7304062820 msgr2=0x7f730414d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:57.811 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:57.808+0000 7f730c789700 1 -- 172.21.15.110:0/2410467400 shutdown_connections 2021-03-25T14:16:57.811 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:57.808+0000 7f730c789700 1 -- 172.21.15.110:0/2410467400 wait complete. 2021-03-25T14:16:57.812 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs_data_ec' removed 2021-03-25T14:16:57.824 INFO:tasks.ceph.mds.a:Restarting daemon 2021-03-25T14:16:57.824 INFO:tasks.ceph.mds.a:Stopping old one... 2021-03-25T14:16:57.825 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-03-25T14:16:57.825 INFO:teuthology.orchestra.run:waiting for 300 2021-03-25T14:16:57.825 INFO:tasks.ceph.mds.c:Restarting daemon 2021-03-25T14:16:57.825 INFO:tasks.ceph.mds.c:Stopping old one... 2021-03-25T14:16:57.825 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-03-25T14:16:57.825 INFO:teuthology.orchestra.run:waiting for 300 2021-03-25T14:16:57.826 INFO:tasks.ceph.mds.b:Restarting daemon 2021-03-25T14:16:57.826 INFO:tasks.ceph.mds.b:Stopping old one... 2021-03-25T14:16:57.826 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-03-25T14:16:57.826 INFO:teuthology.orchestra.run:waiting for 300 2021-03-25T14:16:57.826 INFO:tasks.ceph.mds.d:Restarting daemon 2021-03-25T14:16:57.826 INFO:tasks.ceph.mds.d:Stopping old one... 2021-03-25T14:16:57.826 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2021-03-25T14:16:57.826 INFO:teuthology.orchestra.run:waiting for 300 2021-03-25T14:16:57.834 INFO:tasks.ceph.mds.a:Stopped 2021-03-25T14:16:57.834 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-03-25T14:16:57.835 INFO:tasks.ceph.mds.c:Stopped 2021-03-25T14:16:57.835 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-03-25T14:16:57.836 INFO:tasks.ceph.mds.d:Stopped 2021-03-25T14:16:57.836 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2021-03-25T14:16:57.844 INFO:tasks.ceph.mds.b:Stopped 2021-03-25T14:16:57.844 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-03-25T14:16:57.876 INFO:tasks.ceph.mds.a:Started 2021-03-25T14:16:57.876 DEBUG:teuthology.parallel:result is None 2021-03-25T14:16:57.877 INFO:tasks.ceph.mds.c:Started 2021-03-25T14:16:57.877 DEBUG:teuthology.parallel:result is None 2021-03-25T14:16:57.885 INFO:tasks.ceph.mds.d:Started 2021-03-25T14:16:57.885 DEBUG:teuthology.parallel:result is None 2021-03-25T14:16:57.886 INFO:tasks.ceph.mds.b:Started 2021-03-25T14:16:57.887 DEBUG:teuthology.parallel:result is None 2021-03-25T14:16:57.887 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2021-03-25T14:16:57.953 INFO:tasks.ceph.mds.c.smithi110.stdout:starting mds.c at 2021-03-25T14:16:57.954 INFO:tasks.ceph.mds.a.smithi110.stdout:starting mds.a at 2021-03-25T14:16:57.968 INFO:tasks.ceph.mds.b.smithi174.stdout:starting mds.b at 2021-03-25T14:16:57.968 INFO:tasks.ceph.mds.d.smithi174.stdout:starting mds.d at 2021-03-25T14:16:57.970 INFO:tasks.ceph.mds.d.smithi174.stderr:2021-03-25T14:16:57.968+0000 7fe1de8a2700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2021-03-25T14:16:58.013 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.011+0000 7f2b611a3700 1 Processor -- start 2021-03-25T14:16:58.013 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.011+0000 7f2b611a3700 1 -- start start 2021-03-25T14:16:58.016 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.012+0000 7f2b611a3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2b5c0be5a0 0x7f2b5c09d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:58.016 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.012+0000 7f2b611a3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b5c0b9ba0 0x7f2b5c143270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:58.017 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.012+0000 7f2b611a3700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2b5c143760 0x7f2b5c149a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:58.017 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.012+0000 7f2b611a3700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b5c14d0e0 con 0x7f2b5c143760 2021-03-25T14:16:58.017 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.012+0000 7f2b611a3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b5c14d380 con 0x7f2b5c0be5a0 2021-03-25T14:16:58.017 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.012+0000 7f2b611a3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c14d620 con 0x7f2b5c0b9ba0 2021-03-25T14:16:58.017 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.012+0000 7f2b5b59e700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2b5c143760 0x7f2b5c149a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:58.017 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.012+0000 7f2b5b59e700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2b5c143760 0x7f2b5c149a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48998/0 (socket says 172.21.15.110:48998) 2021-03-25T14:16:58.017 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.012+0000 7f2b5b59e700 1 -- 172.21.15.110:0/3083994418 learned_addr learned my addr 172.21.15.110:0/3083994418 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:58.017 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.012+0000 7f2b5ad9d700 1 --2- 172.21.15.110:0/3083994418 >> v2:172.21.15.174:3300/0 conn(0x7f2b5c0be5a0 0x7f2b5c09d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:58.017 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.013+0000 7f2b5a59c700 1 --2- 172.21.15.110:0/3083994418 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b5c0b9ba0 0x7f2b5c143270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:58.017 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.013+0000 7f2b5b59e700 1 -- 172.21.15.110:0/3083994418 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b5c0b9ba0 msgr2=0x7f2b5c143270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:58.017 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.013+0000 7f2b5b59e700 1 --2- 172.21.15.110:0/3083994418 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b5c0b9ba0 0x7f2b5c143270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:58.018 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.013+0000 7f2b5b59e700 1 -- 172.21.15.110:0/3083994418 >> v2:172.21.15.174:3300/0 conn(0x7f2b5c0be5a0 msgr2=0x7f2b5c09d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:58.018 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.013+0000 7f2b5b59e700 1 --2- 172.21.15.110:0/3083994418 >> v2:172.21.15.174:3300/0 conn(0x7f2b5c0be5a0 0x7f2b5c09d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:58.018 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.013+0000 7f2b5b59e700 1 -- 172.21.15.110:0/3083994418 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b5c14d8c0 con 0x7f2b5c143760 2021-03-25T14:16:58.018 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.013+0000 7f2b5a59c700 1 --2- 172.21.15.110:0/3083994418 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b5c0b9ba0 0x7f2b5c143270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:16:58.018 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.013+0000 7f2b5ad9d700 1 --2- 172.21.15.110:0/3083994418 >> v2:172.21.15.174:3300/0 conn(0x7f2b5c0be5a0 0x7f2b5c09d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:16:58.018 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.013+0000 7f2b5b59e700 1 --2- 172.21.15.110:0/3083994418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b5c143760 0x7f2b5c149a00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f2b5c060560 tx=0x7f2b540092d0).ready entity=mon.0 client_cookie=1b50a0cea798c682 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:58.018 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.013+0000 7f2b59d9b700 1 -- 172.21.15.110:0/3083994418 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5400bc80 con 0x7f2b5c143760 2021-03-25T14:16:58.018 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.014+0000 7f2b59d9b700 1 -- 172.21.15.110:0/3083994418 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b5400bde0 con 0x7f2b5c143760 2021-03-25T14:16:58.018 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.014+0000 7f2b59d9b700 1 -- 172.21.15.110:0/3083994418 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b54011610 con 0x7f2b5c143760 2021-03-25T14:16:58.022 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.015+0000 7f2b611a3700 1 -- 172.21.15.110:0/3083994418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b5c143760 msgr2=0x7f2b5c149a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:58.022 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.015+0000 7f2b611a3700 1 --2- 172.21.15.110:0/3083994418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b5c143760 0x7f2b5c149a00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f2b5c060560 tx=0x7f2b540092d0).stop 2021-03-25T14:16:58.022 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.015+0000 7f2b611a3700 1 -- 172.21.15.110:0/3083994418 shutdown_connections 2021-03-25T14:16:58.022 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.015+0000 7f2b611a3700 1 --2- 172.21.15.110:0/3083994418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b5c143760 0x7f2b5c149a00 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:58.022 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.015+0000 7f2b611a3700 1 --2- 172.21.15.110:0/3083994418 >> v2:172.21.15.174:3300/0 conn(0x7f2b5c0be5a0 0x7f2b5c09d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:58.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.015+0000 7f2b611a3700 1 --2- 172.21.15.110:0/3083994418 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b5c0b9ba0 0x7f2b5c143270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:58.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.015+0000 7f2b611a3700 1 -- 172.21.15.110:0/3083994418 >> 172.21.15.110:0/3083994418 conn(0x7f2b5c0616d0 msgr2=0x7f2b5c0bdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:58.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.015+0000 7f2b611a3700 1 -- 172.21.15.110:0/3083994418 shutdown_connections 2021-03-25T14:16:58.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.015+0000 7f2b611a3700 1 -- 172.21.15.110:0/3083994418 wait complete. 2021-03-25T14:16:58.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.016+0000 7f2b611a3700 1 Processor -- start 2021-03-25T14:16:58.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.017+0000 7f2b611a3700 1 -- start start 2021-03-25T14:16:58.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.017+0000 7f2b611a3700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b5c0b9ba0 0x7f2b5c14f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:58.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.017+0000 7f2b611a3700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b5c0be5a0 0x7f2b5c0b8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:58.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.017+0000 7f2b611a3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b5c143760 0x7f2b5c0a0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:58.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.017+0000 7f2b611a3700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c144c00 con 0x7f2b5c0b9ba0 2021-03-25T14:16:58.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.017+0000 7f2b611a3700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c144ea0 con 0x7f2b5c0be5a0 2021-03-25T14:16:58.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.017+0000 7f2b611a3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c145140 con 0x7f2b5c143760 2021-03-25T14:16:58.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.017+0000 7f2b5ad9d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b5c0b9ba0 0x7f2b5c14f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:58.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.017+0000 7f2b5ad9d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b5c0b9ba0 0x7f2b5c14f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49004/0 (socket says 172.21.15.110:49004) 2021-03-25T14:16:58.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.017+0000 7f2b5ad9d700 1 -- 172.21.15.110:0/3947402857 learned_addr learned my addr 172.21.15.110:0/3947402857 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:58.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.017+0000 7f2b5b59e700 1 --2- 172.21.15.110:0/3947402857 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b5c143760 0x7f2b5c0a0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:58.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.017+0000 7f2b5a59c700 1 --2- 172.21.15.110:0/3947402857 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b5c0be5a0 0x7f2b5c0b8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:58.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.018+0000 7f2b5ad9d700 1 -- 172.21.15.110:0/3947402857 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b5c143760 msgr2=0x7f2b5c0a0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:58.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.018+0000 7f2b5ad9d700 1 --2- 172.21.15.110:0/3947402857 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b5c143760 0x7f2b5c0a0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:58.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.018+0000 7f2b5ad9d700 1 -- 172.21.15.110:0/3947402857 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b5c0be5a0 msgr2=0x7f2b5c0b8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:58.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.018+0000 7f2b5ad9d700 1 --2- 172.21.15.110:0/3947402857 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b5c0be5a0 0x7f2b5c0b8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:58.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.018+0000 7f2b5ad9d700 1 -- 172.21.15.110:0/3947402857 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b5c158e20 con 0x7f2b5c0b9ba0 2021-03-25T14:16:58.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.018+0000 7f2b5ad9d700 1 --2- 172.21.15.110:0/3947402857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b5c0b9ba0 0x7f2b5c14f0a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f2b4c00ed10 tx=0x7f2b4c006e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:58.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.018+0000 7f2b42ffd700 1 -- 172.21.15.110:0/3947402857 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c00ee70 con 0x7f2b5c0b9ba0 2021-03-25T14:16:58.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.018+0000 7f2b42ffd700 1 -- 172.21.15.110:0/3947402857 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b4c00cb30 con 0x7f2b5c0b9ba0 2021-03-25T14:16:58.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.018+0000 7f2b611a3700 1 -- 172.21.15.110:0/3947402857 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b5c158ae0 con 0x7f2b5c0b9ba0 2021-03-25T14:16:58.025 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.018+0000 7f2b42ffd700 1 -- 172.21.15.110:0/3947402857 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c00ceb0 con 0x7f2b5c0b9ba0 2021-03-25T14:16:58.025 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.018+0000 7f2b611a3700 1 -- 172.21.15.110:0/3947402857 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b5c0a12e0 con 0x7f2b5c0b9ba0 2021-03-25T14:16:58.025 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.019+0000 7f2b611a3700 1 -- 172.21.15.110:0/3947402857 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b5c05d7b0 con 0x7f2b5c0b9ba0 2021-03-25T14:16:58.025 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.019+0000 7f2b42ffd700 1 -- 172.21.15.110:0/3947402857 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f2b4c012600 con 0x7f2b5c0b9ba0 2021-03-25T14:16:58.025 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.019+0000 7f2b42ffd700 1 --2- 172.21.15.110:0/3947402857 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f2b3c05a0b0 0x7f2b3c05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:58.025 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.019+0000 7f2b42ffd700 1 -- 172.21.15.110:0/3947402857 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5692+0+0 (secure 0 0 0) 0x7f2b4c074140 con 0x7f2b5c0b9ba0 2021-03-25T14:16:58.025 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.019+0000 7f2b5a59c700 1 --2- 172.21.15.110:0/3947402857 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f2b3c05a0b0 0x7f2b3c05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:58.025 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.020+0000 7f2b5a59c700 1 --2- 172.21.15.110:0/3947402857 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f2b3c05a0b0 0x7f2b3c05c570 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f2b5c148ef0 tx=0x7f2b50008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:58.025 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.023+0000 7f2b42ffd700 1 -- 172.21.15.110:0/3947402857 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f2b4c047c60 con 0x7f2b5c0b9ba0 2021-03-25T14:16:58.191 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.189+0000 7f2b611a3700 1 -- 172.21.15.110:0/3947402857 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f2b5c062cc0 con 0x7f2b5c0b9ba0 2021-03-25T14:16:58.978 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.976+0000 7f2b42ffd700 1 -- 172.21.15.110:0/3947402857 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v31) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2b4c04b280 con 0x7f2b5c0b9ba0 2021-03-25T14:16:58.980 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.978+0000 7f2b611a3700 1 -- 172.21.15.110:0/3947402857 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f2b3c05a0b0 msgr2=0x7f2b3c05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:58.981 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.978+0000 7f2b611a3700 1 --2- 172.21.15.110:0/3947402857 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f2b3c05a0b0 0x7f2b3c05c570 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f2b5c148ef0 tx=0x7f2b50008040).stop 2021-03-25T14:16:58.981 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.978+0000 7f2b611a3700 1 -- 172.21.15.110:0/3947402857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b5c0b9ba0 msgr2=0x7f2b5c14f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:58.981 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.978+0000 7f2b611a3700 1 --2- 172.21.15.110:0/3947402857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b5c0b9ba0 0x7f2b5c14f0a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f2b4c00ed10 tx=0x7f2b4c006e20).stop 2021-03-25T14:16:58.981 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.978+0000 7f2b611a3700 1 -- 172.21.15.110:0/3947402857 shutdown_connections 2021-03-25T14:16:58.981 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.978+0000 7f2b611a3700 1 --2- 172.21.15.110:0/3947402857 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f2b3c05a0b0 0x7f2b3c05c570 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:58.981 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.978+0000 7f2b611a3700 1 --2- 172.21.15.110:0/3947402857 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b5c143760 0x7f2b5c0a0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:58.981 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.978+0000 7f2b611a3700 1 --2- 172.21.15.110:0/3947402857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b5c0b9ba0 0x7f2b5c14f0a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:58.981 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.978+0000 7f2b611a3700 1 --2- 172.21.15.110:0/3947402857 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b5c0be5a0 0x7f2b5c0b8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:58.981 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.978+0000 7f2b611a3700 1 -- 172.21.15.110:0/3947402857 >> 172.21.15.110:0/3947402857 conn(0x7f2b5c0616d0 msgr2=0x7f2b5c14a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:58.981 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.978+0000 7f2b611a3700 1 -- 172.21.15.110:0/3947402857 shutdown_connections 2021-03-25T14:16:58.981 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:58.978+0000 7f2b611a3700 1 -- 172.21.15.110:0/3947402857 wait complete. 2021-03-25T14:16:58.982 INFO:teuthology.orchestra.run.smithi110.stderr: removed all blocklist entries 2021-03-25T14:16:58.994 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-03-25T14:16:59.116 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.105+0000 7f303599d700 1 Processor -- start 2021-03-25T14:16:59.117 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.105+0000 7f303599d700 1 -- start start 2021-03-25T14:16:59.117 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.106+0000 7f303599d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f303014a080 0x7f30300b6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:59.117 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.106+0000 7f303599d700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f303014a6a0 con 0x7f30300647e0 2021-03-25T14:16:59.117 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.106+0000 7f303599d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30300631a0 con 0x7f30300b6230 2021-03-25T14:16:59.117 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.106+0000 7f303599d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f303014a4c0 con 0x7f303014a080 2021-03-25T14:16:59.117 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.106+0000 7f30267fc700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f30300647e0 0x7f303014ac50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41952/0 (socket says 172.21.15.110:41952) 2021-03-25T14:16:59.117 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.106+0000 7f30267fc700 1 -- 172.21.15.110:0/2434812591 learned_addr learned my addr 172.21.15.110:0/2434812591 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:16:59.117 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.106+0000 7f302f7fe700 1 --2- 172.21.15.110:0/2434812591 >> v2:172.21.15.174:3300/0 conn(0x7f303014a080 0x7f30300b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:59.117 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.106+0000 7f302e7fc700 1 -- 172.21.15.110:0/2434812591 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3371002092 0 0) 0x7f303014a6a0 con 0x7f30300647e0 2021-03-25T14:16:59.117 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.106+0000 7f302e7fc700 1 -- 172.21.15.110:0/2434812591 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3010003270 con 0x7f30300647e0 2021-03-25T14:16:59.118 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.106+0000 7f302e7fc700 1 -- 172.21.15.110:0/2434812591 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3480954464 0 0) 0x7f3010003270 con 0x7f30300647e0 2021-03-25T14:16:59.118 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.106+0000 7f302e7fc700 1 -- 172.21.15.110:0/2434812591 >> v2:172.21.15.174:3300/0 conn(0x7f303014a080 msgr2=0x7f30300b6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:59.118 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.106+0000 7f302e7fc700 1 --2- 172.21.15.110:0/2434812591 >> v2:172.21.15.174:3300/0 conn(0x7f303014a080 0x7f30300b6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:59.118 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.106+0000 7f302e7fc700 1 -- 172.21.15.110:0/2434812591 >> v1:172.21.15.174:6789/0 conn(0x7f30300b6230 legacy=0x7f30300a2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:59.118 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.106+0000 7f302e7fc700 1 -- 172.21.15.110:0/2434812591 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3030063440 con 0x7f30300647e0 2021-03-25T14:16:59.118 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.106+0000 7f302e7fc700 1 -- 172.21.15.110:0/2434812591 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f3018001520 con 0x7f30300647e0 2021-03-25T14:16:59.118 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.106+0000 7f302e7fc700 1 -- 172.21.15.110:0/2434812591 >> v1:172.21.15.110:6789/0 conn(0x7f30300647e0 legacy=0x7f303014ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:59.118 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.106+0000 7f302e7fc700 1 --2- 172.21.15.110:0/2434812591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3010003760 0x7f3010003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:59.118 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.107+0000 7f302e7fc700 1 --2- 172.21.15.110:0/2434812591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3010004510 0x7f3010004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:59.118 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.107+0000 7f302e7fc700 1 --2- 172.21.15.110:0/2434812591 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3010004e80 0x7f301000b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:59.118 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.107+0000 7f302e7fc700 1 -- 172.21.15.110:0/2434812591 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303014a4c0 con 0x7f3010004510 2021-03-25T14:16:59.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.107+0000 7f302e7fc700 1 -- 172.21.15.110:0/2434812591 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3010004200 con 0x7f3010003760 2021-03-25T14:16:59.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.107+0000 7f302e7fc700 1 -- 172.21.15.110:0/2434812591 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f301000bc50 con 0x7f3010004e80 2021-03-25T14:16:59.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.107+0000 7f30267fc700 1 --2- 172.21.15.110:0/2434812591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3010004510 0x7f3010004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:59.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.107+0000 7f302f7fe700 1 --2- 172.21.15.110:0/2434812591 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3010004e80 0x7f301000b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:59.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.107+0000 7f302effd700 1 --2- 172.21.15.110:0/2434812591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3010003760 0x7f3010003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:59.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.107+0000 7f30267fc700 1 -- 172.21.15.110:0/2434812591 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3010004e80 msgr2=0x7f301000b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:59.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.107+0000 7f30267fc700 1 --2- 172.21.15.110:0/2434812591 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3010004e80 0x7f301000b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:59.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.107+0000 7f30267fc700 1 -- 172.21.15.110:0/2434812591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3010003760 msgr2=0x7f3010003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:59.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.107+0000 7f30267fc700 1 --2- 172.21.15.110:0/2434812591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3010003760 0x7f3010003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:59.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.107+0000 7f30267fc700 1 -- 172.21.15.110:0/2434812591 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3010003270 con 0x7f3010004510 2021-03-25T14:16:59.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.107+0000 7f302f7fe700 1 -- 172.21.15.110:0/2434812591 reap_dead start 2021-03-25T14:16:59.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.107+0000 7f30267fc700 1 --2- 172.21.15.110:0/2434812591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3010004510 0x7f3010004990 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f301800c440 tx=0x7f3030063330).ready entity=mon.0 client_cookie=6379dbfd1ccdbc6a server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:59.120 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.107+0000 7f302e7fc700 1 -- 172.21.15.110:0/2434812591 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301800ce70 con 0x7f3010004510 2021-03-25T14:16:59.120 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.107+0000 7f302e7fc700 1 -- 172.21.15.110:0/2434812591 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30180072e0 con 0x7f3010004510 2021-03-25T14:16:59.120 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.107+0000 7f302e7fc700 1 -- 172.21.15.110:0/2434812591 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3018005620 con 0x7f3010004510 2021-03-25T14:16:59.120 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.108+0000 7f303599d700 1 -- 172.21.15.110:0/2434812591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3010004510 msgr2=0x7f3010004990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:59.120 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.108+0000 7f303599d700 1 --2- 172.21.15.110:0/2434812591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3010004510 0x7f3010004990 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f301800c440 tx=0x7f3030063330).stop 2021-03-25T14:16:59.120 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.108+0000 7f303599d700 1 -- 172.21.15.110:0/2434812591 shutdown_connections 2021-03-25T14:16:59.120 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.108+0000 7f303599d700 1 --2- 172.21.15.110:0/2434812591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3010004510 0x7f3010004990 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:59.120 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.108+0000 7f303599d700 1 -- 172.21.15.110:0/2434812591 >> 172.21.15.110:0/2434812591 conn(0x7f3030060c40 msgr2=0x7f3030061020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:59.120 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.108+0000 7f303599d700 1 -- 172.21.15.110:0/2434812591 shutdown_connections 2021-03-25T14:16:59.120 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.108+0000 7f303599d700 1 -- 172.21.15.110:0/2434812591 wait complete. 2021-03-25T14:16:59.120 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.109+0000 7f303599d700 1 Processor -- start 2021-03-25T14:16:59.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.109+0000 7f303599d700 1 -- start start 2021-03-25T14:16:59.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.110+0000 7f303599d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3010004510 0x7f3030159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:59.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.110+0000 7f303599d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f303014ab80 0x7f303014d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:59.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.110+0000 7f303599d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30300a3640 0x7f30300a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:59.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.110+0000 7f303599d700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303015a130 con 0x7f3010004510 2021-03-25T14:16:59.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.110+0000 7f303599d700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303014be20 con 0x7f30300a3640 2021-03-25T14:16:59.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.110+0000 7f303599d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30300bc730 con 0x7f303014ab80 2021-03-25T14:16:59.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.110+0000 7f302effd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3010004510 0x7f3030159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:59.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.110+0000 7f302effd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3010004510 0x7f3030159c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49026/0 (socket says 172.21.15.110:49026) 2021-03-25T14:16:59.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.110+0000 7f302effd700 1 -- 172.21.15.110:0/4282222443 learned_addr learned my addr 172.21.15.110:0/4282222443 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:59.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.110+0000 7f30267fc700 1 --2- 172.21.15.110:0/4282222443 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f303014ab80 0x7f303014d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:59.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.110+0000 7f302f7fe700 1 --2- 172.21.15.110:0/4282222443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30300a3640 0x7f30300a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:59.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.110+0000 7f302effd700 1 -- 172.21.15.110:0/4282222443 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f303014ab80 msgr2=0x7f303014d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:59.122 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.110+0000 7f302effd700 1 --2- 172.21.15.110:0/4282222443 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f303014ab80 0x7f303014d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:59.122 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.110+0000 7f302effd700 1 -- 172.21.15.110:0/4282222443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30300a3640 msgr2=0x7f30300a3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:59.122 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.110+0000 7f302effd700 1 --2- 172.21.15.110:0/4282222443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30300a3640 0x7f30300a3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:59.122 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.110+0000 7f302effd700 1 -- 172.21.15.110:0/4282222443 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30300bc9d0 con 0x7f3010004510 2021-03-25T14:16:59.122 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.110+0000 7f302f7fe700 1 --2- 172.21.15.110:0/4282222443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30300a3640 0x7f30300a3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:59.122 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.110+0000 7f302effd700 1 --2- 172.21.15.110:0/4282222443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3010004510 0x7f3030159c40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f302000eb40 tx=0x7f3020009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:59.122 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.110+0000 7f30277fe700 1 -- 172.21.15.110:0/4282222443 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3020003dc0 con 0x7f3010004510 2021-03-25T14:16:59.122 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.110+0000 7f30277fe700 1 -- 172.21.15.110:0/4282222443 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302000c780 con 0x7f3010004510 2021-03-25T14:16:59.122 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.110+0000 7f303599d700 1 -- 172.21.15.110:0/4282222443 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30300bcc70 con 0x7f3010004510 2021-03-25T14:16:59.122 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.110+0000 7f30277fe700 1 -- 172.21.15.110:0/4282222443 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302000cb00 con 0x7f3010004510 2021-03-25T14:16:59.122 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.110+0000 7f303599d700 1 -- 172.21.15.110:0/4282222443 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30300bd120 con 0x7f3010004510 2021-03-25T14:16:59.123 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.111+0000 7f303599d700 1 -- 172.21.15.110:0/4282222443 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3030064df0 con 0x7f3010004510 2021-03-25T14:16:59.123 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.111+0000 7f30277fe700 1 -- 172.21.15.110:0/4282222443 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f302001b030 con 0x7f3010004510 2021-03-25T14:16:59.123 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.112+0000 7f30277fe700 1 --2- 172.21.15.110:0/4282222443 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f301405a0e0 0x7f301405c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:59.123 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.112+0000 7f30277fe700 1 -- 172.21.15.110:0/4282222443 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5606+0+0 (secure 0 0 0) 0x7f3020073770 con 0x7f3010004510 2021-03-25T14:16:59.123 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.112+0000 7f30267fc700 1 --2- 172.21.15.110:0/4282222443 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f301405a0e0 0x7f301405c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:59.123 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.112+0000 7f30267fc700 1 --2- 172.21.15.110:0/4282222443 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f301405a0e0 0x7f301405c5a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f301800c440 tx=0x7f3018013000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:59.123 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.116+0000 7f30277fe700 1 -- 172.21.15.110:0/4282222443 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f3020047390 con 0x7f3010004510 2021-03-25T14:16:59.321 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.319+0000 7f303599d700 1 -- 172.21.15.110:0/4282222443 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3030045ae0 con 0x7f3010004510 2021-03-25T14:16:59.321 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.319+0000 7f30277fe700 1 -- 172.21.15.110:0/4282222443 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) v1 ==== 80+0+5905 (secure 0 0 0) 0x7f3020024730 con 0x7f3010004510 2021-03-25T14:16:59.322 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:16:59.322 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2021-03-25T14:16:59.322 INFO:teuthology.orchestra.run.smithi110.stdout: "auth_dump": [ 2021-03-25T14:16:59.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:16:59.322 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "mds.a", 2021-03-25T14:16:59.322 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDxmlxgu8aCEhAA9Q4e7SWq5aDsLFgylcYasw==", 2021-03-25T14:16:59.323 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:16:59.323 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": "allow", 2021-03-25T14:16:59.323 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2021-03-25T14:16:59.323 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2021-03-25T14:16:59.323 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:16:59.324 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:16:59.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:16:59.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:16:59.324 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "mds.b", 2021-03-25T14:16:59.324 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDxmlxgMKt4HRAA2Zg+dO3gKKuJXsTBqargjg==", 2021-03-25T14:16:59.325 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:16:59.325 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": "allow", 2021-03-25T14:16:59.325 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2021-03-25T14:16:59.325 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2021-03-25T14:16:59.325 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:16:59.326 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:16:59.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:16:59.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:16:59.326 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "mds.c", 2021-03-25T14:16:59.327 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDxmlxgEUUtGRAA88JXgGt3G5BUFrM3XSrcqA==", 2021-03-25T14:16:59.327 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:16:59.327 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": "allow", 2021-03-25T14:16:59.327 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2021-03-25T14:16:59.327 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2021-03-25T14:16:59.327 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:16:59.327 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:16:59.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:16:59.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:16:59.328 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "mds.d", 2021-03-25T14:16:59.328 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDxmlxgW9AxJBAA15D4zF2B1SapEee6SmRcvg==", 2021-03-25T14:16:59.328 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:16:59.328 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": "allow", 2021-03-25T14:16:59.328 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2021-03-25T14:16:59.328 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2021-03-25T14:16:59.328 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:16:59.328 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:16:59.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:16:59.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:16:59.328 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "osd.0", 2021-03-25T14:16:59.329 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDymlxgwZp8OBAAq9v4WdTkWcbGA+npuycbMg==", 2021-03-25T14:16:59.329 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:16:59.329 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2021-03-25T14:16:59.329 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2021-03-25T14:16:59.329 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:16:59.329 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:16:59.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:16:59.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:16:59.329 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "osd.1", 2021-03-25T14:16:59.329 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQD1mlxgGbipOBAA4pnOC/cuKte3/s/OynFO4Q==", 2021-03-25T14:16:59.329 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:16:59.330 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2021-03-25T14:16:59.330 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2021-03-25T14:16:59.330 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:16:59.330 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:16:59.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:16:59.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:16:59.330 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "osd.2", 2021-03-25T14:16:59.331 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQD4mlxgoMlQNhAAX+mGQaqbPBWJ6ML34o+2Ag==", 2021-03-25T14:16:59.331 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:16:59.331 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2021-03-25T14:16:59.331 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2021-03-25T14:16:59.331 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:16:59.331 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:16:59.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:16:59.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:16:59.332 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "osd.3", 2021-03-25T14:16:59.332 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQD7mlxgwMTDMxAASdzfZH/r/hxi4yntbTE44A==", 2021-03-25T14:16:59.332 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:16:59.332 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2021-03-25T14:16:59.332 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2021-03-25T14:16:59.332 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:16:59.333 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:16:59.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:16:59.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:16:59.333 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "osd.4", 2021-03-25T14:16:59.333 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQABm1xgveHKFxAAxxfuXs2iAaCtDS99y84xUA==", 2021-03-25T14:16:59.333 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:16:59.333 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2021-03-25T14:16:59.333 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2021-03-25T14:16:59.334 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:16:59.334 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:16:59.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:16:59.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:16:59.334 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "osd.5", 2021-03-25T14:16:59.334 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQAEm1xgfmgAFhAAS7sBExbnejoEm+RPDBfUbA==", 2021-03-25T14:16:59.334 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:16:59.335 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2021-03-25T14:16:59.335 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2021-03-25T14:16:59.335 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:16:59.335 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:16:59.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:16:59.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:16:59.335 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "osd.6", 2021-03-25T14:16:59.335 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQAHm1xg4ve5ExAA/lvAG/VBB5q20gHi8/t7qg==", 2021-03-25T14:16:59.336 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:16:59.336 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2021-03-25T14:16:59.336 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2021-03-25T14:16:59.336 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:16:59.336 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:16:59.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:16:59.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:16:59.337 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "osd.7", 2021-03-25T14:16:59.337 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQAKm1xgmgHpERAA5e/kkmZ5/bM9r1eLQn+47Q==", 2021-03-25T14:16:59.337 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:16:59.337 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2021-03-25T14:16:59.337 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2021-03-25T14:16:59.337 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:16:59.337 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:16:59.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:16:59.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:16:59.338 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "client.0", 2021-03-25T14:16:59.338 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDxmlxg8erbJxAAJisHYL2sfUoCtEM84zXmTQ==", 2021-03-25T14:16:59.338 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:16:59.338 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": "allow", 2021-03-25T14:16:59.338 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow r", 2021-03-25T14:16:59.339 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow rw", 2021-03-25T14:16:59.339 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow rwx" 2021-03-25T14:16:59.339 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:16:59.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:16:59.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:16:59.339 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "client.1", 2021-03-25T14:16:59.339 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDxmlxg7uW1KhAAkf3kOWqyE6uoDsXybdU8CQ==", 2021-03-25T14:16:59.340 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:16:59.340 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": "allow", 2021-03-25T14:16:59.340 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow r", 2021-03-25T14:16:59.340 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow rw", 2021-03-25T14:16:59.340 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow rwx" 2021-03-25T14:16:59.340 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:16:59.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:16:59.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:16:59.341 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "client.admin", 2021-03-25T14:16:59.341 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDwmlxguzAoMxAA3QaeA8eVjVA329iGXhytNg==", 2021-03-25T14:16:59.341 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:16:59.341 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": "allow *", 2021-03-25T14:16:59.341 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2021-03-25T14:16:59.341 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2021-03-25T14:16:59.341 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:16:59.342 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:16:59.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:16:59.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:16:59.342 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "client.bootstrap-mds", 2021-03-25T14:16:59.342 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQAUm1xg5FkcOhAAuQ2R83Z5YgPWC3nHLTSFwA==", 2021-03-25T14:16:59.342 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:16:59.342 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow profile bootstrap-mds" 2021-03-25T14:16:59.342 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:16:59.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:16:59.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:16:59.343 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "client.bootstrap-mgr", 2021-03-25T14:16:59.343 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQAUm1xgp2QcOhAAULK+sT3vzWaUJ15lCW0JeQ==", 2021-03-25T14:16:59.343 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:16:59.343 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow profile bootstrap-mgr" 2021-03-25T14:16:59.343 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:16:59.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:16:59.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:16:59.343 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "client.bootstrap-osd", 2021-03-25T14:16:59.343 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQAUm1xg/G4cOhAA/lYHPrvKfuR6Sqe6aPnPJQ==", 2021-03-25T14:16:59.343 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:16:59.343 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow profile bootstrap-osd" 2021-03-25T14:16:59.344 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:16:59.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:16:59.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:16:59.344 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "client.bootstrap-rbd", 2021-03-25T14:16:59.344 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQAUm1xge3ccOhAAUI3ARGFP9gt8gk9bYfSgKw==", 2021-03-25T14:16:59.344 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:16:59.344 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow profile bootstrap-rbd" 2021-03-25T14:16:59.344 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:16:59.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:16:59.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:16:59.344 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "client.bootstrap-rbd-mirror", 2021-03-25T14:16:59.344 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQAUm1xgC4IcOhAAMbm0oGglAtIDnYBd3e9hVw==", 2021-03-25T14:16:59.345 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:16:59.345 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2021-03-25T14:16:59.345 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:16:59.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:16:59.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:16:59.345 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "client.bootstrap-rgw", 2021-03-25T14:16:59.345 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQAUm1xgi4ocOhAAu6+a99W6qDmdbi1dt9yIAw==", 2021-03-25T14:16:59.345 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:16:59.345 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow profile bootstrap-rgw" 2021-03-25T14:16:59.345 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:16:59.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:16:59.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:16:59.345 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "mgr.x", 2021-03-25T14:16:59.346 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDxmlxgW4eaDxAAeURkSVsbMqQMPgz6bES0zw==", 2021-03-25T14:16:59.346 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:16:59.346 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": "allow *", 2021-03-25T14:16:59.346 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow profile mgr", 2021-03-25T14:16:59.346 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:16:59.346 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:16:59.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:16:59.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:16:59.346 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "mgr.y", 2021-03-25T14:16:59.346 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDxmlxgil5jCxAAt3504C7TGciH7KF4EIkmhw==", 2021-03-25T14:16:59.346 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:16:59.346 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": "allow *", 2021-03-25T14:16:59.347 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow profile mgr", 2021-03-25T14:16:59.347 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:16:59.347 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:16:59.347 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:16:59.347 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2021-03-25T14:16:59.347 INFO:teuthology.orchestra.run.smithi110.stdout:} 2021-03-25T14:16:59.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.321+0000 7f303599d700 1 -- 172.21.15.110:0/4282222443 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f301405a0e0 msgr2=0x7f301405c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:59.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.321+0000 7f303599d700 1 --2- 172.21.15.110:0/4282222443 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f301405a0e0 0x7f301405c5a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f301800c440 tx=0x7f3018013000).stop 2021-03-25T14:16:59.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.321+0000 7f303599d700 1 -- 172.21.15.110:0/4282222443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3010004510 msgr2=0x7f3030159c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:59.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.321+0000 7f303599d700 1 --2- 172.21.15.110:0/4282222443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3010004510 0x7f3030159c40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f302000eb40 tx=0x7f3020009040).stop 2021-03-25T14:16:59.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.321+0000 7f303599d700 1 -- 172.21.15.110:0/4282222443 shutdown_connections 2021-03-25T14:16:59.350 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.321+0000 7f303599d700 1 --2- 172.21.15.110:0/4282222443 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f301405a0e0 0x7f301405c5a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:59.350 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.321+0000 7f303599d700 1 --2- 172.21.15.110:0/4282222443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30300a3640 0x7f30300a3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:59.350 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.321+0000 7f303599d700 1 --2- 172.21.15.110:0/4282222443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3010004510 0x7f3030159c40 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:59.350 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.321+0000 7f303599d700 1 --2- 172.21.15.110:0/4282222443 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f303014ab80 0x7f303014d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:59.350 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.321+0000 7f303599d700 1 -- 172.21.15.110:0/4282222443 >> 172.21.15.110:0/4282222443 conn(0x7f3030060c40 msgr2=0x7f3030068790 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:59.351 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.321+0000 7f303599d700 1 -- 172.21.15.110:0/4282222443 shutdown_connections 2021-03-25T14:16:59.351 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.321+0000 7f303599d700 1 -- 172.21.15.110:0/4282222443 wait complete. 2021-03-25T14:16:59.352 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2021-03-25T14:16:59.462 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.460+0000 7fd2e3db2700 1 Processor -- start 2021-03-25T14:16:59.462 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.460+0000 7fd2e3db2700 1 -- start start 2021-03-25T14:16:59.469 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.461+0000 7fd2e3db2700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd2dc0b0be0 0x7fd2dc067470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:59.469 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.461+0000 7fd2e3db2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2dc0b6460 0x7fd2dc069040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:59.469 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.461+0000 7fd2e3db2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd2dc0bbce0 0x7fd2dc0b84d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:59.469 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.461+0000 7fd2e3db2700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2dc064c50 con 0x7fd2dc0b0be0 2021-03-25T14:16:59.469 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.461+0000 7fd2e3db2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2dc0b2940 con 0x7fd2dc0bbce0 2021-03-25T14:16:59.469 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.461+0000 7fd2e3db2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2dc0649b0 con 0x7fd2dc0b6460 2021-03-25T14:16:59.469 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.461+0000 7fd2e1b4e700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd2dc0b0be0 0x7fd2dc067470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:59.469 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.461+0000 7fd2e1b4e700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd2dc0b0be0 0x7fd2dc067470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49034/0 (socket says 172.21.15.110:49034) 2021-03-25T14:16:59.470 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.461+0000 7fd2e1b4e700 1 -- 172.21.15.110:0/1924602446 learned_addr learned my addr 172.21.15.110:0/1924602446 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:59.470 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.461+0000 7fd2e134d700 1 --2- 172.21.15.110:0/1924602446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2dc0b6460 0x7fd2dc069040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:59.470 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.461+0000 7fd2e234f700 1 --2- 172.21.15.110:0/1924602446 >> v2:172.21.15.174:3300/0 conn(0x7fd2dc0bbce0 0x7fd2dc0b84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:59.470 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.462+0000 7fd2e1b4e700 1 -- 172.21.15.110:0/1924602446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2dc0b6460 msgr2=0x7fd2dc069040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:59.470 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.462+0000 7fd2e1b4e700 1 --2- 172.21.15.110:0/1924602446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2dc0b6460 0x7fd2dc069040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:59.470 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.462+0000 7fd2e1b4e700 1 -- 172.21.15.110:0/1924602446 >> v2:172.21.15.174:3300/0 conn(0x7fd2dc0bbce0 msgr2=0x7fd2dc0b84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:59.470 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.462+0000 7fd2e1b4e700 1 --2- 172.21.15.110:0/1924602446 >> v2:172.21.15.174:3300/0 conn(0x7fd2dc0bbce0 0x7fd2dc0b84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:59.470 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.462+0000 7fd2e1b4e700 1 -- 172.21.15.110:0/1924602446 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2dc0b72f0 con 0x7fd2dc0b0be0 2021-03-25T14:16:59.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.462+0000 7fd2e234f700 1 --2- 172.21.15.110:0/1924602446 >> v2:172.21.15.174:3300/0 conn(0x7fd2dc0bbce0 0x7fd2dc0b84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:16:59.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.462+0000 7fd2e1b4e700 1 --2- 172.21.15.110:0/1924602446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2dc0b0be0 0x7fd2dc067470 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7fd2dc0bc770 tx=0x7fd2d8006ee0).ready entity=mon.0 client_cookie=70ea669b1644b5df server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:59.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.462+0000 7fd2e0b4c700 1 -- 172.21.15.110:0/1924602446 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8009840 con 0x7fd2dc0b0be0 2021-03-25T14:16:59.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.462+0000 7fd2e0b4c700 1 -- 172.21.15.110:0/1924602446 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d80099a0 con 0x7fd2dc0b0be0 2021-03-25T14:16:59.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.462+0000 7fd2e0b4c700 1 -- 172.21.15.110:0/1924602446 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8009d20 con 0x7fd2dc0b0be0 2021-03-25T14:16:59.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.462+0000 7fd2e3db2700 1 -- 172.21.15.110:0/1924602446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2dc0b0be0 msgr2=0x7fd2dc067470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:59.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.462+0000 7fd2e3db2700 1 --2- 172.21.15.110:0/1924602446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2dc0b0be0 0x7fd2dc067470 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7fd2dc0bc770 tx=0x7fd2d8006ee0).stop 2021-03-25T14:16:59.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.462+0000 7fd2e3db2700 1 -- 172.21.15.110:0/1924602446 shutdown_connections 2021-03-25T14:16:59.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.462+0000 7fd2e3db2700 1 --2- 172.21.15.110:0/1924602446 >> v2:172.21.15.174:3300/0 conn(0x7fd2dc0bbce0 0x7fd2dc0b84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:59.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.462+0000 7fd2e3db2700 1 --2- 172.21.15.110:0/1924602446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2dc0b0be0 0x7fd2dc067470 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:59.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.462+0000 7fd2e3db2700 1 --2- 172.21.15.110:0/1924602446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2dc0b6460 0x7fd2dc069040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:59.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.462+0000 7fd2e3db2700 1 -- 172.21.15.110:0/1924602446 >> 172.21.15.110:0/1924602446 conn(0x7fd2dc0663f0 msgr2=0x7fd2dc066800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:59.472 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.463+0000 7fd2e3db2700 1 -- 172.21.15.110:0/1924602446 shutdown_connections 2021-03-25T14:16:59.472 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.463+0000 7fd2e3db2700 1 -- 172.21.15.110:0/1924602446 wait complete. 2021-03-25T14:16:59.472 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.464+0000 7fd2e3db2700 1 Processor -- start 2021-03-25T14:16:59.472 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.464+0000 7fd2e3db2700 1 -- start start 2021-03-25T14:16:59.472 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.464+0000 7fd2e3db2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2dc0b0be0 0x7fd2dc09ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:59.472 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.464+0000 7fd2e3db2700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2dc0b6460 0x7fd2dc13cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:59.472 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.464+0000 7fd2e3db2700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2dc0bbce0 0x7fd2dc13d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:59.472 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.464+0000 7fd2e3db2700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2dc13d7b0 con 0x7fd2dc0b6460 2021-03-25T14:16:59.472 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.464+0000 7fd2e3db2700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2dc144fd0 con 0x7fd2dc0bbce0 2021-03-25T14:16:59.472 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.464+0000 7fd2e3db2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2dc143df0 con 0x7fd2dc0b0be0 2021-03-25T14:16:59.472 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.464+0000 7fd2e134d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2dc0b6460 0x7fd2dc13cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:59.473 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.464+0000 7fd2e134d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2dc0b6460 0x7fd2dc13cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49040/0 (socket says 172.21.15.110:49040) 2021-03-25T14:16:59.473 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.464+0000 7fd2e134d700 1 -- 172.21.15.110:0/1746725126 learned_addr learned my addr 172.21.15.110:0/1746725126 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:59.473 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.465+0000 7fd2e234f700 1 --2- 172.21.15.110:0/1746725126 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2dc0bbce0 0x7fd2dc13d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:59.473 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.465+0000 7fd2e1b4e700 1 --2- 172.21.15.110:0/1746725126 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2dc0b0be0 0x7fd2dc09ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:59.473 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.465+0000 7fd2e134d700 1 -- 172.21.15.110:0/1746725126 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2dc0b0be0 msgr2=0x7fd2dc09ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:59.473 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.465+0000 7fd2e134d700 1 --2- 172.21.15.110:0/1746725126 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2dc0b0be0 0x7fd2dc09ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:59.473 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.465+0000 7fd2e134d700 1 -- 172.21.15.110:0/1746725126 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2dc0bbce0 msgr2=0x7fd2dc13d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:59.474 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.465+0000 7fd2e134d700 1 --2- 172.21.15.110:0/1746725126 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2dc0bbce0 0x7fd2dc13d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:59.474 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.465+0000 7fd2e134d700 1 -- 172.21.15.110:0/1746725126 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2dc144090 con 0x7fd2dc0b6460 2021-03-25T14:16:59.474 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.465+0000 7fd2e134d700 1 --2- 172.21.15.110:0/1746725126 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2dc0b6460 0x7fd2dc13cdd0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7fd2cc00ec00 tx=0x7fd2cc006e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:59.474 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.465+0000 7fd2c9ffb700 1 -- 172.21.15.110:0/1746725126 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc00c9d0 con 0x7fd2dc0b6460 2021-03-25T14:16:59.474 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.465+0000 7fd2c9ffb700 1 -- 172.21.15.110:0/1746725126 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2cc00cb30 con 0x7fd2dc0b6460 2021-03-25T14:16:59.474 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.465+0000 7fd2e3db2700 1 -- 172.21.15.110:0/1746725126 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2dc144330 con 0x7fd2dc0b6460 2021-03-25T14:16:59.474 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.465+0000 7fd2c9ffb700 1 -- 172.21.15.110:0/1746725126 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc00ceb0 con 0x7fd2dc0b6460 2021-03-25T14:16:59.474 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.465+0000 7fd2e3db2700 1 -- 172.21.15.110:0/1746725126 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2dc1456a0 con 0x7fd2dc0b6460 2021-03-25T14:16:59.475 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.466+0000 7fd2e3db2700 1 -- 172.21.15.110:0/1746725126 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2dc0bc1a0 con 0x7fd2dc0b6460 2021-03-25T14:16:59.475 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.466+0000 7fd2c9ffb700 1 -- 172.21.15.110:0/1746725126 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fd2cc012600 con 0x7fd2dc0b6460 2021-03-25T14:16:59.475 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.466+0000 7fd2c9ffb700 1 --2- 172.21.15.110:0/1746725126 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd2bc05a0b0 0x7fd2bc05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:59.475 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.466+0000 7fd2c9ffb700 1 -- 172.21.15.110:0/1746725126 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5606+0+0 (secure 0 0 0) 0x7fd2cc073f80 con 0x7fd2dc0b6460 2021-03-25T14:16:59.475 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.467+0000 7fd2e1b4e700 1 --2- 172.21.15.110:0/1746725126 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd2bc05a0b0 0x7fd2bc05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:59.476 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.467+0000 7fd2e1b4e700 1 --2- 172.21.15.110:0/1746725126 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd2bc05a0b0 0x7fd2bc05c570 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fd2d8006f20 tx=0x7fd2d8016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:59.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.470+0000 7fd2c9ffb700 1 -- 172.21.15.110:0/1746725126 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fd2cc047af0 con 0x7fd2dc0b6460 2021-03-25T14:16:59.676 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.674+0000 7fd2e3db2700 1 -- 172.21.15.110:0/1746725126 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fd2dc1453c0 con 0x7fd2dc0b6460 2021-03-25T14:16:59.679 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.677+0000 7fd2c9ffb700 1 -- 172.21.15.110:0/1746725126 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 updated v3) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd2cc04b110 con 0x7fd2dc0b6460 2021-03-25T14:16:59.682 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.679+0000 7fd2e3db2700 1 -- 172.21.15.110:0/1746725126 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd2bc05a0b0 msgr2=0x7fd2bc05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:59.682 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.679+0000 7fd2e3db2700 1 --2- 172.21.15.110:0/1746725126 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd2bc05a0b0 0x7fd2bc05c570 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fd2d8006f20 tx=0x7fd2d8016000).stop 2021-03-25T14:16:59.682 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.679+0000 7fd2e3db2700 1 -- 172.21.15.110:0/1746725126 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2dc0b6460 msgr2=0x7fd2dc13cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:59.682 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.679+0000 7fd2e3db2700 1 --2- 172.21.15.110:0/1746725126 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2dc0b6460 0x7fd2dc13cdd0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7fd2cc00ec00 tx=0x7fd2cc006e20).stop 2021-03-25T14:16:59.682 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.679+0000 7fd2e3db2700 1 -- 172.21.15.110:0/1746725126 shutdown_connections 2021-03-25T14:16:59.682 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.679+0000 7fd2e3db2700 1 --2- 172.21.15.110:0/1746725126 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd2bc05a0b0 0x7fd2bc05c570 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:59.682 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.679+0000 7fd2e3db2700 1 --2- 172.21.15.110:0/1746725126 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2dc0bbce0 0x7fd2dc13d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:59.682 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.679+0000 7fd2e3db2700 1 --2- 172.21.15.110:0/1746725126 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2dc0b0be0 0x7fd2dc09ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:59.682 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.679+0000 7fd2e3db2700 1 --2- 172.21.15.110:0/1746725126 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2dc0b6460 0x7fd2dc13cdd0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:59.682 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.679+0000 7fd2e3db2700 1 -- 172.21.15.110:0/1746725126 >> 172.21.15.110:0/1746725126 conn(0x7fd2dc0663f0 msgr2=0x7fd2dc140f10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:59.682 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.679+0000 7fd2e3db2700 1 -- 172.21.15.110:0/1746725126 shutdown_connections 2021-03-25T14:16:59.683 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.679+0000 7fd2e3db2700 1 -- 172.21.15.110:0/1746725126 wait complete. 2021-03-25T14:16:59.683 INFO:teuthology.orchestra.run.smithi110.stderr:updated 2021-03-25T14:16:59.692 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2021-03-25T14:16:59.804 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.802+0000 7f267c5e3700 1 Processor -- start 2021-03-25T14:16:59.804 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.802+0000 7f267c5e3700 1 -- start start 2021-03-25T14:16:59.807 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.803+0000 7f267c5e3700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f26740be5a0 0x7f267414ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:59.807 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.803+0000 7f267c5e3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2674148a20 0x7f2674147cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:59.807 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.803+0000 7f267c5e3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f26740b9bc0 0x7f26741481b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:59.807 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.803+0000 7f267c5e3700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f267414a960 con 0x7f26740be5a0 2021-03-25T14:16:59.807 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.803+0000 7f267c5e3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f267414b3c0 con 0x7f26740b9bc0 2021-03-25T14:16:59.807 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.803+0000 7f267c5e3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f267414b660 con 0x7f2674148a20 2021-03-25T14:16:59.808 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.803+0000 7f267a37f700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f26740be5a0 0x7f267414ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:59.808 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.803+0000 7f267a37f700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f26740be5a0 0x7f267414ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49046/0 (socket says 172.21.15.110:49046) 2021-03-25T14:16:59.808 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.803+0000 7f267a37f700 1 -- 172.21.15.110:0/3526089585 learned_addr learned my addr 172.21.15.110:0/3526089585 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:59.808 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.803+0000 7f2679b7e700 1 --2- 172.21.15.110:0/3526089585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2674148a20 0x7f2674147cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:59.808 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.803+0000 7f267ab80700 1 --2- 172.21.15.110:0/3526089585 >> v2:172.21.15.174:3300/0 conn(0x7f26740b9bc0 0x7f26741481b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:59.808 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.803+0000 7f267a37f700 1 -- 172.21.15.110:0/3526089585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2674148a20 msgr2=0x7f2674147cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:59.808 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.803+0000 7f267a37f700 1 --2- 172.21.15.110:0/3526089585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2674148a20 0x7f2674147cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:59.808 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.803+0000 7f267a37f700 1 -- 172.21.15.110:0/3526089585 >> v2:172.21.15.174:3300/0 conn(0x7f26740b9bc0 msgr2=0x7f26741481b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:16:59.808 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.803+0000 7f267a37f700 1 --2- 172.21.15.110:0/3526089585 >> v2:172.21.15.174:3300/0 conn(0x7f26740b9bc0 0x7f26741481b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:59.808 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.803+0000 7f267a37f700 1 -- 172.21.15.110:0/3526089585 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f267414b900 con 0x7f26740be5a0 2021-03-25T14:16:59.808 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.804+0000 7f267a37f700 1 --2- 172.21.15.110:0/3526089585 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26740be5a0 0x7f267414ab20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f2674145150 tx=0x7f2670006ee0).ready entity=mon.0 client_cookie=b24aa88bbdd7208b server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:59.808 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.804+0000 7f267937d700 1 -- 172.21.15.110:0/3526089585 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26700098d0 con 0x7f26740be5a0 2021-03-25T14:16:59.808 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.804+0000 7f267937d700 1 -- 172.21.15.110:0/3526089585 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2670009a30 con 0x7f26740be5a0 2021-03-25T14:16:59.809 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.804+0000 7f267937d700 1 -- 172.21.15.110:0/3526089585 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2670009db0 con 0x7f26740be5a0 2021-03-25T14:16:59.809 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.804+0000 7f267c5e3700 1 -- 172.21.15.110:0/3526089585 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26740be5a0 msgr2=0x7f267414ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:59.809 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.804+0000 7f267c5e3700 1 --2- 172.21.15.110:0/3526089585 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26740be5a0 0x7f267414ab20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f2674145150 tx=0x7f2670006ee0).stop 2021-03-25T14:16:59.809 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.804+0000 7f267c5e3700 1 -- 172.21.15.110:0/3526089585 shutdown_connections 2021-03-25T14:16:59.809 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.804+0000 7f267c5e3700 1 --2- 172.21.15.110:0/3526089585 >> v2:172.21.15.174:3300/0 conn(0x7f26740b9bc0 0x7f26741481b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:59.809 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.804+0000 7f267c5e3700 1 --2- 172.21.15.110:0/3526089585 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26740be5a0 0x7f267414ab20 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:59.809 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.804+0000 7f267c5e3700 1 --2- 172.21.15.110:0/3526089585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2674148a20 0x7f2674147cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:59.809 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.804+0000 7f267c5e3700 1 -- 172.21.15.110:0/3526089585 >> 172.21.15.110:0/3526089585 conn(0x7f26740616d0 msgr2=0x7f26740bdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:16:59.809 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.804+0000 7f267c5e3700 1 -- 172.21.15.110:0/3526089585 shutdown_connections 2021-03-25T14:16:59.809 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.804+0000 7f267c5e3700 1 -- 172.21.15.110:0/3526089585 wait complete. 2021-03-25T14:16:59.809 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.805+0000 7f267c5e3700 1 Processor -- start 2021-03-25T14:16:59.809 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.805+0000 7f267c5e3700 1 -- start start 2021-03-25T14:16:59.812 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.806+0000 7f267c5e3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f26740b9bc0 0x7f26740b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:59.812 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.806+0000 7f267c5e3700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26740be5a0 0x7f2674140e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:59.812 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.806+0000 7f267c5e3700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2674148a20 0x7f2674141320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:59.812 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.806+0000 7f267c5e3700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26740a0660 con 0x7f2674148a20 2021-03-25T14:16:59.812 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.806+0000 7f267c5e3700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2674064de0 con 0x7f26740be5a0 2021-03-25T14:16:59.812 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.806+0000 7f267c5e3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26740b5100 con 0x7f26740b9bc0 2021-03-25T14:16:59.812 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.806+0000 7f267ab80700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2674148a20 0x7f2674141320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:59.812 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.806+0000 7f267ab80700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2674148a20 0x7f2674141320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49056/0 (socket says 172.21.15.110:49056) 2021-03-25T14:16:59.812 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.806+0000 7f267ab80700 1 -- 172.21.15.110:0/872786277 learned_addr learned my addr 172.21.15.110:0/872786277 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:16:59.812 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.806+0000 7f267a37f700 1 --2- 172.21.15.110:0/872786277 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f26740b9bc0 0x7f26740b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:59.812 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.806+0000 7f2679b7e700 1 --2- 172.21.15.110:0/872786277 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26740be5a0 0x7f2674140e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:59.813 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.806+0000 7f267ab80700 1 -- 172.21.15.110:0/872786277 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f26740b9bc0 msgr2=0x7f26740b77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:59.813 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.806+0000 7f267ab80700 1 --2- 172.21.15.110:0/872786277 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f26740b9bc0 0x7f26740b77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:59.813 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.806+0000 7f267ab80700 1 -- 172.21.15.110:0/872786277 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26740be5a0 msgr2=0x7f2674140e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:16:59.813 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.806+0000 7f267ab80700 1 --2- 172.21.15.110:0/872786277 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26740be5a0 0x7f2674140e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:16:59.813 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.806+0000 7f267ab80700 1 -- 172.21.15.110:0/872786277 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26740639f0 con 0x7f2674148a20 2021-03-25T14:16:59.813 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.807+0000 7f267ab80700 1 --2- 172.21.15.110:0/872786277 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2674148a20 0x7f2674141320 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f266c00ebf0 tx=0x7f266c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:59.813 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.808+0000 7f26627fc700 1 -- 172.21.15.110:0/872786277 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c00c740 con 0x7f2674148a20 2021-03-25T14:16:59.813 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.808+0000 7f267c5e3700 1 -- 172.21.15.110:0/872786277 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26740b7cd0 con 0x7f2674148a20 2021-03-25T14:16:59.813 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.808+0000 7f267c5e3700 1 -- 172.21.15.110:0/872786277 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2674065e50 con 0x7f2674148a20 2021-03-25T14:16:59.813 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.808+0000 7f26627fc700 1 -- 172.21.15.110:0/872786277 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266c00cab0 con 0x7f2674148a20 2021-03-25T14:16:59.813 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.809+0000 7f26627fc700 1 -- 172.21.15.110:0/872786277 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c00cc20 con 0x7f2674148a20 2021-03-25T14:16:59.813 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.809+0000 7f267c5e3700 1 -- 172.21.15.110:0/872786277 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f267405d7b0 con 0x7f2674148a20 2021-03-25T14:16:59.813 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.809+0000 7f26627fc700 1 -- 172.21.15.110:0/872786277 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f266c01d460 con 0x7f2674148a20 2021-03-25T14:16:59.813 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.810+0000 7f26627fc700 1 --2- 172.21.15.110:0/872786277 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f265405a0b0 0x7f265405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:16:59.814 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.810+0000 7f26627fc700 1 -- 172.21.15.110:0/872786277 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5606+0+0 (secure 0 0 0) 0x7f266c073b60 con 0x7f2674148a20 2021-03-25T14:16:59.814 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.810+0000 7f267a37f700 1 --2- 172.21.15.110:0/872786277 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f265405a0b0 0x7f265405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:16:59.814 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.810+0000 7f267a37f700 1 --2- 172.21.15.110:0/872786277 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f265405a0b0 0x7f265405c570 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f2670006f20 tx=0x7f2670016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:16:59.815 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:16:59.813+0000 7f26627fc700 1 -- 172.21.15.110:0/872786277 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f266c047670 con 0x7f2674148a20 2021-03-25T14:17:00.019 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.017+0000 7f267c5e3700 1 -- 172.21.15.110:0/872786277 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f26740a3d20 con 0x7f2674148a20 2021-03-25T14:17:00.022 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.020+0000 7f26627fc700 1 -- 172.21.15.110:0/872786277 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 updated v4) v1 ==== 97+0+0 (secure 0 0 0) 0x7f266c04ac90 con 0x7f2674148a20 2021-03-25T14:17:00.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.022+0000 7f267c5e3700 1 -- 172.21.15.110:0/872786277 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f265405a0b0 msgr2=0x7f265405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:00.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.022+0000 7f267c5e3700 1 --2- 172.21.15.110:0/872786277 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f265405a0b0 0x7f265405c570 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f2670006f20 tx=0x7f2670016000).stop 2021-03-25T14:17:00.025 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.022+0000 7f267c5e3700 1 -- 172.21.15.110:0/872786277 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2674148a20 msgr2=0x7f2674141320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:00.025 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.022+0000 7f267c5e3700 1 --2- 172.21.15.110:0/872786277 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2674148a20 0x7f2674141320 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f266c00ebf0 tx=0x7f266c008040).stop 2021-03-25T14:17:00.025 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.022+0000 7f267c5e3700 1 -- 172.21.15.110:0/872786277 shutdown_connections 2021-03-25T14:17:00.025 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.022+0000 7f267c5e3700 1 --2- 172.21.15.110:0/872786277 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f265405a0b0 0x7f265405c570 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:00.025 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.022+0000 7f267c5e3700 1 --2- 172.21.15.110:0/872786277 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2674148a20 0x7f2674141320 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:00.025 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.022+0000 7f267c5e3700 1 --2- 172.21.15.110:0/872786277 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f26740b9bc0 0x7f26740b77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:00.025 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.022+0000 7f267c5e3700 1 --2- 172.21.15.110:0/872786277 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26740be5a0 0x7f2674140e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:00.025 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.022+0000 7f267c5e3700 1 -- 172.21.15.110:0/872786277 >> 172.21.15.110:0/872786277 conn(0x7f26740616d0 msgr2=0x7f26740ba030 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:00.025 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.022+0000 7f267c5e3700 1 -- 172.21.15.110:0/872786277 shutdown_connections 2021-03-25T14:17:00.025 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.022+0000 7f267c5e3700 1 -- 172.21.15.110:0/872786277 wait complete. 2021-03-25T14:17:00.026 INFO:teuthology.orchestra.run.smithi110.stderr:updated 2021-03-25T14:17:00.035 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2021-03-25T14:17:00.146 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.144+0000 7f5f00dcf700 1 Processor -- start 2021-03-25T14:17:00.146 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.144+0000 7f5f00dcf700 1 -- start start 2021-03-25T14:17:00.148 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.144+0000 7f5f00dcf700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5efc0b9ba0 0x7f5efc143980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:00.149 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.144+0000 7f5f00dcf700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5efc09d2a0 0x7f5efc149a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:00.149 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.145+0000 7f5f00dcf700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5efc14d0e0 con 0x7f5efc0be5a0 2021-03-25T14:17:00.149 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.145+0000 7f5f00dcf700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5efc14d380 con 0x7f5efc09d2a0 2021-03-25T14:17:00.149 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.145+0000 7f5f00dcf700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc14d620 con 0x7f5efc0b9ba0 2021-03-25T14:17:00.149 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.145+0000 7f5efad9d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5efc09d2a0 0x7f5efc149a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:00.149 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.145+0000 7f5efad9d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5efc09d2a0 0x7f5efc149a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49064/0 (socket says 172.21.15.110:49064) 2021-03-25T14:17:00.149 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.145+0000 7f5efa59c700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f5efc0be5a0 0x7f5efc143270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41996/0 (socket says 172.21.15.110:41996) 2021-03-25T14:17:00.149 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.145+0000 7f5efad9d700 1 -- 172.21.15.110:0/13736446 learned_addr learned my addr 172.21.15.110:0/13736446 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:00.149 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.145+0000 7f5ef9d9b700 1 --2- 172.21.15.110:0/13736446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5efc0b9ba0 0x7f5efc143980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:00.149 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.145+0000 7f5efad9d700 1 -- 172.21.15.110:0/13736446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5efc0b9ba0 msgr2=0x7f5efc143980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:00.149 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.145+0000 7f5efad9d700 1 --2- 172.21.15.110:0/13736446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5efc0b9ba0 0x7f5efc143980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:00.150 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.145+0000 7f5efad9d700 1 -- 172.21.15.110:0/13736446 >> v1:172.21.15.110:6789/0 conn(0x7f5efc0be5a0 legacy=0x7f5efc143270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:00.150 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.145+0000 7f5efad9d700 1 -- 172.21.15.110:0/13736446 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5efc14d8c0 con 0x7f5efc09d2a0 2021-03-25T14:17:00.150 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.145+0000 7f5ef959a700 1 -- 172.21.15.110:0/13736446 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1796797335 0 0) 0x7f5efc14d0e0 con 0x7f5efc0be5a0 2021-03-25T14:17:00.150 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.145+0000 7f5efad9d700 1 --2- 172.21.15.110:0/13736446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5efc09d2a0 0x7f5efc149a00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f5ef4009d90 tx=0x7f5ef40092d0).ready entity=mon.0 client_cookie=e005fdc5529ae1df server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:00.150 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.145+0000 7f5ef959a700 1 -- 172.21.15.110:0/13736446 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef400bc80 con 0x7f5efc09d2a0 2021-03-25T14:17:00.150 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.145+0000 7f5ef959a700 1 -- 172.21.15.110:0/13736446 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef400bde0 con 0x7f5efc09d2a0 2021-03-25T14:17:00.150 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.145+0000 7f5ef959a700 1 -- 172.21.15.110:0/13736446 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4011610 con 0x7f5efc09d2a0 2021-03-25T14:17:00.150 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.146+0000 7f5f00dcf700 1 -- 172.21.15.110:0/13736446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5efc09d2a0 msgr2=0x7f5efc149a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:00.150 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.146+0000 7f5f00dcf700 1 --2- 172.21.15.110:0/13736446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5efc09d2a0 0x7f5efc149a00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f5ef4009d90 tx=0x7f5ef40092d0).stop 2021-03-25T14:17:00.150 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.146+0000 7f5f00dcf700 1 -- 172.21.15.110:0/13736446 shutdown_connections 2021-03-25T14:17:00.150 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.146+0000 7f5f00dcf700 1 --2- 172.21.15.110:0/13736446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5efc09d2a0 0x7f5efc149a00 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:00.151 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.146+0000 7f5f00dcf700 1 --2- 172.21.15.110:0/13736446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5efc0b9ba0 0x7f5efc143980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:00.151 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.146+0000 7f5f00dcf700 1 -- 172.21.15.110:0/13736446 >> 172.21.15.110:0/13736446 conn(0x7f5efc0616d0 msgr2=0x7f5efc0bdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:00.151 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.146+0000 7f5f00dcf700 1 -- 172.21.15.110:0/13736446 shutdown_connections 2021-03-25T14:17:00.151 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.146+0000 7f5f00dcf700 1 -- 172.21.15.110:0/13736446 wait complete. 2021-03-25T14:17:00.151 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.147+0000 7f5f00dcf700 1 Processor -- start 2021-03-25T14:17:00.151 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.147+0000 7f5f00dcf700 1 -- start start 2021-03-25T14:17:00.154 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.147+0000 7f5f00dcf700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5efc09d2a0 0x7f5efc158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:00.154 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.147+0000 7f5f00dcf700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5efc0b9ba0 0x7f5efc1451b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:00.154 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.147+0000 7f5f00dcf700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5efc0be5a0 0x7f5efc15c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:00.154 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.147+0000 7f5f00dcf700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc145cd0 con 0x7f5efc09d2a0 2021-03-25T14:17:00.154 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.147+0000 7f5f00dcf700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc145f20 con 0x7f5efc0be5a0 2021-03-25T14:17:00.154 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.147+0000 7f5f00dcf700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc1461c0 con 0x7f5efc0b9ba0 2021-03-25T14:17:00.154 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.148+0000 7f5efa59c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5efc09d2a0 0x7f5efc158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:00.154 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.148+0000 7f5efa59c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5efc09d2a0 0x7f5efc158c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49066/0 (socket says 172.21.15.110:49066) 2021-03-25T14:17:00.154 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.148+0000 7f5efa59c700 1 -- 172.21.15.110:0/1835055283 learned_addr learned my addr 172.21.15.110:0/1835055283 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:00.155 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.148+0000 7f5ef9d9b700 1 --2- 172.21.15.110:0/1835055283 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5efc0b9ba0 0x7f5efc1451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:00.155 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.148+0000 7f5efad9d700 1 --2- 172.21.15.110:0/1835055283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5efc0be5a0 0x7f5efc15c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:00.155 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.148+0000 7f5efa59c700 1 -- 172.21.15.110:0/1835055283 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5efc0b9ba0 msgr2=0x7f5efc1451b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:00.155 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.148+0000 7f5efa59c700 1 --2- 172.21.15.110:0/1835055283 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5efc0b9ba0 0x7f5efc1451b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:00.155 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.148+0000 7f5efa59c700 1 -- 172.21.15.110:0/1835055283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5efc0be5a0 msgr2=0x7f5efc15c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:00.155 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.148+0000 7f5efa59c700 1 --2- 172.21.15.110:0/1835055283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5efc0be5a0 0x7f5efc15c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:00.155 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.148+0000 7f5efa59c700 1 -- 172.21.15.110:0/1835055283 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5efc146460 con 0x7f5efc09d2a0 2021-03-25T14:17:00.155 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.148+0000 7f5efad9d700 1 --2- 172.21.15.110:0/1835055283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5efc0be5a0 0x7f5efc15c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:00.155 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.148+0000 7f5efa59c700 1 --2- 172.21.15.110:0/1835055283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5efc09d2a0 0x7f5efc158c00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f5ef000c740 tx=0x7f5ef0007b10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:00.155 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.148+0000 7f5eea7fc700 1 -- 172.21.15.110:0/1835055283 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef00072e0 con 0x7f5efc09d2a0 2021-03-25T14:17:00.156 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.148+0000 7f5eea7fc700 1 -- 172.21.15.110:0/1835055283 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef0005560 con 0x7f5efc09d2a0 2021-03-25T14:17:00.156 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.148+0000 7f5f00dcf700 1 -- 172.21.15.110:0/1835055283 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5efc146700 con 0x7f5efc09d2a0 2021-03-25T14:17:00.156 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.148+0000 7f5eea7fc700 1 -- 172.21.15.110:0/1835055283 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef00058e0 con 0x7f5efc09d2a0 2021-03-25T14:17:00.156 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.148+0000 7f5f00dcf700 1 -- 172.21.15.110:0/1835055283 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5efc145a40 con 0x7f5efc09d2a0 2021-03-25T14:17:00.156 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.149+0000 7f5f00dcf700 1 -- 172.21.15.110:0/1835055283 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5efc146b60 con 0x7f5efc09d2a0 2021-03-25T14:17:00.156 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.149+0000 7f5eea7fc700 1 -- 172.21.15.110:0/1835055283 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f5ef0010070 con 0x7f5efc09d2a0 2021-03-25T14:17:00.156 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.150+0000 7f5eea7fc700 1 --2- 172.21.15.110:0/1835055283 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5ed805a0b0 0x7f5ed805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:00.156 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.150+0000 7f5eea7fc700 1 -- 172.21.15.110:0/1835055283 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5606+0+0 (secure 0 0 0) 0x7f5ef0073210 con 0x7f5efc09d2a0 2021-03-25T14:17:00.156 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.150+0000 7f5ef9d9b700 1 --2- 172.21.15.110:0/1835055283 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5ed805a0b0 0x7f5ed805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:00.156 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.150+0000 7f5ef9d9b700 1 --2- 172.21.15.110:0/1835055283 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5ed805a0b0 0x7f5ed805c570 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f5efc149180 tx=0x7f5eec008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:00.157 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.153+0000 7f5eea7fc700 1 -- 172.21.15.110:0/1835055283 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f5ef0046d20 con 0x7f5efc09d2a0 2021-03-25T14:17:00.362 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.360+0000 7f5f00dcf700 1 -- 172.21.15.110:0/1835055283 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f5efc05d7b0 con 0x7f5efc09d2a0 2021-03-25T14:17:00.364 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.363+0000 7f5eea7fc700 1 -- 172.21.15.110:0/1835055283 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 updated v5) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5ef004a340 con 0x7f5efc09d2a0 2021-03-25T14:17:00.367 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.365+0000 7f5f00dcf700 1 -- 172.21.15.110:0/1835055283 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5ed805a0b0 msgr2=0x7f5ed805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:00.368 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.365+0000 7f5f00dcf700 1 --2- 172.21.15.110:0/1835055283 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5ed805a0b0 0x7f5ed805c570 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f5efc149180 tx=0x7f5eec008040).stop 2021-03-25T14:17:00.368 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.365+0000 7f5f00dcf700 1 -- 172.21.15.110:0/1835055283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5efc09d2a0 msgr2=0x7f5efc158c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:00.368 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.365+0000 7f5f00dcf700 1 --2- 172.21.15.110:0/1835055283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5efc09d2a0 0x7f5efc158c00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f5ef000c740 tx=0x7f5ef0007b10).stop 2021-03-25T14:17:00.368 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.365+0000 7f5f00dcf700 1 -- 172.21.15.110:0/1835055283 shutdown_connections 2021-03-25T14:17:00.368 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.365+0000 7f5f00dcf700 1 --2- 172.21.15.110:0/1835055283 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5ed805a0b0 0x7f5ed805c570 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:00.368 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.365+0000 7f5f00dcf700 1 --2- 172.21.15.110:0/1835055283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5efc0be5a0 0x7f5efc15c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:00.368 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.365+0000 7f5f00dcf700 1 --2- 172.21.15.110:0/1835055283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5efc09d2a0 0x7f5efc158c00 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:00.368 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.365+0000 7f5f00dcf700 1 --2- 172.21.15.110:0/1835055283 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5efc0b9ba0 0x7f5efc1451b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:00.368 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.365+0000 7f5f00dcf700 1 -- 172.21.15.110:0/1835055283 >> 172.21.15.110:0/1835055283 conn(0x7f5efc0616d0 msgr2=0x7f5efc0bdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:00.368 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.365+0000 7f5f00dcf700 1 -- 172.21.15.110:0/1835055283 shutdown_connections 2021-03-25T14:17:00.368 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.365+0000 7f5f00dcf700 1 -- 172.21.15.110:0/1835055283 wait complete. 2021-03-25T14:17:00.369 INFO:teuthology.orchestra.run.smithi110.stderr:updated 2021-03-25T14:17:00.378 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2021-03-25T14:17:00.489 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.487+0000 7f43c55ba700 1 Processor -- start 2021-03-25T14:17:00.489 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.487+0000 7f43c55ba700 1 -- start start 2021-03-25T14:17:00.496 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.488+0000 7f43c55ba700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43c009cd40 0x7f43c00be680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:00.496 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.488+0000 7f43c55ba700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f43c00bc590 0x7f43c01469f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:00.496 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.488+0000 7f43c55ba700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c0147a80 con 0x7f43c00be2a0 2021-03-25T14:17:00.497 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.488+0000 7f43c55ba700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c00bba90 con 0x7f43c00bc590 2021-03-25T14:17:00.497 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.488+0000 7f43c55ba700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c00ba2c0 con 0x7f43c009cd40 2021-03-25T14:17:00.497 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.488+0000 7f43bffff700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f43c00be2a0 0x7f43c00bbe80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:42010/0 (socket says 172.21.15.110:42010) 2021-03-25T14:17:00.497 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.488+0000 7f43bffff700 1 -- 172.21.15.110:0/355024587 learned_addr learned my addr 172.21.15.110:0/355024587 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:00.497 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.488+0000 7f43c4db9700 1 --2- 172.21.15.110:0/355024587 >> v2:172.21.15.174:3300/0 conn(0x7f43c00bc590 0x7f43c01469f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:00.497 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.488+0000 7f43bf7fe700 1 --2- 172.21.15.110:0/355024587 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43c009cd40 0x7f43c00be680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:00.497 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.488+0000 7f43beffd700 1 -- 172.21.15.110:0/355024587 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1182421895 0 0) 0x7f43c0147a80 con 0x7f43c00be2a0 2021-03-25T14:17:00.497 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.488+0000 7f43beffd700 1 -- 172.21.15.110:0/355024587 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43ac003270 con 0x7f43c00be2a0 2021-03-25T14:17:00.497 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.488+0000 7f43beffd700 1 -- 172.21.15.110:0/355024587 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3018623959 0 0) 0x7f43ac003270 con 0x7f43c00be2a0 2021-03-25T14:17:00.497 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.488+0000 7f43beffd700 1 -- 172.21.15.110:0/355024587 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43c009cd40 msgr2=0x7f43c00be680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:00.497 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.488+0000 7f43beffd700 1 --2- 172.21.15.110:0/355024587 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43c009cd40 0x7f43c00be680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:00.497 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.488+0000 7f43beffd700 1 -- 172.21.15.110:0/355024587 >> v2:172.21.15.174:3300/0 conn(0x7f43c00bc590 msgr2=0x7f43c01469f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:00.498 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.488+0000 7f43beffd700 1 --2- 172.21.15.110:0/355024587 >> v2:172.21.15.174:3300/0 conn(0x7f43c00bc590 0x7f43c01469f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:00.498 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.488+0000 7f43beffd700 1 -- 172.21.15.110:0/355024587 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c0147d20 con 0x7f43c00be2a0 2021-03-25T14:17:00.498 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.488+0000 7f43beffd700 1 -- 172.21.15.110:0/355024587 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f43b0001520 con 0x7f43c00be2a0 2021-03-25T14:17:00.498 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.488+0000 7f43beffd700 1 -- 172.21.15.110:0/355024587 >> v1:172.21.15.110:6789/0 conn(0x7f43c00be2a0 legacy=0x7f43c00bbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:00.498 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.488+0000 7f43beffd700 1 --2- 172.21.15.110:0/355024587 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43ac003760 0x7f43ac003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:00.498 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.488+0000 7f43beffd700 1 --2- 172.21.15.110:0/355024587 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43c009cd40 0x7f43ac004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:00.498 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.489+0000 7f43beffd700 1 --2- 172.21.15.110:0/355024587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43ac004a00 0x7f43ac004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:00.498 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.489+0000 7f43beffd700 1 -- 172.21.15.110:0/355024587 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c00ba2c0 con 0x7f43ac004a00 2021-03-25T14:17:00.498 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.489+0000 7f43beffd700 1 -- 172.21.15.110:0/355024587 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac004200 con 0x7f43ac003760 2021-03-25T14:17:00.498 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.489+0000 7f43beffd700 1 -- 172.21.15.110:0/355024587 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac00b760 con 0x7f43c009cd40 2021-03-25T14:17:00.498 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.489+0000 7f43c4db9700 1 --2- 172.21.15.110:0/355024587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43ac004a00 0x7f43ac004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:00.498 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.489+0000 7f43bffff700 1 --2- 172.21.15.110:0/355024587 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43ac003760 0x7f43ac003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:00.499 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.489+0000 7f43bf7fe700 1 --2- 172.21.15.110:0/355024587 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43c009cd40 0x7f43ac004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:00.499 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.489+0000 7f43c4db9700 1 -- 172.21.15.110:0/355024587 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43c009cd40 msgr2=0x7f43ac004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:00.499 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.489+0000 7f43c4db9700 1 --2- 172.21.15.110:0/355024587 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43c009cd40 0x7f43ac004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:00.499 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.489+0000 7f43c4db9700 1 -- 172.21.15.110:0/355024587 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43ac003760 msgr2=0x7f43ac003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:00.499 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.489+0000 7f43c4db9700 1 --2- 172.21.15.110:0/355024587 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43ac003760 0x7f43ac003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:00.499 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.489+0000 7f43c4db9700 1 -- 172.21.15.110:0/355024587 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ac003270 con 0x7f43ac004a00 2021-03-25T14:17:00.499 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.489+0000 7f43c4db9700 1 --2- 172.21.15.110:0/355024587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43ac004a00 0x7f43ac004e80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f43b8009ed0 tx=0x7f43b8009220).ready entity=mon.0 client_cookie=115cb7af76cc3ab1 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:00.499 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.489+0000 7f43beffd700 1 -- 172.21.15.110:0/355024587 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b80095f0 con 0x7f43ac004a00 2021-03-25T14:17:00.499 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.489+0000 7f43beffd700 1 -- 172.21.15.110:0/355024587 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b800ec80 con 0x7f43ac004a00 2021-03-25T14:17:00.499 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.489+0000 7f43beffd700 1 -- 172.21.15.110:0/355024587 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b80123f0 con 0x7f43ac004a00 2021-03-25T14:17:00.499 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.490+0000 7f43c55ba700 1 -- 172.21.15.110:0/355024587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43ac004a00 msgr2=0x7f43ac004e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:00.499 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.490+0000 7f43c55ba700 1 --2- 172.21.15.110:0/355024587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43ac004a00 0x7f43ac004e80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f43b8009ed0 tx=0x7f43b8009220).stop 2021-03-25T14:17:00.500 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.490+0000 7f43c4db9700 1 -- 172.21.15.110:0/355024587 reap_dead start 2021-03-25T14:17:00.500 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.490+0000 7f43c55ba700 1 -- 172.21.15.110:0/355024587 shutdown_connections 2021-03-25T14:17:00.500 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.490+0000 7f43c55ba700 1 -- 172.21.15.110:0/355024587 >> 172.21.15.110:0/355024587 conn(0x7f43c0061710 msgr2=0x7f43c00bdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:00.500 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.490+0000 7f43c55ba700 1 -- 172.21.15.110:0/355024587 shutdown_connections 2021-03-25T14:17:00.500 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.490+0000 7f43c55ba700 1 -- 172.21.15.110:0/355024587 wait complete. 2021-03-25T14:17:00.500 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.491+0000 7f43c55ba700 1 Processor -- start 2021-03-25T14:17:00.500 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.491+0000 7f43c55ba700 1 -- start start 2021-03-25T14:17:00.500 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.491+0000 7f43c55ba700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43c01488d0 0x7f43c014b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:00.500 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.491+0000 7f43c55ba700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43c0141d00 0x7f43c0142180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:00.500 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.492+0000 7f43c55ba700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43c0063220 0x7f43c00636a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:00.500 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.492+0000 7f43c55ba700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c009fa00 con 0x7f43c01488d0 2021-03-25T14:17:00.501 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.492+0000 7f43c55ba700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c00644f0 con 0x7f43c0141d00 2021-03-25T14:17:00.501 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.492+0000 7f43c55ba700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c0064790 con 0x7f43c0063220 2021-03-25T14:17:00.501 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.492+0000 7f43bffff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43c01488d0 0x7f43c014b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:00.501 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.492+0000 7f43bffff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43c01488d0 0x7f43c014b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49086/0 (socket says 172.21.15.110:49086) 2021-03-25T14:17:00.501 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.492+0000 7f43bffff700 1 -- 172.21.15.110:0/3584723587 learned_addr learned my addr 172.21.15.110:0/3584723587 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:00.501 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.492+0000 7f43bf7fe700 1 --2- 172.21.15.110:0/3584723587 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43c0141d00 0x7f43c0142180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:00.501 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.492+0000 7f43c4db9700 1 --2- 172.21.15.110:0/3584723587 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43c0063220 0x7f43c00636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:00.501 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.492+0000 7f43bffff700 1 -- 172.21.15.110:0/3584723587 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43c0063220 msgr2=0x7f43c00636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:00.501 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.492+0000 7f43bffff700 1 --2- 172.21.15.110:0/3584723587 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43c0063220 0x7f43c00636a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:00.501 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.492+0000 7f43bffff700 1 -- 172.21.15.110:0/3584723587 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43c0141d00 msgr2=0x7f43c0142180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:00.501 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.492+0000 7f43bffff700 1 --2- 172.21.15.110:0/3584723587 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43c0141d00 0x7f43c0142180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:00.501 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.492+0000 7f43bffff700 1 -- 172.21.15.110:0/3584723587 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c0064a30 con 0x7f43c01488d0 2021-03-25T14:17:00.501 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.492+0000 7f43c4db9700 1 --2- 172.21.15.110:0/3584723587 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43c0063220 0x7f43c00636a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:00.502 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.492+0000 7f43bffff700 1 --2- 172.21.15.110:0/3584723587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43c01488d0 0x7f43c014b4c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f43b0000fd0 tx=0x7f43c00b3ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:00.502 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.492+0000 7f43a7fff700 1 -- 172.21.15.110:0/3584723587 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b000fa30 con 0x7f43c01488d0 2021-03-25T14:17:00.502 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.492+0000 7f43a7fff700 1 -- 172.21.15.110:0/3584723587 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b000fb90 con 0x7f43c01488d0 2021-03-25T14:17:00.502 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.492+0000 7f43c55ba700 1 -- 172.21.15.110:0/3584723587 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c0064cd0 con 0x7f43c01488d0 2021-03-25T14:17:00.502 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.492+0000 7f43a7fff700 1 -- 172.21.15.110:0/3584723587 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b0012350 con 0x7f43c01488d0 2021-03-25T14:17:00.502 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.492+0000 7f43c55ba700 1 -- 172.21.15.110:0/3584723587 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c00a01a0 con 0x7f43c01488d0 2021-03-25T14:17:00.502 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.493+0000 7f43c55ba700 1 -- 172.21.15.110:0/3584723587 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c0045ae0 con 0x7f43c01488d0 2021-03-25T14:17:00.502 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.493+0000 7f43a7fff700 1 -- 172.21.15.110:0/3584723587 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f43b00126c0 con 0x7f43c01488d0 2021-03-25T14:17:00.502 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.494+0000 7f43a7fff700 1 --2- 172.21.15.110:0/3584723587 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f43a005a0e0 0x7f43a005c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:00.502 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.494+0000 7f43a7fff700 1 -- 172.21.15.110:0/3584723587 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5606+0+0 (secure 0 0 0) 0x7f43b00734c0 con 0x7f43c01488d0 2021-03-25T14:17:00.502 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.494+0000 7f43bf7fe700 1 --2- 172.21.15.110:0/3584723587 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f43a005a0e0 0x7f43a005c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:00.502 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.494+0000 7f43bf7fe700 1 --2- 172.21.15.110:0/3584723587 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f43a005a0e0 0x7f43a005c5a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f43b4006ac0 tx=0x7f43b4006e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:00.503 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.498+0000 7f43a7fff700 1 -- 172.21.15.110:0/3584723587 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f43b0047030 con 0x7f43c01488d0 2021-03-25T14:17:00.701 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.699+0000 7f43c55ba700 1 -- 172.21.15.110:0/3584723587 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f43c0061c50 con 0x7f43c01488d0 2021-03-25T14:17:00.705 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.703+0000 7f43a7fff700 1 -- 172.21.15.110:0/3584723587 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 updated v6) v1 ==== 97+0+0 (secure 0 0 0) 0x7f43b0019030 con 0x7f43c01488d0 2021-03-25T14:17:00.707 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.705+0000 7f43c55ba700 1 -- 172.21.15.110:0/3584723587 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f43a005a0e0 msgr2=0x7f43a005c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:00.707 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.705+0000 7f43c55ba700 1 --2- 172.21.15.110:0/3584723587 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f43a005a0e0 0x7f43a005c5a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f43b4006ac0 tx=0x7f43b4006e20).stop 2021-03-25T14:17:00.707 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.705+0000 7f43c55ba700 1 -- 172.21.15.110:0/3584723587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43c01488d0 msgr2=0x7f43c014b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:00.707 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.705+0000 7f43c55ba700 1 --2- 172.21.15.110:0/3584723587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43c01488d0 0x7f43c014b4c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f43b0000fd0 tx=0x7f43c00b3ab0).stop 2021-03-25T14:17:00.707 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.705+0000 7f43c55ba700 1 -- 172.21.15.110:0/3584723587 shutdown_connections 2021-03-25T14:17:00.707 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.705+0000 7f43c55ba700 1 --2- 172.21.15.110:0/3584723587 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f43a005a0e0 0x7f43a005c5a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:00.708 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.705+0000 7f43c55ba700 1 --2- 172.21.15.110:0/3584723587 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43c0063220 0x7f43c00636a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:00.708 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.705+0000 7f43c55ba700 1 --2- 172.21.15.110:0/3584723587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43c01488d0 0x7f43c014b4c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:00.708 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.705+0000 7f43c55ba700 1 --2- 172.21.15.110:0/3584723587 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43c0141d00 0x7f43c0142180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:00.708 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.705+0000 7f43c55ba700 1 -- 172.21.15.110:0/3584723587 >> 172.21.15.110:0/3584723587 conn(0x7f43c0061710 msgr2=0x7f43c0145710 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:00.708 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.705+0000 7f43c55ba700 1 -- 172.21.15.110:0/3584723587 shutdown_connections 2021-03-25T14:17:00.708 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.705+0000 7f43c55ba700 1 -- 172.21.15.110:0/3584723587 wait complete. 2021-03-25T14:17:00.708 INFO:teuthology.orchestra.run.smithi110.stderr:updated 2021-03-25T14:17:00.718 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2021-03-25T14:17:00.830 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.828+0000 7f0048a8d700 1 Processor -- start 2021-03-25T14:17:00.830 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.828+0000 7f0048a8d700 1 -- start start 2021-03-25T14:17:00.832 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.828+0000 7f0048a8d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0044143980 0x7f004409d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:00.832 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.828+0000 7f0048a8d700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f004414d0e0 con 0x7f00440b9ba0 2021-03-25T14:17:00.832 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.828+0000 7f0048a8d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f004414d380 con 0x7f00440be5a0 2021-03-25T14:17:00.833 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.828+0000 7f0048a8d700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f004414d620 con 0x7f0044143980 2021-03-25T14:17:00.833 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.829+0000 7f0042d9d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0044143980 0x7f004409d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:00.833 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.829+0000 7f003bfff700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f00440b9ba0 0x7f0044149a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:42032/0 (socket says 172.21.15.110:42032) 2021-03-25T14:17:00.833 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.829+0000 7f0042d9d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0044143980 0x7f004409d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49098/0 (socket says 172.21.15.110:49098) 2021-03-25T14:17:00.833 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.829+0000 7f003bfff700 1 -- 172.21.15.110:0/1518413360 learned_addr learned my addr 172.21.15.110:0/1518413360 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:00.833 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.829+0000 7f0042d9d700 1 -- 172.21.15.110:0/1518413360 >> v1:172.21.15.174:6789/0 conn(0x7f00440be5a0 legacy=0x7f0044143270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:00.833 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.829+0000 7f0042d9d700 1 -- 172.21.15.110:0/1518413360 >> v1:172.21.15.110:6789/0 conn(0x7f00440b9ba0 legacy=0x7f0044149a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:00.833 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.829+0000 7f0042d9d700 1 -- 172.21.15.110:0/1518413360 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f004414d8c0 con 0x7f0044143980 2021-03-25T14:17:00.833 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.829+0000 7f0041d9b700 1 -- 172.21.15.110:0/1518413360 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3636231345 0 0) 0x7f004414d0e0 con 0x7f00440b9ba0 2021-03-25T14:17:00.833 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.829+0000 7f0042d9d700 1 --2- 172.21.15.110:0/1518413360 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0044143980 0x7f004409d2a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f003c009cc0 tx=0x7f003c009220).ready entity=mon.0 client_cookie=f89687b9e2fb3ae4 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:00.833 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.829+0000 7f0041d9b700 1 -- 172.21.15.110:0/1518413360 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c00bc40 con 0x7f0044143980 2021-03-25T14:17:00.833 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.829+0000 7f0041d9b700 1 -- 172.21.15.110:0/1518413360 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003c00bda0 con 0x7f0044143980 2021-03-25T14:17:00.834 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.829+0000 7f0041d9b700 1 -- 172.21.15.110:0/1518413360 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c011610 con 0x7f0044143980 2021-03-25T14:17:00.834 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.830+0000 7f0048a8d700 1 -- 172.21.15.110:0/1518413360 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0044143980 msgr2=0x7f004409d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:00.834 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.830+0000 7f0048a8d700 1 --2- 172.21.15.110:0/1518413360 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0044143980 0x7f004409d2a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f003c009cc0 tx=0x7f003c009220).stop 2021-03-25T14:17:00.834 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.830+0000 7f0048a8d700 1 -- 172.21.15.110:0/1518413360 shutdown_connections 2021-03-25T14:17:00.834 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.830+0000 7f0048a8d700 1 --2- 172.21.15.110:0/1518413360 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0044143980 0x7f004409d2a0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:00.834 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.830+0000 7f0048a8d700 1 -- 172.21.15.110:0/1518413360 >> 172.21.15.110:0/1518413360 conn(0x7f00440616d0 msgr2=0x7f00440bdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:00.834 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.830+0000 7f0048a8d700 1 -- 172.21.15.110:0/1518413360 shutdown_connections 2021-03-25T14:17:00.834 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.830+0000 7f0048a8d700 1 -- 172.21.15.110:0/1518413360 wait complete. 2021-03-25T14:17:00.834 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.831+0000 7f0048a8d700 1 Processor -- start 2021-03-25T14:17:00.834 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.831+0000 7f0048a8d700 1 -- start start 2021-03-25T14:17:00.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.831+0000 7f0048a8d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f00440b9ba0 0x7f00440a2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:00.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.831+0000 7f0048a8d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00440be5a0 0x7f0044159980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:00.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.831+0000 7f0048a8d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0044143980 0x7f0044148570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:00.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.831+0000 7f0048a8d700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0044159e70 con 0x7f0044143980 2021-03-25T14:17:00.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.831+0000 7f0048a8d700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00440b4d50 con 0x7f00440be5a0 2021-03-25T14:17:00.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.831+0000 7f0048a8d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00440a20e0 con 0x7f00440b9ba0 2021-03-25T14:17:00.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.831+0000 7f0042d9d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0044143980 0x7f0044148570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:00.838 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.832+0000 7f0042d9d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0044143980 0x7f0044148570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49104/0 (socket says 172.21.15.110:49104) 2021-03-25T14:17:00.838 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.832+0000 7f0042d9d700 1 -- 172.21.15.110:0/3809556856 learned_addr learned my addr 172.21.15.110:0/3809556856 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:00.838 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.832+0000 7f003bfff700 1 --2- 172.21.15.110:0/3809556856 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00440be5a0 0x7f0044159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:00.838 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.832+0000 7f004259c700 1 --2- 172.21.15.110:0/3809556856 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f00440b9ba0 0x7f00440a2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:00.838 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.832+0000 7f0042d9d700 1 -- 172.21.15.110:0/3809556856 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f00440b9ba0 msgr2=0x7f00440a2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:00.838 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.832+0000 7f0042d9d700 1 --2- 172.21.15.110:0/3809556856 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f00440b9ba0 0x7f00440a2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:00.838 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.832+0000 7f0042d9d700 1 -- 172.21.15.110:0/3809556856 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00440be5a0 msgr2=0x7f0044159980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:00.838 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.832+0000 7f0042d9d700 1 --2- 172.21.15.110:0/3809556856 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00440be5a0 0x7f0044159980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:00.838 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.832+0000 7f0042d9d700 1 -- 172.21.15.110:0/3809556856 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00440a2380 con 0x7f0044143980 2021-03-25T14:17:00.838 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.832+0000 7f0042d9d700 1 --2- 172.21.15.110:0/3809556856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0044143980 0x7f0044148570 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f003c0090b0 tx=0x7f003c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:00.838 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.832+0000 7f003a7fc700 1 -- 172.21.15.110:0/3809556856 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c009e00 con 0x7f0044143980 2021-03-25T14:17:00.838 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.832+0000 7f003a7fc700 1 -- 172.21.15.110:0/3809556856 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003c010aa0 con 0x7f0044143980 2021-03-25T14:17:00.839 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.832+0000 7f0048a8d700 1 -- 172.21.15.110:0/3809556856 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00440a2620 con 0x7f0044143980 2021-03-25T14:17:00.839 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.832+0000 7f003a7fc700 1 -- 172.21.15.110:0/3809556856 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c010e60 con 0x7f0044143980 2021-03-25T14:17:00.839 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.832+0000 7f0048a8d700 1 -- 172.21.15.110:0/3809556856 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00440b2ed0 con 0x7f0044143980 2021-03-25T14:17:00.839 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.833+0000 7f0048a8d700 1 -- 172.21.15.110:0/3809556856 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00440b3090 con 0x7f0044143980 2021-03-25T14:17:00.839 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.833+0000 7f003a7fc700 1 -- 172.21.15.110:0/3809556856 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f003c02a070 con 0x7f0044143980 2021-03-25T14:17:00.839 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.834+0000 7f003a7fc700 1 --2- 172.21.15.110:0/3809556856 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f002805a0b0 0x7f002805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:00.839 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.834+0000 7f003a7fc700 1 -- 172.21.15.110:0/3809556856 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5606+0+0 (secure 0 0 0) 0x7f003c075650 con 0x7f0044143980 2021-03-25T14:17:00.839 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.834+0000 7f004259c700 1 --2- 172.21.15.110:0/3809556856 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f002805a0b0 0x7f002805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:00.839 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.834+0000 7f004259c700 1 --2- 172.21.15.110:0/3809556856 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f002805a0b0 0x7f002805c570 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f0034003730 tx=0x7f0034007ba0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:00.840 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:00.838+0000 7f003a7fc700 1 -- 172.21.15.110:0/3809556856 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f003c0491c0 con 0x7f0044143980 2021-03-25T14:17:01.042 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.040+0000 7f0048a8d700 1 -- 172.21.15.110:0/3809556856 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f004414daa0 con 0x7f0044143980 2021-03-25T14:17:01.045 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.043+0000 7f003a7fc700 1 -- 172.21.15.110:0/3809556856 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 updated v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7f003c01f030 con 0x7f0044143980 2021-03-25T14:17:01.047 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.045+0000 7f0048a8d700 1 -- 172.21.15.110:0/3809556856 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f002805a0b0 msgr2=0x7f002805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:01.047 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.045+0000 7f0048a8d700 1 --2- 172.21.15.110:0/3809556856 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f002805a0b0 0x7f002805c570 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f0034003730 tx=0x7f0034007ba0).stop 2021-03-25T14:17:01.047 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.045+0000 7f0048a8d700 1 -- 172.21.15.110:0/3809556856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0044143980 msgr2=0x7f0044148570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:01.047 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.045+0000 7f0048a8d700 1 --2- 172.21.15.110:0/3809556856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0044143980 0x7f0044148570 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f003c0090b0 tx=0x7f003c017000).stop 2021-03-25T14:17:01.047 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.045+0000 7f0048a8d700 1 -- 172.21.15.110:0/3809556856 shutdown_connections 2021-03-25T14:17:01.047 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.045+0000 7f0048a8d700 1 --2- 172.21.15.110:0/3809556856 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f002805a0b0 0x7f002805c570 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:01.048 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.045+0000 7f0048a8d700 1 --2- 172.21.15.110:0/3809556856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0044143980 0x7f0044148570 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:01.048 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.045+0000 7f0048a8d700 1 --2- 172.21.15.110:0/3809556856 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f00440b9ba0 0x7f00440a2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:01.048 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.045+0000 7f0048a8d700 1 --2- 172.21.15.110:0/3809556856 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00440be5a0 0x7f0044159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:01.048 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.045+0000 7f0048a8d700 1 -- 172.21.15.110:0/3809556856 >> 172.21.15.110:0/3809556856 conn(0x7f00440616d0 msgr2=0x7f004414b610 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:01.048 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.045+0000 7f0048a8d700 1 -- 172.21.15.110:0/3809556856 shutdown_connections 2021-03-25T14:17:01.048 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.045+0000 7f0048a8d700 1 -- 172.21.15.110:0/3809556856 wait complete. 2021-03-25T14:17:01.048 INFO:teuthology.orchestra.run.smithi110.stderr:updated 2021-03-25T14:17:01.058 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2021-03-25T14:17:01.168 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.167+0000 7fc64500c700 1 Processor -- start 2021-03-25T14:17:01.169 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.167+0000 7fc64500c700 1 -- start start 2021-03-25T14:17:01.171 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.167+0000 7fc64500c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc640063250 0x7fc640068d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:01.171 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.167+0000 7fc64500c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc640146c80 0x7fc6401499b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:01.171 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.167+0000 7fc64500c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6400ba820 con 0x7fc64014cb90 2021-03-25T14:17:01.171 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.167+0000 7fc64500c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6401495c0 con 0x7fc640063250 2021-03-25T14:17:01.171 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.167+0000 7fc64500c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc64014d0a0 con 0x7fc640146c80 2021-03-25T14:17:01.172 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.168+0000 7fc64480b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc640146c80 0x7fc6401499b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:01.172 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.168+0000 7fc63ffff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc640063250 0x7fc640068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:01.172 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.168+0000 7fc64480b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc640146c80 0x7fc6401499b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.110:41512/0 (socket says 172.21.15.110:41512) 2021-03-25T14:17:01.172 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.168+0000 7fc63ffff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc640063250 0x7fc640068d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.110:47758/0 (socket says 172.21.15.110:47758) 2021-03-25T14:17:01.172 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.168+0000 7fc64480b700 1 -- 172.21.15.110:0/14437928 learned_addr learned my addr 172.21.15.110:0/14437928 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:01.172 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.168+0000 7fc63f7fe700 1 --1- 172.21.15.110:0/14437928 >> v1:172.21.15.174:6789/0 conn(0x7fc64014cb90 0x7fc640146570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.110:49712/0 (socket says 172.21.15.110:49712) 2021-03-25T14:17:01.172 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.168+0000 7fc64480b700 1 -- 172.21.15.110:0/14437928 >> v2:172.21.15.174:3300/0 conn(0x7fc640063250 msgr2=0x7fc640068d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:01.172 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.168+0000 7fc64480b700 1 --2- 172.21.15.110:0/14437928 >> v2:172.21.15.174:3300/0 conn(0x7fc640063250 0x7fc640068d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:01.172 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.168+0000 7fc64480b700 1 -- 172.21.15.110:0/14437928 >> v1:172.21.15.174:6789/0 conn(0x7fc64014cb90 legacy=0x7fc640146570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:01.172 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.168+0000 7fc64480b700 1 -- 172.21.15.110:0/14437928 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64014d340 con 0x7fc640146c80 2021-03-25T14:17:01.173 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.168+0000 7fc63ffff700 1 --2- 172.21.15.110:0/14437928 >> v2:172.21.15.174:3300/0 conn(0x7fc640063250 0x7fc640068d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:17:01.173 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.168+0000 7fc64480b700 1 --2- 172.21.15.110:0/14437928 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc640146c80 0x7fc6401499b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fc638009d90 tx=0x7fc6380092d0).ready entity=mon.2 client_cookie=37ac3a7039b1326d server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:01.173 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.168+0000 7fc63effd700 1 -- 172.21.15.110:0/14437928 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63800bc80 con 0x7fc640146c80 2021-03-25T14:17:01.173 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.168+0000 7fc63effd700 1 -- 172.21.15.110:0/14437928 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63800bde0 con 0x7fc640146c80 2021-03-25T14:17:01.173 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.168+0000 7fc63effd700 1 -- 172.21.15.110:0/14437928 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc638011610 con 0x7fc640146c80 2021-03-25T14:17:01.173 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.169+0000 7fc64500c700 1 -- 172.21.15.110:0/14437928 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc640146c80 msgr2=0x7fc6401499b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:01.173 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.169+0000 7fc64500c700 1 --2- 172.21.15.110:0/14437928 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc640146c80 0x7fc6401499b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fc638009d90 tx=0x7fc6380092d0).stop 2021-03-25T14:17:01.173 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.169+0000 7fc64500c700 1 -- 172.21.15.110:0/14437928 shutdown_connections 2021-03-25T14:17:01.173 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.169+0000 7fc64500c700 1 --2- 172.21.15.110:0/14437928 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc640146c80 0x7fc6401499b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:01.173 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.169+0000 7fc64500c700 1 --2- 172.21.15.110:0/14437928 >> v2:172.21.15.174:3300/0 conn(0x7fc640063250 0x7fc640068d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:01.173 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.169+0000 7fc64500c700 1 -- 172.21.15.110:0/14437928 >> 172.21.15.110:0/14437928 conn(0x7fc640064900 msgr2=0x7fc6400663e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:01.173 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.169+0000 7fc64500c700 1 -- 172.21.15.110:0/14437928 shutdown_connections 2021-03-25T14:17:01.173 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.169+0000 7fc64500c700 1 -- 172.21.15.110:0/14437928 wait complete. 2021-03-25T14:17:01.176 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.170+0000 7fc64500c700 1 Processor -- start 2021-03-25T14:17:01.176 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.170+0000 7fc64500c700 1 -- start start 2021-03-25T14:17:01.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.172+0000 7fc64500c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc640063250 0x7fc6400bec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:01.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.172+0000 7fc64500c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc640146c80 0x7fc6400b7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:01.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.172+0000 7fc64500c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc64014cb90 0x7fc640147060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:01.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.172+0000 7fc64500c700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6401588e0 con 0x7fc640146c80 2021-03-25T14:17:01.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.172+0000 7fc64500c700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6400b7b20 con 0x7fc640063250 2021-03-25T14:17:01.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.172+0000 7fc64500c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc640147550 con 0x7fc64014cb90 2021-03-25T14:17:01.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.172+0000 7fc63f7fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc640146c80 0x7fc6400b7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:01.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.172+0000 7fc63f7fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc640146c80 0x7fc6400b7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49116/0 (socket says 172.21.15.110:49116) 2021-03-25T14:17:01.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.172+0000 7fc63f7fe700 1 -- 172.21.15.110:0/3183995342 learned_addr learned my addr 172.21.15.110:0/3183995342 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:01.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.172+0000 7fc63ffff700 1 --2- 172.21.15.110:0/3183995342 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc640063250 0x7fc6400bec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:01.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.172+0000 7fc64480b700 1 --2- 172.21.15.110:0/3183995342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc64014cb90 0x7fc640147060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:01.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.172+0000 7fc63f7fe700 1 -- 172.21.15.110:0/3183995342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc64014cb90 msgr2=0x7fc640147060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:01.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.172+0000 7fc63f7fe700 1 --2- 172.21.15.110:0/3183995342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc64014cb90 0x7fc640147060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:01.178 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.172+0000 7fc63f7fe700 1 -- 172.21.15.110:0/3183995342 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc640063250 msgr2=0x7fc6400bec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:01.178 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.172+0000 7fc63f7fe700 1 --2- 172.21.15.110:0/3183995342 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc640063250 0x7fc6400bec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:01.178 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.172+0000 7fc63f7fe700 1 -- 172.21.15.110:0/3183995342 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6400b7d40 con 0x7fc640146c80 2021-03-25T14:17:01.178 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.172+0000 7fc64480b700 1 --2- 172.21.15.110:0/3183995342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc64014cb90 0x7fc640147060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:01.178 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.172+0000 7fc63ffff700 1 --2- 172.21.15.110:0/3183995342 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc640063250 0x7fc6400bec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:01.178 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.172+0000 7fc63f7fe700 1 --2- 172.21.15.110:0/3183995342 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc640146c80 0x7fc6400b7630 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7fc63000c740 tx=0x7fc630007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:01.178 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.172+0000 7fc637fff700 1 -- 172.21.15.110:0/3183995342 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc630007320 con 0x7fc640146c80 2021-03-25T14:17:01.178 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.172+0000 7fc64500c700 1 -- 172.21.15.110:0/3183995342 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6400b7fe0 con 0x7fc640146c80 2021-03-25T14:17:01.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.172+0000 7fc64500c700 1 -- 172.21.15.110:0/3183995342 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc640158d70 con 0x7fc640146c80 2021-03-25T14:17:01.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.172+0000 7fc637fff700 1 -- 172.21.15.110:0/3183995342 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc630005770 con 0x7fc640146c80 2021-03-25T14:17:01.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.172+0000 7fc637fff700 1 -- 172.21.15.110:0/3183995342 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6300058e0 con 0x7fc640146c80 2021-03-25T14:17:01.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.173+0000 7fc64500c700 1 -- 172.21.15.110:0/3183995342 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6400b8170 con 0x7fc640146c80 2021-03-25T14:17:01.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.173+0000 7fc637fff700 1 -- 172.21.15.110:0/3183995342 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fc630010030 con 0x7fc640146c80 2021-03-25T14:17:01.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.173+0000 7fc637fff700 1 --2- 172.21.15.110:0/3183995342 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc62405a0e0 0x7fc62405c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:01.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.173+0000 7fc637fff700 1 -- 172.21.15.110:0/3183995342 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5606+0+0 (secure 0 0 0) 0x7fc630073810 con 0x7fc640146c80 2021-03-25T14:17:01.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.173+0000 7fc63ffff700 1 --2- 172.21.15.110:0/3183995342 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc62405a0e0 0x7fc62405c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:01.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.174+0000 7fc63ffff700 1 --2- 172.21.15.110:0/3183995342 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc62405a0e0 0x7fc62405c5a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fc62800bda0 tx=0x7fc628008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:01.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.178+0000 7fc637fff700 1 -- 172.21.15.110:0/3183995342 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fc630047380 con 0x7fc640146c80 2021-03-25T14:17:01.383 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.381+0000 7fc64500c700 1 -- 172.21.15.110:0/3183995342 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fc64005d070 con 0x7fc640146c80 2021-03-25T14:17:01.386 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.384+0000 7fc637fff700 1 -- 172.21.15.110:0/3183995342 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 updated v8) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc63004a9a0 con 0x7fc640146c80 2021-03-25T14:17:01.389 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.386+0000 7fc64500c700 1 -- 172.21.15.110:0/3183995342 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc62405a0e0 msgr2=0x7fc62405c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:01.389 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.386+0000 7fc64500c700 1 --2- 172.21.15.110:0/3183995342 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc62405a0e0 0x7fc62405c5a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fc62800bda0 tx=0x7fc628008040).stop 2021-03-25T14:17:01.389 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.386+0000 7fc64500c700 1 -- 172.21.15.110:0/3183995342 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc640146c80 msgr2=0x7fc6400b7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:01.389 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.386+0000 7fc64500c700 1 --2- 172.21.15.110:0/3183995342 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc640146c80 0x7fc6400b7630 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7fc63000c740 tx=0x7fc630007c40).stop 2021-03-25T14:17:01.389 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.386+0000 7fc64500c700 1 -- 172.21.15.110:0/3183995342 shutdown_connections 2021-03-25T14:17:01.389 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.386+0000 7fc64500c700 1 --2- 172.21.15.110:0/3183995342 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc62405a0e0 0x7fc62405c5a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:01.389 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.386+0000 7fc64500c700 1 --2- 172.21.15.110:0/3183995342 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc640063250 0x7fc6400bec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:01.389 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.386+0000 7fc64500c700 1 --2- 172.21.15.110:0/3183995342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc64014cb90 0x7fc640147060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:01.389 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.386+0000 7fc64500c700 1 --2- 172.21.15.110:0/3183995342 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc640146c80 0x7fc6400b7630 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:01.389 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.386+0000 7fc64500c700 1 -- 172.21.15.110:0/3183995342 >> 172.21.15.110:0/3183995342 conn(0x7fc640064900 msgr2=0x7fc6400670e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:01.390 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.386+0000 7fc64500c700 1 -- 172.21.15.110:0/3183995342 shutdown_connections 2021-03-25T14:17:01.390 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.386+0000 7fc64500c700 1 -- 172.21.15.110:0/3183995342 wait complete. 2021-03-25T14:17:01.390 INFO:teuthology.orchestra.run.smithi110.stderr:updated 2021-03-25T14:17:01.400 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:17:01.509 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.508+0000 7fb8af305700 1 Processor -- start 2021-03-25T14:17:01.509 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.508+0000 7fb8af305700 1 -- start start 2021-03-25T14:17:01.512 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.508+0000 7fb8af305700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb8a80b1340 0x7fb8a80b1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:01.512 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.508+0000 7fb8af305700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb8a80668d0 0x7fb8a814cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:01.512 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.508+0000 7fb8af305700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8a8067510 con 0x7fb8a8066420 2021-03-25T14:17:01.512 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.508+0000 7fb8af305700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8a80677b0 con 0x7fb8a80668d0 2021-03-25T14:17:01.512 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.508+0000 7fb8af305700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8a8067a50 con 0x7fb8a80b1340 2021-03-25T14:17:01.513 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.508+0000 7fb8ad8a2700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb8a80668d0 0x7fb8a814cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:01.513 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.508+0000 7fb8ac8a0700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fb8a8066420 0x7fb8a8149cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:42062/0 (socket says 172.21.15.110:42062) 2021-03-25T14:17:01.513 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.508+0000 7fb8ad8a2700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb8a80668d0 0x7fb8a814cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49124/0 (socket says 172.21.15.110:49124) 2021-03-25T14:17:01.513 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.508+0000 7fb8ac8a0700 1 -- 172.21.15.110:0/3584227548 learned_addr learned my addr 172.21.15.110:0/3584227548 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:01.513 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.508+0000 7fb8ad0a1700 1 --2- 172.21.15.110:0/3584227548 >> v2:172.21.15.174:3300/0 conn(0x7fb8a80b1340 0x7fb8a80b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:01.513 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.509+0000 7fb8ad8a2700 1 -- 172.21.15.110:0/3584227548 >> v2:172.21.15.174:3300/0 conn(0x7fb8a80b1340 msgr2=0x7fb8a80b1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:01.513 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.509+0000 7fb8ad8a2700 1 --2- 172.21.15.110:0/3584227548 >> v2:172.21.15.174:3300/0 conn(0x7fb8a80b1340 0x7fb8a80b1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:01.513 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.509+0000 7fb8ad8a2700 1 -- 172.21.15.110:0/3584227548 >> v1:172.21.15.110:6789/0 conn(0x7fb8a8066420 legacy=0x7fb8a8149cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:01.513 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.509+0000 7fb8ad8a2700 1 -- 172.21.15.110:0/3584227548 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a8067cf0 con 0x7fb8a80668d0 2021-03-25T14:17:01.513 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.509+0000 7fb897fff700 1 -- 172.21.15.110:0/3584227548 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3394943893 0 0) 0x7fb8a8067510 con 0x7fb8a8066420 2021-03-25T14:17:01.513 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.509+0000 7fb8ad8a2700 1 --2- 172.21.15.110:0/3584227548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8a80668d0 0x7fb8a814cee0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7fb8a0009cc0 tx=0x7fb8a0009220).ready entity=mon.0 client_cookie=726143e0d5ddce8 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:01.513 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.509+0000 7fb897fff700 1 -- 172.21.15.110:0/3584227548 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a000bc40 con 0x7fb8a80668d0 2021-03-25T14:17:01.513 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.509+0000 7fb897fff700 1 -- 172.21.15.110:0/3584227548 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a000bda0 con 0x7fb8a80668d0 2021-03-25T14:17:01.514 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.509+0000 7fb897fff700 1 -- 172.21.15.110:0/3584227548 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a0011610 con 0x7fb8a80668d0 2021-03-25T14:17:01.514 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.509+0000 7fb8af305700 1 -- 172.21.15.110:0/3584227548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8a80668d0 msgr2=0x7fb8a814cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:01.514 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.509+0000 7fb8af305700 1 --2- 172.21.15.110:0/3584227548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8a80668d0 0x7fb8a814cee0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7fb8a0009cc0 tx=0x7fb8a0009220).stop 2021-03-25T14:17:01.514 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.509+0000 7fb8af305700 1 -- 172.21.15.110:0/3584227548 shutdown_connections 2021-03-25T14:17:01.514 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.509+0000 7fb8af305700 1 --2- 172.21.15.110:0/3584227548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8a80668d0 0x7fb8a814cee0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:01.514 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.509+0000 7fb8af305700 1 --2- 172.21.15.110:0/3584227548 >> v2:172.21.15.174:3300/0 conn(0x7fb8a80b1340 0x7fb8a80b1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:01.514 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.509+0000 7fb8af305700 1 -- 172.21.15.110:0/3584227548 >> 172.21.15.110:0/3584227548 conn(0x7fb8a80649a0 msgr2=0x7fb8a805c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:01.514 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.509+0000 7fb8af305700 1 -- 172.21.15.110:0/3584227548 shutdown_connections 2021-03-25T14:17:01.514 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.509+0000 7fb8af305700 1 -- 172.21.15.110:0/3584227548 wait complete. 2021-03-25T14:17:01.514 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.510+0000 7fb8af305700 1 Processor -- start 2021-03-25T14:17:01.514 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.510+0000 7fb8af305700 1 -- start start 2021-03-25T14:17:01.517 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.511+0000 7fb8af305700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8a8066420 0x7fb8a80bf310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:01.517 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.511+0000 7fb8af305700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8a80668d0 0x7fb8a815bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:01.517 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.511+0000 7fb8af305700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8a80b1340 0x7fb8a815c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:01.517 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.511+0000 7fb8af305700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a81453b0 con 0x7fb8a8066420 2021-03-25T14:17:01.517 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.511+0000 7fb8af305700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a81455a0 con 0x7fb8a80b1340 2021-03-25T14:17:01.517 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.511+0000 7fb8af305700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a8143b20 con 0x7fb8a80668d0 2021-03-25T14:17:01.517 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.511+0000 7fb8ad0a1700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8a8066420 0x7fb8a80bf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:01.518 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.511+0000 7fb8ad0a1700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8a8066420 0x7fb8a80bf310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49128/0 (socket says 172.21.15.110:49128) 2021-03-25T14:17:01.518 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.511+0000 7fb8ad0a1700 1 -- 172.21.15.110:0/404222678 learned_addr learned my addr 172.21.15.110:0/404222678 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:01.518 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.512+0000 7fb8ad8a2700 1 --2- 172.21.15.110:0/404222678 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8a80b1340 0x7fb8a815c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:01.518 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.512+0000 7fb8ac8a0700 1 --2- 172.21.15.110:0/404222678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8a80668d0 0x7fb8a815bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:01.518 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.512+0000 7fb8ad0a1700 1 -- 172.21.15.110:0/404222678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8a80668d0 msgr2=0x7fb8a815bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:01.518 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.512+0000 7fb8ad0a1700 1 --2- 172.21.15.110:0/404222678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8a80668d0 0x7fb8a815bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:01.518 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.512+0000 7fb8ad0a1700 1 -- 172.21.15.110:0/404222678 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8a80b1340 msgr2=0x7fb8a815c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:01.518 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.512+0000 7fb8ad0a1700 1 --2- 172.21.15.110:0/404222678 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8a80b1340 0x7fb8a815c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:01.518 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.512+0000 7fb8ad0a1700 1 -- 172.21.15.110:0/404222678 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a8143dc0 con 0x7fb8a8066420 2021-03-25T14:17:01.518 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.512+0000 7fb8ad8a2700 1 --2- 172.21.15.110:0/404222678 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8a80b1340 0x7fb8a815c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:17:01.518 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.512+0000 7fb8ac8a0700 1 --2- 172.21.15.110:0/404222678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8a80668d0 0x7fb8a815bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:17:01.518 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.512+0000 7fb8ad0a1700 1 --2- 172.21.15.110:0/404222678 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8a8066420 0x7fb8a80bf310 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7fb8a400bfd0 tx=0x7fb8a4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:01.518 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.512+0000 7fb8957fa700 1 -- 172.21.15.110:0/404222678 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a400de10 con 0x7fb8a8066420 2021-03-25T14:17:01.519 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.512+0000 7fb8957fa700 1 -- 172.21.15.110:0/404222678 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a40097c0 con 0x7fb8a8066420 2021-03-25T14:17:01.519 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.512+0000 7fb8af305700 1 -- 172.21.15.110:0/404222678 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a8144060 con 0x7fb8a8066420 2021-03-25T14:17:01.519 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.512+0000 7fb8957fa700 1 -- 172.21.15.110:0/404222678 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4009b40 con 0x7fb8a8066420 2021-03-25T14:17:01.519 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.512+0000 7fb8af305700 1 -- 172.21.15.110:0/404222678 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a81476b0 con 0x7fb8a8066420 2021-03-25T14:17:01.519 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.513+0000 7fb8af305700 1 -- 172.21.15.110:0/404222678 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8a81459c0 con 0x7fb8a8066420 2021-03-25T14:17:01.519 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.513+0000 7fb8957fa700 1 -- 172.21.15.110:0/404222678 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fb8a4013480 con 0x7fb8a8066420 2021-03-25T14:17:01.519 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.513+0000 7fb8957fa700 1 --2- 172.21.15.110:0/404222678 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb88805a0e0 0x7fb88805c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:01.519 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.513+0000 7fb8957fa700 1 -- 172.21.15.110:0/404222678 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5606+0+0 (secure 0 0 0) 0x7fb8a4073d90 con 0x7fb8a8066420 2021-03-25T14:17:01.519 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.513+0000 7fb8ac8a0700 1 --2- 172.21.15.110:0/404222678 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb88805a0e0 0x7fb88805c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:01.519 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.514+0000 7fb8ac8a0700 1 --2- 172.21.15.110:0/404222678 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb88805a0e0 0x7fb88805c5a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fb8a8143410 tx=0x7fb898009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:01.520 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.518+0000 7fb8957fa700 1 -- 172.21.15.110:0/404222678 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fb8a40478a0 con 0x7fb8a8066420 2021-03-25T14:17:01.668 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.666+0000 7fb8af305700 1 -- 172.21.15.110:0/404222678 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8a80bf8c0 con 0x7fb8a8066420 2021-03-25T14:17:01.669 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.667+0000 7fb8957fa700 1 -- 172.21.15.110:0/404222678 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+13958 (secure 0 0 0) 0x7fb8a404aec0 con 0x7fb8a8066420 2021-03-25T14:17:01.669 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:01.669 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":31,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:16:58.974492+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:17:01.671 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.668+0000 7fb8af305700 1 -- 172.21.15.110:0/404222678 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb88805a0e0 msgr2=0x7fb88805c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:01.671 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.668+0000 7fb8af305700 1 --2- 172.21.15.110:0/404222678 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb88805a0e0 0x7fb88805c5a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fb8a8143410 tx=0x7fb898009040).stop 2021-03-25T14:17:01.671 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.669+0000 7fb8af305700 1 -- 172.21.15.110:0/404222678 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8a8066420 msgr2=0x7fb8a80bf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:01.671 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.669+0000 7fb8af305700 1 --2- 172.21.15.110:0/404222678 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8a8066420 0x7fb8a80bf310 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7fb8a400bfd0 tx=0x7fb8a4008040).stop 2021-03-25T14:17:01.671 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.669+0000 7fb8af305700 1 -- 172.21.15.110:0/404222678 shutdown_connections 2021-03-25T14:17:01.671 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.669+0000 7fb8af305700 1 --2- 172.21.15.110:0/404222678 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb88805a0e0 0x7fb88805c5a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:01.671 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.669+0000 7fb8af305700 1 --2- 172.21.15.110:0/404222678 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8a80b1340 0x7fb8a815c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:01.671 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.669+0000 7fb8af305700 1 --2- 172.21.15.110:0/404222678 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8a8066420 0x7fb8a80bf310 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:01.671 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.669+0000 7fb8af305700 1 --2- 172.21.15.110:0/404222678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8a80668d0 0x7fb8a815bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:01.672 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.669+0000 7fb8af305700 1 -- 172.21.15.110:0/404222678 >> 172.21.15.110:0/404222678 conn(0x7fb8a80649a0 msgr2=0x7fb8a814c160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:01.672 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.669+0000 7fb8af305700 1 -- 172.21.15.110:0/404222678 shutdown_connections 2021-03-25T14:17:01.672 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.669+0000 7fb8af305700 1 -- 172.21.15.110:0/404222678 wait complete. 2021-03-25T14:17:01.682 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-03-25T14:15:59.047299+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-03-25T14:16:00.537926+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-03-25T14:17:01.682 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-03-25T14:17:01.795 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.793+0000 7f8e532b5700 1 Processor -- start 2021-03-25T14:17:01.795 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.793+0000 7f8e532b5700 1 -- start start 2021-03-25T14:17:01.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.794+0000 7f8e532b5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e4c068440 0x7f8e4c0a2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:01.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.794+0000 7f8e532b5700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e4c14de90 con 0x7f8e4c14da00 2021-03-25T14:17:01.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.794+0000 7f8e532b5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e4c0b6c90 con 0x7f8e4c060e00 2021-03-25T14:17:01.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.794+0000 7f8e532b5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c14a080 con 0x7f8e4c068440 2021-03-25T14:17:01.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.794+0000 7f8e51852700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f8e4c14da00 0x7f8e4c1434b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:42076/0 (socket says 172.21.15.110:42076) 2021-03-25T14:17:01.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.794+0000 7f8e51852700 1 -- 172.21.15.110:0/3434388255 learned_addr learned my addr 172.21.15.110:0/3434388255 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:01.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.794+0000 7f8e50850700 1 --2- 172.21.15.110:0/3434388255 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e4c068440 0x7f8e4c0a2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:01.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.794+0000 7f8e3bfff700 1 -- 172.21.15.110:0/3434388255 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4255680521 0 0) 0x7f8e4c14de90 con 0x7f8e4c14da00 2021-03-25T14:17:01.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.794+0000 7f8e3bfff700 1 -- 172.21.15.110:0/3434388255 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e34003270 con 0x7f8e4c14da00 2021-03-25T14:17:01.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.794+0000 7f8e3bfff700 1 -- 172.21.15.110:0/3434388255 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1801777002 0 0) 0x7f8e34003270 con 0x7f8e4c14da00 2021-03-25T14:17:01.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.794+0000 7f8e3bfff700 1 -- 172.21.15.110:0/3434388255 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e4c068440 msgr2=0x7f8e4c0a2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:01.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.794+0000 7f8e3bfff700 1 --2- 172.21.15.110:0/3434388255 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e4c068440 0x7f8e4c0a2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:01.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.794+0000 7f8e3bfff700 1 -- 172.21.15.110:0/3434388255 >> v1:172.21.15.174:6789/0 conn(0x7f8e4c060e00 legacy=0x7f8e4c149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:01.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.794+0000 7f8e3bfff700 1 -- 172.21.15.110:0/3434388255 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e4c068ca0 con 0x7f8e4c14da00 2021-03-25T14:17:01.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.794+0000 7f8e3bfff700 1 -- 172.21.15.110:0/3434388255 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f8e440018a0 con 0x7f8e4c14da00 2021-03-25T14:17:01.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.794+0000 7f8e3bfff700 1 -- 172.21.15.110:0/3434388255 >> v1:172.21.15.110:6789/0 conn(0x7f8e4c14da00 legacy=0x7f8e4c1434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:01.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.794+0000 7f8e3bfff700 1 --2- 172.21.15.110:0/3434388255 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e34003790 0x7f8e34003bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:01.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.794+0000 7f8e3bfff700 1 --2- 172.21.15.110:0/3434388255 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e4c068440 0x7f8e34004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:01.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.794+0000 7f8e3bfff700 1 --2- 172.21.15.110:0/3434388255 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e34004a00 0x7f8e34004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:01.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.794+0000 7f8e3bfff700 1 -- 172.21.15.110:0/3434388255 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c14a080 con 0x7f8e34004a00 2021-03-25T14:17:01.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.794+0000 7f8e3bfff700 1 -- 172.21.15.110:0/3434388255 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e34004230 con 0x7f8e34003790 2021-03-25T14:17:01.801 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.794+0000 7f8e3bfff700 1 -- 172.21.15.110:0/3434388255 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3400b760 con 0x7f8e4c068440 2021-03-25T14:17:01.801 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.795+0000 7f8e51852700 1 --2- 172.21.15.110:0/3434388255 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e34004a00 0x7f8e34004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:01.801 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.795+0000 7f8e50850700 1 --2- 172.21.15.110:0/3434388255 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e4c068440 0x7f8e34004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:01.801 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.795+0000 7f8e51051700 1 --2- 172.21.15.110:0/3434388255 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e34003790 0x7f8e34003bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:01.801 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.795+0000 7f8e51852700 1 -- 172.21.15.110:0/3434388255 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e4c068440 msgr2=0x7f8e34004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:01.801 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.795+0000 7f8e51852700 1 --2- 172.21.15.110:0/3434388255 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e4c068440 0x7f8e34004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:01.801 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.795+0000 7f8e51852700 1 -- 172.21.15.110:0/3434388255 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e34003790 msgr2=0x7f8e34003bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:01.801 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.795+0000 7f8e51852700 1 --2- 172.21.15.110:0/3434388255 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e34003790 0x7f8e34003bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:01.801 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.795+0000 7f8e51852700 1 -- 172.21.15.110:0/3434388255 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e34003270 con 0x7f8e34004a00 2021-03-25T14:17:01.801 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.795+0000 7f8e51852700 1 --2- 172.21.15.110:0/3434388255 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e34004a00 0x7f8e34004e80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f8e4400c840 tx=0x7f8e4c0b8060).ready entity=mon.0 client_cookie=f2e8df8861b74242 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:01.801 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.795+0000 7f8e3bfff700 1 -- 172.21.15.110:0/3434388255 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e44005bb0 con 0x7f8e34004a00 2021-03-25T14:17:01.801 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.795+0000 7f8e3bfff700 1 -- 172.21.15.110:0/3434388255 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e44005d10 con 0x7f8e34004a00 2021-03-25T14:17:01.802 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.795+0000 7f8e3bfff700 1 -- 172.21.15.110:0/3434388255 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e440072e0 con 0x7f8e34004a00 2021-03-25T14:17:01.802 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.796+0000 7f8e532b5700 1 -- 172.21.15.110:0/3434388255 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e34004a00 msgr2=0x7f8e34004e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:01.802 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.796+0000 7f8e532b5700 1 --2- 172.21.15.110:0/3434388255 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e34004a00 0x7f8e34004e80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f8e4400c840 tx=0x7f8e4c0b8060).stop 2021-03-25T14:17:01.802 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.796+0000 7f8e51852700 1 -- 172.21.15.110:0/3434388255 reap_dead start 2021-03-25T14:17:01.802 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.796+0000 7f8e532b5700 1 -- 172.21.15.110:0/3434388255 shutdown_connections 2021-03-25T14:17:01.802 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.796+0000 7f8e532b5700 1 -- 172.21.15.110:0/3434388255 >> 172.21.15.110:0/3434388255 conn(0x7f8e4c061d50 msgr2=0x7f8e4c062160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:01.802 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.796+0000 7f8e532b5700 1 -- 172.21.15.110:0/3434388255 shutdown_connections 2021-03-25T14:17:01.802 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.796+0000 7f8e532b5700 1 -- 172.21.15.110:0/3434388255 wait complete. 2021-03-25T14:17:01.802 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.797+0000 7f8e532b5700 1 Processor -- start 2021-03-25T14:17:01.802 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.797+0000 7f8e532b5700 1 -- start start 2021-03-25T14:17:01.805 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.797+0000 7f8e532b5700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e4c0a0fe0 0x7f8e4c159510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:01.805 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.797+0000 7f8e532b5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e4c0bd8e0 0x7f8e4c15c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:01.805 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.797+0000 7f8e532b5700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e4c159a00 0x7f8e4c15c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:01.806 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.798+0000 7f8e532b5700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c0a26b0 con 0x7f8e4c0a0fe0 2021-03-25T14:17:01.806 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.798+0000 7f8e532b5700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c0a2950 con 0x7f8e4c159a00 2021-03-25T14:17:01.806 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.798+0000 7f8e532b5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c159070 con 0x7f8e4c0bd8e0 2021-03-25T14:17:01.806 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.798+0000 7f8e51051700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e4c0a0fe0 0x7f8e4c159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:01.806 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.798+0000 7f8e51051700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e4c0a0fe0 0x7f8e4c159510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49148/0 (socket says 172.21.15.110:49148) 2021-03-25T14:17:01.806 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.798+0000 7f8e51051700 1 -- 172.21.15.110:0/3620832701 learned_addr learned my addr 172.21.15.110:0/3620832701 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:01.806 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.798+0000 7f8e50850700 1 --2- 172.21.15.110:0/3620832701 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e4c0bd8e0 0x7f8e4c15c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:01.806 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.798+0000 7f8e51051700 1 -- 172.21.15.110:0/3620832701 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e4c0bd8e0 msgr2=0x7f8e4c15c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:01.806 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.798+0000 7f8e51051700 1 --2- 172.21.15.110:0/3620832701 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e4c0bd8e0 0x7f8e4c15c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:01.806 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.798+0000 7f8e51852700 1 --2- 172.21.15.110:0/3620832701 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e4c159a00 0x7f8e4c15c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:01.806 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.798+0000 7f8e51051700 1 -- 172.21.15.110:0/3620832701 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e4c159a00 msgr2=0x7f8e4c15c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:01.806 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.798+0000 7f8e51051700 1 --2- 172.21.15.110:0/3620832701 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e4c159a00 0x7f8e4c15c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:01.807 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.798+0000 7f8e51051700 1 -- 172.21.15.110:0/3620832701 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e4c158d60 con 0x7f8e4c0a0fe0 2021-03-25T14:17:01.807 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.798+0000 7f8e51051700 1 --2- 172.21.15.110:0/3620832701 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e4c0a0fe0 0x7f8e4c159510 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f8e3c007b90 tx=0x7f8e3c007bc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:01.807 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.798+0000 7f8e397fa700 1 -- 172.21.15.110:0/3620832701 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c00f8d0 con 0x7f8e4c0a0fe0 2021-03-25T14:17:01.807 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.798+0000 7f8e397fa700 1 -- 172.21.15.110:0/3620832701 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3c00fa30 con 0x7f8e4c0a0fe0 2021-03-25T14:17:01.807 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.798+0000 7f8e532b5700 1 -- 172.21.15.110:0/3620832701 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e4c1499b0 con 0x7f8e4c0a0fe0 2021-03-25T14:17:01.807 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.798+0000 7f8e397fa700 1 -- 172.21.15.110:0/3620832701 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c00fdb0 con 0x7f8e4c0a0fe0 2021-03-25T14:17:01.807 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.798+0000 7f8e532b5700 1 -- 172.21.15.110:0/3620832701 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e4c0a1600 con 0x7f8e4c0a0fe0 2021-03-25T14:17:01.807 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.799+0000 7f8e532b5700 1 -- 172.21.15.110:0/3620832701 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e4c05d7b0 con 0x7f8e4c0a0fe0 2021-03-25T14:17:01.807 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.799+0000 7f8e397fa700 1 -- 172.21.15.110:0/3620832701 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f8e3c01b030 con 0x7f8e4c0a0fe0 2021-03-25T14:17:01.807 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.800+0000 7f8e397fa700 1 --2- 172.21.15.110:0/3620832701 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f8e2c05a0b0 0x7f8e2c05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:01.807 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.800+0000 7f8e397fa700 1 -- 172.21.15.110:0/3620832701 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5606+0+0 (secure 0 0 0) 0x7f8e3c073770 con 0x7f8e4c0a0fe0 2021-03-25T14:17:01.807 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.800+0000 7f8e50850700 1 --2- 172.21.15.110:0/3620832701 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f8e2c05a0b0 0x7f8e2c05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:01.808 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.800+0000 7f8e50850700 1 --2- 172.21.15.110:0/3620832701 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f8e2c05a0b0 0x7f8e2c05c570 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f8e48006ac0 tx=0x7f8e48008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:01.808 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.803+0000 7f8e397fa700 1 -- 172.21.15.110:0/3620832701 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f8e3c0472e0 con 0x7f8e4c0a0fe0 2021-03-25T14:17:01.956 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.955+0000 7f8e532b5700 1 -- 172.21.15.110:0/3620832701 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f8e4c0b6c90 con 0x7f8e4c0a0fe0 2021-03-25T14:17:01.956 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.955+0000 7f8e397fa700 1 -- 172.21.15.110:0/3620832701 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v31) v1 ==== 110+0+10 (secure 0 0 0) 0x7f8e4c0b6c90 con 0x7f8e4c0a0fe0 2021-03-25T14:17:01.956 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 1 2021-03-25T14:17:01.958 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.956+0000 7f8e532b5700 1 -- 172.21.15.110:0/3620832701 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f8e2c05a0b0 msgr2=0x7f8e2c05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:01.958 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.956+0000 7f8e532b5700 1 --2- 172.21.15.110:0/3620832701 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f8e2c05a0b0 0x7f8e2c05c570 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f8e48006ac0 tx=0x7f8e48008040).stop 2021-03-25T14:17:01.958 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.957+0000 7f8e532b5700 1 -- 172.21.15.110:0/3620832701 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e4c0a0fe0 msgr2=0x7f8e4c159510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:01.958 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.957+0000 7f8e532b5700 1 --2- 172.21.15.110:0/3620832701 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e4c0a0fe0 0x7f8e4c159510 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f8e3c007b90 tx=0x7f8e3c007bc0).stop 2021-03-25T14:17:01.958 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.957+0000 7f8e532b5700 1 -- 172.21.15.110:0/3620832701 shutdown_connections 2021-03-25T14:17:01.958 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.957+0000 7f8e532b5700 1 --2- 172.21.15.110:0/3620832701 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f8e2c05a0b0 0x7f8e2c05c570 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:01.958 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.957+0000 7f8e532b5700 1 --2- 172.21.15.110:0/3620832701 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e4c159a00 0x7f8e4c15c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:01.958 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.957+0000 7f8e532b5700 1 --2- 172.21.15.110:0/3620832701 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e4c0a0fe0 0x7f8e4c159510 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:01.958 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.957+0000 7f8e532b5700 1 --2- 172.21.15.110:0/3620832701 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e4c0bd8e0 0x7f8e4c15c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:01.959 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.957+0000 7f8e532b5700 1 -- 172.21.15.110:0/3620832701 >> 172.21.15.110:0/3620832701 conn(0x7f8e4c061d50 msgr2=0x7f8e4c14de50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:01.959 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.957+0000 7f8e532b5700 1 -- 172.21.15.110:0/3620832701 shutdown_connections 2021-03-25T14:17:01.959 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:01.957+0000 7f8e532b5700 1 -- 172.21.15.110:0/3620832701 wait complete. 2021-03-25T14:17:01.970 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-03-25T14:17:02.084 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.083+0000 7f167cda6700 1 Processor -- start 2021-03-25T14:17:02.084 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.083+0000 7f167cda6700 1 -- start start 2021-03-25T14:17:02.090 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.084+0000 7f167cda6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f16780b5d00 0x7f1678145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:02.090 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.084+0000 7f167cda6700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1678149c50 con 0x7f16780b0cc0 2021-03-25T14:17:02.090 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.084+0000 7f167cda6700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16781461b0 con 0x7f16780648a0 2021-03-25T14:17:02.090 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.084+0000 7f167cda6700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1678067960 con 0x7f16780b5d00 2021-03-25T14:17:02.090 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.084+0000 7f167659c700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f16780b0cc0 0x7f1678067250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:42092/0 (socket says 172.21.15.110:42092) 2021-03-25T14:17:02.090 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.084+0000 7f167659c700 1 -- 172.21.15.110:0/3785261208 learned_addr learned my addr 172.21.15.110:0/3785261208 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:02.090 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.084+0000 7f167559a700 1 -- 172.21.15.110:0/3785261208 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2687041333 0 0) 0x7f1678149c50 con 0x7f16780b0cc0 2021-03-25T14:17:02.090 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.084+0000 7f1675d9b700 1 --2- 172.21.15.110:0/3785261208 >> v2:172.21.15.174:3300/0 conn(0x7f16780b5d00 0x7f1678145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:02.090 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.084+0000 7f167559a700 1 -- 172.21.15.110:0/3785261208 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1658003270 con 0x7f16780b0cc0 2021-03-25T14:17:02.090 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.085+0000 7f167559a700 1 -- 172.21.15.110:0/3785261208 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3247222132 0 0) 0x7f1658003270 con 0x7f16780b0cc0 2021-03-25T14:17:02.091 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.085+0000 7f167559a700 1 -- 172.21.15.110:0/3785261208 >> v2:172.21.15.174:3300/0 conn(0x7f16780b5d00 msgr2=0x7f1678145cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:02.091 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.085+0000 7f167559a700 1 --2- 172.21.15.110:0/3785261208 >> v2:172.21.15.174:3300/0 conn(0x7f16780b5d00 0x7f1678145cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:02.091 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.085+0000 7f167559a700 1 -- 172.21.15.110:0/3785261208 >> v1:172.21.15.174:6789/0 conn(0x7f16780648a0 legacy=0x7f167809db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:02.091 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.085+0000 7f167559a700 1 -- 172.21.15.110:0/3785261208 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1678149e80 con 0x7f16780b0cc0 2021-03-25T14:17:02.091 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.085+0000 7f167559a700 1 -- 172.21.15.110:0/3785261208 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f16680018a0 con 0x7f16780b0cc0 2021-03-25T14:17:02.091 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.085+0000 7f167559a700 1 -- 172.21.15.110:0/3785261208 >> v1:172.21.15.110:6789/0 conn(0x7f16780b0cc0 legacy=0x7f1678067250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:02.091 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.085+0000 7f167559a700 1 --2- 172.21.15.110:0/3785261208 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1658003760 0x7f1658003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:02.091 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.085+0000 7f167559a700 1 --2- 172.21.15.110:0/3785261208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1658004510 0x7f1658004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:02.091 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.085+0000 7f167559a700 1 --2- 172.21.15.110:0/3785261208 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1658004e80 0x7f165800b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:02.091 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.085+0000 7f167559a700 1 -- 172.21.15.110:0/3785261208 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1678067960 con 0x7f1658004510 2021-03-25T14:17:02.091 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.085+0000 7f167559a700 1 -- 172.21.15.110:0/3785261208 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1658004290 con 0x7f1658004e80 2021-03-25T14:17:02.091 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.085+0000 7f167559a700 1 -- 172.21.15.110:0/3785261208 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f165800bc50 con 0x7f1658003760 2021-03-25T14:17:02.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.085+0000 7f1675d9b700 1 --2- 172.21.15.110:0/3785261208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1658004510 0x7f1658004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:02.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.085+0000 7f167659c700 1 --2- 172.21.15.110:0/3785261208 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1658003760 0x7f1658003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:02.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.085+0000 7f1676d9d700 1 --2- 172.21.15.110:0/3785261208 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1658004e80 0x7f165800b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:02.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.085+0000 7f1675d9b700 1 -- 172.21.15.110:0/3785261208 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1658003760 msgr2=0x7f1658003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:02.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.085+0000 7f1675d9b700 1 --2- 172.21.15.110:0/3785261208 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1658003760 0x7f1658003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:02.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.085+0000 7f1675d9b700 1 -- 172.21.15.110:0/3785261208 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1658004e80 msgr2=0x7f165800b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:02.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.085+0000 7f1675d9b700 1 --2- 172.21.15.110:0/3785261208 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1658004e80 0x7f165800b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:02.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.085+0000 7f1676d9d700 1 -- 172.21.15.110:0/3785261208 reap_dead start 2021-03-25T14:17:02.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.085+0000 7f1675d9b700 1 -- 172.21.15.110:0/3785261208 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1658003270 con 0x7f1658004510 2021-03-25T14:17:02.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.085+0000 7f1675d9b700 1 --2- 172.21.15.110:0/3785261208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1658004510 0x7f1658004990 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f166000cd10 tx=0x7f1660006eb0).ready entity=mon.0 client_cookie=d02a26b63e01b89f server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:02.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.085+0000 7f167559a700 1 -- 172.21.15.110:0/3785261208 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166000c440 con 0x7f1658004510 2021-03-25T14:17:02.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.085+0000 7f167559a700 1 -- 172.21.15.110:0/3785261208 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1660010d80 con 0x7f1658004510 2021-03-25T14:17:02.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.085+0000 7f167559a700 1 -- 172.21.15.110:0/3785261208 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1660013780 con 0x7f1658004510 2021-03-25T14:17:02.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.086+0000 7f167cda6700 1 -- 172.21.15.110:0/3785261208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1658004510 msgr2=0x7f1658004990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:02.093 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.086+0000 7f167cda6700 1 --2- 172.21.15.110:0/3785261208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1658004510 0x7f1658004990 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f166000cd10 tx=0x7f1660006eb0).stop 2021-03-25T14:17:02.093 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.086+0000 7f167cda6700 1 -- 172.21.15.110:0/3785261208 shutdown_connections 2021-03-25T14:17:02.093 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.086+0000 7f167cda6700 1 --2- 172.21.15.110:0/3785261208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1658004510 0x7f1658004990 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:02.093 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.086+0000 7f167cda6700 1 -- 172.21.15.110:0/3785261208 >> 172.21.15.110:0/3785261208 conn(0x7f16780664e0 msgr2=0x7f16780668f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:02.093 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.086+0000 7f167cda6700 1 -- 172.21.15.110:0/3785261208 shutdown_connections 2021-03-25T14:17:02.093 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.086+0000 7f167cda6700 1 -- 172.21.15.110:0/3785261208 wait complete. 2021-03-25T14:17:02.093 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.087+0000 7f167cda6700 1 Processor -- start 2021-03-25T14:17:02.093 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.087+0000 7f167cda6700 1 -- start start 2021-03-25T14:17:02.093 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.088+0000 7f167cda6700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1658004510 0x7f1678154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:02.093 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.088+0000 7f167cda6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16780b5530 0x7f16780a05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:02.094 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.088+0000 7f167cda6700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16780ba9a0 0x7f16780bae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:02.094 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.088+0000 7f167cda6700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167809eb30 con 0x7f1658004510 2021-03-25T14:17:02.094 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.088+0000 7f167cda6700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167808fb00 con 0x7f16780ba9a0 2021-03-25T14:17:02.094 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.088+0000 7f167cda6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f167808fda0 con 0x7f16780b5530 2021-03-25T14:17:02.094 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.088+0000 7f167659c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1658004510 0x7f1678154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:02.094 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.088+0000 7f167659c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1658004510 0x7f1678154d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49168/0 (socket says 172.21.15.110:49168) 2021-03-25T14:17:02.094 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.088+0000 7f167659c700 1 -- 172.21.15.110:0/1456212744 learned_addr learned my addr 172.21.15.110:0/1456212744 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:02.094 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.088+0000 7f167659c700 1 -- 172.21.15.110:0/1456212744 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16780b5530 msgr2=0x7f16780a05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:02.094 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.088+0000 7f167659c700 1 --2- 172.21.15.110:0/1456212744 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16780b5530 0x7f16780a05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:02.095 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.088+0000 7f167659c700 1 -- 172.21.15.110:0/1456212744 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16780ba9a0 msgr2=0x7f16780bae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:02.095 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.088+0000 7f167659c700 1 --2- 172.21.15.110:0/1456212744 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16780ba9a0 0x7f16780bae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:02.095 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.088+0000 7f167659c700 1 -- 172.21.15.110:0/1456212744 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1678090040 con 0x7f1658004510 2021-03-25T14:17:02.095 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.088+0000 7f167659c700 1 --2- 172.21.15.110:0/1456212744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1658004510 0x7f1678154d00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f1668001580 tx=0x7f167814a010).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:02.095 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.088+0000 7f166e7fc700 1 -- 172.21.15.110:0/1456212744 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166800cd80 con 0x7f1658004510 2021-03-25T14:17:02.095 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.088+0000 7f166e7fc700 1 -- 172.21.15.110:0/1456212744 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16680048b0 con 0x7f1658004510 2021-03-25T14:17:02.095 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.088+0000 7f167cda6700 1 -- 172.21.15.110:0/1456212744 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f167809ed90 con 0x7f1658004510 2021-03-25T14:17:02.095 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.088+0000 7f166e7fc700 1 -- 172.21.15.110:0/1456212744 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1668004c30 con 0x7f1658004510 2021-03-25T14:17:02.095 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.088+0000 7f167cda6700 1 -- 172.21.15.110:0/1456212744 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f167809f230 con 0x7f1658004510 2021-03-25T14:17:02.095 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.089+0000 7f167cda6700 1 -- 172.21.15.110:0/1456212744 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f167805e210 con 0x7f1658004510 2021-03-25T14:17:02.096 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.089+0000 7f166e7fc700 1 -- 172.21.15.110:0/1456212744 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f166801a020 con 0x7f1658004510 2021-03-25T14:17:02.096 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.090+0000 7f166e7fc700 1 --2- 172.21.15.110:0/1456212744 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f165c05a0b0 0x7f165c05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:02.096 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.090+0000 7f166e7fc700 1 -- 172.21.15.110:0/1456212744 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5606+0+0 (secure 0 0 0) 0x7f1668073a30 con 0x7f1658004510 2021-03-25T14:17:02.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.090+0000 7f1675d9b700 1 --2- 172.21.15.110:0/1456212744 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f165c05a0b0 0x7f165c05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:02.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.090+0000 7f1675d9b700 1 --2- 172.21.15.110:0/1456212744 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f165c05a0b0 0x7f165c05c570 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f1678144fe0 tx=0x7f166001d000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:02.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.093+0000 7f166e7fc700 1 -- 172.21.15.110:0/1456212744 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f16680475a0 con 0x7f1658004510 2021-03-25T14:17:02.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.243+0000 7f167cda6700 1 -- 172.21.15.110:0/1456212744 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f167805d7b0 con 0x7f1658004510 2021-03-25T14:17:02.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.244+0000 7f166e7fc700 1 -- 172.21.15.110:0/1456212744 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v33) v1 ==== 92+0+10 (secure 0 0 0) 0x7f166804abc0 con 0x7f1658004510 2021-03-25T14:17:02.245 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:17:02.247 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.245+0000 7f167cda6700 1 -- 172.21.15.110:0/1456212744 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f165c05a0b0 msgr2=0x7f165c05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:02.247 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.245+0000 7f167cda6700 1 --2- 172.21.15.110:0/1456212744 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f165c05a0b0 0x7f165c05c570 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f1678144fe0 tx=0x7f166001d000).stop 2021-03-25T14:17:02.247 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.245+0000 7f167cda6700 1 -- 172.21.15.110:0/1456212744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1658004510 msgr2=0x7f1678154d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:02.247 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.245+0000 7f167cda6700 1 --2- 172.21.15.110:0/1456212744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1658004510 0x7f1678154d00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f1668001580 tx=0x7f167814a010).stop 2021-03-25T14:17:02.247 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.245+0000 7f167cda6700 1 -- 172.21.15.110:0/1456212744 shutdown_connections 2021-03-25T14:17:02.247 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.245+0000 7f167cda6700 1 --2- 172.21.15.110:0/1456212744 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f165c05a0b0 0x7f165c05c570 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:02.247 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.245+0000 7f167cda6700 1 --2- 172.21.15.110:0/1456212744 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16780ba9a0 0x7f16780bae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:02.247 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.245+0000 7f167cda6700 1 --2- 172.21.15.110:0/1456212744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1658004510 0x7f1678154d00 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:02.248 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.245+0000 7f167cda6700 1 --2- 172.21.15.110:0/1456212744 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16780b5530 0x7f16780a05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:02.248 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.245+0000 7f167cda6700 1 -- 172.21.15.110:0/1456212744 >> 172.21.15.110:0/1456212744 conn(0x7f16780664e0 msgr2=0x7f16781464b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:02.248 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.245+0000 7f167cda6700 1 -- 172.21.15.110:0/1456212744 shutdown_connections 2021-03-25T14:17:02.248 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.245+0000 7f167cda6700 1 -- 172.21.15.110:0/1456212744 wait complete. 2021-03-25T14:17:02.258 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-03-25T14:17:02.368 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.367+0000 7f95b5695700 1 Processor -- start 2021-03-25T14:17:02.369 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.367+0000 7f95b5695700 1 -- start start 2021-03-25T14:17:02.374 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.368+0000 7f95b5695700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95b00b1720 0x7f95b0149cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:02.374 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.368+0000 7f95b5695700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b0067510 con 0x7f95b014a1e0 2021-03-25T14:17:02.375 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.368+0000 7f95b5695700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b00677b0 con 0x7f95b00b1340 2021-03-25T14:17:02.375 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.368+0000 7f95b5695700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b0067a50 con 0x7f95b00b1720 2021-03-25T14:17:02.375 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.368+0000 7f95af7fe700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f95b014a1e0 0x7f95b014cee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:42114/0 (socket says 172.21.15.110:42114) 2021-03-25T14:17:02.375 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.368+0000 7f95af7fe700 1 -- 172.21.15.110:0/2779178548 learned_addr learned my addr 172.21.15.110:0/2779178548 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:02.375 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.369+0000 7f95ae7fc700 1 --2- 172.21.15.110:0/2779178548 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95b00b1720 0x7f95b0149cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:02.375 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.369+0000 7f95adffb700 1 -- 172.21.15.110:0/2779178548 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4190117477 0 0) 0x7f95b0067510 con 0x7f95b014a1e0 2021-03-25T14:17:02.375 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.369+0000 7f95adffb700 1 -- 172.21.15.110:0/2779178548 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f959c003270 con 0x7f95b014a1e0 2021-03-25T14:17:02.375 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.369+0000 7f95adffb700 1 -- 172.21.15.110:0/2779178548 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3665361243 0 0) 0x7f959c003270 con 0x7f95b014a1e0 2021-03-25T14:17:02.375 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.369+0000 7f95adffb700 1 -- 172.21.15.110:0/2779178548 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95b00b1720 msgr2=0x7f95b0149cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:02.375 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.369+0000 7f95adffb700 1 --2- 172.21.15.110:0/2779178548 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95b00b1720 0x7f95b0149cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:02.375 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.369+0000 7f95adffb700 1 -- 172.21.15.110:0/2779178548 >> v1:172.21.15.174:6789/0 conn(0x7f95b00b1340 legacy=0x7f95b0066420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:02.375 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.369+0000 7f95adffb700 1 -- 172.21.15.110:0/2779178548 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b0067cf0 con 0x7f95b014a1e0 2021-03-25T14:17:02.375 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.369+0000 7f95adffb700 1 -- 172.21.15.110:0/2779178548 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f95a80018a0 con 0x7f95b014a1e0 2021-03-25T14:17:02.376 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.369+0000 7f95adffb700 1 -- 172.21.15.110:0/2779178548 >> v1:172.21.15.110:6789/0 conn(0x7f95b014a1e0 legacy=0x7f95b014cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:02.376 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.369+0000 7f95adffb700 1 --2- 172.21.15.110:0/2779178548 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95b00b1720 0x7f959c003790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:02.376 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.369+0000 7f95adffb700 1 --2- 172.21.15.110:0/2779178548 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f959c003ca0 0x7f959c004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:02.376 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.369+0000 7f95adffb700 1 --2- 172.21.15.110:0/2779178548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f959c004a00 0x7f959c004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:02.376 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.369+0000 7f95adffb700 1 -- 172.21.15.110:0/2779178548 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b0067a50 con 0x7f959c004a00 2021-03-25T14:17:02.376 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.369+0000 7f95adffb700 1 -- 172.21.15.110:0/2779178548 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959c004230 con 0x7f959c003ca0 2021-03-25T14:17:02.376 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.369+0000 7f95adffb700 1 -- 172.21.15.110:0/2779178548 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f959c00b760 con 0x7f95b00b1720 2021-03-25T14:17:02.376 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.369+0000 7f95af7fe700 1 --2- 172.21.15.110:0/2779178548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f959c004a00 0x7f959c004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:02.376 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.369+0000 7f95ae7fc700 1 --2- 172.21.15.110:0/2779178548 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f959c003ca0 0x7f959c004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:02.376 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.369+0000 7f95aeffd700 1 --2- 172.21.15.110:0/2779178548 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95b00b1720 0x7f959c003790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:02.376 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.369+0000 7f95af7fe700 1 -- 172.21.15.110:0/2779178548 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95b00b1720 msgr2=0x7f959c003790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:02.376 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.369+0000 7f95af7fe700 1 --2- 172.21.15.110:0/2779178548 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95b00b1720 0x7f959c003790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:02.376 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.369+0000 7f95af7fe700 1 -- 172.21.15.110:0/2779178548 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f959c003ca0 msgr2=0x7f959c004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:02.376 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.369+0000 7f95af7fe700 1 --2- 172.21.15.110:0/2779178548 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f959c003ca0 0x7f959c004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:02.377 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.370+0000 7f95af7fe700 1 -- 172.21.15.110:0/2779178548 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959c003270 con 0x7f959c004a00 2021-03-25T14:17:02.377 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.370+0000 7f95af7fe700 1 --2- 172.21.15.110:0/2779178548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f959c004a00 0x7f959c004e80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f95a800c840 tx=0x7f95b00676a0).ready entity=mon.0 client_cookie=48212cedd396177 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:02.377 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.370+0000 7f95adffb700 1 -- 172.21.15.110:0/2779178548 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a8005bb0 con 0x7f959c004a00 2021-03-25T14:17:02.377 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.370+0000 7f95adffb700 1 -- 172.21.15.110:0/2779178548 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a8005d10 con 0x7f959c004a00 2021-03-25T14:17:02.377 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.370+0000 7f95adffb700 1 -- 172.21.15.110:0/2779178548 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a80072e0 con 0x7f959c004a00 2021-03-25T14:17:02.377 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.370+0000 7f95b5695700 1 -- 172.21.15.110:0/2779178548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f959c004a00 msgr2=0x7f959c004e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:02.377 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.370+0000 7f95b5695700 1 --2- 172.21.15.110:0/2779178548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f959c004a00 0x7f959c004e80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f95a800c840 tx=0x7f95b00676a0).stop 2021-03-25T14:17:02.377 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.370+0000 7f95af7fe700 1 -- 172.21.15.110:0/2779178548 reap_dead start 2021-03-25T14:17:02.377 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.370+0000 7f95b5695700 1 -- 172.21.15.110:0/2779178548 shutdown_connections 2021-03-25T14:17:02.377 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.370+0000 7f95b5695700 1 -- 172.21.15.110:0/2779178548 >> 172.21.15.110:0/2779178548 conn(0x7f95b00649a0 msgr2=0x7f95b005c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:02.377 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.370+0000 7f95b5695700 1 -- 172.21.15.110:0/2779178548 shutdown_connections 2021-03-25T14:17:02.377 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.370+0000 7f95b5695700 1 -- 172.21.15.110:0/2779178548 wait complete. 2021-03-25T14:17:02.378 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.371+0000 7f95b5695700 1 Processor -- start 2021-03-25T14:17:02.378 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.372+0000 7f95b5695700 1 -- start start 2021-03-25T14:17:02.378 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.372+0000 7f95b5695700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95b00bdeb0 0x7f95b00be290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:02.378 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.372+0000 7f95b5695700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95b0144ed0 0x7f95b0145350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:02.378 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.372+0000 7f95b5695700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95b015c330 0x7f95b015c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:02.378 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.372+0000 7f95b5695700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b0158d60 con 0x7f95b015c330 2021-03-25T14:17:02.378 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.372+0000 7f95b5695700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b0147570 con 0x7f95b0144ed0 2021-03-25T14:17:02.378 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.372+0000 7f95b5695700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b0158f50 con 0x7f95b00bdeb0 2021-03-25T14:17:02.378 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.372+0000 7f95af7fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95b015c330 0x7f95b015c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:02.378 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.372+0000 7f95af7fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95b015c330 0x7f95b015c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49192/0 (socket says 172.21.15.110:49192) 2021-03-25T14:17:02.378 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.372+0000 7f95af7fe700 1 -- 172.21.15.110:0/2430523610 learned_addr learned my addr 172.21.15.110:0/2430523610 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:02.378 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.372+0000 7f95aeffd700 1 --2- 172.21.15.110:0/2430523610 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95b00bdeb0 0x7f95b00be290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:02.379 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.372+0000 7f95ae7fc700 1 --2- 172.21.15.110:0/2430523610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95b0144ed0 0x7f95b0145350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:02.379 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.373+0000 7f95af7fe700 1 -- 172.21.15.110:0/2430523610 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95b00bdeb0 msgr2=0x7f95b00be290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:02.379 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.373+0000 7f95af7fe700 1 --2- 172.21.15.110:0/2430523610 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95b00bdeb0 0x7f95b00be290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:02.379 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.373+0000 7f95af7fe700 1 -- 172.21.15.110:0/2430523610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95b0144ed0 msgr2=0x7f95b0145350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:02.379 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.373+0000 7f95af7fe700 1 --2- 172.21.15.110:0/2430523610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95b0144ed0 0x7f95b0145350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:02.379 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.373+0000 7f95af7fe700 1 -- 172.21.15.110:0/2430523610 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b0144790 con 0x7f95b015c330 2021-03-25T14:17:02.379 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.373+0000 7f95af7fe700 1 --2- 172.21.15.110:0/2430523610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95b015c330 0x7f95b015c790 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f95a800a000 tx=0x7f95a8013000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:02.379 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.373+0000 7f9596ffd700 1 -- 172.21.15.110:0/2430523610 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a801a070 con 0x7f95b015c330 2021-03-25T14:17:02.379 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.373+0000 7f9596ffd700 1 -- 172.21.15.110:0/2430523610 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a80152e0 con 0x7f95b015c330 2021-03-25T14:17:02.379 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.373+0000 7f95b5695700 1 -- 172.21.15.110:0/2430523610 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b0144a30 con 0x7f95b015c330 2021-03-25T14:17:02.379 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.373+0000 7f9596ffd700 1 -- 172.21.15.110:0/2430523610 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a8005bb0 con 0x7f95b015c330 2021-03-25T14:17:02.379 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.373+0000 7f95b5695700 1 -- 172.21.15.110:0/2430523610 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b013f7d0 con 0x7f95b015c330 2021-03-25T14:17:02.379 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.374+0000 7f95b5695700 1 -- 172.21.15.110:0/2430523610 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b0068b30 con 0x7f95b015c330 2021-03-25T14:17:02.380 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.374+0000 7f9596ffd700 1 -- 172.21.15.110:0/2430523610 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f95a8010070 con 0x7f95b015c330 2021-03-25T14:17:02.381 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.374+0000 7f9596ffd700 1 --2- 172.21.15.110:0/2430523610 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f959005a0b0 0x7f959005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:02.381 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.375+0000 7f9596ffd700 1 -- 172.21.15.110:0/2430523610 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5606+0+0 (secure 0 0 0) 0x7f95a8074340 con 0x7f95b015c330 2021-03-25T14:17:02.381 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.375+0000 7f95aeffd700 1 --2- 172.21.15.110:0/2430523610 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f959005a0b0 0x7f959005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:02.381 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.375+0000 7f95aeffd700 1 --2- 172.21.15.110:0/2430523610 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f959005a0b0 0x7f959005c570 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f95a4000c00 tx=0x7f95a4007bc0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:02.381 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.378+0000 7f9596ffd700 1 -- 172.21.15.110:0/2430523610 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f95a8047eb0 con 0x7f95b015c330 2021-03-25T14:17:02.530 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.529+0000 7f95b5695700 1 -- 172.21.15.110:0/2430523610 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f95b0144bc0 con 0x7f95b015c330 2021-03-25T14:17:02.530 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.529+0000 7f9596ffd700 1 -- 172.21.15.110:0/2430523610 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v33) v1 ==== 84+0+143 (secure 0 0 0) 0x7f95a804b4d0 con 0x7f95b015c330 2021-03-25T14:17:02.530 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:02.530 INFO:teuthology.orchestra.run.smithi110.stdout:[ 2021-03-25T14:17:02.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:17:02.531 INFO:teuthology.orchestra.run.smithi110.stdout: "poolnum": 1, 2021-03-25T14:17:02.531 INFO:teuthology.orchestra.run.smithi110.stdout: "poolname": "device_health_metrics" 2021-03-25T14:17:02.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:17:02.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:17:02.531 INFO:teuthology.orchestra.run.smithi110.stdout: "poolnum": 2, 2021-03-25T14:17:02.531 INFO:teuthology.orchestra.run.smithi110.stdout: "poolname": "rbd" 2021-03-25T14:17:02.531 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:17:02.531 INFO:teuthology.orchestra.run.smithi110.stdout:] 2021-03-25T14:17:02.532 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.530+0000 7f95b5695700 1 -- 172.21.15.110:0/2430523610 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f959005a0b0 msgr2=0x7f959005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:02.532 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.530+0000 7f95b5695700 1 --2- 172.21.15.110:0/2430523610 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f959005a0b0 0x7f959005c570 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f95a4000c00 tx=0x7f95a4007bc0).stop 2021-03-25T14:17:02.532 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.530+0000 7f95b5695700 1 -- 172.21.15.110:0/2430523610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95b015c330 msgr2=0x7f95b015c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:02.532 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.530+0000 7f95b5695700 1 --2- 172.21.15.110:0/2430523610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95b015c330 0x7f95b015c790 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f95a800a000 tx=0x7f95a8013000).stop 2021-03-25T14:17:02.533 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.530+0000 7f95b5695700 1 -- 172.21.15.110:0/2430523610 shutdown_connections 2021-03-25T14:17:02.533 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.530+0000 7f95b5695700 1 --2- 172.21.15.110:0/2430523610 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f959005a0b0 0x7f959005c570 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:02.533 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.530+0000 7f95b5695700 1 --2- 172.21.15.110:0/2430523610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95b015c330 0x7f95b015c790 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:02.533 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.530+0000 7f95b5695700 1 --2- 172.21.15.110:0/2430523610 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95b00bdeb0 0x7f95b00be290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:02.533 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.530+0000 7f95b5695700 1 --2- 172.21.15.110:0/2430523610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95b0144ed0 0x7f95b0145350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:02.533 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.530+0000 7f95b5695700 1 -- 172.21.15.110:0/2430523610 >> 172.21.15.110:0/2430523610 conn(0x7f95b00649a0 msgr2=0x7f95b00b32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:02.533 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.530+0000 7f95b5695700 1 -- 172.21.15.110:0/2430523610 shutdown_connections 2021-03-25T14:17:02.533 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.531+0000 7f95b5695700 1 -- 172.21.15.110:0/2430523610 wait complete. 2021-03-25T14:17:02.543 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-03-25T14:17:02.543 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-03-25T14:17:02.656 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.655+0000 7f96d417d700 1 Processor -- start 2021-03-25T14:17:02.656 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.655+0000 7f96d417d700 1 -- start start 2021-03-25T14:17:02.658 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.656+0000 7f96d417d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f96cc143bc0 0x7f96cc0a2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:02.658 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.656+0000 7f96d417d700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96cc0b6c90 con 0x7f96cc068440 2021-03-25T14:17:02.658 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.656+0000 7f96d417d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96cc14a080 con 0x7f96cc060e00 2021-03-25T14:17:02.658 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.656+0000 7f96d417d700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96cc068ca0 con 0x7f96cc143bc0 2021-03-25T14:17:02.658 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.656+0000 7f96d271a700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f96cc143bc0 0x7f96cc0a2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:02.659 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.656+0000 7f96d1718700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f96cc068440 0x7f96cc1434b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:42134/0 (socket says 172.21.15.110:42134) 2021-03-25T14:17:02.659 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.656+0000 7f96d271a700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f96cc143bc0 0x7f96cc0a2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49200/0 (socket says 172.21.15.110:49200) 2021-03-25T14:17:02.659 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.656+0000 7f96d1718700 1 -- 172.21.15.110:0/2487157287 learned_addr learned my addr 172.21.15.110:0/2487157287 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:02.659 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.656+0000 7f96d271a700 1 -- 172.21.15.110:0/2487157287 >> v1:172.21.15.174:6789/0 conn(0x7f96cc060e00 legacy=0x7f96cc149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:02.659 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.656+0000 7f96d271a700 1 -- 172.21.15.110:0/2487157287 >> v1:172.21.15.110:6789/0 conn(0x7f96cc068440 legacy=0x7f96cc1434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:02.659 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.656+0000 7f96d271a700 1 -- 172.21.15.110:0/2487157287 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96cc0a2d40 con 0x7f96cc143bc0 2021-03-25T14:17:02.659 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.656+0000 7f96d0f17700 1 -- 172.21.15.110:0/2487157287 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1110420636 0 0) 0x7f96c8001110 con 0x7f96cc068440 2021-03-25T14:17:02.659 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.656+0000 7f96d271a700 1 --2- 172.21.15.110:0/2487157287 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96cc143bc0 0x7f96cc0a2710 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f96c4009cf0 tx=0x7f96c4009220).ready entity=mon.0 client_cookie=7cb7e2de2644cf2 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:02.660 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.657+0000 7f96d0f17700 1 -- 172.21.15.110:0/2487157287 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c400bc00 con 0x7f96cc143bc0 2021-03-25T14:17:02.660 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.657+0000 7f96d0f17700 1 -- 172.21.15.110:0/2487157287 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c400bd60 con 0x7f96cc143bc0 2021-03-25T14:17:02.660 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.657+0000 7f96d0f17700 1 -- 172.21.15.110:0/2487157287 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c4011610 con 0x7f96cc143bc0 2021-03-25T14:17:02.660 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.657+0000 7f96d417d700 1 -- 172.21.15.110:0/2487157287 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96cc143bc0 msgr2=0x7f96cc0a2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:02.660 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.657+0000 7f96d417d700 1 --2- 172.21.15.110:0/2487157287 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96cc143bc0 0x7f96cc0a2710 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f96c4009cf0 tx=0x7f96c4009220).stop 2021-03-25T14:17:02.660 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.657+0000 7f96d417d700 1 -- 172.21.15.110:0/2487157287 shutdown_connections 2021-03-25T14:17:02.660 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.657+0000 7f96d417d700 1 --2- 172.21.15.110:0/2487157287 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96cc143bc0 0x7f96cc0a2710 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:02.660 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.657+0000 7f96d417d700 1 -- 172.21.15.110:0/2487157287 >> 172.21.15.110:0/2487157287 conn(0x7f96cc061d50 msgr2=0x7f96cc062160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:02.660 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.657+0000 7f96d417d700 1 -- 172.21.15.110:0/2487157287 shutdown_connections 2021-03-25T14:17:02.660 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.657+0000 7f96d417d700 1 -- 172.21.15.110:0/2487157287 wait complete. 2021-03-25T14:17:02.664 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.658+0000 7f96d417d700 1 Processor -- start 2021-03-25T14:17:02.664 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.658+0000 7f96d417d700 1 -- start start 2021-03-25T14:17:02.664 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.659+0000 7f96d417d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f96cc060e00 0x7f96cc09eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:02.664 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.659+0000 7f96d417d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f96cc068440 0x7f96cc0bd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:02.664 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.659+0000 7f96d417d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96cc143bc0 0x7f96cc0a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:02.664 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.659+0000 7f96d417d700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc0bd890 con 0x7f96cc143bc0 2021-03-25T14:17:02.664 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.659+0000 7f96d417d700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc0bdb30 con 0x7f96cc060e00 2021-03-25T14:17:02.664 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.659+0000 7f96d417d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc0bbf10 con 0x7f96cc068440 2021-03-25T14:17:02.664 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.659+0000 7f96d271a700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96cc143bc0 0x7f96cc0a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:02.664 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.659+0000 7f96d271a700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96cc143bc0 0x7f96cc0a05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49206/0 (socket says 172.21.15.110:49206) 2021-03-25T14:17:02.664 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.659+0000 7f96d271a700 1 -- 172.21.15.110:0/4137221231 learned_addr learned my addr 172.21.15.110:0/4137221231 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:02.665 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.659+0000 7f96d1718700 1 --2- 172.21.15.110:0/4137221231 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f96cc068440 0x7f96cc0bd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:02.665 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.659+0000 7f96d1f19700 1 --2- 172.21.15.110:0/4137221231 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f96cc060e00 0x7f96cc09eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:02.665 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.659+0000 7f96d271a700 1 -- 172.21.15.110:0/4137221231 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f96cc068440 msgr2=0x7f96cc0bd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:02.665 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.659+0000 7f96d271a700 1 --2- 172.21.15.110:0/4137221231 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f96cc068440 0x7f96cc0bd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:02.665 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.659+0000 7f96d271a700 1 -- 172.21.15.110:0/4137221231 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f96cc060e00 msgr2=0x7f96cc09eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:02.665 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.659+0000 7f96d271a700 1 --2- 172.21.15.110:0/4137221231 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f96cc060e00 0x7f96cc09eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:02.665 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.659+0000 7f96d271a700 1 -- 172.21.15.110:0/4137221231 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96cc141b80 con 0x7f96cc143bc0 2021-03-25T14:17:02.665 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.659+0000 7f96d1f19700 1 --2- 172.21.15.110:0/4137221231 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f96cc060e00 0x7f96cc09eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:17:02.665 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.659+0000 7f96d271a700 1 --2- 172.21.15.110:0/4137221231 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96cc143bc0 0x7f96cc0a05d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f96c4009260 tx=0x7f96c4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:02.665 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.659+0000 7f96b9ffb700 1 -- 172.21.15.110:0/4137221231 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c4011e30 con 0x7f96cc143bc0 2021-03-25T14:17:02.665 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.659+0000 7f96b9ffb700 1 -- 172.21.15.110:0/4137221231 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c401f070 con 0x7f96cc143bc0 2021-03-25T14:17:02.665 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.659+0000 7f96d417d700 1 -- 172.21.15.110:0/4137221231 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96cc09e680 con 0x7f96cc143bc0 2021-03-25T14:17:02.666 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.659+0000 7f96b9ffb700 1 -- 172.21.15.110:0/4137221231 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c401abe0 con 0x7f96cc143bc0 2021-03-25T14:17:02.666 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.660+0000 7f96d417d700 1 -- 172.21.15.110:0/4137221231 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96cc09eb10 con 0x7f96cc143bc0 2021-03-25T14:17:02.666 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.660+0000 7f96d417d700 1 -- 172.21.15.110:0/4137221231 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96cc0bdcf0 con 0x7f96cc143bc0 2021-03-25T14:17:02.666 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.661+0000 7f96b9ffb700 1 -- 172.21.15.110:0/4137221231 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f96c400f070 con 0x7f96cc143bc0 2021-03-25T14:17:02.666 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.661+0000 7f96b9ffb700 1 --2- 172.21.15.110:0/4137221231 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f96ac05a0b0 0x7f96ac05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:02.666 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.661+0000 7f96b9ffb700 1 -- 172.21.15.110:0/4137221231 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5606+0+0 (secure 0 0 0) 0x7f96c4075660 con 0x7f96cc143bc0 2021-03-25T14:17:02.666 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.661+0000 7f96d1f19700 1 --2- 172.21.15.110:0/4137221231 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f96ac05a0b0 0x7f96ac05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:02.666 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.661+0000 7f96d1f19700 1 --2- 172.21.15.110:0/4137221231 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f96ac05a0b0 0x7f96ac05c570 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f96bc006fd0 tx=0x7f96bc008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:02.666 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.665+0000 7f96b9ffb700 1 -- 172.21.15.110:0/4137221231 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f96c40491d0 con 0x7f96cc143bc0 2021-03-25T14:17:02.813 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.812+0000 7f96d417d700 1 -- 172.21.15.110:0/4137221231 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f96cc05d7b0 con 0x7f96cc143bc0 2021-03-25T14:17:02.994 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.993+0000 7f96b9ffb700 1 -- 172.21.15.110:0/4137221231 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v34) v1 ==== 133+0+0 (secure 0 0 0) 0x7f96c404c7f0 con 0x7f96cc143bc0 2021-03-25T14:17:02.996 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.995+0000 7f96d417d700 1 -- 172.21.15.110:0/4137221231 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f96ac05a0b0 msgr2=0x7f96ac05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:02.996 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.995+0000 7f96d417d700 1 --2- 172.21.15.110:0/4137221231 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f96ac05a0b0 0x7f96ac05c570 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f96bc006fd0 tx=0x7f96bc008040).stop 2021-03-25T14:17:02.996 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.995+0000 7f96d417d700 1 -- 172.21.15.110:0/4137221231 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96cc143bc0 msgr2=0x7f96cc0a05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:02.996 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.995+0000 7f96d417d700 1 --2- 172.21.15.110:0/4137221231 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96cc143bc0 0x7f96cc0a05d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f96c4009260 tx=0x7f96c4017000).stop 2021-03-25T14:17:02.997 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.995+0000 7f96d417d700 1 -- 172.21.15.110:0/4137221231 shutdown_connections 2021-03-25T14:17:02.997 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.995+0000 7f96d417d700 1 --2- 172.21.15.110:0/4137221231 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f96ac05a0b0 0x7f96ac05c570 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:02.997 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.995+0000 7f96d417d700 1 --2- 172.21.15.110:0/4137221231 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f96cc060e00 0x7f96cc09eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:02.997 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.995+0000 7f96d417d700 1 --2- 172.21.15.110:0/4137221231 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96cc143bc0 0x7f96cc0a05d0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:02.997 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.995+0000 7f96d417d700 1 --2- 172.21.15.110:0/4137221231 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f96cc068440 0x7f96cc0bd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:02.997 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.995+0000 7f96d417d700 1 -- 172.21.15.110:0/4137221231 >> 172.21.15.110:0/4137221231 conn(0x7f96cc061d50 msgr2=0x7f96cc1496d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:02.997 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.995+0000 7f96d417d700 1 -- 172.21.15.110:0/4137221231 shutdown_connections 2021-03-25T14:17:02.997 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:02.995+0000 7f96d417d700 1 -- 172.21.15.110:0/4137221231 wait complete. 2021-03-25T14:17:02.997 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs_metadata' created 2021-03-25T14:17:03.008 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-03-25T14:17:03.122 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.121+0000 7f9ca2f39700 1 Processor -- start 2021-03-25T14:17:03.123 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.122+0000 7f9ca2f39700 1 -- start start 2021-03-25T14:17:03.125 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.122+0000 7f9ca2f39700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9c9c14d470 0x7f9c9c14d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:03.125 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.122+0000 7f9ca2f39700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9c9c14cc90 0x7f9c9c1493c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:03.125 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.122+0000 7f9ca2f39700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c9c1498b0 0x7f9c9c0685d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:03.126 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.122+0000 7f9ca2f39700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c9c0691b0 con 0x7f9c9c14cc90 2021-03-25T14:17:03.126 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.122+0000 7f9ca2f39700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c9c0bc2b0 con 0x7f9c9c14d470 2021-03-25T14:17:03.126 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.122+0000 7f9ca2f39700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c149dd0 con 0x7f9c9c1498b0 2021-03-25T14:17:03.126 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.122+0000 7f9c9bfff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9c9c14cc90 0x7f9c9c1493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:03.126 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.122+0000 7f9c9bfff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9c9c14cc90 0x7f9c9c1493c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49214/0 (socket says 172.21.15.110:49214) 2021-03-25T14:17:03.126 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.122+0000 7f9c9bfff700 1 -- 172.21.15.110:0/1946116001 learned_addr learned my addr 172.21.15.110:0/1946116001 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:03.126 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.123+0000 7f9ca0cd5700 1 --2- 172.21.15.110:0/1946116001 >> v2:172.21.15.174:3300/0 conn(0x7f9c9c14d470 0x7f9c9c14d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:03.126 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.123+0000 7f9ca14d6700 1 --2- 172.21.15.110:0/1946116001 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c9c1498b0 0x7f9c9c0685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:03.126 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.123+0000 7f9c9bfff700 1 -- 172.21.15.110:0/1946116001 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c9c1498b0 msgr2=0x7f9c9c0685d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:03.126 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.123+0000 7f9c9bfff700 1 --2- 172.21.15.110:0/1946116001 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c9c1498b0 0x7f9c9c0685d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:03.126 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.123+0000 7f9c9bfff700 1 -- 172.21.15.110:0/1946116001 >> v2:172.21.15.174:3300/0 conn(0x7f9c9c14d470 msgr2=0x7f9c9c14d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:03.126 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.123+0000 7f9c9bfff700 1 --2- 172.21.15.110:0/1946116001 >> v2:172.21.15.174:3300/0 conn(0x7f9c9c14d470 0x7f9c9c14d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:03.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.123+0000 7f9c9bfff700 1 -- 172.21.15.110:0/1946116001 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c9c14a070 con 0x7f9c9c14cc90 2021-03-25T14:17:03.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.123+0000 7f9c9bfff700 1 --2- 172.21.15.110:0/1946116001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c9c14cc90 0x7f9c9c1493c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f9c9c061fa0 tx=0x7f9c88006ee0).ready entity=mon.0 client_cookie=33c4fe934537c98a server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:03.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.123+0000 7f9c9b7fe700 1 -- 172.21.15.110:0/1946116001 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c88009690 con 0x7f9c9c14cc90 2021-03-25T14:17:03.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.123+0000 7f9c9b7fe700 1 -- 172.21.15.110:0/1946116001 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c880097f0 con 0x7f9c9c14cc90 2021-03-25T14:17:03.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.123+0000 7f9c9b7fe700 1 -- 172.21.15.110:0/1946116001 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c88009b70 con 0x7f9c9c14cc90 2021-03-25T14:17:03.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.123+0000 7f9ca2f39700 1 -- 172.21.15.110:0/1946116001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c9c14cc90 msgr2=0x7f9c9c1493c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:03.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.123+0000 7f9ca2f39700 1 --2- 172.21.15.110:0/1946116001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c9c14cc90 0x7f9c9c1493c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f9c9c061fa0 tx=0x7f9c88006ee0).stop 2021-03-25T14:17:03.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.123+0000 7f9ca2f39700 1 -- 172.21.15.110:0/1946116001 shutdown_connections 2021-03-25T14:17:03.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.123+0000 7f9ca2f39700 1 --2- 172.21.15.110:0/1946116001 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c9c1498b0 0x7f9c9c0685d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:03.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.123+0000 7f9ca2f39700 1 --2- 172.21.15.110:0/1946116001 >> v2:172.21.15.174:3300/0 conn(0x7f9c9c14d470 0x7f9c9c14d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:03.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.123+0000 7f9ca2f39700 1 --2- 172.21.15.110:0/1946116001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c9c14cc90 0x7f9c9c1493c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:03.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.124+0000 7f9ca2f39700 1 -- 172.21.15.110:0/1946116001 >> 172.21.15.110:0/1946116001 conn(0x7f9c9c060c40 msgr2=0x7f9c9c061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:03.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.124+0000 7f9ca2f39700 1 -- 172.21.15.110:0/1946116001 shutdown_connections 2021-03-25T14:17:03.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.124+0000 7f9ca2f39700 1 -- 172.21.15.110:0/1946116001 wait complete. 2021-03-25T14:17:03.128 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.125+0000 7f9ca2f39700 1 Processor -- start 2021-03-25T14:17:03.128 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.125+0000 7f9ca2f39700 1 -- start start 2021-03-25T14:17:03.130 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.125+0000 7f9ca2f39700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c9c1498b0 0x7f9c9c1443c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:03.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.125+0000 7f9ca2f39700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c9c14cc90 0x7f9c9c0c0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:03.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.125+0000 7f9ca2f39700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c9c14d470 0x7f9c9c063ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:03.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.125+0000 7f9ca2f39700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c063450 con 0x7f9c9c1498b0 2021-03-25T14:17:03.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.125+0000 7f9ca2f39700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c1430f0 con 0x7f9c9c14d470 2021-03-25T14:17:03.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.125+0000 7f9ca2f39700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c143790 con 0x7f9c9c14cc90 2021-03-25T14:17:03.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.125+0000 7f9ca0cd5700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c9c1498b0 0x7f9c9c1443c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:03.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.126+0000 7f9ca0cd5700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c9c1498b0 0x7f9c9c1443c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49218/0 (socket says 172.21.15.110:49218) 2021-03-25T14:17:03.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.126+0000 7f9ca0cd5700 1 -- 172.21.15.110:0/1353848375 learned_addr learned my addr 172.21.15.110:0/1353848375 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:03.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.126+0000 7f9c9bfff700 1 --2- 172.21.15.110:0/1353848375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c9c14cc90 0x7f9c9c0c0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:03.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.126+0000 7f9ca14d6700 1 --2- 172.21.15.110:0/1353848375 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c9c14d470 0x7f9c9c063ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:03.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.126+0000 7f9ca0cd5700 1 -- 172.21.15.110:0/1353848375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c9c14cc90 msgr2=0x7f9c9c0c0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:03.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.126+0000 7f9ca0cd5700 1 --2- 172.21.15.110:0/1353848375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c9c14cc90 0x7f9c9c0c0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:03.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.126+0000 7f9ca0cd5700 1 -- 172.21.15.110:0/1353848375 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c9c14d470 msgr2=0x7f9c9c063ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:03.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.126+0000 7f9ca0cd5700 1 --2- 172.21.15.110:0/1353848375 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c9c14d470 0x7f9c9c063ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:03.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.126+0000 7f9ca0cd5700 1 -- 172.21.15.110:0/1353848375 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c9c143a30 con 0x7f9c9c1498b0 2021-03-25T14:17:03.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.126+0000 7f9ca0cd5700 1 --2- 172.21.15.110:0/1353848375 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c9c1498b0 0x7f9c9c1443c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f9c9000ec00 tx=0x7f9c90006e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:03.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.126+0000 7f9c98ff9700 1 -- 172.21.15.110:0/1353848375 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9000c850 con 0x7f9c9c1498b0 2021-03-25T14:17:03.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.126+0000 7f9c98ff9700 1 -- 172.21.15.110:0/1353848375 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c9000c9b0 con 0x7f9c9c1498b0 2021-03-25T14:17:03.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.126+0000 7f9ca2f39700 1 -- 172.21.15.110:0/1353848375 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c9c143cd0 con 0x7f9c9c1498b0 2021-03-25T14:17:03.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.126+0000 7f9c98ff9700 1 -- 172.21.15.110:0/1353848375 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9000cd30 con 0x7f9c9c1498b0 2021-03-25T14:17:03.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.126+0000 7f9ca2f39700 1 -- 172.21.15.110:0/1353848375 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c9c143500 con 0x7f9c9c1498b0 2021-03-25T14:17:03.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.127+0000 7f9ca2f39700 1 -- 172.21.15.110:0/1353848375 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c9c150a80 con 0x7f9c9c1498b0 2021-03-25T14:17:03.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.127+0000 7f9c98ff9700 1 -- 172.21.15.110:0/1353848375 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f9c90012600 con 0x7f9c9c1498b0 2021-03-25T14:17:03.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.127+0000 7f9c98ff9700 1 --2- 172.21.15.110:0/1353848375 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f9c7c05a0b0 0x7f9c7c05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:03.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.128+0000 7f9c98ff9700 1 -- 172.21.15.110:0/1353848375 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5960+0+0 (secure 0 0 0) 0x7f9c90073fc0 con 0x7f9c9c1498b0 2021-03-25T14:17:03.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.128+0000 7f9c9bfff700 1 --2- 172.21.15.110:0/1353848375 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f9c7c05a0b0 0x7f9c7c05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:03.133 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.128+0000 7f9c9bfff700 1 --2- 172.21.15.110:0/1353848375 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f9c7c05a0b0 0x7f9c7c05c570 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f9c88006f20 tx=0x7f9c88016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:03.133 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.131+0000 7f9c98ff9700 1 -- 172.21.15.110:0/1353848375 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f9c900479d0 con 0x7f9c9c1498b0 2021-03-25T14:17:03.282 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.281+0000 7f9ca2f39700 1 -- 172.21.15.110:0/1353848375 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f9c9c05d7b0 con 0x7f9c9c1498b0 2021-03-25T14:17:03.995 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:03.995+0000 7f9c98ff9700 1 -- 172.21.15.110:0/1353848375 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v35) v1 ==== 125+0+0 (secure 0 0 0) 0x7f9c9004aff0 con 0x7f9c9c1498b0 2021-03-25T14:17:04.001 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.000+0000 7f9ca2f39700 1 -- 172.21.15.110:0/1353848375 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f9c7c05a0b0 msgr2=0x7f9c7c05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:04.001 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.000+0000 7f9ca2f39700 1 --2- 172.21.15.110:0/1353848375 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f9c7c05a0b0 0x7f9c7c05c570 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f9c88006f20 tx=0x7f9c88016000).stop 2021-03-25T14:17:04.001 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.000+0000 7f9ca2f39700 1 -- 172.21.15.110:0/1353848375 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c9c1498b0 msgr2=0x7f9c9c1443c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:04.001 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.000+0000 7f9ca2f39700 1 --2- 172.21.15.110:0/1353848375 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c9c1498b0 0x7f9c9c1443c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f9c9000ec00 tx=0x7f9c90006e20).stop 2021-03-25T14:17:04.002 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.000+0000 7f9ca2f39700 1 -- 172.21.15.110:0/1353848375 shutdown_connections 2021-03-25T14:17:04.002 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.000+0000 7f9ca2f39700 1 --2- 172.21.15.110:0/1353848375 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f9c7c05a0b0 0x7f9c7c05c570 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:04.002 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.000+0000 7f9ca2f39700 1 --2- 172.21.15.110:0/1353848375 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c9c14d470 0x7f9c9c063ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:04.002 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.000+0000 7f9ca2f39700 1 --2- 172.21.15.110:0/1353848375 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c9c1498b0 0x7f9c9c1443c0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:04.002 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.000+0000 7f9ca2f39700 1 --2- 172.21.15.110:0/1353848375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c9c14cc90 0x7f9c9c0c0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:04.002 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.000+0000 7f9ca2f39700 1 -- 172.21.15.110:0/1353848375 >> 172.21.15.110:0/1353848375 conn(0x7f9c9c060c40 msgr2=0x7f9c9c0b4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:04.002 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.000+0000 7f9ca2f39700 1 -- 172.21.15.110:0/1353848375 shutdown_connections 2021-03-25T14:17:04.002 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.000+0000 7f9ca2f39700 1 -- 172.21.15.110:0/1353848375 wait complete. 2021-03-25T14:17:04.003 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs_data' created 2021-03-25T14:17:04.016 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2021-03-25T14:17:04.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.131+0000 7f2185231700 1 Processor -- start 2021-03-25T14:17:04.171 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.131+0000 7f2185231700 1 -- start start 2021-03-25T14:17:04.176 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.132+0000 7f2185231700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21800b0cc0 0x7f2180145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:04.176 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.132+0000 7f2185231700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f21800b5d00 0x7f2180067250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:04.176 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.132+0000 7f2185231700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2180149c50 con 0x7f21800648a0 2021-03-25T14:17:04.176 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.132+0000 7f2185231700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21801461b0 con 0x7f21800b5d00 2021-03-25T14:17:04.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.132+0000 7f2185231700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2180149e80 con 0x7f21800b0cc0 2021-03-25T14:17:04.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.132+0000 7f217e59c700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f21800b5d00 0x7f2180067250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:04.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.132+0000 7f217e59c700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f21800b5d00 0x7f2180067250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49226/0 (socket says 172.21.15.110:49226) 2021-03-25T14:17:04.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.132+0000 7f217e59c700 1 -- 172.21.15.110:0/2091922463 learned_addr learned my addr 172.21.15.110:0/2091922463 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:04.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.132+0000 7f217ed9d700 1 --2- 172.21.15.110:0/2091922463 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21800b0cc0 0x7f2180145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:04.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.132+0000 7f217e59c700 1 -- 172.21.15.110:0/2091922463 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21800b0cc0 msgr2=0x7f2180145cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:04.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.132+0000 7f217e59c700 1 --2- 172.21.15.110:0/2091922463 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21800b0cc0 0x7f2180145cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:04.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.132+0000 7f217e59c700 1 -- 172.21.15.110:0/2091922463 >> v1:172.21.15.174:6789/0 conn(0x7f21800648a0 legacy=0x7f218009db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:04.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.132+0000 7f217e59c700 1 -- 172.21.15.110:0/2091922463 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21800b6650 con 0x7f21800b5d00 2021-03-25T14:17:04.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.132+0000 7f217e59c700 1 --2- 172.21.15.110:0/2091922463 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21800b5d00 0x7f2180067250 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f217400ba20 tx=0x7f2174006ee0).ready entity=mon.0 client_cookie=3bdd7830a28691df server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:04.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.132+0000 7f217dd9b700 1 -- 172.21.15.110:0/2091922463 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2174009890 con 0x7f21800b5d00 2021-03-25T14:17:04.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.132+0000 7f217dd9b700 1 -- 172.21.15.110:0/2091922463 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21740099f0 con 0x7f21800b5d00 2021-03-25T14:17:04.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.132+0000 7f217dd9b700 1 -- 172.21.15.110:0/2091922463 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2174009d70 con 0x7f21800b5d00 2021-03-25T14:17:04.178 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.133+0000 7f2185231700 1 -- 172.21.15.110:0/2091922463 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21800b5d00 msgr2=0x7f2180067250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:04.178 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.133+0000 7f2185231700 1 --2- 172.21.15.110:0/2091922463 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21800b5d00 0x7f2180067250 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f217400ba20 tx=0x7f2174006ee0).stop 2021-03-25T14:17:04.178 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.133+0000 7f2185231700 1 -- 172.21.15.110:0/2091922463 shutdown_connections 2021-03-25T14:17:04.178 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.133+0000 7f2185231700 1 --2- 172.21.15.110:0/2091922463 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21800b0cc0 0x7f2180145cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:04.178 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.133+0000 7f2185231700 1 --2- 172.21.15.110:0/2091922463 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21800b5d00 0x7f2180067250 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:04.178 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.133+0000 7f2185231700 1 -- 172.21.15.110:0/2091922463 >> 172.21.15.110:0/2091922463 conn(0x7f21800664e0 msgr2=0x7f21800668f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:04.178 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.133+0000 7f2185231700 1 -- 172.21.15.110:0/2091922463 shutdown_connections 2021-03-25T14:17:04.178 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.133+0000 7f2185231700 1 -- 172.21.15.110:0/2091922463 wait complete. 2021-03-25T14:17:04.178 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.134+0000 7f2185231700 1 Processor -- start 2021-03-25T14:17:04.178 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.134+0000 7f2185231700 1 -- start start 2021-03-25T14:17:04.178 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.135+0000 7f2185231700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21800648a0 0x7f21800a0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:04.178 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.135+0000 7f2185231700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f21800b0cc0 0x7f2180159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:04.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.135+0000 7f2185231700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21800b5d00 0x7f218015a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:04.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.135+0000 7f2185231700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21800b50c0 con 0x7f21800b5d00 2021-03-25T14:17:04.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.135+0000 7f2185231700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2180091b20 con 0x7f21800b0cc0 2021-03-25T14:17:04.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.135+0000 7f2185231700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f218009d1c0 con 0x7f21800648a0 2021-03-25T14:17:04.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.135+0000 7f217f59e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21800b5d00 0x7f218015a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:04.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.135+0000 7f217f59e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21800b5d00 0x7f218015a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49234/0 (socket says 172.21.15.110:49234) 2021-03-25T14:17:04.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.135+0000 7f217f59e700 1 -- 172.21.15.110:0/2220990856 learned_addr learned my addr 172.21.15.110:0/2220990856 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:04.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.135+0000 7f217e59c700 1 --2- 172.21.15.110:0/2220990856 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f21800b0cc0 0x7f2180159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:04.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.135+0000 7f217f59e700 1 -- 172.21.15.110:0/2220990856 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21800648a0 msgr2=0x7f21800a0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:04.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.135+0000 7f217f59e700 1 --2- 172.21.15.110:0/2220990856 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21800648a0 0x7f21800a0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:04.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.135+0000 7f217f59e700 1 -- 172.21.15.110:0/2220990856 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f21800b0cc0 msgr2=0x7f2180159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:04.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.135+0000 7f217f59e700 1 --2- 172.21.15.110:0/2220990856 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f21800b0cc0 0x7f2180159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:04.179 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.135+0000 7f217f59e700 1 -- 172.21.15.110:0/2220990856 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f218009d460 con 0x7f21800b5d00 2021-03-25T14:17:04.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.135+0000 7f217f59e700 1 --2- 172.21.15.110:0/2220990856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21800b5d00 0x7f218015a490 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f217800cae0 tx=0x7f21780023f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:04.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.135+0000 7f2166ffd700 1 -- 172.21.15.110:0/2220990856 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217800a760 con 0x7f21800b5d00 2021-03-25T14:17:04.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.136+0000 7f2166ffd700 1 -- 172.21.15.110:0/2220990856 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217800a8e0 con 0x7f21800b5d00 2021-03-25T14:17:04.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.136+0000 7f2185231700 1 -- 172.21.15.110:0/2220990856 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21800b32d0 con 0x7f21800b5d00 2021-03-25T14:17:04.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.136+0000 7f2166ffd700 1 -- 172.21.15.110:0/2220990856 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217800aca0 con 0x7f21800b5d00 2021-03-25T14:17:04.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.136+0000 7f2185231700 1 -- 172.21.15.110:0/2220990856 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21800a13f0 con 0x7f21800b5d00 2021-03-25T14:17:04.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.136+0000 7f2185231700 1 -- 172.21.15.110:0/2220990856 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21800b5210 con 0x7f21800b5d00 2021-03-25T14:17:04.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.137+0000 7f2166ffd700 1 -- 172.21.15.110:0/2220990856 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f2178019030 con 0x7f21800b5d00 2021-03-25T14:17:04.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.137+0000 7f2166ffd700 1 --2- 172.21.15.110:0/2220990856 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f216005a0b0 0x7f216005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:04.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.137+0000 7f2166ffd700 1 -- 172.21.15.110:0/2220990856 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6310+0+0 (secure 0 0 0) 0x7f2178073e20 con 0x7f21800b5d00 2021-03-25T14:17:04.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.137+0000 7f217ed9d700 1 --2- 172.21.15.110:0/2220990856 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f216005a0b0 0x7f216005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:04.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.138+0000 7f217ed9d700 1 --2- 172.21.15.110:0/2220990856 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f216005a0b0 0x7f216005c570 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f2170006fd0 tx=0x7f2170008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:04.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.141+0000 7f2166ffd700 1 -- 172.21.15.110:0/2220990856 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f2178047800 con 0x7f21800b5d00 2021-03-25T14:17:04.328 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.327+0000 7f2185231700 1 -- 172.21.15.110:0/2220990856 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f21800b5210 con 0x7f21800b5d00 2021-03-25T14:17:04.332 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.332+0000 7f2166ffd700 1 -- 172.21.15.110:0/2220990856 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f21800b5210 con 0x7f21800b5d00 2021-03-25T14:17:04.336 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.335+0000 7f2185231700 1 -- 172.21.15.110:0/2220990856 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f216005a0b0 msgr2=0x7f216005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:04.336 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.335+0000 7f2185231700 1 --2- 172.21.15.110:0/2220990856 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f216005a0b0 0x7f216005c570 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f2170006fd0 tx=0x7f2170008040).stop 2021-03-25T14:17:04.336 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.335+0000 7f2185231700 1 -- 172.21.15.110:0/2220990856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21800b5d00 msgr2=0x7f218015a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:04.336 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.335+0000 7f2185231700 1 --2- 172.21.15.110:0/2220990856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21800b5d00 0x7f218015a490 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f217800cae0 tx=0x7f21780023f0).stop 2021-03-25T14:17:04.338 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.336+0000 7f2185231700 1 -- 172.21.15.110:0/2220990856 shutdown_connections 2021-03-25T14:17:04.338 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.336+0000 7f2185231700 1 --2- 172.21.15.110:0/2220990856 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f216005a0b0 0x7f216005c570 secure :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0x7f2170006fd0 tx=0x7f2170008040).stop 2021-03-25T14:17:04.338 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.336+0000 7f2185231700 1 --2- 172.21.15.110:0/2220990856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21800b5d00 0x7f218015a490 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:04.338 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.336+0000 7f2185231700 1 --2- 172.21.15.110:0/2220990856 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21800648a0 0x7f21800a0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:04.339 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.336+0000 7f2185231700 1 --2- 172.21.15.110:0/2220990856 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f21800b0cc0 0x7f2180159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:04.339 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.336+0000 7f2185231700 1 -- 172.21.15.110:0/2220990856 >> 172.21.15.110:0/2220990856 conn(0x7f21800664e0 msgr2=0x7f2180067820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:04.339 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.338+0000 7f2185231700 1 -- 172.21.15.110:0/2220990856 shutdown_connections 2021-03-25T14:17:04.339 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.338+0000 7f2185231700 1 -- 172.21.15.110:0/2220990856 wait complete. 2021-03-25T14:17:04.347 INFO:teuthology.orchestra.run.smithi110.stderr:new fs with metadata pool 6 and data pool 7 2021-03-25T14:17:04.358 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:17:04.468 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.467+0000 7fce3a488700 1 Processor -- start 2021-03-25T14:17:04.468 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.467+0000 7fce3a488700 1 -- start start 2021-03-25T14:17:04.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.467+0000 7fce3a488700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce340b1340 0x7fce340b1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:04.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.467+0000 7fce3a488700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fce340668a0 0x7fce3414cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:04.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.467+0000 7fce3a488700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce34067510 con 0x7fce34066420 2021-03-25T14:17:04.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.467+0000 7fce3a488700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce340677b0 con 0x7fce340668a0 2021-03-25T14:17:04.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.467+0000 7fce3a488700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce34067a50 con 0x7fce340b1340 2021-03-25T14:17:04.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.468+0000 7fce38a25700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fce340668a0 0x7fce3414cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:04.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.468+0000 7fce38a25700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fce340668a0 0x7fce3414cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49256/0 (socket says 172.21.15.110:49256) 2021-03-25T14:17:04.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.468+0000 7fce337fe700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fce34066420 0x7fce34149cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:42190/0 (socket says 172.21.15.110:42190) 2021-03-25T14:17:04.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.468+0000 7fce38a25700 1 -- 172.21.15.110:0/2476806235 learned_addr learned my addr 172.21.15.110:0/2476806235 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:04.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.468+0000 7fce33fff700 1 --2- 172.21.15.110:0/2476806235 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce340b1340 0x7fce340b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:04.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.468+0000 7fce38a25700 1 -- 172.21.15.110:0/2476806235 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce340b1340 msgr2=0x7fce340b1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:04.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.468+0000 7fce38a25700 1 --2- 172.21.15.110:0/2476806235 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce340b1340 0x7fce340b1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:04.472 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.468+0000 7fce38a25700 1 -- 172.21.15.110:0/2476806235 >> v1:172.21.15.110:6789/0 conn(0x7fce34066420 legacy=0x7fce34149cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:04.472 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.468+0000 7fce38a25700 1 -- 172.21.15.110:0/2476806235 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce34067cf0 con 0x7fce340668a0 2021-03-25T14:17:04.472 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.468+0000 7fce32ffd700 1 -- 172.21.15.110:0/2476806235 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 457189854 0 0) 0x7fce34067510 con 0x7fce34066420 2021-03-25T14:17:04.472 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.468+0000 7fce38a25700 1 --2- 172.21.15.110:0/2476806235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce340668a0 0x7fce3414cee0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7fce2c009d90 tx=0x7fce2c0092d0).ready entity=mon.0 client_cookie=a0423d9fb8b1202e server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:04.472 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.468+0000 7fce32ffd700 1 -- 172.21.15.110:0/2476806235 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2c00bc80 con 0x7fce340668a0 2021-03-25T14:17:04.472 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.468+0000 7fce32ffd700 1 -- 172.21.15.110:0/2476806235 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2c00bde0 con 0x7fce340668a0 2021-03-25T14:17:04.472 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.468+0000 7fce32ffd700 1 -- 172.21.15.110:0/2476806235 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2c011610 con 0x7fce340668a0 2021-03-25T14:17:04.472 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.469+0000 7fce3a488700 1 -- 172.21.15.110:0/2476806235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce340668a0 msgr2=0x7fce3414cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:04.472 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.469+0000 7fce3a488700 1 --2- 172.21.15.110:0/2476806235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce340668a0 0x7fce3414cee0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7fce2c009d90 tx=0x7fce2c0092d0).stop 2021-03-25T14:17:04.472 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.469+0000 7fce3a488700 1 -- 172.21.15.110:0/2476806235 shutdown_connections 2021-03-25T14:17:04.472 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.469+0000 7fce3a488700 1 --2- 172.21.15.110:0/2476806235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce340668a0 0x7fce3414cee0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:04.472 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.469+0000 7fce3a488700 1 --2- 172.21.15.110:0/2476806235 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce340b1340 0x7fce340b1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:04.472 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.469+0000 7fce3a488700 1 -- 172.21.15.110:0/2476806235 >> 172.21.15.110:0/2476806235 conn(0x7fce340649a0 msgr2=0x7fce3405c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:04.473 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.469+0000 7fce3a488700 1 -- 172.21.15.110:0/2476806235 shutdown_connections 2021-03-25T14:17:04.473 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.469+0000 7fce3a488700 1 -- 172.21.15.110:0/2476806235 wait complete. 2021-03-25T14:17:04.473 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.470+0000 7fce3a488700 1 Processor -- start 2021-03-25T14:17:04.473 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.470+0000 7fce3a488700 1 -- start start 2021-03-25T14:17:04.476 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.471+0000 7fce3a488700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce34066420 0x7fce341484a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:04.476 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.471+0000 7fce3a488700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce340668a0 0x7fce3414b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:04.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.471+0000 7fce3a488700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce340b1340 0x7fce34142820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:04.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.471+0000 7fce3a488700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce34145a60 con 0x7fce340668a0 2021-03-25T14:17:04.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.471+0000 7fce3a488700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce34149bb0 con 0x7fce340b1340 2021-03-25T14:17:04.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.471+0000 7fce3a488700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce34143a30 con 0x7fce34066420 2021-03-25T14:17:04.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.471+0000 7fce337fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce340668a0 0x7fce3414b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:04.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.471+0000 7fce337fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce340668a0 0x7fce3414b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49260/0 (socket says 172.21.15.110:49260) 2021-03-25T14:17:04.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.471+0000 7fce337fe700 1 -- 172.21.15.110:0/1360146733 learned_addr learned my addr 172.21.15.110:0/1360146733 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:04.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.471+0000 7fce33fff700 1 --2- 172.21.15.110:0/1360146733 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce34066420 0x7fce341484a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:04.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.471+0000 7fce38a25700 1 --2- 172.21.15.110:0/1360146733 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce340b1340 0x7fce34142820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:04.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.471+0000 7fce337fe700 1 -- 172.21.15.110:0/1360146733 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce34066420 msgr2=0x7fce341484a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:04.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.471+0000 7fce337fe700 1 --2- 172.21.15.110:0/1360146733 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce34066420 0x7fce341484a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:04.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.471+0000 7fce337fe700 1 -- 172.21.15.110:0/1360146733 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce340b1340 msgr2=0x7fce34142820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:04.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.471+0000 7fce337fe700 1 --2- 172.21.15.110:0/1360146733 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce340b1340 0x7fce34142820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:04.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.471+0000 7fce337fe700 1 -- 172.21.15.110:0/1360146733 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce34149de0 con 0x7fce340668a0 2021-03-25T14:17:04.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.471+0000 7fce337fe700 1 --2- 172.21.15.110:0/1360146733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce340668a0 0x7fce3414b5c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7fce2800c740 tx=0x7fce28007b10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:04.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.471+0000 7fce1bfff700 1 -- 172.21.15.110:0/1360146733 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce280072e0 con 0x7fce340668a0 2021-03-25T14:17:04.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.471+0000 7fce1bfff700 1 -- 172.21.15.110:0/1360146733 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce28005560 con 0x7fce340668a0 2021-03-25T14:17:04.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.471+0000 7fce3a488700 1 -- 172.21.15.110:0/1360146733 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce3414a080 con 0x7fce340668a0 2021-03-25T14:17:04.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.471+0000 7fce1bfff700 1 -- 172.21.15.110:0/1360146733 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce280058e0 con 0x7fce340668a0 2021-03-25T14:17:04.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.472+0000 7fce3a488700 1 -- 172.21.15.110:0/1360146733 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce3414a5c0 con 0x7fce340668a0 2021-03-25T14:17:04.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.473+0000 7fce3a488700 1 -- 172.21.15.110:0/1360146733 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce3405d7b0 con 0x7fce340668a0 2021-03-25T14:17:04.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.473+0000 7fce1bfff700 1 -- 172.21.15.110:0/1360146733 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fce28010070 con 0x7fce340668a0 2021-03-25T14:17:04.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.473+0000 7fce1bfff700 1 --2- 172.21.15.110:0/1360146733 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fce1405a0e0 0x7fce1405c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:04.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.473+0000 7fce1bfff700 1 -- 172.21.15.110:0/1360146733 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6426+0+0 (secure 0 0 0) 0x7fce280734d0 con 0x7fce340668a0 2021-03-25T14:17:04.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.473+0000 7fce33fff700 1 --2- 172.21.15.110:0/1360146733 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fce1405a0e0 0x7fce1405c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:04.479 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.474+0000 7fce33fff700 1 --2- 172.21.15.110:0/1360146733 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fce1405a0e0 0x7fce1405c5a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fce2400cb00 tx=0x7fce24006e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:04.479 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.477+0000 7fce1bfff700 1 -- 172.21.15.110:0/1360146733 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fce28046d10 con 0x7fce340668a0 2021-03-25T14:17:04.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.628+0000 7fce3a488700 1 -- 172.21.15.110:0/1360146733 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce340bbd70 con 0x7fce340668a0 2021-03-25T14:17:04.631 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.629+0000 7fce1bfff700 1 -- 172.21.15.110:0/1360146733 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+17135 (secure 0 0 0) 0x7fce2804a330 con 0x7fce340668a0 2021-03-25T14:17:04.632 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:04.632 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":36,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:17:04.328602+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2021-03-25T14:17:02.835058+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2021-03-25T14:17:03.303869+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:17:04.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.631+0000 7fce3a488700 1 -- 172.21.15.110:0/1360146733 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fce1405a0e0 msgr2=0x7fce1405c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:04.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.631+0000 7fce3a488700 1 --2- 172.21.15.110:0/1360146733 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fce1405a0e0 0x7fce1405c5a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fce2400cb00 tx=0x7fce24006e20).stop 2021-03-25T14:17:04.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.631+0000 7fce3a488700 1 -- 172.21.15.110:0/1360146733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce340668a0 msgr2=0x7fce3414b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:04.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.631+0000 7fce3a488700 1 --2- 172.21.15.110:0/1360146733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce340668a0 0x7fce3414b5c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7fce2800c740 tx=0x7fce28007b10).stop 2021-03-25T14:17:04.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.631+0000 7fce3a488700 1 -- 172.21.15.110:0/1360146733 shutdown_connections 2021-03-25T14:17:04.635 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.631+0000 7fce3a488700 1 --2- 172.21.15.110:0/1360146733 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fce1405a0e0 0x7fce1405c5a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:04.635 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.631+0000 7fce3a488700 1 --2- 172.21.15.110:0/1360146733 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce340b1340 0x7fce34142820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:04.635 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.631+0000 7fce3a488700 1 --2- 172.21.15.110:0/1360146733 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce34066420 0x7fce341484a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:04.635 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.631+0000 7fce3a488700 1 --2- 172.21.15.110:0/1360146733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce340668a0 0x7fce3414b5c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:04.635 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.631+0000 7fce3a488700 1 -- 172.21.15.110:0/1360146733 >> 172.21.15.110:0/1360146733 conn(0x7fce340649a0 msgr2=0x7fce340be080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:04.635 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.631+0000 7fce3a488700 1 -- 172.21.15.110:0/1360146733 shutdown_connections 2021-03-25T14:17:04.635 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.631+0000 7fce3a488700 1 -- 172.21.15.110:0/1360146733 wait complete. 2021-03-25T14:17:04.644 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:17:04.753 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.752+0000 7ff0f959f700 1 Processor -- start 2021-03-25T14:17:04.753 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.752+0000 7ff0f959f700 1 -- start start 2021-03-25T14:17:04.760 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.753+0000 7ff0f959f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff0f4067870 0x7ff0f414a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:04.760 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.753+0000 7ff0f959f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0f40b66c0 0x7ff0f40641a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:04.760 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.753+0000 7ff0f959f700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0f41499a0 con 0x7ff0f4067c50 2021-03-25T14:17:04.760 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.753+0000 7ff0f959f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0f4143e40 con 0x7ff0f4067870 2021-03-25T14:17:04.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.753+0000 7ff0f959f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f40b7040 con 0x7ff0f40b66c0 2021-03-25T14:17:04.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.753+0000 7ff0f37fe700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7ff0f4067c50 0x7ff0f41463d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:42202/0 (socket says 172.21.15.110:42202) 2021-03-25T14:17:04.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.753+0000 7ff0f37fe700 1 -- 172.21.15.110:0/3986162011 learned_addr learned my addr 172.21.15.110:0/3986162011 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:04.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.753+0000 7ff0f2ffd700 1 -- 172.21.15.110:0/3986162011 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 379603856 0 0) 0x7ff0f41499a0 con 0x7ff0f4067c50 2021-03-25T14:17:04.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.754+0000 7ff0f3fff700 1 --2- 172.21.15.110:0/3986162011 >> v2:172.21.15.174:3300/0 conn(0x7ff0f4067870 0x7ff0f414a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:04.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.754+0000 7ff0f2ffd700 1 -- 172.21.15.110:0/3986162011 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0e0003270 con 0x7ff0f4067c50 2021-03-25T14:17:04.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.753+0000 7ff0f8d9e700 1 --2- 172.21.15.110:0/3986162011 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0f40b66c0 0x7ff0f40641a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:04.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.754+0000 7ff0f2ffd700 1 -- 172.21.15.110:0/3986162011 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 807915988 0 0) 0x7ff0e0003270 con 0x7ff0f4067c50 2021-03-25T14:17:04.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.754+0000 7ff0f2ffd700 1 -- 172.21.15.110:0/3986162011 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0f40b66c0 msgr2=0x7ff0f40641a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:04.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.754+0000 7ff0f2ffd700 1 --2- 172.21.15.110:0/3986162011 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0f40b66c0 0x7ff0f40641a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:04.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.754+0000 7ff0f2ffd700 1 -- 172.21.15.110:0/3986162011 >> v2:172.21.15.174:3300/0 conn(0x7ff0f4067870 msgr2=0x7ff0f414a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:04.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.754+0000 7ff0f2ffd700 1 --2- 172.21.15.110:0/3986162011 >> v2:172.21.15.174:3300/0 conn(0x7ff0f4067870 0x7ff0f414a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:04.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.754+0000 7ff0f2ffd700 1 -- 172.21.15.110:0/3986162011 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f40b72e0 con 0x7ff0f4067c50 2021-03-25T14:17:04.762 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.754+0000 7ff0f2ffd700 1 -- 172.21.15.110:0/3986162011 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7ff0e8001520 con 0x7ff0f4067c50 2021-03-25T14:17:04.762 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.754+0000 7ff0f2ffd700 1 -- 172.21.15.110:0/3986162011 >> v1:172.21.15.110:6789/0 conn(0x7ff0f4067c50 legacy=0x7ff0f41463d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:04.762 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.754+0000 7ff0f2ffd700 1 --2- 172.21.15.110:0/3986162011 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0e0003760 0x7ff0e0003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:04.762 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.754+0000 7ff0f2ffd700 1 --2- 172.21.15.110:0/3986162011 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0f40b66c0 0x7ff0e0004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:04.762 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.754+0000 7ff0f2ffd700 1 --2- 172.21.15.110:0/3986162011 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0e0004a00 0x7ff0e0004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:04.762 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.754+0000 7ff0f2ffd700 1 -- 172.21.15.110:0/3986162011 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f4143e40 con 0x7ff0e0004a00 2021-03-25T14:17:04.762 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.754+0000 7ff0f2ffd700 1 -- 172.21.15.110:0/3986162011 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f40b7040 con 0x7ff0e0003760 2021-03-25T14:17:04.763 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.754+0000 7ff0f2ffd700 1 -- 172.21.15.110:0/3986162011 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e0004200 con 0x7ff0f40b66c0 2021-03-25T14:17:04.763 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.754+0000 7ff0f8d9e700 1 --2- 172.21.15.110:0/3986162011 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0e0004a00 0x7ff0e0004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:04.763 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.754+0000 7ff0f37fe700 1 --2- 172.21.15.110:0/3986162011 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0f40b66c0 0x7ff0e0004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:04.763 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.754+0000 7ff0f3fff700 1 --2- 172.21.15.110:0/3986162011 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0e0003760 0x7ff0e0003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:04.763 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.754+0000 7ff0f8d9e700 1 -- 172.21.15.110:0/3986162011 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0f40b66c0 msgr2=0x7ff0e0004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:04.763 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.754+0000 7ff0f8d9e700 1 --2- 172.21.15.110:0/3986162011 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0f40b66c0 0x7ff0e0004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:04.764 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.754+0000 7ff0f8d9e700 1 -- 172.21.15.110:0/3986162011 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0e0003760 msgr2=0x7ff0e0003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:04.764 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.754+0000 7ff0f8d9e700 1 --2- 172.21.15.110:0/3986162011 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0e0003760 0x7ff0e0003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:04.764 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.754+0000 7ff0f8d9e700 1 -- 172.21.15.110:0/3986162011 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e0003270 con 0x7ff0e0004a00 2021-03-25T14:17:04.764 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.754+0000 7ff0f8d9e700 1 --2- 172.21.15.110:0/3986162011 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0e0004a00 0x7ff0e0004e80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7ff0ec009ed0 tx=0x7ff0ec009220).ready entity=mon.0 client_cookie=359cbbe833770500 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:04.764 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.755+0000 7ff0f2ffd700 1 -- 172.21.15.110:0/3986162011 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec0095f0 con 0x7ff0e0004a00 2021-03-25T14:17:04.764 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.755+0000 7ff0f2ffd700 1 -- 172.21.15.110:0/3986162011 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ec00ec80 con 0x7ff0e0004a00 2021-03-25T14:17:04.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.755+0000 7ff0f2ffd700 1 -- 172.21.15.110:0/3986162011 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec0123f0 con 0x7ff0e0004a00 2021-03-25T14:17:04.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.755+0000 7ff0f959f700 1 -- 172.21.15.110:0/3986162011 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0e0004a00 msgr2=0x7ff0e0004e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:04.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.755+0000 7ff0f959f700 1 --2- 172.21.15.110:0/3986162011 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0e0004a00 0x7ff0e0004e80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7ff0ec009ed0 tx=0x7ff0ec009220).stop 2021-03-25T14:17:04.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.755+0000 7ff0f8d9e700 1 -- 172.21.15.110:0/3986162011 reap_dead start 2021-03-25T14:17:04.766 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.755+0000 7ff0f959f700 1 -- 172.21.15.110:0/3986162011 shutdown_connections 2021-03-25T14:17:04.766 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.755+0000 7ff0f959f700 1 -- 172.21.15.110:0/3986162011 >> 172.21.15.110:0/3986162011 conn(0x7ff0f4066350 msgr2=0x7ff0f4066760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:04.766 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.755+0000 7ff0f959f700 1 -- 172.21.15.110:0/3986162011 shutdown_connections 2021-03-25T14:17:04.766 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.755+0000 7ff0f959f700 1 -- 172.21.15.110:0/3986162011 wait complete. 2021-03-25T14:17:04.766 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.756+0000 7ff0f959f700 1 Processor -- start 2021-03-25T14:17:04.766 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.756+0000 7ff0f959f700 1 -- start start 2021-03-25T14:17:04.767 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.757+0000 7ff0f959f700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0f40b9da0 0x7ff0f40b58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:04.767 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.757+0000 7ff0f959f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0f41578e0 0x7ff0f409fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:04.767 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.757+0000 7ff0f959f700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0f409afb0 0x7ff0f40a0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:04.767 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.757+0000 7ff0f959f700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f415afc0 con 0x7ff0f40b9da0 2021-03-25T14:17:04.767 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.757+0000 7ff0f959f700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f4156f00 con 0x7ff0f409afb0 2021-03-25T14:17:04.767 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.757+0000 7ff0f959f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f41571a0 con 0x7ff0f41578e0 2021-03-25T14:17:04.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.757+0000 7ff0f3fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0f40b9da0 0x7ff0f40b58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:04.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.757+0000 7ff0f3fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0f40b9da0 0x7ff0f40b58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49276/0 (socket says 172.21.15.110:49276) 2021-03-25T14:17:04.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.757+0000 7ff0f3fff700 1 -- 172.21.15.110:0/3384418593 learned_addr learned my addr 172.21.15.110:0/3384418593 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:04.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.757+0000 7ff0f8d9e700 1 --2- 172.21.15.110:0/3384418593 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0f409afb0 0x7ff0f40a0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:04.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.757+0000 7ff0f37fe700 1 --2- 172.21.15.110:0/3384418593 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0f41578e0 0x7ff0f409fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:04.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.757+0000 7ff0f3fff700 1 -- 172.21.15.110:0/3384418593 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0f41578e0 msgr2=0x7ff0f409fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:04.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.757+0000 7ff0f3fff700 1 --2- 172.21.15.110:0/3384418593 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0f41578e0 0x7ff0f409fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:04.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.757+0000 7ff0f3fff700 1 -- 172.21.15.110:0/3384418593 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0f409afb0 msgr2=0x7ff0f40a0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:04.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.757+0000 7ff0f3fff700 1 --2- 172.21.15.110:0/3384418593 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0f409afb0 0x7ff0f40a0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:04.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.757+0000 7ff0f3fff700 1 -- 172.21.15.110:0/3384418593 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f4157440 con 0x7ff0f40b9da0 2021-03-25T14:17:04.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.757+0000 7ff0f37fe700 1 --2- 172.21.15.110:0/3384418593 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0f41578e0 0x7ff0f409fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:04.768 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.757+0000 7ff0f3fff700 1 --2- 172.21.15.110:0/3384418593 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0f40b9da0 0x7ff0f40b58e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7ff0e4006890 tx=0x7ff0e4006e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:04.769 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.758+0000 7ff0dbfff700 1 -- 172.21.15.110:0/3384418593 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e400b3e0 con 0x7ff0f40b9da0 2021-03-25T14:17:04.769 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.758+0000 7ff0dbfff700 1 -- 172.21.15.110:0/3384418593 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e400fa10 con 0x7ff0f40b9da0 2021-03-25T14:17:04.769 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.758+0000 7ff0dbfff700 1 -- 172.21.15.110:0/3384418593 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e400fd90 con 0x7ff0f40b9da0 2021-03-25T14:17:04.769 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.758+0000 7ff0f959f700 1 -- 172.21.15.110:0/3384418593 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0f4156c20 con 0x7ff0f40b9da0 2021-03-25T14:17:04.769 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.758+0000 7ff0f959f700 1 -- 172.21.15.110:0/3384418593 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0f40ba180 con 0x7ff0f40b9da0 2021-03-25T14:17:04.769 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.759+0000 7ff0f959f700 1 -- 172.21.15.110:0/3384418593 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0f4045ae0 con 0x7ff0f40b9da0 2021-03-25T14:17:04.769 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.759+0000 7ff0dbfff700 1 -- 172.21.15.110:0/3384418593 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7ff0e4014650 con 0x7ff0f40b9da0 2021-03-25T14:17:04.769 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.759+0000 7ff0dbfff700 1 --2- 172.21.15.110:0/3384418593 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff0d405a0b0 0x7ff0d405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:04.769 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.759+0000 7ff0dbfff700 1 -- 172.21.15.110:0/3384418593 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6426+0+0 (secure 0 0 0) 0x7ff0e40744a0 con 0x7ff0f40b9da0 2021-03-25T14:17:04.769 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.759+0000 7ff0f37fe700 1 --2- 172.21.15.110:0/3384418593 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff0d405a0b0 0x7ff0d405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:04.769 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.760+0000 7ff0f37fe700 1 --2- 172.21.15.110:0/3384418593 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff0d405a0b0 0x7ff0d405c570 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7ff0e80078c0 tx=0x7ff0e8009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:04.770 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.763+0000 7ff0dbfff700 1 -- 172.21.15.110:0/3384418593 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7ff0e4047ce0 con 0x7ff0f40b9da0 2021-03-25T14:17:04.916 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.915+0000 7ff0f959f700 1 -- 172.21.15.110:0/3384418593 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0f40693a0 con 0x7ff0f40b9da0 2021-03-25T14:17:04.916 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.916+0000 7ff0dbfff700 1 -- 172.21.15.110:0/3384418593 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+17135 (secure 0 0 0) 0x7ff0e404b300 con 0x7ff0f40b9da0 2021-03-25T14:17:04.917 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:04.917 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":36,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:17:04.328602+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2021-03-25T14:17:02.835058+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2021-03-25T14:17:03.303869+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:17:04.919 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.917+0000 7ff0f959f700 1 -- 172.21.15.110:0/3384418593 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff0d405a0b0 msgr2=0x7ff0d405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:04.919 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.917+0000 7ff0f959f700 1 --2- 172.21.15.110:0/3384418593 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff0d405a0b0 0x7ff0d405c570 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7ff0e80078c0 tx=0x7ff0e8009040).stop 2021-03-25T14:17:04.919 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.917+0000 7ff0f959f700 1 -- 172.21.15.110:0/3384418593 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0f40b9da0 msgr2=0x7ff0f40b58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:04.919 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.917+0000 7ff0f959f700 1 --2- 172.21.15.110:0/3384418593 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0f40b9da0 0x7ff0f40b58e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7ff0e4006890 tx=0x7ff0e4006e20).stop 2021-03-25T14:17:04.919 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.917+0000 7ff0f959f700 1 -- 172.21.15.110:0/3384418593 shutdown_connections 2021-03-25T14:17:04.919 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.917+0000 7ff0f959f700 1 --2- 172.21.15.110:0/3384418593 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff0d405a0b0 0x7ff0d405c570 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:04.919 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.917+0000 7ff0f959f700 1 --2- 172.21.15.110:0/3384418593 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0f409afb0 0x7ff0f40a0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:04.919 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.917+0000 7ff0f959f700 1 --2- 172.21.15.110:0/3384418593 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0f40b9da0 0x7ff0f40b58e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:04.919 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.917+0000 7ff0f959f700 1 --2- 172.21.15.110:0/3384418593 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0f41578e0 0x7ff0f409fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:04.919 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.917+0000 7ff0f959f700 1 -- 172.21.15.110:0/3384418593 >> 172.21.15.110:0/3384418593 conn(0x7ff0f4066350 msgr2=0x7ff0f4149380 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:04.919 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.917+0000 7ff0f959f700 1 -- 172.21.15.110:0/3384418593 shutdown_connections 2021-03-25T14:17:04.920 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:04.917+0000 7ff0f959f700 1 -- 172.21.15.110:0/3384418593 wait complete. 2021-03-25T14:17:04.930 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-03-25T14:17:05.046 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.045+0000 7f01c1521700 1 Processor -- start 2021-03-25T14:17:05.046 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.045+0000 7f01c1521700 1 -- start start 2021-03-25T14:17:05.048 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.045+0000 7f01c1521700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f01bc064800 0x7f01bc064be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:05.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.045+0000 7f01c1521700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01bc065d30 0x7f01bc149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:05.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.045+0000 7f01c1521700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01bc14cf60 con 0x7f01bc066c30 2021-03-25T14:17:05.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.045+0000 7f01c1521700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01bc14d200 con 0x7f01bc064800 2021-03-25T14:17:05.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.045+0000 7f01c1521700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc14d4a0 con 0x7f01bc065d30 2021-03-25T14:17:05.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.046+0000 7f01bb7fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01bc065d30 0x7f01bc149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:05.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.046+0000 7f01baffd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f01bc064800 0x7f01bc064be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:05.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.046+0000 7f01ba7fc700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f01bc066c30 0x7f01bc065620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.110:49886/0 (socket says 172.21.15.110:49886) 2021-03-25T14:17:05.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.046+0000 7f01bb7fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01bc065d30 0x7f01bc149dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.110:41684/0 (socket says 172.21.15.110:41684) 2021-03-25T14:17:05.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.046+0000 7f01ba7fc700 1 -- 172.21.15.110:0/3069987728 learned_addr learned my addr 172.21.15.110:0/3069987728 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:05.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.046+0000 7f01b9ffb700 1 -- 172.21.15.110:0/3069987728 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 400764303 0 0) 0x7f01bc14cf60 con 0x7f01bc066c30 2021-03-25T14:17:05.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.046+0000 7f01b9ffb700 1 -- 172.21.15.110:0/3069987728 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01a8003270 con 0x7f01bc066c30 2021-03-25T14:17:05.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.046+0000 7f01bb7fe700 1 -- 172.21.15.110:0/3069987728 >> v2:172.21.15.174:3300/0 conn(0x7f01bc064800 msgr2=0x7f01bc064be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:05.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.046+0000 7f01bb7fe700 1 --2- 172.21.15.110:0/3069987728 >> v2:172.21.15.174:3300/0 conn(0x7f01bc064800 0x7f01bc064be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:05.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.046+0000 7f01bb7fe700 1 -- 172.21.15.110:0/3069987728 >> v1:172.21.15.174:6789/0 conn(0x7f01bc066c30 legacy=0x7f01bc065620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:05.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.046+0000 7f01bb7fe700 1 -- 172.21.15.110:0/3069987728 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01bc14d740 con 0x7f01bc065d30 2021-03-25T14:17:05.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.046+0000 7f01bb7fe700 1 --2- 172.21.15.110:0/3069987728 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01bc065d30 0x7f01bc149dc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f01b4009cc0 tx=0x7f01b4009220).ready entity=mon.2 client_cookie=cf47a60a14b081ff server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:05.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.047+0000 7f01b9ffb700 1 -- 172.21.15.110:0/3069987728 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b400b960 con 0x7f01bc065d30 2021-03-25T14:17:05.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.047+0000 7f01b9ffb700 1 -- 172.21.15.110:0/3069987728 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b400bac0 con 0x7f01bc065d30 2021-03-25T14:17:05.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.047+0000 7f01b9ffb700 1 -- 172.21.15.110:0/3069987728 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b400be40 con 0x7f01bc065d30 2021-03-25T14:17:05.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.047+0000 7f01c1521700 1 -- 172.21.15.110:0/3069987728 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01bc065d30 msgr2=0x7f01bc149dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:05.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.047+0000 7f01c1521700 1 --2- 172.21.15.110:0/3069987728 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01bc065d30 0x7f01bc149dc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f01b4009cc0 tx=0x7f01b4009220).stop 2021-03-25T14:17:05.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.047+0000 7f01c1521700 1 -- 172.21.15.110:0/3069987728 shutdown_connections 2021-03-25T14:17:05.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.047+0000 7f01c1521700 1 --2- 172.21.15.110:0/3069987728 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01bc065d30 0x7f01bc149dc0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:05.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.047+0000 7f01c1521700 1 --2- 172.21.15.110:0/3069987728 >> v2:172.21.15.174:3300/0 conn(0x7f01bc064800 0x7f01bc064be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:05.051 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.047+0000 7f01c1521700 1 -- 172.21.15.110:0/3069987728 >> 172.21.15.110:0/3069987728 conn(0x7f01bc060c40 msgr2=0x7f01bc061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:05.051 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.047+0000 7f01c1521700 1 -- 172.21.15.110:0/3069987728 shutdown_connections 2021-03-25T14:17:05.051 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.047+0000 7f01c1521700 1 -- 172.21.15.110:0/3069987728 wait complete. 2021-03-25T14:17:05.053 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.048+0000 7f01c1521700 1 Processor -- start 2021-03-25T14:17:05.053 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.048+0000 7f01c1521700 1 -- start start 2021-03-25T14:17:05.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.049+0000 7f01c1521700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01bc064800 0x7f01bc0b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:05.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.049+0000 7f01c1521700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01bc065d30 0x7f01bc1591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:05.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.049+0000 7f01c1521700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01bc066c30 0x7f01bc0bdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:05.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.049+0000 7f01c1521700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc0ba3c0 con 0x7f01bc064800 2021-03-25T14:17:05.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.049+0000 7f01c1521700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc0b9e80 con 0x7f01bc066c30 2021-03-25T14:17:05.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.049+0000 7f01c1521700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc0ba120 con 0x7f01bc065d30 2021-03-25T14:17:05.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.049+0000 7f01baffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01bc064800 0x7f01bc0b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:05.055 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.049+0000 7f01baffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01bc064800 0x7f01bc0b2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49290/0 (socket says 172.21.15.110:49290) 2021-03-25T14:17:05.055 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.049+0000 7f01baffd700 1 -- 172.21.15.110:0/1598400909 learned_addr learned my addr 172.21.15.110:0/1598400909 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:05.055 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.049+0000 7f01ba7fc700 1 --2- 172.21.15.110:0/1598400909 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01bc065d30 0x7f01bc1591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:05.055 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.049+0000 7f01bb7fe700 1 --2- 172.21.15.110:0/1598400909 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01bc066c30 0x7f01bc0bdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:05.055 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.050+0000 7f01baffd700 1 -- 172.21.15.110:0/1598400909 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01bc065d30 msgr2=0x7f01bc1591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:05.055 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.050+0000 7f01baffd700 1 --2- 172.21.15.110:0/1598400909 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01bc065d30 0x7f01bc1591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:05.055 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.050+0000 7f01baffd700 1 -- 172.21.15.110:0/1598400909 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01bc066c30 msgr2=0x7f01bc0bdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:05.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.050+0000 7f01baffd700 1 --2- 172.21.15.110:0/1598400909 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01bc066c30 0x7f01bc0bdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:05.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.050+0000 7f01baffd700 1 -- 172.21.15.110:0/1598400909 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01bc158aa0 con 0x7f01bc064800 2021-03-25T14:17:05.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.050+0000 7f01ba7fc700 1 --2- 172.21.15.110:0/1598400909 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01bc065d30 0x7f01bc1591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:05.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.050+0000 7f01baffd700 1 --2- 172.21.15.110:0/1598400909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01bc064800 0x7f01bc0b2f20 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f01b000ebd0 tx=0x7f01b0006e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:05.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.050+0000 7f01a2ffd700 1 -- 172.21.15.110:0/1598400909 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b000ca60 con 0x7f01bc064800 2021-03-25T14:17:05.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.050+0000 7f01a2ffd700 1 -- 172.21.15.110:0/1598400909 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b000cbc0 con 0x7f01bc064800 2021-03-25T14:17:05.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.050+0000 7f01c1521700 1 -- 172.21.15.110:0/1598400909 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01bc158d40 con 0x7f01bc064800 2021-03-25T14:17:05.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.050+0000 7f01a2ffd700 1 -- 172.21.15.110:0/1598400909 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b00123f0 con 0x7f01bc064800 2021-03-25T14:17:05.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.050+0000 7f01c1521700 1 -- 172.21.15.110:0/1598400909 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01bc0b9a50 con 0x7f01bc064800 2021-03-25T14:17:05.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.051+0000 7f01c1521700 1 -- 172.21.15.110:0/1598400909 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01bc05d7b0 con 0x7f01bc064800 2021-03-25T14:17:05.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.051+0000 7f01a2ffd700 1 -- 172.21.15.110:0/1598400909 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f01b0012760 con 0x7f01bc064800 2021-03-25T14:17:05.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.051+0000 7f01a2ffd700 1 --2- 172.21.15.110:0/1598400909 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f019c05a0b0 0x7f019c05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:05.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.051+0000 7f01a2ffd700 1 -- 172.21.15.110:0/1598400909 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6426+0+0 (secure 0 0 0) 0x7f01b00742c0 con 0x7f01bc064800 2021-03-25T14:17:05.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.051+0000 7f01ba7fc700 1 --2- 172.21.15.110:0/1598400909 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f019c05a0b0 0x7f019c05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:05.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.052+0000 7f01ba7fc700 1 --2- 172.21.15.110:0/1598400909 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f019c05a0b0 0x7f019c05c570 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f01ac007fd0 tx=0x7f01ac009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:05.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.055+0000 7f01a2ffd700 1 -- 172.21.15.110:0/1598400909 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f01b0047b00 con 0x7f01bc064800 2021-03-25T14:17:05.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.241+0000 7f01c1521700 1 -- 172.21.15.110:0/1598400909 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f01bc061c50 con 0x7f01bc064800 2021-03-25T14:17:05.336 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.335+0000 7f01a2ffd700 1 -- 172.21.15.110:0/1598400909 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f01b004b120 con 0x7f01bc064800 2021-03-25T14:17:05.338 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.337+0000 7f01c1521700 1 -- 172.21.15.110:0/1598400909 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f019c05a0b0 msgr2=0x7f019c05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:05.338 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.337+0000 7f01c1521700 1 --2- 172.21.15.110:0/1598400909 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f019c05a0b0 0x7f019c05c570 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f01ac007fd0 tx=0x7f01ac009040).stop 2021-03-25T14:17:05.338 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.337+0000 7f01c1521700 1 -- 172.21.15.110:0/1598400909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01bc064800 msgr2=0x7f01bc0b2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:05.338 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.337+0000 7f01c1521700 1 --2- 172.21.15.110:0/1598400909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01bc064800 0x7f01bc0b2f20 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f01b000ebd0 tx=0x7f01b0006e20).stop 2021-03-25T14:17:05.339 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.337+0000 7f01c1521700 1 -- 172.21.15.110:0/1598400909 shutdown_connections 2021-03-25T14:17:05.339 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.337+0000 7f01c1521700 1 --2- 172.21.15.110:0/1598400909 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f019c05a0b0 0x7f019c05c570 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:05.339 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.337+0000 7f01c1521700 1 --2- 172.21.15.110:0/1598400909 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01bc066c30 0x7f01bc0bdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:05.339 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.337+0000 7f01c1521700 1 --2- 172.21.15.110:0/1598400909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01bc064800 0x7f01bc0b2f20 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:05.339 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.337+0000 7f01c1521700 1 --2- 172.21.15.110:0/1598400909 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01bc065d30 0x7f01bc1591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:05.339 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.337+0000 7f01c1521700 1 -- 172.21.15.110:0/1598400909 >> 172.21.15.110:0/1598400909 conn(0x7f01bc060c40 msgr2=0x7f01bc14bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:05.339 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.337+0000 7f01c1521700 1 -- 172.21.15.110:0/1598400909 shutdown_connections 2021-03-25T14:17:05.339 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.337+0000 7f01c1521700 1 -- 172.21.15.110:0/1598400909 wait complete. 2021-03-25T14:17:05.351 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-03-25T14:17:05.461 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.460+0000 7f3e8bae6700 1 Processor -- start 2021-03-25T14:17:05.461 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.461+0000 7f3e8bae6700 1 -- start start 2021-03-25T14:17:05.464 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.461+0000 7f3e8bae6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3e840bbca0 0x7f3e84067840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:05.464 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.461+0000 7f3e8bae6700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3e84144960 0x7f3e84144da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:05.464 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.461+0000 7f3e8bae6700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e840afee0 con 0x7f3e84068ac0 2021-03-25T14:17:05.464 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.461+0000 7f3e8bae6700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e84145d40 con 0x7f3e84144960 2021-03-25T14:17:05.464 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.461+0000 7f3e8bae6700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e84145fe0 con 0x7f3e840bbca0 2021-03-25T14:17:05.464 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.462+0000 7f3e8a083700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3e84144960 0x7f3e84144da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:05.464 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.462+0000 7f3e8a083700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3e84144960 0x7f3e84144da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49298/0 (socket says 172.21.15.110:49298) 2021-03-25T14:17:05.465 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.462+0000 7f3e8a083700 1 -- 172.21.15.110:0/4081745115 learned_addr learned my addr 172.21.15.110:0/4081745115 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:05.465 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.462+0000 7f3e89081700 1 --1- 172.21.15.110:0/4081745115 >> v1:172.21.15.110:6789/0 conn(0x7f3e84068ac0 0x7f3e840acf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:42234/0 (socket says 172.21.15.110:42234) 2021-03-25T14:17:05.465 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.462+0000 7f3e89882700 1 --2- 172.21.15.110:0/4081745115 >> v2:172.21.15.174:3300/0 conn(0x7f3e840bbca0 0x7f3e84067840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:05.465 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.462+0000 7f3e8a083700 1 -- 172.21.15.110:0/4081745115 >> v2:172.21.15.174:3300/0 conn(0x7f3e840bbca0 msgr2=0x7f3e84067840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:05.465 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.462+0000 7f3e8a083700 1 --2- 172.21.15.110:0/4081745115 >> v2:172.21.15.174:3300/0 conn(0x7f3e840bbca0 0x7f3e84067840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:05.465 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.462+0000 7f3e8a083700 1 -- 172.21.15.110:0/4081745115 >> v1:172.21.15.110:6789/0 conn(0x7f3e84068ac0 legacy=0x7f3e840acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:05.465 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.462+0000 7f3e8a083700 1 -- 172.21.15.110:0/4081745115 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e84145b10 con 0x7f3e84144960 2021-03-25T14:17:05.465 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.462+0000 7f3e88880700 1 -- 172.21.15.110:0/4081745115 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3197604475 0 0) 0x7f3e840afee0 con 0x7f3e84068ac0 2021-03-25T14:17:05.466 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.462+0000 7f3e8a083700 1 --2- 172.21.15.110:0/4081745115 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e84144960 0x7f3e84144da0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f3e84067140 tx=0x7f3e7c00b570).ready entity=mon.0 client_cookie=863e2b5d9e2bb6c5 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:05.466 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.462+0000 7f3e88880700 1 -- 172.21.15.110:0/4081745115 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c010680 con 0x7f3e84144960 2021-03-25T14:17:05.466 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.462+0000 7f3e88880700 1 -- 172.21.15.110:0/4081745115 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7c0107e0 con 0x7f3e84144960 2021-03-25T14:17:05.466 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.462+0000 7f3e88880700 1 -- 172.21.15.110:0/4081745115 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c010b60 con 0x7f3e84144960 2021-03-25T14:17:05.466 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.463+0000 7f3e8bae6700 1 -- 172.21.15.110:0/4081745115 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e84144960 msgr2=0x7f3e84144da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:05.466 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.463+0000 7f3e8bae6700 1 --2- 172.21.15.110:0/4081745115 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e84144960 0x7f3e84144da0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f3e84067140 tx=0x7f3e7c00b570).stop 2021-03-25T14:17:05.466 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.463+0000 7f3e8bae6700 1 -- 172.21.15.110:0/4081745115 shutdown_connections 2021-03-25T14:17:05.466 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.463+0000 7f3e8bae6700 1 --2- 172.21.15.110:0/4081745115 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e84144960 0x7f3e84144da0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:05.466 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.463+0000 7f3e8bae6700 1 --2- 172.21.15.110:0/4081745115 >> v2:172.21.15.174:3300/0 conn(0x7f3e840bbca0 0x7f3e84067840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:05.466 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.463+0000 7f3e8bae6700 1 -- 172.21.15.110:0/4081745115 >> 172.21.15.110:0/4081745115 conn(0x7f3e84063850 msgr2=0x7f3e8405c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:05.466 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.463+0000 7f3e8bae6700 1 -- 172.21.15.110:0/4081745115 shutdown_connections 2021-03-25T14:17:05.467 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.463+0000 7f3e8bae6700 1 -- 172.21.15.110:0/4081745115 wait complete. 2021-03-25T14:17:05.469 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.464+0000 7f3e8bae6700 1 Processor -- start 2021-03-25T14:17:05.469 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.464+0000 7f3e8bae6700 1 -- start start 2021-03-25T14:17:05.469 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.465+0000 7f3e8bae6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3e84068ac0 0x7f3e8413ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:05.470 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.465+0000 7f3e8bae6700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e840bbca0 0x7f3e8413f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:05.470 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.465+0000 7f3e8bae6700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3e84144960 0x7f3e840af3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:05.470 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.465+0000 7f3e8bae6700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e840b0e50 con 0x7f3e840bbca0 2021-03-25T14:17:05.470 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.465+0000 7f3e8bae6700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8413ef10 con 0x7f3e84144960 2021-03-25T14:17:05.470 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.465+0000 7f3e8bae6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e841578d0 con 0x7f3e84068ac0 2021-03-25T14:17:05.470 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.465+0000 7f3e89081700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e840bbca0 0x7f3e8413f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:05.470 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.465+0000 7f3e89081700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e840bbca0 0x7f3e8413f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49304/0 (socket says 172.21.15.110:49304) 2021-03-25T14:17:05.470 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.465+0000 7f3e89081700 1 -- 172.21.15.110:0/3013989275 learned_addr learned my addr 172.21.15.110:0/3013989275 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:05.470 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.465+0000 7f3e89882700 1 --2- 172.21.15.110:0/3013989275 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3e84068ac0 0x7f3e8413ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:05.470 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.465+0000 7f3e8a083700 1 --2- 172.21.15.110:0/3013989275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3e84144960 0x7f3e840af3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:05.470 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.465+0000 7f3e89081700 1 -- 172.21.15.110:0/3013989275 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3e84068ac0 msgr2=0x7f3e8413ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:05.470 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.465+0000 7f3e89081700 1 --2- 172.21.15.110:0/3013989275 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3e84068ac0 0x7f3e8413ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:05.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.465+0000 7f3e89081700 1 -- 172.21.15.110:0/3013989275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3e84144960 msgr2=0x7f3e840af3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:05.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.465+0000 7f3e89081700 1 --2- 172.21.15.110:0/3013989275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3e84144960 0x7f3e840af3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:05.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.465+0000 7f3e89081700 1 -- 172.21.15.110:0/3013989275 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e84157b70 con 0x7f3e840bbca0 2021-03-25T14:17:05.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.465+0000 7f3e8a083700 1 --2- 172.21.15.110:0/3013989275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3e84144960 0x7f3e840af3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:05.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.465+0000 7f3e89081700 1 --2- 172.21.15.110:0/3013989275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e840bbca0 0x7f3e8413f320 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f3e7400c740 tx=0x7f3e74007b10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:05.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.465+0000 7f3e71ffb700 1 -- 172.21.15.110:0/3013989275 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e740072e0 con 0x7f3e840bbca0 2021-03-25T14:17:05.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.465+0000 7f3e71ffb700 1 -- 172.21.15.110:0/3013989275 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e74005560 con 0x7f3e840bbca0 2021-03-25T14:17:05.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.465+0000 7f3e8bae6700 1 -- 172.21.15.110:0/3013989275 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e84157e10 con 0x7f3e840bbca0 2021-03-25T14:17:05.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.465+0000 7f3e71ffb700 1 -- 172.21.15.110:0/3013989275 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e740058e0 con 0x7f3e840bbca0 2021-03-25T14:17:05.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.466+0000 7f3e8bae6700 1 -- 172.21.15.110:0/3013989275 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e840b0730 con 0x7f3e840bbca0 2021-03-25T14:17:05.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.466+0000 7f3e8bae6700 1 -- 172.21.15.110:0/3013989275 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e840678a0 con 0x7f3e840bbca0 2021-03-25T14:17:05.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.467+0000 7f3e71ffb700 1 -- 172.21.15.110:0/3013989275 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f3e74010070 con 0x7f3e840bbca0 2021-03-25T14:17:05.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.467+0000 7f3e71ffb700 1 --2- 172.21.15.110:0/3013989275 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3e6405a0b0 0x7f3e6405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:05.472 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.467+0000 7f3e71ffb700 1 -- 172.21.15.110:0/3013989275 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6426+0+0 (secure 0 0 0) 0x7f3e740734f0 con 0x7f3e840bbca0 2021-03-25T14:17:05.472 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.467+0000 7f3e89882700 1 --2- 172.21.15.110:0/3013989275 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3e6405a0b0 0x7f3e6405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:05.472 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.467+0000 7f3e89882700 1 --2- 172.21.15.110:0/3013989275 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3e6405a0b0 0x7f3e6405c570 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f3e80006fd0 tx=0x7f3e80008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:05.472 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.471+0000 7f3e71ffb700 1 -- 172.21.15.110:0/3013989275 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f3e74046cd0 con 0x7f3e840bbca0 2021-03-25T14:17:05.656 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.655+0000 7f3e8bae6700 1 -- 172.21.15.110:0/3013989275 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e84158270 con 0x7f3e840bbca0 2021-03-25T14:17:05.657 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.656+0000 7f3e71ffb700 1 -- 172.21.15.110:0/3013989275 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+2847 (secure 0 0 0) 0x7f3e7404a2f0 con 0x7f3e840bbca0 2021-03-25T14:17:05.657 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:05.657 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4804,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6834/4176268149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4176268149},{"type":"v1","addr":"172.21.15.174:6834","nonce":4176268149}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":12},{"gid":4807,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/1554277551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6833","nonce":1554277551},{"type":"v1","addr":"172.21.15.174:6835","nonce":1554277551}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":13},{"gid":5025,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.110:6836/2267546898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2267546898},{"type":"v1","addr":"172.21.15.110:6836","nonce":2267546898}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":13}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-03-25T14:17:04.328765+0000","modified":"2021-03-25T14:17:05.329972+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6837/503424314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":503424314},{"type":"v1","addr":"172.21.15.110:6837","nonce":503424314}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-03-25T14:17:05.659 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.658+0000 7f3e8bae6700 1 -- 172.21.15.110:0/3013989275 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3e6405a0b0 msgr2=0x7f3e6405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:05.659 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.658+0000 7f3e8bae6700 1 --2- 172.21.15.110:0/3013989275 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3e6405a0b0 0x7f3e6405c570 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f3e80006fd0 tx=0x7f3e80008040).stop 2021-03-25T14:17:05.659 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.658+0000 7f3e8bae6700 1 -- 172.21.15.110:0/3013989275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e840bbca0 msgr2=0x7f3e8413f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:05.659 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.658+0000 7f3e8bae6700 1 --2- 172.21.15.110:0/3013989275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e840bbca0 0x7f3e8413f320 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f3e7400c740 tx=0x7f3e74007b10).stop 2021-03-25T14:17:05.659 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.658+0000 7f3e8bae6700 1 -- 172.21.15.110:0/3013989275 shutdown_connections 2021-03-25T14:17:05.659 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.658+0000 7f3e8bae6700 1 --2- 172.21.15.110:0/3013989275 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3e6405a0b0 0x7f3e6405c570 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:05.659 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.658+0000 7f3e8bae6700 1 --2- 172.21.15.110:0/3013989275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3e84144960 0x7f3e840af3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:05.660 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.658+0000 7f3e8bae6700 1 --2- 172.21.15.110:0/3013989275 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3e84068ac0 0x7f3e8413ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:05.660 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.658+0000 7f3e8bae6700 1 --2- 172.21.15.110:0/3013989275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e840bbca0 0x7f3e8413f320 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:05.660 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.658+0000 7f3e8bae6700 1 -- 172.21.15.110:0/3013989275 >> 172.21.15.110:0/3013989275 conn(0x7f3e84063850 msgr2=0x7f3e84144d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:05.660 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.658+0000 7f3e8bae6700 1 -- 172.21.15.110:0/3013989275 shutdown_connections 2021-03-25T14:17:05.660 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.658+0000 7f3e8bae6700 1 -- 172.21.15.110:0/3013989275 wait complete. 2021-03-25T14:17:05.660 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 15 2021-03-25T14:17:05.670 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:17:05.779 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.778+0000 7fe447c23700 1 Processor -- start 2021-03-25T14:17:05.780 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.779+0000 7fe447c23700 1 -- start start 2021-03-25T14:17:05.782 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.779+0000 7fe447c23700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe4400b9730 0x7fe44014cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:05.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.779+0000 7fe447c23700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe4400667d0 0x7fe44014d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:05.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.779+0000 7fe447c23700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe4400a1f20 0x7fe44014d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:05.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.779+0000 7fe447c23700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe44014db10 con 0x7fe4400b9730 2021-03-25T14:17:05.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.779+0000 7fe447c23700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4400a1b90 con 0x7fe4400a1f20 2021-03-25T14:17:05.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.779+0000 7fe447c23700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe440064680 con 0x7fe4400667d0 2021-03-25T14:17:05.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.780+0000 7fe4459bf700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe4400b9730 0x7fe44014cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:05.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.780+0000 7fe4459bf700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe4400b9730 0x7fe44014cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49310/0 (socket says 172.21.15.110:49310) 2021-03-25T14:17:05.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.780+0000 7fe4459bf700 1 -- 172.21.15.110:0/3484202208 learned_addr learned my addr 172.21.15.110:0/3484202208 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:05.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.780+0000 7fe4461c0700 1 --2- 172.21.15.110:0/3484202208 >> v2:172.21.15.174:3300/0 conn(0x7fe4400a1f20 0x7fe44014d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:05.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.780+0000 7fe4451be700 1 --2- 172.21.15.110:0/3484202208 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe4400667d0 0x7fe44014d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:05.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.780+0000 7fe4459bf700 1 -- 172.21.15.110:0/3484202208 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe4400667d0 msgr2=0x7fe44014d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:05.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.780+0000 7fe4459bf700 1 --2- 172.21.15.110:0/3484202208 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe4400667d0 0x7fe44014d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:05.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.780+0000 7fe4459bf700 1 -- 172.21.15.110:0/3484202208 >> v2:172.21.15.174:3300/0 conn(0x7fe4400a1f20 msgr2=0x7fe44014d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:05.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.780+0000 7fe4459bf700 1 --2- 172.21.15.110:0/3484202208 >> v2:172.21.15.174:3300/0 conn(0x7fe4400a1f20 0x7fe44014d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:05.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.780+0000 7fe4459bf700 1 -- 172.21.15.110:0/3484202208 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe440064840 con 0x7fe4400b9730 2021-03-25T14:17:05.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.780+0000 7fe4459bf700 1 --2- 172.21.15.110:0/3484202208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4400b9730 0x7fe44014cc40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7fe43c00ba80 tx=0x7fe43c006ee0).ready entity=mon.0 client_cookie=392791cac50bc39b server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:05.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.780+0000 7fe4449bd700 1 -- 172.21.15.110:0/3484202208 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c009920 con 0x7fe4400b9730 2021-03-25T14:17:05.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.780+0000 7fe4449bd700 1 -- 172.21.15.110:0/3484202208 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe43c009a80 con 0x7fe4400b9730 2021-03-25T14:17:05.785 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.780+0000 7fe4449bd700 1 -- 172.21.15.110:0/3484202208 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c009e00 con 0x7fe4400b9730 2021-03-25T14:17:05.785 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.781+0000 7fe447c23700 1 -- 172.21.15.110:0/3484202208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4400b9730 msgr2=0x7fe44014cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:05.785 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.781+0000 7fe447c23700 1 --2- 172.21.15.110:0/3484202208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4400b9730 0x7fe44014cc40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7fe43c00ba80 tx=0x7fe43c006ee0).stop 2021-03-25T14:17:05.785 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.781+0000 7fe447c23700 1 -- 172.21.15.110:0/3484202208 shutdown_connections 2021-03-25T14:17:05.785 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.781+0000 7fe447c23700 1 --2- 172.21.15.110:0/3484202208 >> v2:172.21.15.174:3300/0 conn(0x7fe4400a1f20 0x7fe44014d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:05.785 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.781+0000 7fe447c23700 1 --2- 172.21.15.110:0/3484202208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4400b9730 0x7fe44014cc40 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:05.785 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.781+0000 7fe447c23700 1 --2- 172.21.15.110:0/3484202208 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe4400667d0 0x7fe44014d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:05.785 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.781+0000 7fe447c23700 1 -- 172.21.15.110:0/3484202208 >> 172.21.15.110:0/3484202208 conn(0x7fe4400bce50 msgr2=0x7fe4400b8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:05.785 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.781+0000 7fe447c23700 1 -- 172.21.15.110:0/3484202208 shutdown_connections 2021-03-25T14:17:05.785 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.781+0000 7fe447c23700 1 -- 172.21.15.110:0/3484202208 wait complete. 2021-03-25T14:17:05.785 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.782+0000 7fe447c23700 1 Processor -- start 2021-03-25T14:17:05.785 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.782+0000 7fe447c23700 1 -- start start 2021-03-25T14:17:05.788 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.783+0000 7fe447c23700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe4400667d0 0x7fe4400b7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:05.789 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.783+0000 7fe447c23700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4400a1f20 0x7fe4400a0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:05.789 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.783+0000 7fe447c23700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4400b9730 0x7fe440143f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:05.789 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.783+0000 7fe447c23700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4400b6e70 con 0x7fe4400b9730 2021-03-25T14:17:05.789 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.783+0000 7fe447c23700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4400b84e0 con 0x7fe4400a1f20 2021-03-25T14:17:05.789 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.783+0000 7fe447c23700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe44014c560 con 0x7fe4400667d0 2021-03-25T14:17:05.789 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.783+0000 7fe4461c0700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4400b9730 0x7fe440143f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:05.789 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.783+0000 7fe4461c0700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4400b9730 0x7fe440143f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49318/0 (socket says 172.21.15.110:49318) 2021-03-25T14:17:05.789 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.783+0000 7fe4461c0700 1 -- 172.21.15.110:0/1458675957 learned_addr learned my addr 172.21.15.110:0/1458675957 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:05.789 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.783+0000 7fe4459bf700 1 --2- 172.21.15.110:0/1458675957 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe4400667d0 0x7fe4400b7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:05.789 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.783+0000 7fe4451be700 1 --2- 172.21.15.110:0/1458675957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4400a1f20 0x7fe4400a0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:05.789 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.783+0000 7fe4461c0700 1 -- 172.21.15.110:0/1458675957 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe4400667d0 msgr2=0x7fe4400b7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:05.790 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.783+0000 7fe4461c0700 1 --2- 172.21.15.110:0/1458675957 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe4400667d0 0x7fe4400b7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:05.790 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.783+0000 7fe4461c0700 1 -- 172.21.15.110:0/1458675957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4400a1f20 msgr2=0x7fe4400a0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:05.790 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.783+0000 7fe4461c0700 1 --2- 172.21.15.110:0/1458675957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4400a1f20 0x7fe4400a0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:05.790 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.783+0000 7fe4461c0700 1 -- 172.21.15.110:0/1458675957 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe44014b500 con 0x7fe4400b9730 2021-03-25T14:17:05.790 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.783+0000 7fe4461c0700 1 --2- 172.21.15.110:0/1458675957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4400b9730 0x7fe440143f80 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7fe43800ebf0 tx=0x7fe438008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:05.790 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.783+0000 7fe42dffb700 1 -- 172.21.15.110:0/1458675957 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43800c7c0 con 0x7fe4400b9730 2021-03-25T14:17:05.790 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.783+0000 7fe42dffb700 1 -- 172.21.15.110:0/1458675957 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe43800c920 con 0x7fe4400b9730 2021-03-25T14:17:05.790 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.783+0000 7fe447c23700 1 -- 172.21.15.110:0/1458675957 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe44014b7a0 con 0x7fe4400b9730 2021-03-25T14:17:05.790 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.783+0000 7fe42dffb700 1 -- 172.21.15.110:0/1458675957 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43800cce0 con 0x7fe4400b9730 2021-03-25T14:17:05.790 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.783+0000 7fe447c23700 1 -- 172.21.15.110:0/1458675957 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4400b7610 con 0x7fe4400b9730 2021-03-25T14:17:05.790 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.784+0000 7fe447c23700 1 -- 172.21.15.110:0/1458675957 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe44005d7b0 con 0x7fe4400b9730 2021-03-25T14:17:05.790 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.785+0000 7fe42dffb700 1 -- 172.21.15.110:0/1458675957 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fe438013640 con 0x7fe4400b9730 2021-03-25T14:17:05.791 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.785+0000 7fe42dffb700 1 --2- 172.21.15.110:0/1458675957 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe42005a0b0 0x7fe42005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:05.791 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.785+0000 7fe42dffb700 1 -- 172.21.15.110:0/1458675957 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6426+0+0 (secure 0 0 0) 0x7fe4380745f0 con 0x7fe4400b9730 2021-03-25T14:17:05.791 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.785+0000 7fe4459bf700 1 --2- 172.21.15.110:0/1458675957 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe42005a0b0 0x7fe42005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:05.791 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.786+0000 7fe4459bf700 1 --2- 172.21.15.110:0/1458675957 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe42005a0b0 0x7fe42005c570 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fe43c006f20 tx=0x7fe43c016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:05.791 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.789+0000 7fe42dffb700 1 -- 172.21.15.110:0/1458675957 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fe438047da0 con 0x7fe4400b9730 2021-03-25T14:17:05.938 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.938+0000 7fe447c23700 1 -- 172.21.15.110:0/1458675957 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4400625c0 con 0x7fe4400b9730 2021-03-25T14:17:05.939 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.938+0000 7fe42dffb700 1 -- 172.21.15.110:0/1458675957 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+17122 (secure 0 0 0) 0x7fe43804b3c0 con 0x7fe4400b9730 2021-03-25T14:17:05.940 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:05.940 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":37,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:17:05.330250+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2021-03-25T14:17:02.835058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2021-03-25T14:17:03.303869+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:17:05.941 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.940+0000 7fe447c23700 1 -- 172.21.15.110:0/1458675957 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe42005a0b0 msgr2=0x7fe42005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:05.941 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.940+0000 7fe447c23700 1 --2- 172.21.15.110:0/1458675957 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe42005a0b0 0x7fe42005c570 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fe43c006f20 tx=0x7fe43c016000).stop 2021-03-25T14:17:05.941 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.940+0000 7fe447c23700 1 -- 172.21.15.110:0/1458675957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4400b9730 msgr2=0x7fe440143f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:05.942 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.940+0000 7fe447c23700 1 --2- 172.21.15.110:0/1458675957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4400b9730 0x7fe440143f80 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7fe43800ebf0 tx=0x7fe438008040).stop 2021-03-25T14:17:05.942 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.940+0000 7fe447c23700 1 -- 172.21.15.110:0/1458675957 shutdown_connections 2021-03-25T14:17:05.942 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.940+0000 7fe447c23700 1 --2- 172.21.15.110:0/1458675957 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe42005a0b0 0x7fe42005c570 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:05.942 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.940+0000 7fe447c23700 1 --2- 172.21.15.110:0/1458675957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4400b9730 0x7fe440143f80 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:05.942 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.940+0000 7fe447c23700 1 --2- 172.21.15.110:0/1458675957 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe4400667d0 0x7fe4400b7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:05.942 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.940+0000 7fe447c23700 1 --2- 172.21.15.110:0/1458675957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4400a1f20 0x7fe4400a0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:05.942 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.940+0000 7fe447c23700 1 -- 172.21.15.110:0/1458675957 >> 172.21.15.110:0/1458675957 conn(0x7fe4400bce50 msgr2=0x7fe440148780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:05.942 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.940+0000 7fe447c23700 1 -- 172.21.15.110:0/1458675957 shutdown_connections 2021-03-25T14:17:05.942 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:05.940+0000 7fe447c23700 1 -- 172.21.15.110:0/1458675957 wait complete. 2021-03-25T14:17:05.953 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw pool=cephfs_data' mds allow 2021-03-25T14:17:06.071 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.070+0000 7f996244b700 1 Processor -- start 2021-03-25T14:17:06.071 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.070+0000 7f996244b700 1 -- start start 2021-03-25T14:17:06.076 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.070+0000 7f996244b700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f995c0be3a0 0x7f995c0b4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:06.076 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.071+0000 7f996244b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f995c0b47a0 0x7f995c148c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:06.076 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.071+0000 7f996244b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f995c149120 0x7f995c0b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:06.076 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.071+0000 7f996244b700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f995c0b4c20 con 0x7f995c0be3a0 2021-03-25T14:17:06.077 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.071+0000 7f996244b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f995c149960 con 0x7f995c149120 2021-03-25T14:17:06.077 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.071+0000 7f996244b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f995c149c00 con 0x7f995c0b47a0 2021-03-25T14:17:06.077 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.071+0000 7f995bfff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f995c0be3a0 0x7f995c0b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:06.077 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.071+0000 7f995bfff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f995c0be3a0 0x7f995c0b4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49322/0 (socket says 172.21.15.110:49322) 2021-03-25T14:17:06.077 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.071+0000 7f995bfff700 1 -- 172.21.15.110:0/1442406567 learned_addr learned my addr 172.21.15.110:0/1442406567 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:06.077 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.071+0000 7f995b7fe700 1 --2- 172.21.15.110:0/1442406567 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f995c0b47a0 0x7f995c148c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:06.077 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.071+0000 7f995bfff700 1 -- 172.21.15.110:0/1442406567 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f995c0b47a0 msgr2=0x7f995c148c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:06.077 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.071+0000 7f995bfff700 1 --2- 172.21.15.110:0/1442406567 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f995c0b47a0 0x7f995c148c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:06.077 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.071+0000 7f99609e8700 1 --2- 172.21.15.110:0/1442406567 >> v2:172.21.15.174:3300/0 conn(0x7f995c149120 0x7f995c0b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:06.077 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.071+0000 7f995bfff700 1 -- 172.21.15.110:0/1442406567 >> v2:172.21.15.174:3300/0 conn(0x7f995c149120 msgr2=0x7f995c0b8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:06.077 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.071+0000 7f995bfff700 1 --2- 172.21.15.110:0/1442406567 >> v2:172.21.15.174:3300/0 conn(0x7f995c149120 0x7f995c0b8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:06.077 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.071+0000 7f995bfff700 1 -- 172.21.15.110:0/1442406567 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f995c149ea0 con 0x7f995c0be3a0 2021-03-25T14:17:06.078 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.071+0000 7f99609e8700 1 --2- 172.21.15.110:0/1442406567 >> v2:172.21.15.174:3300/0 conn(0x7f995c149120 0x7f995c0b8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:17:06.078 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.071+0000 7f995bfff700 1 --2- 172.21.15.110:0/1442406567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f995c0be3a0 0x7f995c0b4100 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f995c0a0ae0 tx=0x7f994c006ee0).ready entity=mon.0 client_cookie=fa10f101f43d8338 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:06.078 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.071+0000 7f995affd700 1 -- 172.21.15.110:0/1442406567 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c009840 con 0x7f995c0be3a0 2021-03-25T14:17:06.078 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.071+0000 7f995affd700 1 -- 172.21.15.110:0/1442406567 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994c0099a0 con 0x7f995c0be3a0 2021-03-25T14:17:06.078 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.071+0000 7f995affd700 1 -- 172.21.15.110:0/1442406567 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c009d20 con 0x7f995c0be3a0 2021-03-25T14:17:06.078 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.072+0000 7f996244b700 1 -- 172.21.15.110:0/1442406567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f995c0be3a0 msgr2=0x7f995c0b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:06.078 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.072+0000 7f996244b700 1 --2- 172.21.15.110:0/1442406567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f995c0be3a0 0x7f995c0b4100 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f995c0a0ae0 tx=0x7f994c006ee0).stop 2021-03-25T14:17:06.078 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.072+0000 7f996244b700 1 -- 172.21.15.110:0/1442406567 shutdown_connections 2021-03-25T14:17:06.078 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.072+0000 7f996244b700 1 --2- 172.21.15.110:0/1442406567 >> v2:172.21.15.174:3300/0 conn(0x7f995c149120 0x7f995c0b8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:06.078 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.072+0000 7f996244b700 1 --2- 172.21.15.110:0/1442406567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f995c0be3a0 0x7f995c0b4100 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:06.078 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.072+0000 7f996244b700 1 --2- 172.21.15.110:0/1442406567 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f995c0b47a0 0x7f995c148c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:06.078 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.072+0000 7f996244b700 1 -- 172.21.15.110:0/1442406567 >> 172.21.15.110:0/1442406567 conn(0x7f995c0686f0 msgr2=0x7f995c068b00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:06.079 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.072+0000 7f996244b700 1 -- 172.21.15.110:0/1442406567 shutdown_connections 2021-03-25T14:17:06.079 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.072+0000 7f996244b700 1 -- 172.21.15.110:0/1442406567 wait complete. 2021-03-25T14:17:06.079 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.073+0000 7f996244b700 1 Processor -- start 2021-03-25T14:17:06.079 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.073+0000 7f996244b700 1 -- start start 2021-03-25T14:17:06.079 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.074+0000 7f996244b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f995c0b47a0 0x7f995c15c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:06.079 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.074+0000 7f996244b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f995c0be3a0 0x7f995c0647c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:06.079 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.074+0000 7f996244b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f995c149120 0x7f995c14d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:06.079 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.074+0000 7f996244b700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995c15cd40 con 0x7f995c0b47a0 2021-03-25T14:17:06.079 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.074+0000 7f996244b700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995c0a3240 con 0x7f995c0be3a0 2021-03-25T14:17:06.079 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.074+0000 7f996244b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f995c1588a0 con 0x7f995c149120 2021-03-25T14:17:06.079 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.074+0000 7f995bfff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f995c0b47a0 0x7f995c15c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:06.079 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.074+0000 7f995bfff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f995c0b47a0 0x7f995c15c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49328/0 (socket says 172.21.15.110:49328) 2021-03-25T14:17:06.080 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.074+0000 7f995bfff700 1 -- 172.21.15.110:0/3232026303 learned_addr learned my addr 172.21.15.110:0/3232026303 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:06.080 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.074+0000 7f995b7fe700 1 --2- 172.21.15.110:0/3232026303 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f995c0be3a0 0x7f995c0647c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:06.080 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.074+0000 7f99609e8700 1 --2- 172.21.15.110:0/3232026303 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f995c149120 0x7f995c14d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:06.080 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.074+0000 7f995bfff700 1 -- 172.21.15.110:0/3232026303 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f995c149120 msgr2=0x7f995c14d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:06.080 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.074+0000 7f995bfff700 1 --2- 172.21.15.110:0/3232026303 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f995c149120 0x7f995c14d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:06.080 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.074+0000 7f995bfff700 1 -- 172.21.15.110:0/3232026303 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f995c0be3a0 msgr2=0x7f995c0647c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:06.080 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.074+0000 7f995bfff700 1 --2- 172.21.15.110:0/3232026303 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f995c0be3a0 0x7f995c0647c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:06.080 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.074+0000 7f995bfff700 1 -- 172.21.15.110:0/3232026303 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f995c0b7b10 con 0x7f995c0b47a0 2021-03-25T14:17:06.080 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.074+0000 7f995bfff700 1 --2- 172.21.15.110:0/3232026303 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f995c0b47a0 0x7f995c15c850 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f994c011950 tx=0x7f994c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:06.080 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.074+0000 7f9943fff700 1 -- 172.21.15.110:0/3232026303 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c011ea0 con 0x7f995c0b47a0 2021-03-25T14:17:06.080 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.075+0000 7f9943fff700 1 -- 172.21.15.110:0/3232026303 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994c00bec0 con 0x7f995c0b47a0 2021-03-25T14:17:06.080 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.075+0000 7f996244b700 1 -- 172.21.15.110:0/3232026303 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f995c0a3470 con 0x7f995c0b47a0 2021-03-25T14:17:06.080 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.075+0000 7f9943fff700 1 -- 172.21.15.110:0/3232026303 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c01c630 con 0x7f995c0b47a0 2021-03-25T14:17:06.081 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.075+0000 7f996244b700 1 -- 172.21.15.110:0/3232026303 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f995c0a2470 con 0x7f995c0b47a0 2021-03-25T14:17:06.081 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.075+0000 7f996244b700 1 -- 172.21.15.110:0/3232026303 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f995c05d7b0 con 0x7f995c0b47a0 2021-03-25T14:17:06.081 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.076+0000 7f9943fff700 1 -- 172.21.15.110:0/3232026303 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f994c00f070 con 0x7f995c0b47a0 2021-03-25T14:17:06.082 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.076+0000 7f9943fff700 1 --2- 172.21.15.110:0/3232026303 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f993c05a0b0 0x7f993c05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:06.082 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.076+0000 7f9943fff700 1 -- 172.21.15.110:0/3232026303 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6426+0+0 (secure 0 0 0) 0x7f994c075380 con 0x7f995c0b47a0 2021-03-25T14:17:06.082 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.076+0000 7f995b7fe700 1 --2- 172.21.15.110:0/3232026303 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f993c05a0b0 0x7f993c05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:06.082 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.076+0000 7f995b7fe700 1 --2- 172.21.15.110:0/3232026303 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f993c05a0b0 0x7f993c05c570 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f995c147b70 tx=0x7f9950008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:06.082 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.080+0000 7f9943fff700 1 -- 172.21.15.110:0/3232026303 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f994c048b60 con 0x7f995c0b47a0 2021-03-25T14:17:06.286 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.286+0000 7f996244b700 1 -- 172.21.15.110:0/3232026303 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]} v 0) v1 -- 0x7f995c064d10 con 0x7f995c0b47a0 2021-03-25T14:17:06.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.289+0000 7f9943fff700 1 -- 172.21.15.110:0/3232026303 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]}]=0 updated caps for client.0 v9) v1 ==== 184+0+0 (secure 0 0 0) 0x7f994c04c180 con 0x7f995c0b47a0 2021-03-25T14:17:06.292 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.291+0000 7f996244b700 1 -- 172.21.15.110:0/3232026303 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f993c05a0b0 msgr2=0x7f993c05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:06.292 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.291+0000 7f996244b700 1 --2- 172.21.15.110:0/3232026303 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f993c05a0b0 0x7f993c05c570 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f995c147b70 tx=0x7f9950008040).stop 2021-03-25T14:17:06.293 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.291+0000 7f996244b700 1 -- 172.21.15.110:0/3232026303 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f995c0b47a0 msgr2=0x7f995c15c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:06.293 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.291+0000 7f996244b700 1 --2- 172.21.15.110:0/3232026303 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f995c0b47a0 0x7f995c15c850 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f994c011950 tx=0x7f994c016000).stop 2021-03-25T14:17:06.293 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.291+0000 7f996244b700 1 -- 172.21.15.110:0/3232026303 shutdown_connections 2021-03-25T14:17:06.293 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.291+0000 7f996244b700 1 --2- 172.21.15.110:0/3232026303 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f993c05a0b0 0x7f993c05c570 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:06.293 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.291+0000 7f996244b700 1 --2- 172.21.15.110:0/3232026303 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f995c149120 0x7f995c14d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:06.293 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.291+0000 7f996244b700 1 --2- 172.21.15.110:0/3232026303 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f995c0b47a0 0x7f995c15c850 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:06.293 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.291+0000 7f996244b700 1 --2- 172.21.15.110:0/3232026303 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f995c0be3a0 0x7f995c0647c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:06.293 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.291+0000 7f996244b700 1 -- 172.21.15.110:0/3232026303 >> 172.21.15.110:0/3232026303 conn(0x7f995c0686f0 msgr2=0x7f995c061390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:06.293 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.291+0000 7f996244b700 1 -- 172.21.15.110:0/3232026303 shutdown_connections 2021-03-25T14:17:06.293 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.291+0000 7f996244b700 1 -- 172.21.15.110:0/3232026303 wait complete. 2021-03-25T14:17:06.293 INFO:teuthology.orchestra.run.smithi110.stderr:updated caps for client.0 2021-03-25T14:17:06.303 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-03-25T14:17:06.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.413+0000 7f59520a8700 1 Processor -- start 2021-03-25T14:17:06.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.414+0000 7f59520a8700 1 -- start start 2021-03-25T14:17:06.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.414+0000 7f59520a8700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f594c14cee0 0x7f594c14d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:06.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.414+0000 7f59520a8700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f594c067510 con 0x7f594c0b1340 2021-03-25T14:17:06.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.414+0000 7f59520a8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f594c0677b0 con 0x7f594c0b1720 2021-03-25T14:17:06.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.414+0000 7f59520a8700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f594c067a50 con 0x7f594c14cee0 2021-03-25T14:17:06.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.414+0000 7f594bfff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f594c14cee0 0x7f594c14d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:06.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.414+0000 7f594bfff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f594c14cee0 0x7f594c14d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49338/0 (socket says 172.21.15.110:49338) 2021-03-25T14:17:06.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.414+0000 7f594bfff700 1 -- 172.21.15.110:0/2097346033 learned_addr learned my addr 172.21.15.110:0/2097346033 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:06.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.414+0000 7f594b7fe700 1 --1- 172.21.15.110:0/2097346033 >> v1:172.21.15.110:6789/0 conn(0x7f594c0b1340 0x7f594c066420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:42272/0 (socket says 172.21.15.110:42272) 2021-03-25T14:17:06.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.415+0000 7f594bfff700 1 -- 172.21.15.110:0/2097346033 >> v1:172.21.15.174:6789/0 conn(0x7f594c0b1720 legacy=0x7f594c149cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:06.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.415+0000 7f594bfff700 1 -- 172.21.15.110:0/2097346033 >> v1:172.21.15.110:6789/0 conn(0x7f594c0b1340 legacy=0x7f594c066420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:06.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.415+0000 7f594a7fc700 1 -- 172.21.15.110:0/2097346033 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3907518238 0 0) 0x7f594c067510 con 0x7f594c0b1340 2021-03-25T14:17:06.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.415+0000 7f594bfff700 1 -- 172.21.15.110:0/2097346033 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f594c067cf0 con 0x7f594c14cee0 2021-03-25T14:17:06.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.415+0000 7f594bfff700 1 --2- 172.21.15.110:0/2097346033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f594c14cee0 0x7f594c14d370 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f5944009dc0 tx=0x7f59440092d0).ready entity=mon.0 client_cookie=b7181ee644cbab21 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:06.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.415+0000 7f594a7fc700 1 -- 172.21.15.110:0/2097346033 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594400bbb0 con 0x7f594c14cee0 2021-03-25T14:17:06.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.415+0000 7f594a7fc700 1 -- 172.21.15.110:0/2097346033 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f594400bd10 con 0x7f594c14cee0 2021-03-25T14:17:06.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.415+0000 7f594a7fc700 1 -- 172.21.15.110:0/2097346033 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5944011610 con 0x7f594c14cee0 2021-03-25T14:17:06.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.416+0000 7f59520a8700 1 -- 172.21.15.110:0/2097346033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f594c14cee0 msgr2=0x7f594c14d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:06.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.416+0000 7f59520a8700 1 --2- 172.21.15.110:0/2097346033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f594c14cee0 0x7f594c14d370 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f5944009dc0 tx=0x7f59440092d0).stop 2021-03-25T14:17:06.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.416+0000 7f59520a8700 1 -- 172.21.15.110:0/2097346033 shutdown_connections 2021-03-25T14:17:06.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.416+0000 7f59520a8700 1 --2- 172.21.15.110:0/2097346033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f594c14cee0 0x7f594c14d370 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:06.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.416+0000 7f59520a8700 1 -- 172.21.15.110:0/2097346033 >> 172.21.15.110:0/2097346033 conn(0x7f594c0649a0 msgr2=0x7f594c05c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:06.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.416+0000 7f59520a8700 1 -- 172.21.15.110:0/2097346033 shutdown_connections 2021-03-25T14:17:06.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.416+0000 7f59520a8700 1 -- 172.21.15.110:0/2097346033 wait complete. 2021-03-25T14:17:06.422 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.417+0000 7f59520a8700 1 Processor -- start 2021-03-25T14:17:06.422 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.417+0000 7f59520a8700 1 -- start start 2021-03-25T14:17:06.422 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.417+0000 7f59520a8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f594c0b1340 0x7f594c143be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:06.423 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.417+0000 7f59520a8700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f594c0b1720 0x7f594c13f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:06.423 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.418+0000 7f59520a8700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f594c14cee0 0x7f594c13f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:06.423 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.418+0000 7f59520a8700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594c14c3d0 con 0x7f594c0b1720 2021-03-25T14:17:06.423 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.418+0000 7f59520a8700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594c14c670 con 0x7f594c14cee0 2021-03-25T14:17:06.423 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.418+0000 7f59520a8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f594c14c910 con 0x7f594c0b1340 2021-03-25T14:17:06.423 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.418+0000 7f594affd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f594c0b1720 0x7f594c13f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:06.423 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.418+0000 7f594affd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f594c0b1720 0x7f594c13f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49344/0 (socket says 172.21.15.110:49344) 2021-03-25T14:17:06.423 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.418+0000 7f594affd700 1 -- 172.21.15.110:0/3238897436 learned_addr learned my addr 172.21.15.110:0/3238897436 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:06.423 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.418+0000 7f594b7fe700 1 --2- 172.21.15.110:0/3238897436 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f594c0b1340 0x7f594c143be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:06.423 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.418+0000 7f594bfff700 1 --2- 172.21.15.110:0/3238897436 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f594c14cee0 0x7f594c13f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:06.423 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.418+0000 7f594affd700 1 -- 172.21.15.110:0/3238897436 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f594c0b1340 msgr2=0x7f594c143be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:06.423 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.418+0000 7f594affd700 1 --2- 172.21.15.110:0/3238897436 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f594c0b1340 0x7f594c143be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:06.424 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.418+0000 7f594affd700 1 -- 172.21.15.110:0/3238897436 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f594c14cee0 msgr2=0x7f594c13f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:06.424 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.418+0000 7f594affd700 1 --2- 172.21.15.110:0/3238897436 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f594c14cee0 0x7f594c13f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:06.424 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.418+0000 7f594affd700 1 -- 172.21.15.110:0/3238897436 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f594c14aa70 con 0x7f594c0b1720 2021-03-25T14:17:06.424 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.418+0000 7f594bfff700 1 --2- 172.21.15.110:0/3238897436 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f594c14cee0 0x7f594c13f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:06.424 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.418+0000 7f594affd700 1 --2- 172.21.15.110:0/3238897436 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f594c0b1720 0x7f594c13f3b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f594000c710 tx=0x7f5940007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:06.424 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.418+0000 7f59337fe700 1 -- 172.21.15.110:0/3238897436 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5940007020 con 0x7f594c0b1720 2021-03-25T14:17:06.424 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.418+0000 7f59337fe700 1 -- 172.21.15.110:0/3238897436 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5940007180 con 0x7f594c0b1720 2021-03-25T14:17:06.424 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.418+0000 7f59520a8700 1 -- 172.21.15.110:0/3238897436 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f594c14ad10 con 0x7f594c0b1720 2021-03-25T14:17:06.424 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.418+0000 7f59337fe700 1 -- 172.21.15.110:0/3238897436 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5940006520 con 0x7f594c0b1720 2021-03-25T14:17:06.424 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.418+0000 7f59520a8700 1 -- 172.21.15.110:0/3238897436 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f594c147b80 con 0x7f594c0b1720 2021-03-25T14:17:06.424 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.419+0000 7f59520a8700 1 -- 172.21.15.110:0/3238897436 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f594c14b0d0 con 0x7f594c0b1720 2021-03-25T14:17:06.424 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.419+0000 7f59337fe700 1 -- 172.21.15.110:0/3238897436 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f5940010070 con 0x7f594c0b1720 2021-03-25T14:17:06.425 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.420+0000 7f59337fe700 1 --2- 172.21.15.110:0/3238897436 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f592c05a0b0 0x7f592c05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:06.425 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.420+0000 7f59337fe700 1 -- 172.21.15.110:0/3238897436 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6426+0+0 (secure 0 0 0) 0x7f59400731c0 con 0x7f594c0b1720 2021-03-25T14:17:06.425 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.420+0000 7f594b7fe700 1 --2- 172.21.15.110:0/3238897436 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f592c05a0b0 0x7f592c05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:06.425 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.420+0000 7f594b7fe700 1 --2- 172.21.15.110:0/3238897436 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f592c05a0b0 0x7f592c05c570 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f594c156a10 tx=0x7f593c007bd0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:06.425 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.423+0000 7f59337fe700 1 -- 172.21.15.110:0/3238897436 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f5940046a00 con 0x7f594c0b1720 2021-03-25T14:17:06.612 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.611+0000 7f59520a8700 1 -- 172.21.15.110:0/3238897436 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f594c14aea0 con 0x7f594c0b1720 2021-03-25T14:17:06.613 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.611+0000 7f59337fe700 1 -- 172.21.15.110:0/3238897436 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+2847 (secure 0 0 0) 0x7f594004a020 con 0x7f594c0b1720 2021-03-25T14:17:06.613 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:06.613 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4804,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6834/4176268149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4176268149},{"type":"v1","addr":"172.21.15.174:6834","nonce":4176268149}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":12},{"gid":4807,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/1554277551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6833","nonce":1554277551},{"type":"v1","addr":"172.21.15.174:6835","nonce":1554277551}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":13},{"gid":5025,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.110:6836/2267546898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2267546898},{"type":"v1","addr":"172.21.15.110:6836","nonce":2267546898}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":13}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-03-25T14:17:04.328765+0000","modified":"2021-03-25T14:17:05.329972+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6837/503424314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":503424314},{"type":"v1","addr":"172.21.15.110:6837","nonce":503424314}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-03-25T14:17:06.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.613+0000 7f59520a8700 1 -- 172.21.15.110:0/3238897436 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f592c05a0b0 msgr2=0x7f592c05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:06.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.613+0000 7f59520a8700 1 --2- 172.21.15.110:0/3238897436 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f592c05a0b0 0x7f592c05c570 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f594c156a10 tx=0x7f593c007bd0).stop 2021-03-25T14:17:06.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.613+0000 7f59520a8700 1 -- 172.21.15.110:0/3238897436 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f594c0b1720 msgr2=0x7f594c13f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:06.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.613+0000 7f59520a8700 1 --2- 172.21.15.110:0/3238897436 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f594c0b1720 0x7f594c13f3b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f594000c710 tx=0x7f5940007c80).stop 2021-03-25T14:17:06.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.613+0000 7f59520a8700 1 -- 172.21.15.110:0/3238897436 shutdown_connections 2021-03-25T14:17:06.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.613+0000 7f59520a8700 1 --2- 172.21.15.110:0/3238897436 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f592c05a0b0 0x7f592c05c570 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:06.616 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.613+0000 7f59520a8700 1 --2- 172.21.15.110:0/3238897436 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f594c14cee0 0x7f594c13f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:06.616 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.613+0000 7f59520a8700 1 --2- 172.21.15.110:0/3238897436 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f594c0b1340 0x7f594c143be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:06.616 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.613+0000 7f59520a8700 1 --2- 172.21.15.110:0/3238897436 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f594c0b1720 0x7f594c13f3b0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:06.616 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.613+0000 7f59520a8700 1 -- 172.21.15.110:0/3238897436 >> 172.21.15.110:0/3238897436 conn(0x7f594c0649a0 msgr2=0x7f594c0663b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:06.616 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.614+0000 7f59520a8700 1 -- 172.21.15.110:0/3238897436 shutdown_connections 2021-03-25T14:17:06.616 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:06.614+0000 7f59520a8700 1 -- 172.21.15.110:0/3238897436 wait complete. 2021-03-25T14:17:06.616 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 15 2021-03-25T14:17:07.029 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-03-25T14:17:04.328765+0000', 'modified': '2021-03-25T14:17:05.329972+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5028}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5028': {'gid': 5028, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.110:6837/503424314', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6835', 'nonce': 503424314}, {'type': 'v1', 'addr': '172.21.15.110:6837', 'nonce': 503424314}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138303579357183, 'flags': 0}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-03-25T14:17:07.030 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-03-25T14:17:07.030 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-03-25T14:17:07.163 INFO:teuthology.orchestra.run.smithi110.stdout:{"cluster_fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","whoami":0,"id":5028,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":2.8220461750000001,"mdsmap_epoch":15,"osdmap_epoch":38,"osdmap_epoch_barrier":36,"uptime":9.1954719489999999} 2021-03-25T14:17:07.163 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5524cbad-8383-4081-a708-5d9e9f7cc15c", "fs_name": "cephfs", "id": 5028, "mdsmap_epoch": 15, "osdmap_epoch": 38, "osdmap_epoch_barrier": 36, "rank_uptime": 2.822046175, "state": "up:active", "uptime": 9.195471949, "want_state": "up:active", "whoami": 0 } 2021-03-25T14:17:07.164 DEBUG:teuthology.orchestra.run.smithi110:> ceph fs ls 2021-03-25T14:17:07.265 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.261+0000 7f84c4f77700 1 Processor -- start 2021-03-25T14:17:07.265 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.261+0000 7f84c4f77700 1 -- start start 2021-03-25T14:17:07.265 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.262+0000 7f84c4f77700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f84c00660b0 0x7f84c0066490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:07.265 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.262+0000 7f84c4f77700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f84c00bdda0 0x7f84c014b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:07.265 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.262+0000 7f84c4f77700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84c00bab60 con 0x7f84c009f1f0 2021-03-25T14:17:07.265 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.262+0000 7f84c4f77700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84c009fb00 con 0x7f84c00bdda0 2021-03-25T14:17:07.265 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.262+0000 7f84c4f77700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84c014ac60 con 0x7f84c00660b0 2021-03-25T14:17:07.265 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.262+0000 7f84b7fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f84c00bdda0 0x7f84c014b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:07.265 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.262+0000 7f84b7fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f84c00bdda0 0x7f84c014b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49352/0 (socket says 172.21.15.110:49352) 2021-03-25T14:17:07.265 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.262+0000 7f84bed9d700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f84c009f1f0 0x7f84c00ba450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:42290/0 (socket says 172.21.15.110:42290) 2021-03-25T14:17:07.265 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.262+0000 7f84b7fff700 1 -- 172.21.15.110:0/985178013 learned_addr learned my addr 172.21.15.110:0/985178013 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:07.266 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.262+0000 7f84b7fff700 1 -- 172.21.15.110:0/985178013 >> v2:172.21.15.174:3300/0 conn(0x7f84c00660b0 msgr2=0x7f84c0066490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:07.266 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.262+0000 7f84b7fff700 1 --2- 172.21.15.110:0/985178013 >> v2:172.21.15.174:3300/0 conn(0x7f84c00660b0 0x7f84c0066490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:07.266 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.262+0000 7f84b7fff700 1 -- 172.21.15.110:0/985178013 >> v1:172.21.15.110:6789/0 conn(0x7f84c009f1f0 legacy=0x7f84c00ba450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:07.266 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.262+0000 7f84b7fff700 1 -- 172.21.15.110:0/985178013 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c014af00 con 0x7f84c00bdda0 2021-03-25T14:17:07.266 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.262+0000 7f84bdd9b700 1 -- 172.21.15.110:0/985178013 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1089739543 0 0) 0x7f84c00bab60 con 0x7f84c009f1f0 2021-03-25T14:17:07.266 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.263+0000 7f84b7fff700 1 --2- 172.21.15.110:0/985178013 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84c00bdda0 0x7f84c014b640 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f84a800ba20 tx=0x7f84a8006ee0).ready entity=mon.0 client_cookie=61ab7a87fb46afbe server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:07.266 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.263+0000 7f84bdd9b700 1 -- 172.21.15.110:0/985178013 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a8009890 con 0x7f84c00bdda0 2021-03-25T14:17:07.266 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.263+0000 7f84bdd9b700 1 -- 172.21.15.110:0/985178013 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a80099f0 con 0x7f84c00bdda0 2021-03-25T14:17:07.266 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.263+0000 7f84bdd9b700 1 -- 172.21.15.110:0/985178013 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a8009d70 con 0x7f84c00bdda0 2021-03-25T14:17:07.266 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.263+0000 7f84c4f77700 1 -- 172.21.15.110:0/985178013 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84c00bdda0 msgr2=0x7f84c014b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:07.266 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.263+0000 7f84c4f77700 1 --2- 172.21.15.110:0/985178013 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84c00bdda0 0x7f84c014b640 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f84a800ba20 tx=0x7f84a8006ee0).stop 2021-03-25T14:17:07.266 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.263+0000 7f84c4f77700 1 -- 172.21.15.110:0/985178013 shutdown_connections 2021-03-25T14:17:07.266 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.263+0000 7f84c4f77700 1 --2- 172.21.15.110:0/985178013 >> v2:172.21.15.174:3300/0 conn(0x7f84c00660b0 0x7f84c0066490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:07.267 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.263+0000 7f84c4f77700 1 --2- 172.21.15.110:0/985178013 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84c00bdda0 0x7f84c014b640 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:07.267 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.263+0000 7f84c4f77700 1 -- 172.21.15.110:0/985178013 >> 172.21.15.110:0/985178013 conn(0x7f84c0062480 msgr2=0x7f84c0062890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:07.267 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.263+0000 7f84c4f77700 1 -- 172.21.15.110:0/985178013 shutdown_connections 2021-03-25T14:17:07.267 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.263+0000 7f84c4f77700 1 -- 172.21.15.110:0/985178013 wait complete. 2021-03-25T14:17:07.270 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.264+0000 7f84c4f77700 1 Processor -- start 2021-03-25T14:17:07.270 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.264+0000 7f84c4f77700 1 -- start start 2021-03-25T14:17:07.270 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.265+0000 7f84c4f77700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84c00660b0 0x7f84c0091980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:07.270 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.265+0000 7f84c4f77700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84c009f1f0 0x7f84c015a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:07.270 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.265+0000 7f84c4f77700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84c00bdda0 0x7f84c015c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:07.270 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.265+0000 7f84c4f77700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c015d120 con 0x7f84c00660b0 2021-03-25T14:17:07.270 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.265+0000 7f84c4f77700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c0090d00 con 0x7f84c009f1f0 2021-03-25T14:17:07.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.265+0000 7f84c4f77700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84c0090fa0 con 0x7f84c00bdda0 2021-03-25T14:17:07.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.265+0000 7f84be59c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84c00660b0 0x7f84c0091980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:07.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.265+0000 7f84be59c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84c00660b0 0x7f84c0091980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49356/0 (socket says 172.21.15.110:49356) 2021-03-25T14:17:07.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.265+0000 7f84be59c700 1 -- 172.21.15.110:0/856192510 learned_addr learned my addr 172.21.15.110:0/856192510 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:07.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.265+0000 7f84b7fff700 1 --2- 172.21.15.110:0/856192510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84c009f1f0 0x7f84c015a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:07.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.265+0000 7f84bed9d700 1 --2- 172.21.15.110:0/856192510 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84c00bdda0 0x7f84c015c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:07.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.265+0000 7f84be59c700 1 -- 172.21.15.110:0/856192510 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84c00bdda0 msgr2=0x7f84c015c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:07.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.265+0000 7f84be59c700 1 --2- 172.21.15.110:0/856192510 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84c00bdda0 0x7f84c015c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:07.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.265+0000 7f84be59c700 1 -- 172.21.15.110:0/856192510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84c009f1f0 msgr2=0x7f84c015a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:07.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.265+0000 7f84be59c700 1 --2- 172.21.15.110:0/856192510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84c009f1f0 0x7f84c015a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:07.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.265+0000 7f84be59c700 1 -- 172.21.15.110:0/856192510 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c0091240 con 0x7f84c00660b0 2021-03-25T14:17:07.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.265+0000 7f84b7fff700 1 --2- 172.21.15.110:0/856192510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84c009f1f0 0x7f84c015a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:17:07.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.266+0000 7f84be59c700 1 --2- 172.21.15.110:0/856192510 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84c00660b0 0x7f84c0091980 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f84b000b8b0 tx=0x7f84b0006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:07.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.266+0000 7f84b67fc700 1 -- 172.21.15.110:0/856192510 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b000d680 con 0x7f84c00660b0 2021-03-25T14:17:07.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.266+0000 7f84b67fc700 1 -- 172.21.15.110:0/856192510 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b000d800 con 0x7f84c00660b0 2021-03-25T14:17:07.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.266+0000 7f84c4f77700 1 -- 172.21.15.110:0/856192510 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c00914e0 con 0x7f84c00660b0 2021-03-25T14:17:07.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.266+0000 7f84b67fc700 1 -- 172.21.15.110:0/856192510 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b000dbc0 con 0x7f84c00660b0 2021-03-25T14:17:07.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.266+0000 7f84c4f77700 1 -- 172.21.15.110:0/856192510 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c008fa80 con 0x7f84c00660b0 2021-03-25T14:17:07.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.266+0000 7f84c4f77700 1 -- 172.21.15.110:0/856192510 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84c0091670 con 0x7f84c00660b0 2021-03-25T14:17:07.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.267+0000 7f84b67fc700 1 -- 172.21.15.110:0/856192510 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f84b0018460 con 0x7f84c00660b0 2021-03-25T14:17:07.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.267+0000 7f84b67fc700 1 --2- 172.21.15.110:0/856192510 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f84a405a0b0 0x7f84a405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:07.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.267+0000 7f84b67fc700 1 -- 172.21.15.110:0/856192510 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6426+0+0 (secure 0 0 0) 0x7f84b0073c20 con 0x7f84c00660b0 2021-03-25T14:17:07.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.267+0000 7f84b7fff700 1 --2- 172.21.15.110:0/856192510 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f84a405a0b0 0x7f84a405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:07.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.268+0000 7f84b7fff700 1 --2- 172.21.15.110:0/856192510 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f84a405a0b0 0x7f84a405c570 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f84c00b96d0 tx=0x7f84a8016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:07.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.271+0000 7f84b67fc700 1 -- 172.21.15.110:0/856192510 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f84b0047400 con 0x7f84c00660b0 2021-03-25T14:17:07.457 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.455+0000 7f84c4f77700 1 -- 172.21.15.110:0/856192510 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f84c006aaa0 con 0x7f84c00660b0 2021-03-25T14:17:07.457 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.456+0000 7f84b67fc700 1 -- 172.21.15.110:0/856192510 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f84b004aa20 con 0x7f84c00660b0 2021-03-25T14:17:07.457 INFO:teuthology.orchestra.run.smithi110.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2021-03-25T14:17:07.459 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.457+0000 7f84c4f77700 1 -- 172.21.15.110:0/856192510 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f84a405a0b0 msgr2=0x7f84a405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:07.459 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.457+0000 7f84c4f77700 1 --2- 172.21.15.110:0/856192510 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f84a405a0b0 0x7f84a405c570 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f84c00b96d0 tx=0x7f84a8016000).stop 2021-03-25T14:17:07.459 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.457+0000 7f84c4f77700 1 -- 172.21.15.110:0/856192510 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84c00660b0 msgr2=0x7f84c0091980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:07.459 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.457+0000 7f84c4f77700 1 --2- 172.21.15.110:0/856192510 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84c00660b0 0x7f84c0091980 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f84b000b8b0 tx=0x7f84b0006ef0).stop 2021-03-25T14:17:07.459 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.457+0000 7f84c4f77700 1 -- 172.21.15.110:0/856192510 shutdown_connections 2021-03-25T14:17:07.459 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.457+0000 7f84c4f77700 1 --2- 172.21.15.110:0/856192510 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f84a405a0b0 0x7f84a405c570 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:07.459 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.457+0000 7f84c4f77700 1 --2- 172.21.15.110:0/856192510 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84c00bdda0 0x7f84c015c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:07.459 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.457+0000 7f84c4f77700 1 --2- 172.21.15.110:0/856192510 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84c00660b0 0x7f84c0091980 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:07.459 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.457+0000 7f84c4f77700 1 --2- 172.21.15.110:0/856192510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84c009f1f0 0x7f84c015a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:07.459 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.457+0000 7f84c4f77700 1 -- 172.21.15.110:0/856192510 >> 172.21.15.110:0/856192510 conn(0x7f84c0062480 msgr2=0x7f84c00bcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:07.460 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.458+0000 7f84c4f77700 1 -- 172.21.15.110:0/856192510 shutdown_connections 2021-03-25T14:17:07.460 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:07.458+0000 7f84c4f77700 1 -- 172.21.15.110:0/856192510 wait complete. 2021-03-25T14:17:07.468 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2021-03-25T14:17:07.468 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2021-03-25T14:17:07.469 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi110.front.sepia.ceph.com 2021-03-25T14:17:07.469 INFO:tasks.cephfs.mount:self.client.name = client.0 2021-03-25T14:17:07.469 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2021-03-25T14:17:07.469 INFO:tasks.cephfs.mount:self.cephfs_name = None 2021-03-25T14:17:07.469 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2021-03-25T14:17:07.469 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2021-03-25T14:17:07.469 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2021-03-25T14:17:07.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:07.469 DEBUG:teuthology.orchestra.run.smithi110:> ip addr 2021-03-25T14:17:07.484 INFO:teuthology.orchestra.run.smithi110.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2021-03-25T14:17:07.484 INFO:teuthology.orchestra.run.smithi110.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2021-03-25T14:17:07.484 INFO:teuthology.orchestra.run.smithi110.stdout: inet 127.0.0.1/8 scope host lo 2021-03-25T14:17:07.485 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:07.485 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 ::1/128 scope host 2021-03-25T14:17:07.485 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:07.485 INFO:teuthology.orchestra.run.smithi110.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-03-25T14:17:07.485 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:14 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:17:07.485 INFO:teuthology.orchestra.run.smithi110.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-03-25T14:17:07.485 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:15 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:17:07.485 INFO:teuthology.orchestra.run.smithi110.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-03-25T14:17:07.485 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:34 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:17:07.486 INFO:teuthology.orchestra.run.smithi110.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2021-03-25T14:17:07.486 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:35 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:17:07.486 INFO:teuthology.orchestra.run.smithi110.stdout: inet 172.21.15.110/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2021-03-25T14:17:07.486 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft 42574sec preferred_lft 42574sec 2021-03-25T14:17:07.486 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::ec4:7aff:fe8f:cc35/64 scope link 2021-03-25T14:17:07.486 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:07.486 INFO:teuthology.orchestra.run.smithi110.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2021-03-25T14:17:07.486 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 1a:d9:4b:2f:6c:02 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:17:07.486 INFO:teuthology.orchestra.run.smithi110.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2021-03-25T14:17:07.486 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:07.486 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::1835:66ff:feca:f994/64 scope link 2021-03-25T14:17:07.486 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:07.487 INFO:teuthology.orchestra.run.smithi110.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2021-03-25T14:17:07.487 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 1a:d9:4b:2f:6c:02 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2021-03-25T14:17:07.487 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::18d9:4bff:fe2f:6c02/64 scope link 2021-03-25T14:17:07.487 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:07.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:07.487 DEBUG:teuthology.orchestra.run.smithi110:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2021-03-25T14:17:07.546 INFO:teuthology.orchestra.run.smithi110.stdout:1 2021-03-25T14:17:07.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:07.548 DEBUG:teuthology.orchestra.run.smithi110:> route 2021-03-25T14:17:07.604 INFO:teuthology.orchestra.run.smithi110.stdout:Kernel IP routing table 2021-03-25T14:17:07.604 INFO:teuthology.orchestra.run.smithi110.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2021-03-25T14:17:07.604 INFO:teuthology.orchestra.run.smithi110.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2021-03-25T14:17:07.604 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2021-03-25T14:17:07.604 INFO:teuthology.orchestra.run.smithi110.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2021-03-25T14:17:07.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:07.605 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec sudo bash -c ' 2021-03-25T14:17:07.605 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2021-03-25T14:17:07.605 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2021-03-25T14:17:07.605 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2021-03-25T14:17:07.605 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2021-03-25T14:17:07.605 DEBUG:teuthology.orchestra.run.smithi110:> ') 2021-03-25T14:17:07.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:07.699 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2021-03-25T14:17:07.713 INFO:teuthology.orchestra.run.smithi110.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2021-03-25T14:17:07.713 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2021-03-25T14:17:07.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:07.714 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set brx.0 up 2021-03-25T14:17:07.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:07.778 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p /home/ubuntu/cephtest/mnt.0 2021-03-25T14:17:07.832 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-03-25T14:17:07.832 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2021-03-25T14:17:07.910 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2021-03-25T14:17:07.910 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2021-03-25T14:17:07.966 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2021-03-25T14:17:07.966 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2021-03-25T14:17:07.968 INFO:tasks.cephfs.kernel_mount:mount command passed 2021-03-25T14:17:07.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:07.968 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2021-03-25T14:17:08.033 DEBUG:teuthology.orchestra.run.smithi174:> ceph fs ls 2021-03-25T14:17:08.144 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.142+0000 7f4acb3ec700 1 Processor -- start 2021-03-25T14:17:08.144 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.142+0000 7f4acb3ec700 1 -- start start 2021-03-25T14:17:08.145 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.143+0000 7f4acb3ec700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ac4146f20 0x7f4ac4151030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:08.145 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.143+0000 7f4acb3ec700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ac40b05f0 con 0x7f4ac414a510 2021-03-25T14:17:08.145 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.143+0000 7f4acb3ec700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ac4146540 con 0x7f4ac40bbd00 2021-03-25T14:17:08.146 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.143+0000 7f4acb3ec700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac40ad5f0 con 0x7f4ac4146f20 2021-03-25T14:17:08.146 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.143+0000 7f4ac9989700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ac4146f20 0x7f4ac4151030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:08.146 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.143+0000 7f4ac9188700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f4ac40bbd00 0x7f4ac40afdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:49380/0 (socket says 172.21.15.174:49380) 2021-03-25T14:17:08.146 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.143+0000 7f4ac9188700 1 -- 172.21.15.174:0/1044426080 learned_addr learned my addr 172.21.15.174:0/1044426080 (peer_addr_for_me v1:172.21.15.174:0/0) 2021-03-25T14:17:08.146 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.143+0000 7f4ab3fff700 1 -- 172.21.15.174:0/1044426080 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 872864727 0 0) 0x7f4ac4146540 con 0x7f4ac40bbd00 2021-03-25T14:17:08.146 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.143+0000 7f4ab3fff700 1 -- 172.21.15.174:0/1044426080 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4aac003270 con 0x7f4ac40bbd00 2021-03-25T14:17:08.146 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.143+0000 7f4ac9989700 1 -- 172.21.15.174:0/1044426080 >> v1:172.21.15.174:6789/0 conn(0x7f4ac40bbd00 legacy=0x7f4ac40afdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:08.146 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.143+0000 7f4ac9989700 1 -- 172.21.15.174:0/1044426080 >> v1:172.21.15.110:6789/0 conn(0x7f4ac414a510 legacy=0x7f4ac40acee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:08.146 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.143+0000 7f4ac9989700 1 -- 172.21.15.174:0/1044426080 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac41467e0 con 0x7f4ac4146f20 2021-03-25T14:17:08.146 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.144+0000 7f4ac9989700 1 --2- 172.21.15.174:0/1044426080 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ac4146f20 0x7f4ac4151030 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f4abc009cf0 tx=0x7f4abc009220).ready entity=mon.2 client_cookie=55d7b9593435bf06 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:08.146 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.144+0000 7f4ab3fff700 1 -- 172.21.15.174:0/1044426080 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4abc00ba40 con 0x7f4ac4146f20 2021-03-25T14:17:08.147 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.144+0000 7f4ab3fff700 1 -- 172.21.15.174:0/1044426080 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4abc00bba0 con 0x7f4ac4146f20 2021-03-25T14:17:08.147 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.144+0000 7f4ab3fff700 1 -- 172.21.15.174:0/1044426080 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4abc011400 con 0x7f4ac4146f20 2021-03-25T14:17:08.149 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.144+0000 7f4acb3ec700 1 -- 172.21.15.174:0/1044426080 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ac4146f20 msgr2=0x7f4ac4151030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:08.149 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.144+0000 7f4acb3ec700 1 --2- 172.21.15.174:0/1044426080 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ac4146f20 0x7f4ac4151030 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f4abc009cf0 tx=0x7f4abc009220).stop 2021-03-25T14:17:08.150 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.144+0000 7f4acb3ec700 1 -- 172.21.15.174:0/1044426080 shutdown_connections 2021-03-25T14:17:08.150 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.144+0000 7f4acb3ec700 1 --2- 172.21.15.174:0/1044426080 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ac4146f20 0x7f4ac4151030 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:08.150 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.144+0000 7f4acb3ec700 1 -- 172.21.15.174:0/1044426080 >> 172.21.15.174:0/1044426080 conn(0x7f4ac4062580 msgr2=0x7f4ac4062990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:08.150 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.144+0000 7f4acb3ec700 1 -- 172.21.15.174:0/1044426080 shutdown_connections 2021-03-25T14:17:08.150 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.144+0000 7f4acb3ec700 1 -- 172.21.15.174:0/1044426080 wait complete. 2021-03-25T14:17:08.150 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.145+0000 7f4acb3ec700 1 Processor -- start 2021-03-25T14:17:08.150 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.145+0000 7f4acb3ec700 1 -- start start 2021-03-25T14:17:08.150 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.146+0000 7f4acb3ec700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ac40bbd00 0x7f4ac413dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:08.150 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.146+0000 7f4acb3ec700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ac4146f20 0x7f4ac4140260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:08.150 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.146+0000 7f4acb3ec700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ac414a510 0x7f4ac4134010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:08.150 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.146+0000 7f4acb3ec700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac413e3d0 con 0x7f4ac40bbd00 2021-03-25T14:17:08.150 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.146+0000 7f4acb3ec700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac4143e60 con 0x7f4ac4146f20 2021-03-25T14:17:08.151 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.146+0000 7f4acb3ec700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac4145400 con 0x7f4ac414a510 2021-03-25T14:17:08.151 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.146+0000 7f4ac9989700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ac414a510 0x7f4ac4134010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:08.151 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.146+0000 7f4ac8987700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ac4146f20 0x7f4ac4140260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:08.151 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.147+0000 7f4ac9989700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ac414a510 0x7f4ac4134010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:34798/0 (socket says 172.21.15.174:34798) 2021-03-25T14:17:08.151 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.147+0000 7f4ac9989700 1 -- 172.21.15.174:0/281840765 learned_addr learned my addr 172.21.15.174:0/281840765 (peer_addr_for_me v2:172.21.15.174:0/0) 2021-03-25T14:17:08.151 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.147+0000 7f4ac9188700 1 --2- 172.21.15.174:0/281840765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ac40bbd00 0x7f4ac413dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:08.151 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.147+0000 7f4ac9989700 1 -- 172.21.15.174:0/281840765 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ac4146f20 msgr2=0x7f4ac4140260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:08.151 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.147+0000 7f4ac9989700 1 --2- 172.21.15.174:0/281840765 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ac4146f20 0x7f4ac4140260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:08.151 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.147+0000 7f4ac9989700 1 -- 172.21.15.174:0/281840765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ac40bbd00 msgr2=0x7f4ac413dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:08.151 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.147+0000 7f4ac9989700 1 --2- 172.21.15.174:0/281840765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ac40bbd00 0x7f4ac413dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:08.151 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.147+0000 7f4ac9989700 1 -- 172.21.15.174:0/281840765 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac41461b0 con 0x7f4ac414a510 2021-03-25T14:17:08.151 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.147+0000 7f4ac9989700 1 --2- 172.21.15.174:0/281840765 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ac414a510 0x7f4ac4134010 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f4abc00b470 tx=0x7f4abc017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:08.151 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.147+0000 7f4ab17fa700 1 -- 172.21.15.174:0/281840765 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4abc01b6f0 con 0x7f4ac414a510 2021-03-25T14:17:08.152 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.147+0000 7f4ab17fa700 1 -- 172.21.15.174:0/281840765 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4abc01b850 con 0x7f4ac414a510 2021-03-25T14:17:08.152 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.147+0000 7f4acb3ec700 1 -- 172.21.15.174:0/281840765 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ac4159a50 con 0x7f4ac414a510 2021-03-25T14:17:08.152 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.147+0000 7f4ab17fa700 1 -- 172.21.15.174:0/281840765 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4abc01bc10 con 0x7f4ac414a510 2021-03-25T14:17:08.152 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.147+0000 7f4acb3ec700 1 -- 172.21.15.174:0/281840765 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ac413d8d0 con 0x7f4ac414a510 2021-03-25T14:17:08.152 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.148+0000 7f4acb3ec700 1 -- 172.21.15.174:0/281840765 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ac4159be0 con 0x7f4ac414a510 2021-03-25T14:17:08.153 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.148+0000 7f4ab17fa700 1 -- 172.21.15.174:0/281840765 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f4abc00f070 con 0x7f4ac414a510 2021-03-25T14:17:08.153 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.149+0000 7f4ab17fa700 1 --2- 172.21.15.174:0/281840765 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4aa405a0b0 0x7f4aa405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:08.153 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.149+0000 7f4ab17fa700 1 -- 172.21.15.174:0/281840765 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6426+0+0 (secure 0 0 0) 0x7f4abc076260 con 0x7f4ac414a510 2021-03-25T14:17:08.153 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.149+0000 7f4ac9188700 1 --2- 172.21.15.174:0/281840765 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4aa405a0b0 0x7f4aa405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:08.153 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.149+0000 7f4ac9188700 1 --2- 172.21.15.174:0/281840765 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4aa405a0b0 0x7f4aa405c570 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f4ac40ba2b0 tx=0x7f4ac0009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:08.154 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.153+0000 7f4ab17fa700 1 -- 172.21.15.174:0/281840765 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f4abc049aa0 con 0x7f4ac414a510 2021-03-25T14:17:08.340 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.339+0000 7f4acb3ec700 1 -- 172.21.15.174:0/281840765 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4ac4146340 con 0x7f4ac414a510 2021-03-25T14:17:08.341 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.339+0000 7f4ab17fa700 1 -- 172.21.15.174:0/281840765 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4abc04d0c0 con 0x7f4ac414a510 2021-03-25T14:17:08.341 INFO:teuthology.orchestra.run.smithi174.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2021-03-25T14:17:08.343 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.340+0000 7f4acb3ec700 1 -- 172.21.15.174:0/281840765 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4aa405a0b0 msgr2=0x7f4aa405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:08.343 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.340+0000 7f4acb3ec700 1 --2- 172.21.15.174:0/281840765 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4aa405a0b0 0x7f4aa405c570 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f4ac40ba2b0 tx=0x7f4ac0009040).stop 2021-03-25T14:17:08.343 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.341+0000 7f4acb3ec700 1 -- 172.21.15.174:0/281840765 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ac414a510 msgr2=0x7f4ac4134010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:08.343 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.341+0000 7f4acb3ec700 1 --2- 172.21.15.174:0/281840765 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ac414a510 0x7f4ac4134010 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f4abc00b470 tx=0x7f4abc017000).stop 2021-03-25T14:17:08.343 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.341+0000 7f4acb3ec700 1 -- 172.21.15.174:0/281840765 shutdown_connections 2021-03-25T14:17:08.343 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.341+0000 7f4acb3ec700 1 --2- 172.21.15.174:0/281840765 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4aa405a0b0 0x7f4aa405c570 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:08.343 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.341+0000 7f4acb3ec700 1 --2- 172.21.15.174:0/281840765 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ac414a510 0x7f4ac4134010 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:08.343 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.341+0000 7f4acb3ec700 1 --2- 172.21.15.174:0/281840765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ac40bbd00 0x7f4ac413dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:08.344 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.341+0000 7f4acb3ec700 1 --2- 172.21.15.174:0/281840765 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ac4146f20 0x7f4ac4140260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:08.344 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.341+0000 7f4acb3ec700 1 -- 172.21.15.174:0/281840765 >> 172.21.15.174:0/281840765 conn(0x7f4ac4062580 msgr2=0x7f4ac40ba4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:08.344 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.341+0000 7f4acb3ec700 1 -- 172.21.15.174:0/281840765 shutdown_connections 2021-03-25T14:17:08.344 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:08.341+0000 7f4acb3ec700 1 -- 172.21.15.174:0/281840765 wait complete. 2021-03-25T14:17:08.352 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2021-03-25T14:17:08.353 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2021-03-25T14:17:08.353 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi174.front.sepia.ceph.com 2021-03-25T14:17:08.353 INFO:tasks.cephfs.mount:self.client.name = client.1 2021-03-25T14:17:08.353 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2021-03-25T14:17:08.353 INFO:tasks.cephfs.mount:self.cephfs_name = None 2021-03-25T14:17:08.353 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2021-03-25T14:17:08.353 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2021-03-25T14:17:08.353 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2021-03-25T14:17:08.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:08.353 DEBUG:teuthology.orchestra.run.smithi174:> ip addr 2021-03-25T14:17:08.368 INFO:teuthology.orchestra.run.smithi174.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2021-03-25T14:17:08.368 INFO:teuthology.orchestra.run.smithi174.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2021-03-25T14:17:08.368 INFO:teuthology.orchestra.run.smithi174.stdout: inet 127.0.0.1/8 scope host lo 2021-03-25T14:17:08.368 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:08.368 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 ::1/128 scope host 2021-03-25T14:17:08.368 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:08.368 INFO:teuthology.orchestra.run.smithi174.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-03-25T14:17:08.369 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:d9:36:e0 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:17:08.369 INFO:teuthology.orchestra.run.smithi174.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-03-25T14:17:08.369 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:d9:36:e1 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:17:08.369 INFO:teuthology.orchestra.run.smithi174.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-03-25T14:17:08.369 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:88:77:1a brd ff:ff:ff:ff:ff:ff 2021-03-25T14:17:08.369 INFO:teuthology.orchestra.run.smithi174.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2021-03-25T14:17:08.369 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:88:77:1b brd ff:ff:ff:ff:ff:ff 2021-03-25T14:17:08.369 INFO:teuthology.orchestra.run.smithi174.stdout: inet 172.21.15.174/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2021-03-25T14:17:08.369 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft 42574sec preferred_lft 42574sec 2021-03-25T14:17:08.369 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::ec4:7aff:fe88:771b/64 scope link 2021-03-25T14:17:08.369 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:08.369 INFO:teuthology.orchestra.run.smithi174.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2021-03-25T14:17:08.370 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 32:28:39:9e:9c:fe brd ff:ff:ff:ff:ff:ff 2021-03-25T14:17:08.370 INFO:teuthology.orchestra.run.smithi174.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2021-03-25T14:17:08.370 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:08.370 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::2843:d3ff:fe04:eed1/64 scope link 2021-03-25T14:17:08.370 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:08.370 INFO:teuthology.orchestra.run.smithi174.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2021-03-25T14:17:08.370 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 32:28:39:9e:9c:fe brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2021-03-25T14:17:08.370 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::3028:39ff:fe9e:9cfe/64 scope link 2021-03-25T14:17:08.370 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:08.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:08.371 DEBUG:teuthology.orchestra.run.smithi174:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2021-03-25T14:17:08.432 INFO:teuthology.orchestra.run.smithi174.stdout:1 2021-03-25T14:17:08.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:08.433 DEBUG:teuthology.orchestra.run.smithi174:> route 2021-03-25T14:17:08.489 INFO:teuthology.orchestra.run.smithi174.stdout:Kernel IP routing table 2021-03-25T14:17:08.490 INFO:teuthology.orchestra.run.smithi174.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2021-03-25T14:17:08.490 INFO:teuthology.orchestra.run.smithi174.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2021-03-25T14:17:08.490 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2021-03-25T14:17:08.490 INFO:teuthology.orchestra.run.smithi174.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2021-03-25T14:17:08.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:08.490 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec sudo bash -c ' 2021-03-25T14:17:08.490 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2021-03-25T14:17:08.491 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2021-03-25T14:17:08.491 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2021-03-25T14:17:08.491 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2021-03-25T14:17:08.491 DEBUG:teuthology.orchestra.run.smithi174:> ') 2021-03-25T14:17:08.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:08.585 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list 2021-03-25T14:17:08.599 INFO:teuthology.orchestra.run.smithi174.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2021-03-25T14:17:08.599 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2021-03-25T14:17:08.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:08.600 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set brx.0 up 2021-03-25T14:17:08.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:08.663 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p /home/ubuntu/cephtest/mnt.1 2021-03-25T14:17:08.718 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-03-25T14:17:08.718 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,norbytes 2021-03-25T14:17:08.796 INFO:teuthology.orchestra.run.smithi174.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,norbytes 2021-03-25T14:17:08.796 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,name=1,norbytes" will pass to kernel. 2021-03-25T14:17:08.810 INFO:tasks.ceph.mds.a.smithi110.stderr:2021-03-25T14:17:08.810+0000 7f4fae97d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2021-03-25T14:17:08.842 INFO:teuthology.orchestra.run.smithi174.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,norbytes 2021-03-25T14:17:08.842 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,name=1,norbytes" will pass to kernel. 2021-03-25T14:17:08.845 INFO:tasks.cephfs.kernel_mount:mount command passed 2021-03-25T14:17:08.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:08.845 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2021-03-25T14:17:08.912 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2021-03-25T14:17:09.029 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.028+0000 7fd559dd6700 1 Processor -- start 2021-03-25T14:17:09.030 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.028+0000 7fd559dd6700 1 -- start start 2021-03-25T14:17:09.032 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.029+0000 7fd559dd6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5540b6410 0x7fd5540ba870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:09.032 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.029+0000 7fd559dd6700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd5540bad60 0x7fd5540bc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:09.032 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.029+0000 7fd559dd6700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5540bb2d0 con 0x7fd5540b67f0 2021-03-25T14:17:09.032 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.029+0000 7fd559dd6700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5540bb570 con 0x7fd5540bad60 2021-03-25T14:17:09.032 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.029+0000 7fd559dd6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5540bb810 con 0x7fd5540b6410 2021-03-25T14:17:09.032 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.029+0000 7fd553fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd5540bad60 0x7fd5540bc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:09.032 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.029+0000 7fd552ffd700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fd5540b67f0 0x7fd554149ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:42304/0 (socket says 172.21.15.110:42304) 2021-03-25T14:17:09.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.029+0000 7fd552ffd700 1 -- 172.21.15.110:0/2485640838 learned_addr learned my addr 172.21.15.110:0/2485640838 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:09.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.029+0000 7fd5537fe700 1 --2- 172.21.15.110:0/2485640838 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5540b6410 0x7fd5540ba870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:09.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.030+0000 7fd5527fc700 1 -- 172.21.15.110:0/2485640838 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 24720363 0 0) 0x7fd5540bb2d0 con 0x7fd5540b67f0 2021-03-25T14:17:09.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.030+0000 7fd5527fc700 1 -- 172.21.15.110:0/2485640838 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd540003270 con 0x7fd5540b67f0 2021-03-25T14:17:09.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.030+0000 7fd553fff700 1 -- 172.21.15.110:0/2485640838 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5540b6410 msgr2=0x7fd5540ba870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:09.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.030+0000 7fd553fff700 1 --2- 172.21.15.110:0/2485640838 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5540b6410 0x7fd5540ba870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:09.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.030+0000 7fd553fff700 1 -- 172.21.15.110:0/2485640838 >> v1:172.21.15.110:6789/0 conn(0x7fd5540b67f0 legacy=0x7fd554149ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:09.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.030+0000 7fd553fff700 1 -- 172.21.15.110:0/2485640838 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5540bc210 con 0x7fd5540bad60 2021-03-25T14:17:09.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.030+0000 7fd553fff700 1 --2- 172.21.15.110:0/2485640838 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5540bad60 0x7fd5540bc950 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7fd54c009cc0 tx=0x7fd54c009220).ready entity=mon.0 client_cookie=262820b7905805fb server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:09.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.030+0000 7fd5527fc700 1 -- 172.21.15.110:0/2485640838 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c00b9f0 con 0x7fd5540bad60 2021-03-25T14:17:09.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.030+0000 7fd5527fc700 1 -- 172.21.15.110:0/2485640838 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54c00bb50 con 0x7fd5540bad60 2021-03-25T14:17:09.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.030+0000 7fd5527fc700 1 -- 172.21.15.110:0/2485640838 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c011400 con 0x7fd5540bad60 2021-03-25T14:17:09.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.030+0000 7fd559dd6700 1 -- 172.21.15.110:0/2485640838 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5540bad60 msgr2=0x7fd5540bc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:09.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.030+0000 7fd559dd6700 1 --2- 172.21.15.110:0/2485640838 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5540bad60 0x7fd5540bc950 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7fd54c009cc0 tx=0x7fd54c009220).stop 2021-03-25T14:17:09.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.030+0000 7fd559dd6700 1 -- 172.21.15.110:0/2485640838 shutdown_connections 2021-03-25T14:17:09.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.030+0000 7fd559dd6700 1 --2- 172.21.15.110:0/2485640838 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5540bad60 0x7fd5540bc950 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:09.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.030+0000 7fd559dd6700 1 --2- 172.21.15.110:0/2485640838 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5540b6410 0x7fd5540ba870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:09.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.030+0000 7fd559dd6700 1 -- 172.21.15.110:0/2485640838 >> 172.21.15.110:0/2485640838 conn(0x7fd554060c40 msgr2=0x7fd554061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:09.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.030+0000 7fd559dd6700 1 -- 172.21.15.110:0/2485640838 shutdown_connections 2021-03-25T14:17:09.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.030+0000 7fd559dd6700 1 -- 172.21.15.110:0/2485640838 wait complete. 2021-03-25T14:17:09.037 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.032+0000 7fd559dd6700 1 Processor -- start 2021-03-25T14:17:09.037 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.032+0000 7fd559dd6700 1 -- start start 2021-03-25T14:17:09.037 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.032+0000 7fd559dd6700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd5540b6410 0x7fd5541596b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:09.037 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.032+0000 7fd559dd6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5540b67f0 0x7fd55414ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:09.038 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.032+0000 7fd559dd6700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5540bad60 0x7fd554143030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:09.038 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.032+0000 7fd559dd6700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd55414c720 con 0x7fd5540bad60 2021-03-25T14:17:09.038 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.032+0000 7fd559dd6700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd55414bf60 con 0x7fd5540b6410 2021-03-25T14:17:09.038 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.032+0000 7fd559dd6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5540693c0 con 0x7fd5540b67f0 2021-03-25T14:17:09.038 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.032+0000 7fd553fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5540bad60 0x7fd554143030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:09.038 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.033+0000 7fd5537fe700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd5540b6410 0x7fd5541596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:09.038 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.033+0000 7fd553fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5540bad60 0x7fd554143030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49376/0 (socket says 172.21.15.110:49376) 2021-03-25T14:17:09.038 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.033+0000 7fd553fff700 1 -- 172.21.15.110:0/2150464204 learned_addr learned my addr 172.21.15.110:0/2150464204 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:09.038 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.033+0000 7fd5537fe700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd5540b6410 0x7fd5541596b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.110:48024/0 (socket says 172.21.15.110:48024) 2021-03-25T14:17:09.038 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.033+0000 7fd552ffd700 1 --2- 172.21.15.110:0/2150464204 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5540b67f0 0x7fd55414ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:09.038 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.033+0000 7fd553fff700 1 -- 172.21.15.110:0/2150464204 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5540b67f0 msgr2=0x7fd55414ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:09.038 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.033+0000 7fd553fff700 1 --2- 172.21.15.110:0/2150464204 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5540b67f0 0x7fd55414ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:09.038 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.033+0000 7fd553fff700 1 -- 172.21.15.110:0/2150464204 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd5540b6410 msgr2=0x7fd5541596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:09.039 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.033+0000 7fd553fff700 1 --2- 172.21.15.110:0/2150464204 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd5540b6410 0x7fd5541596b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:09.039 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.033+0000 7fd553fff700 1 -- 172.21.15.110:0/2150464204 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd554159ba0 con 0x7fd5540bad60 2021-03-25T14:17:09.039 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.033+0000 7fd5537fe700 1 --2- 172.21.15.110:0/2150464204 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd5540b6410 0x7fd5541596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:17:09.039 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.033+0000 7fd553fff700 1 --2- 172.21.15.110:0/2150464204 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5540bad60 0x7fd554143030 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7fd54c0090b0 tx=0x7fd54c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:09.039 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.033+0000 7fd53b7fe700 1 -- 172.21.15.110:0/2150464204 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c01b620 con 0x7fd5540bad60 2021-03-25T14:17:09.039 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.033+0000 7fd53b7fe700 1 -- 172.21.15.110:0/2150464204 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54c01b780 con 0x7fd5540bad60 2021-03-25T14:17:09.039 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.033+0000 7fd559dd6700 1 -- 172.21.15.110:0/2150464204 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd55414c910 con 0x7fd5540bad60 2021-03-25T14:17:09.039 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.033+0000 7fd53b7fe700 1 -- 172.21.15.110:0/2150464204 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c01bb20 con 0x7fd5540bad60 2021-03-25T14:17:09.039 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.033+0000 7fd559dd6700 1 -- 172.21.15.110:0/2150464204 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd55414ce50 con 0x7fd5540bad60 2021-03-25T14:17:09.039 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.034+0000 7fd559dd6700 1 -- 172.21.15.110:0/2150464204 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd55405d7b0 con 0x7fd5540bad60 2021-03-25T14:17:09.039 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.034+0000 7fd53b7fe700 1 -- 172.21.15.110:0/2150464204 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fd54c00f070 con 0x7fd5540bad60 2021-03-25T14:17:09.039 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.034+0000 7fd53b7fe700 1 --2- 172.21.15.110:0/2150464204 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd53405a0b0 0x7fd53405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:09.039 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.035+0000 7fd53b7fe700 1 -- 172.21.15.110:0/2150464204 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6426+0+0 (secure 0 0 0) 0x7fd54c075ae0 con 0x7fd5540bad60 2021-03-25T14:17:09.040 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.035+0000 7fd5537fe700 1 --2- 172.21.15.110:0/2150464204 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd53405a0b0 0x7fd53405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:09.040 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.035+0000 7fd5537fe700 1 --2- 172.21.15.110:0/2150464204 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd53405a0b0 0x7fd53405c570 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fd55414c4c0 tx=0x7fd544006e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:09.040 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.038+0000 7fd53b7fe700 1 -- 172.21.15.110:0/2150464204 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fd54c049320 con 0x7fd5540bad60 2021-03-25T14:17:09.247 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.246+0000 7fd559dd6700 1 -- 172.21.15.110:0/2150464204 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7fd55414dbc0 con 0x7fd5540bad60 2021-03-25T14:17:09.247 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.246+0000 7fd53b7fe700 1 -- 172.21.15.110:0/2150464204 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 entity client.testuser does not exist v9) v1 ==== 121+0+0 (secure 0 0 0) 0x7fd54c04c940 con 0x7fd5540bad60 2021-03-25T14:17:09.249 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.248+0000 7fd559dd6700 1 -- 172.21.15.110:0/2150464204 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd53405a0b0 msgr2=0x7fd53405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:09.249 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.248+0000 7fd559dd6700 1 --2- 172.21.15.110:0/2150464204 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd53405a0b0 0x7fd53405c570 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fd55414c4c0 tx=0x7fd544006e20).stop 2021-03-25T14:17:09.249 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.248+0000 7fd559dd6700 1 -- 172.21.15.110:0/2150464204 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5540bad60 msgr2=0x7fd554143030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:09.249 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.248+0000 7fd559dd6700 1 --2- 172.21.15.110:0/2150464204 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5540bad60 0x7fd554143030 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7fd54c0090b0 tx=0x7fd54c017000).stop 2021-03-25T14:17:09.249 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.248+0000 7fd559dd6700 1 -- 172.21.15.110:0/2150464204 shutdown_connections 2021-03-25T14:17:09.249 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.248+0000 7fd559dd6700 1 --2- 172.21.15.110:0/2150464204 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd53405a0b0 0x7fd53405c570 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:09.249 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.248+0000 7fd559dd6700 1 --2- 172.21.15.110:0/2150464204 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd5540b6410 0x7fd5541596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:09.249 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.248+0000 7fd559dd6700 1 --2- 172.21.15.110:0/2150464204 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5540bad60 0x7fd554143030 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:09.250 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.248+0000 7fd559dd6700 1 --2- 172.21.15.110:0/2150464204 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5540b67f0 0x7fd55414ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:09.250 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.248+0000 7fd559dd6700 1 -- 172.21.15.110:0/2150464204 >> 172.21.15.110:0/2150464204 conn(0x7fd554060c40 msgr2=0x7fd5540a2080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:09.250 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.248+0000 7fd559dd6700 1 -- 172.21.15.110:0/2150464204 shutdown_connections 2021-03-25T14:17:09.250 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.248+0000 7fd559dd6700 1 -- 172.21.15.110:0/2150464204 wait complete. 2021-03-25T14:17:09.250 INFO:teuthology.orchestra.run.smithi110.stderr:entity client.testuser does not exist 2021-03-25T14:17:09.260 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true 2021-03-25T14:17:09.372 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.371+0000 7fe355410700 1 Processor -- start 2021-03-25T14:17:09.373 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.372+0000 7fe355410700 1 -- start start 2021-03-25T14:17:09.375 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.372+0000 7fe355410700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe350068a80 0x7fe3500633b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:09.375 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.372+0000 7fe355410700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe35014cda0 con 0x7fe35014d8e0 2021-03-25T14:17:09.375 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.372+0000 7fe355410700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3500b79f0 con 0x7fe350068e60 2021-03-25T14:17:09.375 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.372+0000 7fe355410700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe350149e40 con 0x7fe350068a80 2021-03-25T14:17:09.375 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.372+0000 7fe34f7fe700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fe35014d8e0 0x7fe350148bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:42320/0 (socket says 172.21.15.110:42320) 2021-03-25T14:17:09.376 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.372+0000 7fe34f7fe700 1 -- 172.21.15.110:0/919832776 learned_addr learned my addr 172.21.15.110:0/919832776 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:09.376 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.373+0000 7fe34effd700 1 --2- 172.21.15.110:0/919832776 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe350068a80 0x7fe3500633b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:09.376 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.373+0000 7fe34dffb700 1 -- 172.21.15.110:0/919832776 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2995069264 0 0) 0x7fe35014cda0 con 0x7fe35014d8e0 2021-03-25T14:17:09.376 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.373+0000 7fe34dffb700 1 -- 172.21.15.110:0/919832776 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe33c003270 con 0x7fe35014d8e0 2021-03-25T14:17:09.376 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.373+0000 7fe34dffb700 1 -- 172.21.15.110:0/919832776 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3856179717 0 0) 0x7fe3500b79f0 con 0x7fe350068e60 2021-03-25T14:17:09.376 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.373+0000 7fe34dffb700 1 -- 172.21.15.110:0/919832776 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe35014cda0 con 0x7fe350068e60 2021-03-25T14:17:09.376 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.373+0000 7fe34effd700 1 -- 172.21.15.110:0/919832776 >> v1:172.21.15.174:6789/0 conn(0x7fe350068e60 legacy=0x7fe35014d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:09.376 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.373+0000 7fe34effd700 1 -- 172.21.15.110:0/919832776 >> v1:172.21.15.110:6789/0 conn(0x7fe35014d8e0 legacy=0x7fe350148bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:09.376 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.373+0000 7fe34effd700 1 -- 172.21.15.110:0/919832776 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe35014a0e0 con 0x7fe350068a80 2021-03-25T14:17:09.376 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.373+0000 7fe34effd700 1 --2- 172.21.15.110:0/919832776 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe350068a80 0x7fe3500633b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fe34000b9f0 tx=0x7fe340006e20).ready entity=mon.2 client_cookie=6128865d527a19c9 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:09.376 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.373+0000 7fe34dffb700 1 -- 172.21.15.110:0/919832776 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe340009630 con 0x7fe350068a80 2021-03-25T14:17:09.376 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.373+0000 7fe34dffb700 1 -- 172.21.15.110:0/919832776 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe340009790 con 0x7fe350068a80 2021-03-25T14:17:09.376 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.373+0000 7fe34dffb700 1 -- 172.21.15.110:0/919832776 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe340009b10 con 0x7fe350068a80 2021-03-25T14:17:09.377 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.374+0000 7fe355410700 1 -- 172.21.15.110:0/919832776 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe350068a80 msgr2=0x7fe3500633b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:09.377 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.374+0000 7fe355410700 1 --2- 172.21.15.110:0/919832776 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe350068a80 0x7fe3500633b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fe34000b9f0 tx=0x7fe340006e20).stop 2021-03-25T14:17:09.377 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.374+0000 7fe355410700 1 -- 172.21.15.110:0/919832776 shutdown_connections 2021-03-25T14:17:09.377 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.374+0000 7fe355410700 1 --2- 172.21.15.110:0/919832776 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe350068a80 0x7fe3500633b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:09.377 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.374+0000 7fe355410700 1 -- 172.21.15.110:0/919832776 >> 172.21.15.110:0/919832776 conn(0x7fe3500627d0 msgr2=0x7fe3500bca70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:09.377 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.374+0000 7fe355410700 1 -- 172.21.15.110:0/919832776 shutdown_connections 2021-03-25T14:17:09.377 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.374+0000 7fe355410700 1 -- 172.21.15.110:0/919832776 wait complete. 2021-03-25T14:17:09.380 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.375+0000 7fe355410700 1 Processor -- start 2021-03-25T14:17:09.380 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.375+0000 7fe355410700 1 -- start start 2021-03-25T14:17:09.380 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.376+0000 7fe355410700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe350068a80 0x7fe35014efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:09.380 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.376+0000 7fe355410700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe350068e60 0x7fe35015cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:09.381 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.376+0000 7fe355410700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe35014d8e0 0x7fe35009fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:09.381 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.376+0000 7fe355410700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3500bb290 con 0x7fe350068e60 2021-03-25T14:17:09.381 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.376+0000 7fe355410700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3500a1f20 con 0x7fe350068a80 2021-03-25T14:17:09.381 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.376+0000 7fe355410700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3500a21c0 con 0x7fe35014d8e0 2021-03-25T14:17:09.381 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.376+0000 7fe34e7fc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe350068e60 0x7fe35015cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:09.381 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.376+0000 7fe34e7fc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe350068e60 0x7fe35015cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49390/0 (socket says 172.21.15.110:49390) 2021-03-25T14:17:09.381 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.376+0000 7fe34e7fc700 1 -- 172.21.15.110:0/589664508 learned_addr learned my addr 172.21.15.110:0/589664508 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:09.381 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.376+0000 7fe34f7fe700 1 --2- 172.21.15.110:0/589664508 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe35014d8e0 0x7fe35009fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:09.381 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.376+0000 7fe34effd700 1 --2- 172.21.15.110:0/589664508 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe350068a80 0x7fe35014efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:09.381 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.376+0000 7fe34e7fc700 1 -- 172.21.15.110:0/589664508 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe35014d8e0 msgr2=0x7fe35009fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:09.381 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.376+0000 7fe34e7fc700 1 --2- 172.21.15.110:0/589664508 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe35014d8e0 0x7fe35009fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:09.381 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.376+0000 7fe34e7fc700 1 -- 172.21.15.110:0/589664508 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe350068a80 msgr2=0x7fe35014efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:09.382 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.376+0000 7fe34e7fc700 1 --2- 172.21.15.110:0/589664508 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe350068a80 0x7fe35014efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:09.382 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.376+0000 7fe34e7fc700 1 -- 172.21.15.110:0/589664508 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe35015c610 con 0x7fe350068e60 2021-03-25T14:17:09.382 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.376+0000 7fe34e7fc700 1 --2- 172.21.15.110:0/589664508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe350068e60 0x7fe35015cd50 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7fe34400c710 tx=0x7fe344007a30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:09.382 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.376+0000 7fe336ffd700 1 -- 172.21.15.110:0/589664508 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34400f470 con 0x7fe350068e60 2021-03-25T14:17:09.382 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.376+0000 7fe336ffd700 1 -- 172.21.15.110:0/589664508 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34400f5d0 con 0x7fe350068e60 2021-03-25T14:17:09.382 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.376+0000 7fe355410700 1 -- 172.21.15.110:0/589664508 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe35015c8b0 con 0x7fe350068e60 2021-03-25T14:17:09.382 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.376+0000 7fe336ffd700 1 -- 172.21.15.110:0/589664508 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34400f950 con 0x7fe350068e60 2021-03-25T14:17:09.382 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.376+0000 7fe355410700 1 -- 172.21.15.110:0/589664508 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe35014f4c0 con 0x7fe350068e60 2021-03-25T14:17:09.382 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.377+0000 7fe355410700 1 -- 172.21.15.110:0/589664508 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3500a2380 con 0x7fe350068e60 2021-03-25T14:17:09.382 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.378+0000 7fe336ffd700 1 -- 172.21.15.110:0/589664508 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fe344019030 con 0x7fe350068e60 2021-03-25T14:17:09.382 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.378+0000 7fe336ffd700 1 --2- 172.21.15.110:0/589664508 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe33005a0b0 0x7fe33005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:09.382 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.378+0000 7fe336ffd700 1 -- 172.21.15.110:0/589664508 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6426+0+0 (secure 0 0 0) 0x7fe344073140 con 0x7fe350068e60 2021-03-25T14:17:09.382 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.378+0000 7fe34effd700 1 --2- 172.21.15.110:0/589664508 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe33005a0b0 0x7fe33005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:09.383 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.378+0000 7fe34effd700 1 --2- 172.21.15.110:0/589664508 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe33005a0b0 0x7fe33005c570 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fe34000b150 tx=0x7fe340016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:09.383 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.382+0000 7fe336ffd700 1 -- 172.21.15.110:0/589664508 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fe344045620 con 0x7fe350068e60 2021-03-25T14:17:09.566 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:09.565+0000 7fe355410700 1 -- 172.21.15.110:0/589664508 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true"} v 0) v1 -- 0x7fe350069c70 con 0x7fe350068e60 2021-03-25T14:17:10.012 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.011+0000 7fe336ffd700 1 -- 172.21.15.110:0/589664508 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true"}]=0 v16) v1 ==== 106+0+0 (secure 0 0 0) 0x7fe3440469d0 con 0x7fe350068e60 2021-03-25T14:17:10.014 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.013+0000 7fe355410700 1 -- 172.21.15.110:0/589664508 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe33005a0b0 msgr2=0x7fe33005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:10.014 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.013+0000 7fe355410700 1 --2- 172.21.15.110:0/589664508 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe33005a0b0 0x7fe33005c570 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fe34000b150 tx=0x7fe340016000).stop 2021-03-25T14:17:10.014 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.013+0000 7fe355410700 1 -- 172.21.15.110:0/589664508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe350068e60 msgr2=0x7fe35015cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:10.014 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.013+0000 7fe355410700 1 --2- 172.21.15.110:0/589664508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe350068e60 0x7fe35015cd50 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7fe34400c710 tx=0x7fe344007a30).stop 2021-03-25T14:17:10.014 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.013+0000 7fe355410700 1 -- 172.21.15.110:0/589664508 shutdown_connections 2021-03-25T14:17:10.014 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.013+0000 7fe355410700 1 --2- 172.21.15.110:0/589664508 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe33005a0b0 0x7fe33005c570 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:10.015 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.013+0000 7fe355410700 1 --2- 172.21.15.110:0/589664508 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe350068a80 0x7fe35014efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:10.015 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.013+0000 7fe355410700 1 --2- 172.21.15.110:0/589664508 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe35014d8e0 0x7fe35009fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:10.015 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.013+0000 7fe355410700 1 --2- 172.21.15.110:0/589664508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe350068e60 0x7fe35015cd50 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:10.015 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.013+0000 7fe355410700 1 -- 172.21.15.110:0/589664508 >> 172.21.15.110:0/589664508 conn(0x7fe3500627d0 msgr2=0x7fe3500b2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:10.015 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.013+0000 7fe355410700 1 -- 172.21.15.110:0/589664508 shutdown_connections 2021-03-25T14:17:10.015 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.013+0000 7fe355410700 1 -- 172.21.15.110:0/589664508 wait complete. 2021-03-25T14:17:10.026 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:17:10.135 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.135+0000 7fe27b13f700 1 Processor -- start 2021-03-25T14:17:10.136 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.135+0000 7fe27b13f700 1 -- start start 2021-03-25T14:17:10.138 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.135+0000 7fe27b13f700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe2740bafe0 0x7fe2740a2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:10.139 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.136+0000 7fe27b13f700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2740b2ea0 con 0x7fe27414d6d0 2021-03-25T14:17:10.139 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.136+0000 7fe27b13f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2740b3140 con 0x7fe27414d250 2021-03-25T14:17:10.139 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.136+0000 7fe27b13f700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe274149980 con 0x7fe2740bafe0 2021-03-25T14:17:10.139 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.136+0000 7fe27a13d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe2740bafe0 0x7fe2740a2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:10.139 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.136+0000 7fe27a93e700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fe27414d6d0 0x7fe274149270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:42332/0 (socket says 172.21.15.110:42332) 2021-03-25T14:17:10.139 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.136+0000 7fe27a93e700 1 -- 172.21.15.110:0/780673275 learned_addr learned my addr 172.21.15.110:0/780673275 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:10.139 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.136+0000 7fe27a13d700 1 -- 172.21.15.110:0/780673275 >> v1:172.21.15.174:6789/0 conn(0x7fe27414d250 legacy=0x7fe274148b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:10.139 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.136+0000 7fe27a13d700 1 -- 172.21.15.110:0/780673275 >> v1:172.21.15.110:6789/0 conn(0x7fe27414d6d0 legacy=0x7fe274149270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:10.139 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.136+0000 7fe27913b700 1 -- 172.21.15.110:0/780673275 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3292077776 0 0) 0x7fe2740b2ea0 con 0x7fe27414d6d0 2021-03-25T14:17:10.139 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.136+0000 7fe27a13d700 1 -- 172.21.15.110:0/780673275 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2740b33e0 con 0x7fe2740bafe0 2021-03-25T14:17:10.139 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.136+0000 7fe27a13d700 1 --2- 172.21.15.110:0/780673275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2740bafe0 0x7fe2740a2e10 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7fe26400b9c0 tx=0x7fe264006e20).ready entity=mon.0 client_cookie=11c51e4e817d4212 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:10.140 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.136+0000 7fe27913b700 1 -- 172.21.15.110:0/780673275 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe264009830 con 0x7fe2740bafe0 2021-03-25T14:17:10.140 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.136+0000 7fe27913b700 1 -- 172.21.15.110:0/780673275 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe264009990 con 0x7fe2740bafe0 2021-03-25T14:17:10.140 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.136+0000 7fe27913b700 1 -- 172.21.15.110:0/780673275 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe264009d10 con 0x7fe2740bafe0 2021-03-25T14:17:10.140 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.137+0000 7fe27b13f700 1 -- 172.21.15.110:0/780673275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2740bafe0 msgr2=0x7fe2740a2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:10.140 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.137+0000 7fe27b13f700 1 --2- 172.21.15.110:0/780673275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2740bafe0 0x7fe2740a2e10 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7fe26400b9c0 tx=0x7fe264006e20).stop 2021-03-25T14:17:10.140 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.137+0000 7fe27b13f700 1 -- 172.21.15.110:0/780673275 shutdown_connections 2021-03-25T14:17:10.140 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.137+0000 7fe27b13f700 1 --2- 172.21.15.110:0/780673275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2740bafe0 0x7fe2740a2e10 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:10.140 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.137+0000 7fe27b13f700 1 -- 172.21.15.110:0/780673275 >> 172.21.15.110:0/780673275 conn(0x7fe2740622e0 msgr2=0x7fe2740626f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:10.140 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.137+0000 7fe27b13f700 1 -- 172.21.15.110:0/780673275 shutdown_connections 2021-03-25T14:17:10.140 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.137+0000 7fe27b13f700 1 -- 172.21.15.110:0/780673275 wait complete. 2021-03-25T14:17:10.140 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.138+0000 7fe27b13f700 1 Processor -- start 2021-03-25T14:17:10.140 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.138+0000 7fe27b13f700 1 -- start start 2021-03-25T14:17:10.143 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.139+0000 7fe27b13f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2740bafe0 0x7fe274146280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:10.143 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.139+0000 7fe27b13f700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe27414d250 0x7fe274146770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:10.143 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.139+0000 7fe27b13f700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe27414d6d0 0x7fe27415c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:10.143 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.139+0000 7fe27b13f700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27414b0d0 con 0x7fe27414d250 2021-03-25T14:17:10.144 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.139+0000 7fe27b13f700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27414bd60 con 0x7fe27414d6d0 2021-03-25T14:17:10.144 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.139+0000 7fe27b13f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe27414c000 con 0x7fe2740bafe0 2021-03-25T14:17:10.144 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.139+0000 7fe27993c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe27414d250 0x7fe274146770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:10.144 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.139+0000 7fe27993c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe27414d250 0x7fe274146770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49402/0 (socket says 172.21.15.110:49402) 2021-03-25T14:17:10.144 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.139+0000 7fe27993c700 1 -- 172.21.15.110:0/4143298173 learned_addr learned my addr 172.21.15.110:0/4143298173 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:10.144 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.139+0000 7fe27a93e700 1 --2- 172.21.15.110:0/4143298173 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe27414d6d0 0x7fe27415c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:10.144 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.139+0000 7fe27993c700 1 -- 172.21.15.110:0/4143298173 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2740bafe0 msgr2=0x7fe274146280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:10.144 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.139+0000 7fe27993c700 1 --2- 172.21.15.110:0/4143298173 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2740bafe0 0x7fe274146280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:10.144 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.139+0000 7fe27993c700 1 -- 172.21.15.110:0/4143298173 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe27414d6d0 msgr2=0x7fe27415c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:10.144 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.139+0000 7fe27993c700 1 --2- 172.21.15.110:0/4143298173 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe27414d6d0 0x7fe27415c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:10.144 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.139+0000 7fe27993c700 1 -- 172.21.15.110:0/4143298173 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe27414ac30 con 0x7fe27414d250 2021-03-25T14:17:10.144 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.139+0000 7fe27a93e700 1 --2- 172.21.15.110:0/4143298173 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe27414d6d0 0x7fe27415c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:17:10.145 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.139+0000 7fe27993c700 1 --2- 172.21.15.110:0/4143298173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe27414d250 0x7fe274146770 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7fe27000c760 tx=0x7fe270007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:10.145 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.139+0000 7fe2627fc700 1 -- 172.21.15.110:0/4143298173 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe270010510 con 0x7fe27414d250 2021-03-25T14:17:10.145 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.139+0000 7fe2627fc700 1 -- 172.21.15.110:0/4143298173 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe270010690 con 0x7fe27414d250 2021-03-25T14:17:10.145 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.139+0000 7fe27b13f700 1 -- 172.21.15.110:0/4143298173 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe274146c60 con 0x7fe27414d250 2021-03-25T14:17:10.145 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.139+0000 7fe2627fc700 1 -- 172.21.15.110:0/4143298173 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe270010a50 con 0x7fe27414d250 2021-03-25T14:17:10.145 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.139+0000 7fe27b13f700 1 -- 172.21.15.110:0/4143298173 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe274063100 con 0x7fe27414d250 2021-03-25T14:17:10.145 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.140+0000 7fe27b13f700 1 -- 172.21.15.110:0/4143298173 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe27414adc0 con 0x7fe27414d250 2021-03-25T14:17:10.145 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.140+0000 7fe2627fc700 1 -- 172.21.15.110:0/4143298173 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fe270010070 con 0x7fe27414d250 2021-03-25T14:17:10.145 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.141+0000 7fe2627fc700 1 --2- 172.21.15.110:0/4143298173 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe25405a0e0 0x7fe25405c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:10.145 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.141+0000 7fe2627fc700 1 -- 172.21.15.110:0/4143298173 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6426+0+0 (secure 0 0 0) 0x7fe270073a40 con 0x7fe27414d250 2021-03-25T14:17:10.145 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.141+0000 7fe27a13d700 1 --2- 172.21.15.110:0/4143298173 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe25405a0e0 0x7fe25405c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:10.145 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.141+0000 7fe27a13d700 1 --2- 172.21.15.110:0/4143298173 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe25405a0e0 0x7fe25405c5a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fe264006e60 tx=0x7fe264016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:10.146 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.144+0000 7fe2627fc700 1 -- 172.21.15.110:0/4143298173 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fe270070620 con 0x7fe27414d250 2021-03-25T14:17:10.297 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.296+0000 7fe27b13f700 1 -- 172.21.15.110:0/4143298173 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe274045ae0 con 0x7fe27414d250 2021-03-25T14:17:10.297 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.297+0000 7fe2627fc700 1 -- 172.21.15.110:0/4143298173 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+17109 (secure 0 0 0) 0x7fe270047280 con 0x7fe27414d250 2021-03-25T14:17:10.298 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:10.298 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":38,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:17:06.337160+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2021-03-25T14:17:02.835058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2021-03-25T14:17:03.303869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:17:10.299 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.298+0000 7fe27b13f700 1 -- 172.21.15.110:0/4143298173 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe25405a0e0 msgr2=0x7fe25405c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:10.300 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.298+0000 7fe27b13f700 1 --2- 172.21.15.110:0/4143298173 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe25405a0e0 0x7fe25405c5a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fe264006e60 tx=0x7fe264016000).stop 2021-03-25T14:17:10.300 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.298+0000 7fe27b13f700 1 -- 172.21.15.110:0/4143298173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe27414d250 msgr2=0x7fe274146770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:10.300 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.298+0000 7fe27b13f700 1 --2- 172.21.15.110:0/4143298173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe27414d250 0x7fe274146770 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7fe27000c760 tx=0x7fe270007c60).stop 2021-03-25T14:17:10.300 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.298+0000 7fe27b13f700 1 -- 172.21.15.110:0/4143298173 shutdown_connections 2021-03-25T14:17:10.300 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.298+0000 7fe27b13f700 1 --2- 172.21.15.110:0/4143298173 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe25405a0e0 0x7fe25405c5a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:10.300 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.298+0000 7fe27b13f700 1 --2- 172.21.15.110:0/4143298173 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe27414d6d0 0x7fe27415c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:10.300 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.298+0000 7fe27b13f700 1 --2- 172.21.15.110:0/4143298173 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2740bafe0 0x7fe274146280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:10.300 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.298+0000 7fe27b13f700 1 --2- 172.21.15.110:0/4143298173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe27414d250 0x7fe274146770 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:10.300 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.298+0000 7fe27b13f700 1 -- 172.21.15.110:0/4143298173 >> 172.21.15.110:0/4143298173 conn(0x7fe2740622e0 msgr2=0x7fe27414c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:10.300 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.298+0000 7fe27b13f700 1 -- 172.21.15.110:0/4143298173 shutdown_connections 2021-03-25T14:17:10.300 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.298+0000 7fe27b13f700 1 -- 172.21.15.110:0/4143298173 wait complete. 2021-03-25T14:17:10.311 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-03-25T14:15:59.047299+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-03-25T14:16:00.537926+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2021-03-25T14:17:02.835058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2021-03-25T14:17:03.303869+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-03-25T14:17:10.311 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-03-25T14:17:10.424 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.423+0000 7f469d947700 1 Processor -- start 2021-03-25T14:17:10.424 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.423+0000 7f469d947700 1 -- start start 2021-03-25T14:17:10.426 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.424+0000 7f469d947700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4698064800 0x7f4698064be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:10.426 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.424+0000 7f469d947700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f469814cf60 con 0x7f4698065d30 2021-03-25T14:17:10.426 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.424+0000 7f469d947700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f469814d200 con 0x7f4698066c30 2021-03-25T14:17:10.427 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.424+0000 7f469d947700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f469814d4a0 con 0x7f4698064800 2021-03-25T14:17:10.427 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.424+0000 7f4696ffd700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4698064800 0x7f4698064be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:10.427 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.424+0000 7f46977fe700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f4698065d30 0x7f4698149dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:42344/0 (socket says 172.21.15.110:42344) 2021-03-25T14:17:10.427 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.424+0000 7f4696ffd700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4698064800 0x7f4698064be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49408/0 (socket says 172.21.15.110:49408) 2021-03-25T14:17:10.427 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.424+0000 7f46977fe700 1 -- 172.21.15.110:0/1536454817 learned_addr learned my addr 172.21.15.110:0/1536454817 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:10.427 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.424+0000 7f4696ffd700 1 -- 172.21.15.110:0/1536454817 >> v1:172.21.15.174:6789/0 conn(0x7f4698066c30 legacy=0x7f4698065620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:10.427 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.424+0000 7f4696ffd700 1 -- 172.21.15.110:0/1536454817 >> v1:172.21.15.110:6789/0 conn(0x7f4698065d30 legacy=0x7f4698149dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:10.427 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.424+0000 7f4696ffd700 1 -- 172.21.15.110:0/1536454817 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469814d740 con 0x7f4698064800 2021-03-25T14:17:10.427 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.424+0000 7f4695ffb700 1 -- 172.21.15.110:0/1536454817 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1309925977 0 0) 0x7f469814cf60 con 0x7f4698065d30 2021-03-25T14:17:10.427 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.424+0000 7f4696ffd700 1 --2- 172.21.15.110:0/1536454817 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4698064800 0x7f4698064be0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f468800b9c0 tx=0x7f4688006e20).ready entity=mon.0 client_cookie=9635a5c05f55d0c4 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:10.427 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.424+0000 7f4695ffb700 1 -- 172.21.15.110:0/1536454817 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46880097e0 con 0x7f4698064800 2021-03-25T14:17:10.427 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.424+0000 7f4695ffb700 1 -- 172.21.15.110:0/1536454817 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4688009940 con 0x7f4698064800 2021-03-25T14:17:10.427 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.424+0000 7f4695ffb700 1 -- 172.21.15.110:0/1536454817 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4688009cc0 con 0x7f4698064800 2021-03-25T14:17:10.428 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.425+0000 7f469d947700 1 -- 172.21.15.110:0/1536454817 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4698064800 msgr2=0x7f4698064be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:10.428 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.425+0000 7f469d947700 1 --2- 172.21.15.110:0/1536454817 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4698064800 0x7f4698064be0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f468800b9c0 tx=0x7f4688006e20).stop 2021-03-25T14:17:10.428 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.425+0000 7f469d947700 1 -- 172.21.15.110:0/1536454817 shutdown_connections 2021-03-25T14:17:10.428 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.425+0000 7f469d947700 1 --2- 172.21.15.110:0/1536454817 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4698064800 0x7f4698064be0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:10.428 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.425+0000 7f469d947700 1 -- 172.21.15.110:0/1536454817 >> 172.21.15.110:0/1536454817 conn(0x7f4698060c40 msgr2=0x7f4698061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:10.428 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.425+0000 7f469d947700 1 -- 172.21.15.110:0/1536454817 shutdown_connections 2021-03-25T14:17:10.428 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.425+0000 7f469d947700 1 -- 172.21.15.110:0/1536454817 wait complete. 2021-03-25T14:17:10.431 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.426+0000 7f469d947700 1 Processor -- start 2021-03-25T14:17:10.431 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.426+0000 7f469d947700 1 -- start start 2021-03-25T14:17:10.431 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.427+0000 7f469d947700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4698064800 0x7f4698148100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:10.431 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.427+0000 7f469d947700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4698065d30 0x7f46981485f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:10.431 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.427+0000 7f469d947700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4698066c30 0x7f46980b77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:10.431 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.427+0000 7f469d947700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4698158bb0 con 0x7f4698065d30 2021-03-25T14:17:10.432 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.427+0000 7f469d947700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4698158de0 con 0x7f4698064800 2021-03-25T14:17:10.432 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.427+0000 7f469d947700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46980a1de0 con 0x7f4698066c30 2021-03-25T14:17:10.432 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.427+0000 7f46967fc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4698065d30 0x7f46981485f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:10.432 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.427+0000 7f46967fc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4698065d30 0x7f46981485f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49416/0 (socket says 172.21.15.110:49416) 2021-03-25T14:17:10.432 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.427+0000 7f46967fc700 1 -- 172.21.15.110:0/2656325435 learned_addr learned my addr 172.21.15.110:0/2656325435 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:10.432 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.427+0000 7f4696ffd700 1 --2- 172.21.15.110:0/2656325435 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4698064800 0x7f4698148100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:10.432 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.427+0000 7f46967fc700 1 -- 172.21.15.110:0/2656325435 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4698066c30 msgr2=0x7f46980b77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:10.432 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.427+0000 7f46967fc700 1 --2- 172.21.15.110:0/2656325435 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4698066c30 0x7f46980b77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:10.432 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.427+0000 7f46967fc700 1 -- 172.21.15.110:0/2656325435 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4698064800 msgr2=0x7f4698148100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:10.432 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.427+0000 7f46967fc700 1 --2- 172.21.15.110:0/2656325435 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4698064800 0x7f4698148100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:10.432 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.427+0000 7f46967fc700 1 -- 172.21.15.110:0/2656325435 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46980a2080 con 0x7f4698065d30 2021-03-25T14:17:10.432 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.427+0000 7f46967fc700 1 --2- 172.21.15.110:0/2656325435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4698065d30 0x7f46981485f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f468c00c710 tx=0x7f468c007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:10.432 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.427+0000 7f467effd700 1 -- 172.21.15.110:0/2656325435 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c007020 con 0x7f4698065d30 2021-03-25T14:17:10.433 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.427+0000 7f467effd700 1 -- 172.21.15.110:0/2656325435 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468c007180 con 0x7f4698065d30 2021-03-25T14:17:10.433 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.427+0000 7f469d947700 1 -- 172.21.15.110:0/2656325435 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46980a2320 con 0x7f4698065d30 2021-03-25T14:17:10.433 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.427+0000 7f467effd700 1 -- 172.21.15.110:0/2656325435 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c006520 con 0x7f4698065d30 2021-03-25T14:17:10.433 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.427+0000 7f469d947700 1 -- 172.21.15.110:0/2656325435 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46980b84a0 con 0x7f4698065d30 2021-03-25T14:17:10.433 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.428+0000 7f469d947700 1 -- 172.21.15.110:0/2656325435 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46980a2500 con 0x7f4698065d30 2021-03-25T14:17:10.433 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.429+0000 7f467effd700 1 -- 172.21.15.110:0/2656325435 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f468c018020 con 0x7f4698065d30 2021-03-25T14:17:10.433 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.429+0000 7f467effd700 1 --2- 172.21.15.110:0/2656325435 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f467805a0b0 0x7f467805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:10.433 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.429+0000 7f467effd700 1 -- 172.21.15.110:0/2656325435 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6426+0+0 (secure 0 0 0) 0x7f468c073710 con 0x7f4698065d30 2021-03-25T14:17:10.433 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.429+0000 7f4696ffd700 1 --2- 172.21.15.110:0/2656325435 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f467805a0b0 0x7f467805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:10.433 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.429+0000 7f4696ffd700 1 --2- 172.21.15.110:0/2656325435 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f467805a0b0 0x7f467805c570 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f4698153210 tx=0x7f4688016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:10.434 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.433+0000 7f467effd700 1 -- 172.21.15.110:0/2656325435 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f46980a2500 con 0x7f4698065d30 2021-03-25T14:17:10.583 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.582+0000 7f469d947700 1 -- 172.21.15.110:0/2656325435 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f46980a2500 con 0x7f4698065d30 2021-03-25T14:17:10.584 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.583+0000 7f467effd700 1 -- 172.21.15.110:0/2656325435 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v38) v1 ==== 110+0+10 (secure 0 0 0) 0x7f46980a2500 con 0x7f4698065d30 2021-03-25T14:17:10.584 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 1 2021-03-25T14:17:10.586 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.584+0000 7f469d947700 1 -- 172.21.15.110:0/2656325435 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f467805a0b0 msgr2=0x7f467805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:10.586 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.584+0000 7f469d947700 1 --2- 172.21.15.110:0/2656325435 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f467805a0b0 0x7f467805c570 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f4698153210 tx=0x7f4688016000).stop 2021-03-25T14:17:10.586 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.584+0000 7f469d947700 1 -- 172.21.15.110:0/2656325435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4698065d30 msgr2=0x7f46981485f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:10.586 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.584+0000 7f469d947700 1 --2- 172.21.15.110:0/2656325435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4698065d30 0x7f46981485f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f468c00c710 tx=0x7f468c007c80).stop 2021-03-25T14:17:10.586 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.584+0000 7f469d947700 1 -- 172.21.15.110:0/2656325435 shutdown_connections 2021-03-25T14:17:10.586 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.584+0000 7f469d947700 1 --2- 172.21.15.110:0/2656325435 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f467805a0b0 0x7f467805c570 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:10.586 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.584+0000 7f469d947700 1 --2- 172.21.15.110:0/2656325435 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4698064800 0x7f4698148100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:10.586 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.584+0000 7f469d947700 1 --2- 172.21.15.110:0/2656325435 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4698066c30 0x7f46980b77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:10.586 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.584+0000 7f469d947700 1 --2- 172.21.15.110:0/2656325435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4698065d30 0x7f46981485f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:10.586 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.584+0000 7f469d947700 1 -- 172.21.15.110:0/2656325435 >> 172.21.15.110:0/2656325435 conn(0x7f4698060c40 msgr2=0x7f469814a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:10.586 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.584+0000 7f469d947700 1 -- 172.21.15.110:0/2656325435 shutdown_connections 2021-03-25T14:17:10.587 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.584+0000 7f469d947700 1 -- 172.21.15.110:0/2656325435 wait complete. 2021-03-25T14:17:10.597 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-03-25T14:17:10.709 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.708+0000 7f34b76a3700 1 Processor -- start 2021-03-25T14:17:10.709 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.708+0000 7f34b76a3700 1 -- start start 2021-03-25T14:17:10.712 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.709+0000 7f34b76a3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f34b00b0cc0 0x7f34b0145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:10.712 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.709+0000 7f34b76a3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34b00b5d00 0x7f34b0067250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:10.712 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.709+0000 7f34b76a3700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34b0149c50 con 0x7f34b00648a0 2021-03-25T14:17:10.712 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.709+0000 7f34b76a3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34b01461b0 con 0x7f34b00b0cc0 2021-03-25T14:17:10.712 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.709+0000 7f34b76a3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b0149e80 con 0x7f34b00b5d00 2021-03-25T14:17:10.712 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.709+0000 7f34b4c3e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34b00b5d00 0x7f34b0067250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:10.712 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.709+0000 7f34b543f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f34b00b0cc0 0x7f34b0145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:10.712 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.709+0000 7f34b4c3e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34b00b5d00 0x7f34b0067250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.110:41822/0 (socket says 172.21.15.110:41822) 2021-03-25T14:17:10.712 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.709+0000 7f34b5c40700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f34b00648a0 0x7f34b009db40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.110:50028/0 (socket says 172.21.15.110:50028) 2021-03-25T14:17:10.713 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.709+0000 7f34b4c3e700 1 -- 172.21.15.110:0/2164501166 learned_addr learned my addr 172.21.15.110:0/2164501166 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:10.713 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.709+0000 7f34b543f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f34b00b0cc0 0x7f34b0145cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.110:48072/0 (socket says 172.21.15.110:48072) 2021-03-25T14:17:10.713 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.709+0000 7f34b4c3e700 1 -- 172.21.15.110:0/2164501166 >> v2:172.21.15.174:3300/0 conn(0x7f34b00b0cc0 msgr2=0x7f34b0145cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:10.713 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.709+0000 7f34b4c3e700 1 --2- 172.21.15.110:0/2164501166 >> v2:172.21.15.174:3300/0 conn(0x7f34b00b0cc0 0x7f34b0145cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:10.713 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.709+0000 7f34b4c3e700 1 -- 172.21.15.110:0/2164501166 >> v1:172.21.15.174:6789/0 conn(0x7f34b00648a0 legacy=0x7f34b009db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:10.713 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.709+0000 7f34b4c3e700 1 -- 172.21.15.110:0/2164501166 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b00b6650 con 0x7f34b00b5d00 2021-03-25T14:17:10.713 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.709+0000 7f34b543f700 1 --2- 172.21.15.110:0/2164501166 >> v2:172.21.15.174:3300/0 conn(0x7f34b00b0cc0 0x7f34b0145cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:17:10.713 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.709+0000 7f34b4c3e700 1 --2- 172.21.15.110:0/2164501166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34b00b5d00 0x7f34b0067250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f34ac00ba20 tx=0x7f34ac006ee0).ready entity=mon.2 client_cookie=4913444e7b873bbf server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:10.713 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.710+0000 7f349ffff700 1 -- 172.21.15.110:0/2164501166 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ac0098d0 con 0x7f34b00b5d00 2021-03-25T14:17:10.713 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.710+0000 7f349ffff700 1 -- 172.21.15.110:0/2164501166 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34ac009a30 con 0x7f34b00b5d00 2021-03-25T14:17:10.713 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.710+0000 7f349ffff700 1 -- 172.21.15.110:0/2164501166 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ac009db0 con 0x7f34b00b5d00 2021-03-25T14:17:10.713 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.710+0000 7f34b76a3700 1 -- 172.21.15.110:0/2164501166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34b00b5d00 msgr2=0x7f34b0067250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:10.714 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.710+0000 7f34b76a3700 1 --2- 172.21.15.110:0/2164501166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34b00b5d00 0x7f34b0067250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f34ac00ba20 tx=0x7f34ac006ee0).stop 2021-03-25T14:17:10.714 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.710+0000 7f34b76a3700 1 -- 172.21.15.110:0/2164501166 shutdown_connections 2021-03-25T14:17:10.714 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.710+0000 7f34b76a3700 1 --2- 172.21.15.110:0/2164501166 >> v2:172.21.15.174:3300/0 conn(0x7f34b00b0cc0 0x7f34b0145cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:10.714 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.710+0000 7f34b76a3700 1 --2- 172.21.15.110:0/2164501166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34b00b5d00 0x7f34b0067250 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:10.714 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.710+0000 7f34b76a3700 1 -- 172.21.15.110:0/2164501166 >> 172.21.15.110:0/2164501166 conn(0x7f34b00664e0 msgr2=0x7f34b00668f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:10.714 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.710+0000 7f34b76a3700 1 -- 172.21.15.110:0/2164501166 shutdown_connections 2021-03-25T14:17:10.714 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.710+0000 7f34b76a3700 1 -- 172.21.15.110:0/2164501166 wait complete. 2021-03-25T14:17:10.714 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.711+0000 7f34b76a3700 1 Processor -- start 2021-03-25T14:17:10.714 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.711+0000 7f34b76a3700 1 -- start start 2021-03-25T14:17:10.717 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.712+0000 7f34b76a3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34b00648a0 0x7f34b0068820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:10.717 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.712+0000 7f34b76a3700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34b00b0cc0 0x7f34b0143160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:10.717 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.712+0000 7f34b76a3700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34b00b5d00 0x7f34b0143650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:10.717 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.712+0000 7f34b76a3700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b00a0d70 con 0x7f34b00b0cc0 2021-03-25T14:17:10.717 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.712+0000 7f34b76a3700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b00a0fa0 con 0x7f34b00b5d00 2021-03-25T14:17:10.717 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.712+0000 7f34b76a3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b00a1240 con 0x7f34b00648a0 2021-03-25T14:17:10.717 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.712+0000 7f34b4c3e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34b00b0cc0 0x7f34b0143160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:10.717 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.712+0000 7f34b4c3e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34b00b0cc0 0x7f34b0143160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49430/0 (socket says 172.21.15.110:49430) 2021-03-25T14:17:10.717 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.712+0000 7f34b4c3e700 1 -- 172.21.15.110:0/844655082 learned_addr learned my addr 172.21.15.110:0/844655082 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:10.717 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.712+0000 7f34b543f700 1 --2- 172.21.15.110:0/844655082 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34b00648a0 0x7f34b0068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:10.717 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.712+0000 7f34b5c40700 1 --2- 172.21.15.110:0/844655082 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34b00b5d00 0x7f34b0143650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:10.718 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.712+0000 7f34b4c3e700 1 -- 172.21.15.110:0/844655082 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34b00648a0 msgr2=0x7f34b0068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:10.718 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.712+0000 7f34b4c3e700 1 --2- 172.21.15.110:0/844655082 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34b00648a0 0x7f34b0068820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:10.718 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.712+0000 7f34b4c3e700 1 -- 172.21.15.110:0/844655082 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34b00b5d00 msgr2=0x7f34b0143650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:10.718 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.712+0000 7f34b4c3e700 1 --2- 172.21.15.110:0/844655082 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34b00b5d00 0x7f34b0143650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:10.718 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.712+0000 7f34b4c3e700 1 -- 172.21.15.110:0/844655082 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b009fdf0 con 0x7f34b00b0cc0 2021-03-25T14:17:10.718 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.712+0000 7f34b543f700 1 --2- 172.21.15.110:0/844655082 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34b00648a0 0x7f34b0068820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:17:10.718 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.712+0000 7f34b5c40700 1 --2- 172.21.15.110:0/844655082 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34b00b5d00 0x7f34b0143650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:17:10.718 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.713+0000 7f34b4c3e700 1 --2- 172.21.15.110:0/844655082 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34b00b0cc0 0x7f34b0143160 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f34ac0093a0 tx=0x7f34ac016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:10.718 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.713+0000 7f349d7fa700 1 -- 172.21.15.110:0/844655082 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ac00be40 con 0x7f34b00b0cc0 2021-03-25T14:17:10.718 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.713+0000 7f34b76a3700 1 -- 172.21.15.110:0/844655082 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34b00a0090 con 0x7f34b00b0cc0 2021-03-25T14:17:10.718 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.713+0000 7f34b76a3700 1 -- 172.21.15.110:0/844655082 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34b00b5720 con 0x7f34b00b0cc0 2021-03-25T14:17:10.718 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.713+0000 7f349d7fa700 1 -- 172.21.15.110:0/844655082 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34ac00b200 con 0x7f34b00b0cc0 2021-03-25T14:17:10.718 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.713+0000 7f349d7fa700 1 -- 172.21.15.110:0/844655082 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ac01c630 con 0x7f34b00b0cc0 2021-03-25T14:17:10.719 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.714+0000 7f34b76a3700 1 -- 172.21.15.110:0/844655082 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3488004fa0 con 0x7f34b00b0cc0 2021-03-25T14:17:10.719 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.714+0000 7f349d7fa700 1 -- 172.21.15.110:0/844655082 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f34ac00f070 con 0x7f34b00b0cc0 2021-03-25T14:17:10.719 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.714+0000 7f349d7fa700 1 --2- 172.21.15.110:0/844655082 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f349005a0e0 0x7f349005c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:10.719 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.714+0000 7f349d7fa700 1 -- 172.21.15.110:0/844655082 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6426+0+0 (secure 0 0 0) 0x7f34ac074ed0 con 0x7f34b00b0cc0 2021-03-25T14:17:10.719 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.714+0000 7f34b543f700 1 --2- 172.21.15.110:0/844655082 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f349005a0e0 0x7f349005c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:10.719 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.715+0000 7f34b543f700 1 --2- 172.21.15.110:0/844655082 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f349005a0e0 0x7f349005c5a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f34a0006c00 tx=0x7f34a0006eb0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:10.719 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.718+0000 7f349d7fa700 1 -- 172.21.15.110:0/844655082 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f34ac048710 con 0x7f34b00b0cc0 2021-03-25T14:17:10.870 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.870+0000 7f34b76a3700 1 -- 172.21.15.110:0/844655082 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f34880057d0 con 0x7f34b00b0cc0 2021-03-25T14:17:10.871 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.870+0000 7f349d7fa700 1 -- 172.21.15.110:0/844655082 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v38) v1 ==== 92+0+10 (secure 0 0 0) 0x7f34ac04bd30 con 0x7f34b00b0cc0 2021-03-25T14:17:10.871 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:17:10.873 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.872+0000 7f34b76a3700 1 -- 172.21.15.110:0/844655082 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f349005a0e0 msgr2=0x7f349005c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:10.873 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.872+0000 7f34b76a3700 1 --2- 172.21.15.110:0/844655082 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f349005a0e0 0x7f349005c5a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f34a0006c00 tx=0x7f34a0006eb0).stop 2021-03-25T14:17:10.873 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.872+0000 7f34b76a3700 1 -- 172.21.15.110:0/844655082 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34b00b0cc0 msgr2=0x7f34b0143160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:10.873 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.872+0000 7f34b76a3700 1 --2- 172.21.15.110:0/844655082 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34b00b0cc0 0x7f34b0143160 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f34ac0093a0 tx=0x7f34ac016000).stop 2021-03-25T14:17:10.873 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.872+0000 7f34b76a3700 1 -- 172.21.15.110:0/844655082 shutdown_connections 2021-03-25T14:17:10.873 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.872+0000 7f34b76a3700 1 --2- 172.21.15.110:0/844655082 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f349005a0e0 0x7f349005c5a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:10.873 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.872+0000 7f34b76a3700 1 --2- 172.21.15.110:0/844655082 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34b00b5d00 0x7f34b0143650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:10.873 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.872+0000 7f34b76a3700 1 --2- 172.21.15.110:0/844655082 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34b00648a0 0x7f34b0068820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:10.873 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.872+0000 7f34b76a3700 1 --2- 172.21.15.110:0/844655082 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34b00b0cc0 0x7f34b0143160 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:10.874 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.872+0000 7f34b76a3700 1 -- 172.21.15.110:0/844655082 >> 172.21.15.110:0/844655082 conn(0x7f34b00664e0 msgr2=0x7f34b0067860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:10.874 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.872+0000 7f34b76a3700 1 -- 172.21.15.110:0/844655082 shutdown_connections 2021-03-25T14:17:10.874 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.872+0000 7f34b76a3700 1 -- 172.21.15.110:0/844655082 wait complete. 2021-03-25T14:17:10.884 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-03-25T14:17:10.997 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.996+0000 7ff6ae408700 1 Processor -- start 2021-03-25T14:17:10.998 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.997+0000 7ff6ae408700 1 -- start start 2021-03-25T14:17:11.000 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.997+0000 7ff6ae408700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff6a80b0cc0 0x7ff6a8145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:11.000 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.997+0000 7ff6ae408700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6a8149c50 con 0x7ff6a80b5d00 2021-03-25T14:17:11.000 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.997+0000 7ff6ae408700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6a81461b0 con 0x7ff6a80648a0 2021-03-25T14:17:11.000 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.997+0000 7ff6ae408700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6a8067960 con 0x7ff6a80b0cc0 2021-03-25T14:17:11.000 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.997+0000 7ff6a7fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff6a80b0cc0 0x7ff6a8145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:11.000 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.997+0000 7ff6a77fe700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7ff6a80b5d00 0x7ff6a8067250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:42376/0 (socket says 172.21.15.110:42376) 2021-03-25T14:17:11.000 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.997+0000 7ff6a77fe700 1 -- 172.21.15.110:0/2368567746 learned_addr learned my addr 172.21.15.110:0/2368567746 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:11.000 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.998+0000 7ff6a7fff700 1 -- 172.21.15.110:0/2368567746 >> v1:172.21.15.174:6789/0 conn(0x7ff6a80648a0 legacy=0x7ff6a809db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:11.000 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.998+0000 7ff6a7fff700 1 -- 172.21.15.110:0/2368567746 >> v1:172.21.15.110:6789/0 conn(0x7ff6a80b5d00 legacy=0x7ff6a8067250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:11.000 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.998+0000 7ff6a7fff700 1 -- 172.21.15.110:0/2368567746 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a8149e80 con 0x7ff6a80b0cc0 2021-03-25T14:17:11.001 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.998+0000 7ff6a6ffd700 1 -- 172.21.15.110:0/2368567746 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3000126683 0 0) 0x7ff6a8149c50 con 0x7ff6a80b5d00 2021-03-25T14:17:11.001 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.998+0000 7ff6a7fff700 1 --2- 172.21.15.110:0/2368567746 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6a80b0cc0 0x7ff6a8145cc0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7ff69800b9c0 tx=0x7ff698006e20).ready entity=mon.0 client_cookie=27c003d73f78cd38 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:11.001 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.998+0000 7ff6a6ffd700 1 -- 172.21.15.110:0/2368567746 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff698009830 con 0x7ff6a80b0cc0 2021-03-25T14:17:11.001 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.998+0000 7ff6a6ffd700 1 -- 172.21.15.110:0/2368567746 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff698009990 con 0x7ff6a80b0cc0 2021-03-25T14:17:11.001 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.998+0000 7ff6a6ffd700 1 -- 172.21.15.110:0/2368567746 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff698009d10 con 0x7ff6a80b0cc0 2021-03-25T14:17:11.001 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.998+0000 7ff6ae408700 1 -- 172.21.15.110:0/2368567746 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6a80b0cc0 msgr2=0x7ff6a8145cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:11.001 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.998+0000 7ff6ae408700 1 --2- 172.21.15.110:0/2368567746 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6a80b0cc0 0x7ff6a8145cc0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7ff69800b9c0 tx=0x7ff698006e20).stop 2021-03-25T14:17:11.001 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.998+0000 7ff6ae408700 1 -- 172.21.15.110:0/2368567746 shutdown_connections 2021-03-25T14:17:11.001 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.998+0000 7ff6ae408700 1 --2- 172.21.15.110:0/2368567746 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6a80b0cc0 0x7ff6a8145cc0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:11.001 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.998+0000 7ff6ae408700 1 -- 172.21.15.110:0/2368567746 >> 172.21.15.110:0/2368567746 conn(0x7ff6a80664e0 msgr2=0x7ff6a80668f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:11.001 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.998+0000 7ff6ae408700 1 -- 172.21.15.110:0/2368567746 shutdown_connections 2021-03-25T14:17:11.001 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.999+0000 7ff6ae408700 1 -- 172.21.15.110:0/2368567746 wait complete. 2021-03-25T14:17:11.004 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:10.999+0000 7ff6ae408700 1 Processor -- start 2021-03-25T14:17:11.004 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.000+0000 7ff6ae408700 1 -- start start 2021-03-25T14:17:11.004 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.000+0000 7ff6ae408700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6a80648a0 0x7ff6a80a0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:11.004 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.000+0000 7ff6ae408700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6a80b0cc0 0x7ff6a80b7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:11.004 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.000+0000 7ff6ae408700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6a80b5d00 0x7ff6a814b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:11.004 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.000+0000 7ff6ae408700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a814a550 con 0x7ff6a80648a0 2021-03-25T14:17:11.004 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.000+0000 7ff6ae408700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a80a08c0 con 0x7ff6a80b0cc0 2021-03-25T14:17:11.004 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.000+0000 7ff6ae408700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a814a7b0 con 0x7ff6a80b5d00 2021-03-25T14:17:11.005 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.000+0000 7ff6a7fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6a80648a0 0x7ff6a80a0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:11.005 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.000+0000 7ff6a7fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6a80648a0 0x7ff6a80a0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49442/0 (socket says 172.21.15.110:49442) 2021-03-25T14:17:11.005 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.000+0000 7ff6a7fff700 1 -- 172.21.15.110:0/3583033450 learned_addr learned my addr 172.21.15.110:0/3583033450 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:11.005 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.001+0000 7ff6a77fe700 1 --2- 172.21.15.110:0/3583033450 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6a80b0cc0 0x7ff6a80b7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:11.005 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.001+0000 7ff6ac9a5700 1 --2- 172.21.15.110:0/3583033450 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6a80b5d00 0x7ff6a814b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:11.005 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.001+0000 7ff6a7fff700 1 -- 172.21.15.110:0/3583033450 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6a80b5d00 msgr2=0x7ff6a814b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:11.005 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.001+0000 7ff6a7fff700 1 --2- 172.21.15.110:0/3583033450 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6a80b5d00 0x7ff6a814b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:11.005 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.001+0000 7ff6a7fff700 1 -- 172.21.15.110:0/3583033450 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6a80b0cc0 msgr2=0x7ff6a80b7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:11.005 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.001+0000 7ff6a7fff700 1 --2- 172.21.15.110:0/3583033450 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6a80b0cc0 0x7ff6a80b7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:11.005 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.001+0000 7ff6a7fff700 1 -- 172.21.15.110:0/3583033450 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a814aa50 con 0x7ff6a80648a0 2021-03-25T14:17:11.005 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.001+0000 7ff6a7fff700 1 --2- 172.21.15.110:0/3583033450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6a80648a0 0x7ff6a80a0290 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7ff69800b150 tx=0x7ff698016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:11.005 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.001+0000 7ff68ffff700 1 -- 172.21.15.110:0/3583033450 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff698011e90 con 0x7ff6a80648a0 2021-03-25T14:17:11.005 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.001+0000 7ff68ffff700 1 -- 172.21.15.110:0/3583033450 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69801d430 con 0x7ff6a80648a0 2021-03-25T14:17:11.005 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.001+0000 7ff6ae408700 1 -- 172.21.15.110:0/3583033450 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a814acf0 con 0x7ff6a80648a0 2021-03-25T14:17:11.006 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.001+0000 7ff68ffff700 1 -- 172.21.15.110:0/3583033450 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69801d7b0 con 0x7ff6a80648a0 2021-03-25T14:17:11.006 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.001+0000 7ff6ae408700 1 -- 172.21.15.110:0/3583033450 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a80b80e0 con 0x7ff6a80648a0 2021-03-25T14:17:11.006 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.002+0000 7ff6ae408700 1 -- 172.21.15.110:0/3583033450 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a80b1390 con 0x7ff6a80648a0 2021-03-25T14:17:11.006 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.002+0000 7ff68ffff700 1 -- 172.21.15.110:0/3583033450 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7ff69800f070 con 0x7ff6a80648a0 2021-03-25T14:17:11.006 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.002+0000 7ff68ffff700 1 --2- 172.21.15.110:0/3583033450 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff68805a0b0 0x7ff68805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:11.006 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.002+0000 7ff68ffff700 1 -- 172.21.15.110:0/3583033450 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6426+0+0 (secure 0 0 0) 0x7ff698075a30 con 0x7ff6a80648a0 2021-03-25T14:17:11.006 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.003+0000 7ff6a77fe700 1 --2- 172.21.15.110:0/3583033450 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff68805a0b0 0x7ff68805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:11.006 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.003+0000 7ff6a77fe700 1 --2- 172.21.15.110:0/3583033450 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff68805a0b0 0x7ff68805c570 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7ff6a80a1200 tx=0x7ff69c009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:11.007 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.006+0000 7ff68ffff700 1 -- 172.21.15.110:0/3583033450 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7ff698049270 con 0x7ff6a80648a0 2021-03-25T14:17:11.155 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.154+0000 7ff6ae408700 1 -- 172.21.15.110:0/3583033450 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff6a80b5b40 con 0x7ff6a80648a0 2021-03-25T14:17:11.155 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.155+0000 7ff68ffff700 1 -- 172.21.15.110:0/3583033450 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) v1 ==== 104+0+10 (secure 0 0 0) 0x7ff69804c890 con 0x7ff6a80648a0 2021-03-25T14:17:11.156 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:17:11.157 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.156+0000 7ff6ae408700 1 -- 172.21.15.110:0/3583033450 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff68805a0b0 msgr2=0x7ff68805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:11.157 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.156+0000 7ff6ae408700 1 --2- 172.21.15.110:0/3583033450 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff68805a0b0 0x7ff68805c570 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7ff6a80a1200 tx=0x7ff69c009040).stop 2021-03-25T14:17:11.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.156+0000 7ff6ae408700 1 -- 172.21.15.110:0/3583033450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6a80648a0 msgr2=0x7ff6a80a0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:11.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.156+0000 7ff6ae408700 1 --2- 172.21.15.110:0/3583033450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6a80648a0 0x7ff6a80a0290 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7ff69800b150 tx=0x7ff698016000).stop 2021-03-25T14:17:11.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.156+0000 7ff6ae408700 1 -- 172.21.15.110:0/3583033450 shutdown_connections 2021-03-25T14:17:11.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.156+0000 7ff6ae408700 1 --2- 172.21.15.110:0/3583033450 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff68805a0b0 0x7ff68805c570 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:11.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.156+0000 7ff6ae408700 1 --2- 172.21.15.110:0/3583033450 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6a80b5d00 0x7ff6a814b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:11.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.156+0000 7ff6ae408700 1 --2- 172.21.15.110:0/3583033450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6a80648a0 0x7ff6a80a0290 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:11.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.156+0000 7ff6ae408700 1 --2- 172.21.15.110:0/3583033450 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6a80b0cc0 0x7ff6a80b7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:11.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.156+0000 7ff6ae408700 1 -- 172.21.15.110:0/3583033450 >> 172.21.15.110:0/3583033450 conn(0x7ff6a80664e0 msgr2=0x7ff6a8068770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:11.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.156+0000 7ff6ae408700 1 -- 172.21.15.110:0/3583033450 shutdown_connections 2021-03-25T14:17:11.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.156+0000 7ff6ae408700 1 -- 172.21.15.110:0/3583033450 wait complete. 2021-03-25T14:17:11.168 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-03-25T14:17:11.280 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.279+0000 7f2317422700 1 Processor -- start 2021-03-25T14:17:11.280 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.279+0000 7f2317422700 1 -- start start 2021-03-25T14:17:11.287 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.280+0000 7f2317422700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f23100bcb10 0x7f23100bcef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:11.287 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.280+0000 7f2317422700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2310068b60 con 0x7f231014a140 2021-03-25T14:17:11.287 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.280+0000 7f2317422700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f231014a550 con 0x7f23100671d0 2021-03-25T14:17:11.287 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.280+0000 7f2317422700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23100a2ad0 con 0x7f23100bcb10 2021-03-25T14:17:11.287 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.280+0000 7f2316c21700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f231014a140 0x7f23100bfeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:42390/0 (socket says 172.21.15.110:42390) 2021-03-25T14:17:11.287 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.280+0000 7f2316c21700 1 -- 172.21.15.110:0/1578398602 learned_addr learned my addr 172.21.15.110:0/1578398602 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:11.287 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.281+0000 7f231541e700 1 -- 172.21.15.110:0/1578398602 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2862639030 0 0) 0x7f2310068b60 con 0x7f231014a140 2021-03-25T14:17:11.288 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.281+0000 7f231541e700 1 -- 172.21.15.110:0/1578398602 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22f8003270 con 0x7f231014a140 2021-03-25T14:17:11.288 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.281+0000 7f2316420700 1 --2- 172.21.15.110:0/1578398602 >> v2:172.21.15.174:3300/0 conn(0x7f23100bcb10 0x7f23100bcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:11.288 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.281+0000 7f231541e700 1 -- 172.21.15.110:0/1578398602 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4196890351 0 0) 0x7f22f8003270 con 0x7f231014a140 2021-03-25T14:17:11.288 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.281+0000 7f231541e700 1 -- 172.21.15.110:0/1578398602 >> v2:172.21.15.174:3300/0 conn(0x7f23100bcb10 msgr2=0x7f23100bcef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:11.288 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.281+0000 7f231541e700 1 --2- 172.21.15.110:0/1578398602 >> v2:172.21.15.174:3300/0 conn(0x7f23100bcb10 0x7f23100bcef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:11.288 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.281+0000 7f231541e700 1 -- 172.21.15.110:0/1578398602 >> v1:172.21.15.174:6789/0 conn(0x7f23100671d0 legacy=0x7f23101317c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:11.288 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.281+0000 7f231541e700 1 -- 172.21.15.110:0/1578398602 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23100bd4f0 con 0x7f231014a140 2021-03-25T14:17:11.288 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.281+0000 7f231541e700 1 -- 172.21.15.110:0/1578398602 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f23080018a0 con 0x7f231014a140 2021-03-25T14:17:11.288 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.281+0000 7f231541e700 1 -- 172.21.15.110:0/1578398602 >> v1:172.21.15.110:6789/0 conn(0x7f231014a140 legacy=0x7f23100bfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:11.288 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.281+0000 7f231541e700 1 --2- 172.21.15.110:0/1578398602 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22f8003760 0x7f22f8003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:11.288 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.281+0000 7f231541e700 1 --2- 172.21.15.110:0/1578398602 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22f8004510 0x7f22f8004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:11.288 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.281+0000 7f231541e700 1 --2- 172.21.15.110:0/1578398602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22f8004e80 0x7f22f800b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:11.288 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.281+0000 7f231541e700 1 -- 172.21.15.110:0/1578398602 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23100a2ad0 con 0x7f22f8004e80 2021-03-25T14:17:11.289 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.281+0000 7f231541e700 1 -- 172.21.15.110:0/1578398602 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f80042b0 con 0x7f22f8004510 2021-03-25T14:17:11.289 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.281+0000 7f231541e700 1 -- 172.21.15.110:0/1578398602 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f800bc50 con 0x7f22f8003760 2021-03-25T14:17:11.289 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.281+0000 7f2316420700 1 --2- 172.21.15.110:0/1578398602 >> v2:172.21.15.174:3300/0 conn(0x7f23100bcb10 0x7f23100bcef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:11.289 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.281+0000 7f2316c21700 1 --2- 172.21.15.110:0/1578398602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22f8004e80 0x7f22f800b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:11.289 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.281+0000 7f2315c1f700 1 --2- 172.21.15.110:0/1578398602 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22f8004510 0x7f22f8004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:11.289 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.281+0000 7f2316420700 1 --2- 172.21.15.110:0/1578398602 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22f8003760 0x7f22f8003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:11.289 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.281+0000 7f2316c21700 1 -- 172.21.15.110:0/1578398602 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22f8003760 msgr2=0x7f22f8003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:11.289 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.281+0000 7f2316c21700 1 --2- 172.21.15.110:0/1578398602 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22f8003760 0x7f22f8003ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:11.289 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.281+0000 7f2316c21700 1 -- 172.21.15.110:0/1578398602 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22f8004510 msgr2=0x7f22f8004990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:11.289 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.281+0000 7f2316c21700 1 --2- 172.21.15.110:0/1578398602 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22f8004510 0x7f22f8004990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:11.289 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.281+0000 7f2316c21700 1 -- 172.21.15.110:0/1578398602 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f8003270 con 0x7f22f8004e80 2021-03-25T14:17:11.289 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.281+0000 7f2316c21700 1 -- 172.21.15.110:0/1578398602 reap_dead start 2021-03-25T14:17:11.289 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.281+0000 7f2316c21700 1 --2- 172.21.15.110:0/1578398602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22f8004e80 0x7f22f800b760 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f230800c840 tx=0x7f23100bd3e0).ready entity=mon.0 client_cookie=8edc989fade01ab0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:11.289 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.282+0000 7f231541e700 1 -- 172.21.15.110:0/1578398602 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2308005bb0 con 0x7f22f8004e80 2021-03-25T14:17:11.289 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.282+0000 7f231541e700 1 -- 172.21.15.110:0/1578398602 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2308005d10 con 0x7f22f8004e80 2021-03-25T14:17:11.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.282+0000 7f231541e700 1 -- 172.21.15.110:0/1578398602 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23080072e0 con 0x7f22f8004e80 2021-03-25T14:17:11.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.282+0000 7f2317422700 1 -- 172.21.15.110:0/1578398602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22f8004e80 msgr2=0x7f22f800b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:11.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.282+0000 7f2317422700 1 --2- 172.21.15.110:0/1578398602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22f8004e80 0x7f22f800b760 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f230800c840 tx=0x7f23100bd3e0).stop 2021-03-25T14:17:11.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.282+0000 7f2317422700 1 -- 172.21.15.110:0/1578398602 shutdown_connections 2021-03-25T14:17:11.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.282+0000 7f2317422700 1 --2- 172.21.15.110:0/1578398602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22f8004e80 0x7f22f800b760 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:11.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.282+0000 7f2317422700 1 -- 172.21.15.110:0/1578398602 >> 172.21.15.110:0/1578398602 conn(0x7f2310064860 msgr2=0x7f23100664d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:11.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.282+0000 7f2317422700 1 -- 172.21.15.110:0/1578398602 shutdown_connections 2021-03-25T14:17:11.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.282+0000 7f2317422700 1 -- 172.21.15.110:0/1578398602 wait complete. 2021-03-25T14:17:11.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.283+0000 7f2317422700 1 Processor -- start 2021-03-25T14:17:11.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.283+0000 7f2317422700 1 -- start start 2021-03-25T14:17:11.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.284+0000 7f2317422700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22f8004e80 0x7f23100b5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:11.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.284+0000 7f2317422700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2310119110 0x7f231015ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:11.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.284+0000 7f2317422700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23100a4fb0 0x7f2310140510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:11.291 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.284+0000 7f2317422700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231015cf50 con 0x7f2310119110 2021-03-25T14:17:11.291 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.284+0000 7f2317422700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2310130100 con 0x7f22f8004e80 2021-03-25T14:17:11.291 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.284+0000 7f2317422700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2310119b60 con 0x7f23100a4fb0 2021-03-25T14:17:11.291 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.284+0000 7f2315c1f700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2310119110 0x7f231015ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:11.291 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.284+0000 7f2315c1f700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2310119110 0x7f231015ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49464/0 (socket says 172.21.15.110:49464) 2021-03-25T14:17:11.291 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.284+0000 7f2315c1f700 1 -- 172.21.15.110:0/3661866297 learned_addr learned my addr 172.21.15.110:0/3661866297 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:11.291 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.284+0000 7f2316420700 1 --2- 172.21.15.110:0/3661866297 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22f8004e80 0x7f23100b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:11.291 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.284+0000 7f2316c21700 1 --2- 172.21.15.110:0/3661866297 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23100a4fb0 0x7f2310140510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:11.292 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.284+0000 7f2315c1f700 1 -- 172.21.15.110:0/3661866297 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23100a4fb0 msgr2=0x7f2310140510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:11.292 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.284+0000 7f2315c1f700 1 --2- 172.21.15.110:0/3661866297 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23100a4fb0 0x7f2310140510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:11.292 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.284+0000 7f2315c1f700 1 -- 172.21.15.110:0/3661866297 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22f8004e80 msgr2=0x7f23100b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:11.292 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.284+0000 7f2315c1f700 1 --2- 172.21.15.110:0/3661866297 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22f8004e80 0x7f23100b5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:11.292 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.284+0000 7f2315c1f700 1 -- 172.21.15.110:0/3661866297 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2310119620 con 0x7f2310119110 2021-03-25T14:17:11.292 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.284+0000 7f2315c1f700 1 --2- 172.21.15.110:0/3661866297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2310119110 0x7f231015ca60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f2300002b80 tx=0x7f2300007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:11.292 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.285+0000 7f22fe7fc700 1 -- 172.21.15.110:0/3661866297 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2300003e10 con 0x7f2310119110 2021-03-25T14:17:11.292 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.285+0000 7f22fe7fc700 1 -- 172.21.15.110:0/3661866297 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230000f8d0 con 0x7f2310119110 2021-03-25T14:17:11.292 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.285+0000 7f2317422700 1 -- 172.21.15.110:0/3661866297 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23101198c0 con 0x7f2310119110 2021-03-25T14:17:11.292 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.285+0000 7f22fe7fc700 1 -- 172.21.15.110:0/3661866297 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230000fc50 con 0x7f2310119110 2021-03-25T14:17:11.292 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.285+0000 7f2317422700 1 -- 172.21.15.110:0/3661866297 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2310140070 con 0x7f2310119110 2021-03-25T14:17:11.292 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.285+0000 7f2317422700 1 -- 172.21.15.110:0/3661866297 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2310140200 con 0x7f2310119110 2021-03-25T14:17:11.292 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.286+0000 7f22fe7fc700 1 -- 172.21.15.110:0/3661866297 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f230001b030 con 0x7f2310119110 2021-03-25T14:17:11.292 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.286+0000 7f22fe7fc700 1 --2- 172.21.15.110:0/3661866297 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f22f005a0b0 0x7f22f005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:11.293 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.286+0000 7f22fe7fc700 1 -- 172.21.15.110:0/3661866297 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6426+0+0 (secure 0 0 0) 0x7f2300073b50 con 0x7f2310119110 2021-03-25T14:17:11.293 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.286+0000 7f2316420700 1 --2- 172.21.15.110:0/3661866297 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f22f005a0b0 0x7f22f005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:11.293 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.286+0000 7f2316420700 1 --2- 172.21.15.110:0/3661866297 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f22f005a0b0 0x7f22f005c570 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f230c00fa90 tx=0x7f230c006f90).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:11.293 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.290+0000 7f22fe7fc700 1 -- 172.21.15.110:0/3661866297 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f2300047390 con 0x7f2310119110 2021-03-25T14:17:11.440 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.439+0000 7f2317422700 1 -- 172.21.15.110:0/3661866297 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2310045ae0 con 0x7f2310119110 2021-03-25T14:17:11.440 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.440+0000 7f22fe7fc700 1 -- 172.21.15.110:0/3661866297 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) v1 ==== 100+0+10 (secure 0 0 0) 0x7f230004a9b0 con 0x7f2310119110 2021-03-25T14:17:11.441 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:17:11.443 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.441+0000 7f2317422700 1 -- 172.21.15.110:0/3661866297 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f22f005a0b0 msgr2=0x7f22f005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:11.443 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.441+0000 7f2317422700 1 --2- 172.21.15.110:0/3661866297 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f22f005a0b0 0x7f22f005c570 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f230c00fa90 tx=0x7f230c006f90).stop 2021-03-25T14:17:11.443 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.441+0000 7f2317422700 1 -- 172.21.15.110:0/3661866297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2310119110 msgr2=0x7f231015ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:11.443 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.441+0000 7f2317422700 1 --2- 172.21.15.110:0/3661866297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2310119110 0x7f231015ca60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f2300002b80 tx=0x7f2300007c10).stop 2021-03-25T14:17:11.443 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.441+0000 7f2317422700 1 -- 172.21.15.110:0/3661866297 shutdown_connections 2021-03-25T14:17:11.443 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.441+0000 7f2317422700 1 --2- 172.21.15.110:0/3661866297 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f22f005a0b0 0x7f22f005c570 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:11.443 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.441+0000 7f2317422700 1 --2- 172.21.15.110:0/3661866297 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22f8004e80 0x7f23100b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:11.443 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.441+0000 7f2317422700 1 --2- 172.21.15.110:0/3661866297 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23100a4fb0 0x7f2310140510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:11.443 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.441+0000 7f2317422700 1 --2- 172.21.15.110:0/3661866297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2310119110 0x7f231015ca60 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:11.443 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.441+0000 7f2317422700 1 -- 172.21.15.110:0/3661866297 >> 172.21.15.110:0/3661866297 conn(0x7f2310064860 msgr2=0x7f2310130af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:11.443 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.441+0000 7f2317422700 1 -- 172.21.15.110:0/3661866297 shutdown_connections 2021-03-25T14:17:11.444 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.441+0000 7f2317422700 1 -- 172.21.15.110:0/3661866297 wait complete. 2021-03-25T14:17:11.454 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-03-25T14:17:11.563 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.562+0000 7f70e3d2e700 1 Processor -- start 2021-03-25T14:17:11.563 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.563+0000 7f70e3d2e700 1 -- start start 2021-03-25T14:17:11.566 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.563+0000 7f70e3d2e700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f70dc0b99b0 0x7f70dc0ba4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:11.566 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.563+0000 7f70e3d2e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70dc148fc0 0x7f70dc0a3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:11.566 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.563+0000 7f70e3d2e700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70dc149450 con 0x7f70dc14a050 2021-03-25T14:17:11.566 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.563+0000 7f70e3d2e700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70dc0ba9e0 con 0x7f70dc0b99b0 2021-03-25T14:17:11.566 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.563+0000 7f70e3d2e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc0babc0 con 0x7f70dc148fc0 2021-03-25T14:17:11.566 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.563+0000 7f70e1aca700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f70dc0b99b0 0x7f70dc0ba4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:11.566 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.563+0000 7f70e12c9700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f70dc14a050 0x7f70dc1488b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:42408/0 (socket says 172.21.15.110:42408) 2021-03-25T14:17:11.566 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.563+0000 7f70e1aca700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f70dc0b99b0 0x7f70dc0ba4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49470/0 (socket says 172.21.15.110:49470) 2021-03-25T14:17:11.567 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.563+0000 7f70e12c9700 1 -- 172.21.15.110:0/1037512531 learned_addr learned my addr 172.21.15.110:0/1037512531 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:11.567 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.564+0000 7f70e22cb700 1 --2- 172.21.15.110:0/1037512531 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70dc148fc0 0x7f70dc0a3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:11.567 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.564+0000 7f70e1aca700 1 -- 172.21.15.110:0/1037512531 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70dc148fc0 msgr2=0x7f70dc0a3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:11.567 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.564+0000 7f70e1aca700 1 --2- 172.21.15.110:0/1037512531 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70dc148fc0 0x7f70dc0a3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:11.567 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.564+0000 7f70e1aca700 1 -- 172.21.15.110:0/1037512531 >> v1:172.21.15.110:6789/0 conn(0x7f70dc14a050 legacy=0x7f70dc1488b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:11.567 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.564+0000 7f70e1aca700 1 -- 172.21.15.110:0/1037512531 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70dc0bae60 con 0x7f70dc0b99b0 2021-03-25T14:17:11.567 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.564+0000 7f70e0ac8700 1 -- 172.21.15.110:0/1037512531 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3337843908 0 0) 0x7f70dc149450 con 0x7f70dc14a050 2021-03-25T14:17:11.567 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.564+0000 7f70e1aca700 1 --2- 172.21.15.110:0/1037512531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70dc0b99b0 0x7f70dc0ba4f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f70d800b9b0 tx=0x7f70d8006dc0).ready entity=mon.0 client_cookie=cedc81c12226a977 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:11.567 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.564+0000 7f70e0ac8700 1 -- 172.21.15.110:0/1037512531 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d800bea0 con 0x7f70dc0b99b0 2021-03-25T14:17:11.567 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.564+0000 7f70e0ac8700 1 -- 172.21.15.110:0/1037512531 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d8006030 con 0x7f70dc0b99b0 2021-03-25T14:17:11.567 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.564+0000 7f70e0ac8700 1 -- 172.21.15.110:0/1037512531 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d80063b0 con 0x7f70dc0b99b0 2021-03-25T14:17:11.567 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.564+0000 7f70e3d2e700 1 -- 172.21.15.110:0/1037512531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70dc0b99b0 msgr2=0x7f70dc0ba4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:11.568 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.564+0000 7f70e3d2e700 1 --2- 172.21.15.110:0/1037512531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70dc0b99b0 0x7f70dc0ba4f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f70d800b9b0 tx=0x7f70d8006dc0).stop 2021-03-25T14:17:11.568 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.564+0000 7f70e3d2e700 1 -- 172.21.15.110:0/1037512531 shutdown_connections 2021-03-25T14:17:11.568 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.564+0000 7f70e3d2e700 1 --2- 172.21.15.110:0/1037512531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70dc0b99b0 0x7f70dc0ba4f0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:11.568 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.564+0000 7f70e3d2e700 1 --2- 172.21.15.110:0/1037512531 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70dc148fc0 0x7f70dc0a3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:11.568 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.564+0000 7f70e3d2e700 1 -- 172.21.15.110:0/1037512531 >> 172.21.15.110:0/1037512531 conn(0x7f70dc060c40 msgr2=0x7f70dc061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:11.568 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.565+0000 7f70e3d2e700 1 -- 172.21.15.110:0/1037512531 shutdown_connections 2021-03-25T14:17:11.568 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.565+0000 7f70e3d2e700 1 -- 172.21.15.110:0/1037512531 wait complete. 2021-03-25T14:17:11.571 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.566+0000 7f70e3d2e700 1 Processor -- start 2021-03-25T14:17:11.571 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.566+0000 7f70e3d2e700 1 -- start start 2021-03-25T14:17:11.571 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.566+0000 7f70e3d2e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70dc0b99b0 0x7f70dc158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:11.572 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.566+0000 7f70e3d2e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70dc148fc0 0x7f70dc0b7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:11.572 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.566+0000 7f70e3d2e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70dc14a050 0x7f70dc138990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:11.572 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.566+0000 7f70e3d2e700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc159210 con 0x7f70dc0b99b0 2021-03-25T14:17:11.572 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.566+0000 7f70e3d2e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc1594b0 con 0x7f70dc148fc0 2021-03-25T14:17:11.572 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.566+0000 7f70e3d2e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc159750 con 0x7f70dc14a050 2021-03-25T14:17:11.572 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.566+0000 7f70e1aca700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70dc0b99b0 0x7f70dc158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:11.572 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.566+0000 7f70e1aca700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70dc0b99b0 0x7f70dc158a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49476/0 (socket says 172.21.15.110:49476) 2021-03-25T14:17:11.572 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.566+0000 7f70e1aca700 1 -- 172.21.15.110:0/1528119686 learned_addr learned my addr 172.21.15.110:0/1528119686 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:11.572 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.566+0000 7f70e22cb700 1 --2- 172.21.15.110:0/1528119686 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70dc14a050 0x7f70dc138990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:11.572 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.566+0000 7f70e12c9700 1 --2- 172.21.15.110:0/1528119686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70dc148fc0 0x7f70dc0b7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:11.572 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.567+0000 7f70e1aca700 1 -- 172.21.15.110:0/1528119686 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70dc14a050 msgr2=0x7f70dc138990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:11.572 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.567+0000 7f70e1aca700 1 --2- 172.21.15.110:0/1528119686 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70dc14a050 0x7f70dc138990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:11.573 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.567+0000 7f70e1aca700 1 -- 172.21.15.110:0/1528119686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70dc148fc0 msgr2=0x7f70dc0b7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:11.573 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.567+0000 7f70e1aca700 1 --2- 172.21.15.110:0/1528119686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70dc148fc0 0x7f70dc0b7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:11.573 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.567+0000 7f70e1aca700 1 -- 172.21.15.110:0/1528119686 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70dc0b4290 con 0x7f70dc0b99b0 2021-03-25T14:17:11.573 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.567+0000 7f70e12c9700 1 --2- 172.21.15.110:0/1528119686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70dc148fc0 0x7f70dc0b7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:11.573 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.567+0000 7f70e22cb700 1 --2- 172.21.15.110:0/1528119686 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70dc14a050 0x7f70dc138990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:11.573 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.567+0000 7f70e1aca700 1 --2- 172.21.15.110:0/1528119686 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70dc0b99b0 0x7f70dc158a20 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f70d8006e00 tx=0x7f70d8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:11.573 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.567+0000 7f70c9ffb700 1 -- 172.21.15.110:0/1528119686 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d8005a60 con 0x7f70dc0b99b0 2021-03-25T14:17:11.573 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.567+0000 7f70c9ffb700 1 -- 172.21.15.110:0/1528119686 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d8005bc0 con 0x7f70dc0b99b0 2021-03-25T14:17:11.573 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.567+0000 7f70e3d2e700 1 -- 172.21.15.110:0/1528119686 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70dc158f10 con 0x7f70dc0b99b0 2021-03-25T14:17:11.573 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.567+0000 7f70c9ffb700 1 -- 172.21.15.110:0/1528119686 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d801d450 con 0x7f70dc0b99b0 2021-03-25T14:17:11.573 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.567+0000 7f70e3d2e700 1 -- 172.21.15.110:0/1528119686 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70dc0b55f0 con 0x7f70dc0b99b0 2021-03-25T14:17:11.573 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.568+0000 7f70e3d2e700 1 -- 172.21.15.110:0/1528119686 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70dc159910 con 0x7f70dc0b99b0 2021-03-25T14:17:11.573 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.568+0000 7f70c9ffb700 1 -- 172.21.15.110:0/1528119686 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f70d8024030 con 0x7f70dc0b99b0 2021-03-25T14:17:11.574 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.569+0000 7f70c9ffb700 1 --2- 172.21.15.110:0/1528119686 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f70bc05a0b0 0x7f70bc05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:11.574 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.569+0000 7f70c9ffb700 1 -- 172.21.15.110:0/1528119686 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6426+0+0 (secure 0 0 0) 0x7f70d8075480 con 0x7f70dc0b99b0 2021-03-25T14:17:11.574 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.569+0000 7f70e12c9700 1 --2- 172.21.15.110:0/1528119686 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f70bc05a0b0 0x7f70bc05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:11.574 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.569+0000 7f70e12c9700 1 --2- 172.21.15.110:0/1528119686 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f70bc05a0b0 0x7f70bc05c570 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f70dc146af0 tx=0x7f70cc009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:11.574 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.572+0000 7f70c9ffb700 1 -- 172.21.15.110:0/1528119686 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f70d8048cc0 con 0x7f70dc0b99b0 2021-03-25T14:17:11.723 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.722+0000 7f70e3d2e700 1 -- 172.21.15.110:0/1528119686 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f70dc0b58d0 con 0x7f70dc0b99b0 2021-03-25T14:17:11.723 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.722+0000 7f70c9ffb700 1 -- 172.21.15.110:0/1528119686 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v38) v1 ==== 84+0+285 (secure 0 0 0) 0x7f70d8022030 con 0x7f70dc0b99b0 2021-03-25T14:17:11.724 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:11.724 INFO:teuthology.orchestra.run.smithi110.stdout:[ 2021-03-25T14:17:11.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:17:11.724 INFO:teuthology.orchestra.run.smithi110.stdout: "poolnum": 1, 2021-03-25T14:17:11.724 INFO:teuthology.orchestra.run.smithi110.stdout: "poolname": "device_health_metrics" 2021-03-25T14:17:11.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:17:11.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:17:11.724 INFO:teuthology.orchestra.run.smithi110.stdout: "poolnum": 2, 2021-03-25T14:17:11.724 INFO:teuthology.orchestra.run.smithi110.stdout: "poolname": "rbd" 2021-03-25T14:17:11.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:17:11.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:17:11.725 INFO:teuthology.orchestra.run.smithi110.stdout: "poolnum": 6, 2021-03-25T14:17:11.725 INFO:teuthology.orchestra.run.smithi110.stdout: "poolname": "cephfs_metadata" 2021-03-25T14:17:11.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:17:11.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:17:11.725 INFO:teuthology.orchestra.run.smithi110.stdout: "poolnum": 7, 2021-03-25T14:17:11.725 INFO:teuthology.orchestra.run.smithi110.stdout: "poolname": "cephfs_data" 2021-03-25T14:17:11.725 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:17:11.725 INFO:teuthology.orchestra.run.smithi110.stdout:] 2021-03-25T14:17:11.726 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.724+0000 7f70e3d2e700 1 -- 172.21.15.110:0/1528119686 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f70bc05a0b0 msgr2=0x7f70bc05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:11.726 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.724+0000 7f70e3d2e700 1 --2- 172.21.15.110:0/1528119686 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f70bc05a0b0 0x7f70bc05c570 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f70dc146af0 tx=0x7f70cc009040).stop 2021-03-25T14:17:11.726 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.724+0000 7f70e3d2e700 1 -- 172.21.15.110:0/1528119686 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70dc0b99b0 msgr2=0x7f70dc158a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:11.726 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.724+0000 7f70e3d2e700 1 --2- 172.21.15.110:0/1528119686 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70dc0b99b0 0x7f70dc158a20 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f70d8006e00 tx=0x7f70d8015000).stop 2021-03-25T14:17:11.726 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.724+0000 7f70e3d2e700 1 -- 172.21.15.110:0/1528119686 shutdown_connections 2021-03-25T14:17:11.727 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.724+0000 7f70e3d2e700 1 --2- 172.21.15.110:0/1528119686 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f70bc05a0b0 0x7f70bc05c570 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:11.727 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.724+0000 7f70e3d2e700 1 --2- 172.21.15.110:0/1528119686 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70dc14a050 0x7f70dc138990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:11.727 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.724+0000 7f70e3d2e700 1 --2- 172.21.15.110:0/1528119686 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70dc0b99b0 0x7f70dc158a20 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:11.727 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.724+0000 7f70e3d2e700 1 --2- 172.21.15.110:0/1528119686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70dc148fc0 0x7f70dc0b7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:11.727 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.724+0000 7f70e3d2e700 1 -- 172.21.15.110:0/1528119686 >> 172.21.15.110:0/1528119686 conn(0x7f70dc060c40 msgr2=0x7f70dc061020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:11.727 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.724+0000 7f70e3d2e700 1 -- 172.21.15.110:0/1528119686 shutdown_connections 2021-03-25T14:17:11.727 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.724+0000 7f70e3d2e700 1 -- 172.21.15.110:0/1528119686 wait complete. 2021-03-25T14:17:11.736 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2021-03-25T14:17:11.737 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata 8 2021-03-25T14:17:11.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.847+0000 7fa921aa8700 1 Processor -- start 2021-03-25T14:17:11.849 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.848+0000 7fa921aa8700 1 -- start start 2021-03-25T14:17:11.852 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.848+0000 7fa921aa8700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa91c067560 0x7fa91c147650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:11.852 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.848+0000 7fa921aa8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa91c147b40 0x7fa91c147fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:11.852 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.849+0000 7fa921aa8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa91c14aa10 0x7fa91c14aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:11.852 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.849+0000 7fa921aa8700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa91c0b7800 con 0x7fa91c067560 2021-03-25T14:17:11.852 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.849+0000 7fa921aa8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa91c0b7d00 con 0x7fa91c147b40 2021-03-25T14:17:11.852 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.849+0000 7fa921aa8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa91c061730 con 0x7fa91c14aa10 2021-03-25T14:17:11.852 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.849+0000 7fa920aa6700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa91c067560 0x7fa91c147650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:11.852 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.849+0000 7fa920aa6700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa91c067560 0x7fa91c147650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49484/0 (socket says 172.21.15.110:49484) 2021-03-25T14:17:11.852 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.849+0000 7fa920aa6700 1 -- 172.21.15.110:0/895364499 learned_addr learned my addr 172.21.15.110:0/895364499 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:11.852 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.849+0000 7fa91bfff700 1 --2- 172.21.15.110:0/895364499 >> v2:172.21.15.174:3300/0 conn(0x7fa91c147b40 0x7fa91c147fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:11.852 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.849+0000 7fa9212a7700 1 --2- 172.21.15.110:0/895364499 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa91c14aa10 0x7fa91c14aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:11.852 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.849+0000 7fa920aa6700 1 -- 172.21.15.110:0/895364499 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa91c14aa10 msgr2=0x7fa91c14aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:11.853 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.849+0000 7fa920aa6700 1 --2- 172.21.15.110:0/895364499 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa91c14aa10 0x7fa91c14aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:11.853 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.849+0000 7fa920aa6700 1 -- 172.21.15.110:0/895364499 >> v2:172.21.15.174:3300/0 conn(0x7fa91c147b40 msgr2=0x7fa91c147fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:11.853 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.849+0000 7fa920aa6700 1 --2- 172.21.15.110:0/895364499 >> v2:172.21.15.174:3300/0 conn(0x7fa91c147b40 0x7fa91c147fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:11.853 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.849+0000 7fa920aa6700 1 -- 172.21.15.110:0/895364499 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa91c0b7ef0 con 0x7fa91c067560 2021-03-25T14:17:11.853 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.849+0000 7fa920aa6700 1 --2- 172.21.15.110:0/895364499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa91c067560 0x7fa91c147650 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7fa91c0671b0 tx=0x7fa904006ee0).ready entity=mon.0 client_cookie=aa7f4836eac1c0fa server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:11.853 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.849+0000 7fa91b7fe700 1 -- 172.21.15.110:0/895364499 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90400be60 con 0x7fa91c067560 2021-03-25T14:17:11.853 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.849+0000 7fa91b7fe700 1 -- 172.21.15.110:0/895364499 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa904009890 con 0x7fa91c067560 2021-03-25T14:17:11.853 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.849+0000 7fa91b7fe700 1 -- 172.21.15.110:0/895364499 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa904009c10 con 0x7fa91c067560 2021-03-25T14:17:11.853 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.850+0000 7fa921aa8700 1 -- 172.21.15.110:0/895364499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa91c067560 msgr2=0x7fa91c147650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:11.853 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.850+0000 7fa921aa8700 1 --2- 172.21.15.110:0/895364499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa91c067560 0x7fa91c147650 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7fa91c0671b0 tx=0x7fa904006ee0).stop 2021-03-25T14:17:11.853 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.850+0000 7fa921aa8700 1 -- 172.21.15.110:0/895364499 shutdown_connections 2021-03-25T14:17:11.853 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.850+0000 7fa921aa8700 1 --2- 172.21.15.110:0/895364499 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa91c14aa10 0x7fa91c14aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:11.854 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.850+0000 7fa921aa8700 1 --2- 172.21.15.110:0/895364499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa91c067560 0x7fa91c147650 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:11.854 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.850+0000 7fa921aa8700 1 --2- 172.21.15.110:0/895364499 >> v2:172.21.15.174:3300/0 conn(0x7fa91c147b40 0x7fa91c147fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:11.854 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.850+0000 7fa921aa8700 1 -- 172.21.15.110:0/895364499 >> 172.21.15.110:0/895364499 conn(0x7fa91c0639a0 msgr2=0x7fa91c063db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:11.854 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.850+0000 7fa921aa8700 1 -- 172.21.15.110:0/895364499 shutdown_connections 2021-03-25T14:17:11.854 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.850+0000 7fa921aa8700 1 -- 172.21.15.110:0/895364499 wait complete. 2021-03-25T14:17:11.854 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.851+0000 7fa921aa8700 1 Processor -- start 2021-03-25T14:17:11.854 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.851+0000 7fa921aa8700 1 -- start start 2021-03-25T14:17:11.857 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.852+0000 7fa921aa8700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa91c067560 0x7fa91c0b0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:11.857 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.852+0000 7fa921aa8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa91c147b40 0x7fa91c0adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:11.857 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.852+0000 7fa921aa8700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa91c14aa10 0x7fa91c145220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:11.857 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.852+0000 7fa921aa8700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91c0b3020 con 0x7fa91c14aa10 2021-03-25T14:17:11.857 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.852+0000 7fa921aa8700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91c0b3250 con 0x7fa91c067560 2021-03-25T14:17:11.857 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.852+0000 7fa921aa8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa91c0b34f0 con 0x7fa91c147b40 2021-03-25T14:17:11.857 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.852+0000 7fa9212a7700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa91c14aa10 0x7fa91c145220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:11.857 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.852+0000 7fa9212a7700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa91c14aa10 0x7fa91c145220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49494/0 (socket says 172.21.15.110:49494) 2021-03-25T14:17:11.858 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.852+0000 7fa9212a7700 1 -- 172.21.15.110:0/3134579348 learned_addr learned my addr 172.21.15.110:0/3134579348 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:11.858 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.852+0000 7fa91bfff700 1 --2- 172.21.15.110:0/3134579348 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa91c147b40 0x7fa91c0adbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:11.858 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.852+0000 7fa920aa6700 1 --2- 172.21.15.110:0/3134579348 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa91c067560 0x7fa91c0b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:11.858 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.852+0000 7fa9212a7700 1 -- 172.21.15.110:0/3134579348 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa91c147b40 msgr2=0x7fa91c0adbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:11.858 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.852+0000 7fa9212a7700 1 --2- 172.21.15.110:0/3134579348 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa91c147b40 0x7fa91c0adbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:11.858 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.852+0000 7fa9212a7700 1 -- 172.21.15.110:0/3134579348 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa91c067560 msgr2=0x7fa91c0b0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:11.858 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.852+0000 7fa9212a7700 1 --2- 172.21.15.110:0/3134579348 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa91c067560 0x7fa91c0b0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:11.858 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.852+0000 7fa9212a7700 1 -- 172.21.15.110:0/3134579348 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa91c0b3790 con 0x7fa91c14aa10 2021-03-25T14:17:11.858 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.852+0000 7fa920aa6700 1 --2- 172.21.15.110:0/3134579348 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa91c067560 0x7fa91c0b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:11.858 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.852+0000 7fa9212a7700 1 --2- 172.21.15.110:0/3134579348 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa91c14aa10 0x7fa91c145220 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7fa91400ef50 tx=0x7fa914009220).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:11.858 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.852+0000 7fa918ff9700 1 -- 172.21.15.110:0/3134579348 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91400cc30 con 0x7fa91c14aa10 2021-03-25T14:17:11.858 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.853+0000 7fa918ff9700 1 -- 172.21.15.110:0/3134579348 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91400cd90 con 0x7fa91c14aa10 2021-03-25T14:17:11.859 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.853+0000 7fa921aa8700 1 -- 172.21.15.110:0/3134579348 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa91c0ae4e0 con 0x7fa91c14aa10 2021-03-25T14:17:11.859 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.853+0000 7fa918ff9700 1 -- 172.21.15.110:0/3134579348 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa914012620 con 0x7fa91c14aa10 2021-03-25T14:17:11.859 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.853+0000 7fa921aa8700 1 -- 172.21.15.110:0/3134579348 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa91c0acf30 con 0x7fa91c14aa10 2021-03-25T14:17:11.859 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.853+0000 7fa921aa8700 1 -- 172.21.15.110:0/3134579348 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa91c0b3920 con 0x7fa91c14aa10 2021-03-25T14:17:11.859 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.854+0000 7fa918ff9700 1 -- 172.21.15.110:0/3134579348 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fa914022070 con 0x7fa91c14aa10 2021-03-25T14:17:11.859 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.854+0000 7fa918ff9700 1 --2- 172.21.15.110:0/3134579348 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa90005a0b0 0x7fa90005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:11.859 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.854+0000 7fa918ff9700 1 -- 172.21.15.110:0/3134579348 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6426+0+0 (secure 0 0 0) 0x7fa914074680 con 0x7fa91c14aa10 2021-03-25T14:17:11.859 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.854+0000 7fa920aa6700 1 --2- 172.21.15.110:0/3134579348 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa90005a0b0 0x7fa90005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:11.859 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.854+0000 7fa920aa6700 1 --2- 172.21.15.110:0/3134579348 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa90005a0b0 0x7fa90005c570 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fa904006f20 tx=0x7fa904016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:11.860 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:11.858+0000 7fa918ff9700 1 -- 172.21.15.110:0/3134579348 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fa914047ec0 con 0x7fa91c14aa10 2021-03-25T14:17:11.884 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-03-25T14:17:11.886 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-03-25T14:17:12.016 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:12.015+0000 7fa921aa8700 1 -- 172.21.15.110:0/3134579348 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num": 8} v 0) v1 -- 0x7fa91c045ae0 con 0x7fa91c14aa10 2021-03-25T14:17:13.017 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.017+0000 7fa918ff9700 1 -- 172.21.15.110:0/3134579348 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num": 8}]=0 pool 'cephfs2_metadata' created v39) v1 ==== 135+0+0 (secure 0 0 0) 0x7fa914016020 con 0x7fa91c14aa10 2021-03-25T14:17:13.021 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.020+0000 7fa921aa8700 1 -- 172.21.15.110:0/3134579348 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa90005a0b0 msgr2=0x7fa90005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:13.021 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.020+0000 7fa921aa8700 1 --2- 172.21.15.110:0/3134579348 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa90005a0b0 0x7fa90005c570 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fa904006f20 tx=0x7fa904016000).stop 2021-03-25T14:17:13.021 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.020+0000 7fa921aa8700 1 -- 172.21.15.110:0/3134579348 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa91c14aa10 msgr2=0x7fa91c145220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:13.021 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.020+0000 7fa921aa8700 1 --2- 172.21.15.110:0/3134579348 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa91c14aa10 0x7fa91c145220 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7fa91400ef50 tx=0x7fa914009220).stop 2021-03-25T14:17:13.021 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.020+0000 7fa921aa8700 1 -- 172.21.15.110:0/3134579348 shutdown_connections 2021-03-25T14:17:13.021 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.020+0000 7fa921aa8700 1 --2- 172.21.15.110:0/3134579348 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa90005a0b0 0x7fa90005c570 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:13.021 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.020+0000 7fa921aa8700 1 --2- 172.21.15.110:0/3134579348 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa91c067560 0x7fa91c0b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:13.022 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.020+0000 7fa921aa8700 1 --2- 172.21.15.110:0/3134579348 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa91c14aa10 0x7fa91c145220 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:13.022 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.020+0000 7fa921aa8700 1 --2- 172.21.15.110:0/3134579348 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa91c147b40 0x7fa91c0adbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:13.022 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.020+0000 7fa921aa8700 1 -- 172.21.15.110:0/3134579348 >> 172.21.15.110:0/3134579348 conn(0x7fa91c0639a0 msgr2=0x7fa91c149360 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:13.022 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.020+0000 7fa921aa8700 1 -- 172.21.15.110:0/3134579348 shutdown_connections 2021-03-25T14:17:13.022 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.020+0000 7fa921aa8700 1 -- 172.21.15.110:0/3134579348 wait complete. 2021-03-25T14:17:13.022 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs2_metadata' created 2021-03-25T14:17:13.035 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 8 2021-03-25T14:17:13.153 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.153+0000 7f4c89737700 1 Processor -- start 2021-03-25T14:17:13.154 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.153+0000 7f4c89737700 1 -- start start 2021-03-25T14:17:13.156 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.153+0000 7f4c89737700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4c84060e00 0x7f4c840a2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:13.157 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.153+0000 7f4c89737700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c8414da00 0x7f4c841434b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:13.157 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.153+0000 7f4c89737700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c840b6c90 con 0x7f4c84068440 2021-03-25T14:17:13.157 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.153+0000 7f4c89737700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c8414deb0 con 0x7f4c84060e00 2021-03-25T14:17:13.157 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.153+0000 7f4c89737700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8414a080 con 0x7f4c8414da00 2021-03-25T14:17:13.157 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.154+0000 7f4c82ffd700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4c84060e00 0x7f4c840a2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:13.157 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.154+0000 7f4c82ffd700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4c84060e00 0x7f4c840a2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49498/0 (socket says 172.21.15.110:49498) 2021-03-25T14:17:13.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.154+0000 7f4c82ffd700 1 -- 172.21.15.110:0/1119557845 learned_addr learned my addr 172.21.15.110:0/1119557845 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:13.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.154+0000 7f4c82ffd700 1 -- 172.21.15.110:0/1119557845 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c8414da00 msgr2=0x7f4c841434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:13.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.154+0000 7f4c82ffd700 1 --2- 172.21.15.110:0/1119557845 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c8414da00 0x7f4c841434b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:13.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.154+0000 7f4c82ffd700 1 -- 172.21.15.110:0/1119557845 >> v1:172.21.15.174:6789/0 conn(0x7f4c84068440 legacy=0x7f4c84149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:13.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.154+0000 7f4c82ffd700 1 -- 172.21.15.110:0/1119557845 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c84068ca0 con 0x7f4c84060e00 2021-03-25T14:17:13.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.154+0000 7f4c82ffd700 1 --2- 172.21.15.110:0/1119557845 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c84060e00 0x7f4c840a2710 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f4c7800ba20 tx=0x7f4c78006ee0).ready entity=mon.0 client_cookie=368b7491a0f6e1ce server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:13.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.154+0000 7f4c81ffb700 1 -- 172.21.15.110:0/1119557845 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c78009890 con 0x7f4c84060e00 2021-03-25T14:17:13.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.154+0000 7f4c81ffb700 1 -- 172.21.15.110:0/1119557845 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c780099f0 con 0x7f4c84060e00 2021-03-25T14:17:13.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.154+0000 7f4c81ffb700 1 -- 172.21.15.110:0/1119557845 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c78009d70 con 0x7f4c84060e00 2021-03-25T14:17:13.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.154+0000 7f4c89737700 1 -- 172.21.15.110:0/1119557845 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c84060e00 msgr2=0x7f4c840a2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:13.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.154+0000 7f4c89737700 1 --2- 172.21.15.110:0/1119557845 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c84060e00 0x7f4c840a2710 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f4c7800ba20 tx=0x7f4c78006ee0).stop 2021-03-25T14:17:13.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.155+0000 7f4c89737700 1 -- 172.21.15.110:0/1119557845 shutdown_connections 2021-03-25T14:17:13.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.155+0000 7f4c89737700 1 --2- 172.21.15.110:0/1119557845 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c8414da00 0x7f4c841434b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:13.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.155+0000 7f4c89737700 1 --2- 172.21.15.110:0/1119557845 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c84060e00 0x7f4c840a2710 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:13.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.155+0000 7f4c89737700 1 -- 172.21.15.110:0/1119557845 >> 172.21.15.110:0/1119557845 conn(0x7f4c84061d50 msgr2=0x7f4c84062160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:13.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.155+0000 7f4c89737700 1 -- 172.21.15.110:0/1119557845 shutdown_connections 2021-03-25T14:17:13.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.155+0000 7f4c89737700 1 -- 172.21.15.110:0/1119557845 wait complete. 2021-03-25T14:17:13.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.156+0000 7f4c89737700 1 Processor -- start 2021-03-25T14:17:13.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.156+0000 7f4c89737700 1 -- start start 2021-03-25T14:17:13.164 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.156+0000 7f4c89737700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c84060e00 0x7f4c84148e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:13.165 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.156+0000 7f4c89737700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c84068440 0x7f4c84142670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:13.165 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.156+0000 7f4c89737700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c8414da00 0x7f4c84140550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:13.165 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.156+0000 7f4c89737700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c840bb910 con 0x7f4c84060e00 2021-03-25T14:17:13.165 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.156+0000 7f4c89737700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c840bac90 con 0x7f4c8414da00 2021-03-25T14:17:13.165 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.156+0000 7f4c89737700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c840baf30 con 0x7f4c84068440 2021-03-25T14:17:13.166 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.157+0000 7f4c82ffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c84060e00 0x7f4c84148e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:13.166 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.157+0000 7f4c82ffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c84060e00 0x7f4c84148e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49502/0 (socket says 172.21.15.110:49502) 2021-03-25T14:17:13.166 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.157+0000 7f4c82ffd700 1 -- 172.21.15.110:0/3551014830 learned_addr learned my addr 172.21.15.110:0/3551014830 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:13.166 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.157+0000 7f4c837fe700 1 --2- 172.21.15.110:0/3551014830 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c8414da00 0x7f4c84140550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:13.166 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.157+0000 7f4c827fc700 1 --2- 172.21.15.110:0/3551014830 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c84068440 0x7f4c84142670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:13.167 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.157+0000 7f4c82ffd700 1 -- 172.21.15.110:0/3551014830 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c84068440 msgr2=0x7f4c84142670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:13.167 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.157+0000 7f4c82ffd700 1 --2- 172.21.15.110:0/3551014830 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c84068440 0x7f4c84142670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:13.167 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.157+0000 7f4c82ffd700 1 -- 172.21.15.110:0/3551014830 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c8414da00 msgr2=0x7f4c84140550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:13.167 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.157+0000 7f4c82ffd700 1 --2- 172.21.15.110:0/3551014830 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c8414da00 0x7f4c84140550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:13.167 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.157+0000 7f4c82ffd700 1 -- 172.21.15.110:0/3551014830 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c840bb1d0 con 0x7f4c84060e00 2021-03-25T14:17:13.168 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.157+0000 7f4c837fe700 1 --2- 172.21.15.110:0/3551014830 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c8414da00 0x7f4c84140550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:13.168 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.157+0000 7f4c82ffd700 1 --2- 172.21.15.110:0/3551014830 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c84060e00 0x7f4c84148e20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f4c840ba930 tx=0x7f4c78016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:13.168 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.157+0000 7f4c6affd700 1 -- 172.21.15.110:0/3551014830 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c78011e30 con 0x7f4c84060e00 2021-03-25T14:17:13.168 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.157+0000 7f4c6affd700 1 -- 172.21.15.110:0/3551014830 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c7801c420 con 0x7f4c84060e00 2021-03-25T14:17:13.169 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.157+0000 7f4c89737700 1 -- 172.21.15.110:0/3551014830 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c84149310 con 0x7f4c84060e00 2021-03-25T14:17:13.169 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.157+0000 7f4c6affd700 1 -- 172.21.15.110:0/3551014830 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7801c7c0 con 0x7f4c84060e00 2021-03-25T14:17:13.169 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.157+0000 7f4c89737700 1 -- 172.21.15.110:0/3551014830 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c84142b60 con 0x7f4c84060e00 2021-03-25T14:17:13.169 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.158+0000 7f4c89737700 1 -- 172.21.15.110:0/3551014830 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c8405d7b0 con 0x7f4c84060e00 2021-03-25T14:17:13.169 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.158+0000 7f4c6affd700 1 -- 172.21.15.110:0/3551014830 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f4c7800f070 con 0x7f4c84060e00 2021-03-25T14:17:13.170 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.159+0000 7f4c6affd700 1 --2- 172.21.15.110:0/3551014830 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4c6405a0b0 0x7f4c6405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:13.170 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.159+0000 7f4c6affd700 1 -- 172.21.15.110:0/3551014830 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f4c780754e0 con 0x7f4c84060e00 2021-03-25T14:17:13.170 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.159+0000 7f4c827fc700 1 --2- 172.21.15.110:0/3551014830 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4c6405a0b0 0x7f4c6405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:13.170 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.159+0000 7f4c827fc700 1 --2- 172.21.15.110:0/3551014830 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4c6405a0b0 0x7f4c6405c570 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f4c84144490 tx=0x7f4c74009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:13.170 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.163+0000 7f4c6affd700 1 -- 172.21.15.110:0/3551014830 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f4c78048bc0 con 0x7f4c84060e00 2021-03-25T14:17:13.312 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:13.311+0000 7f4c89737700 1 -- 172.21.15.110:0/3551014830 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 8} v 0) v1 -- 0x7f4c840b6c90 con 0x7f4c84060e00 2021-03-25T14:17:14.019 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.018+0000 7f4c6affd700 1 -- 172.21.15.110:0/3551014830 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 8}]=0 pool 'cephfs2_data' created v40) v1 ==== 127+0+0 (secure 0 0 0) 0x7f4c840b6c90 con 0x7f4c84060e00 2021-03-25T14:17:14.026 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.025+0000 7f4c89737700 1 -- 172.21.15.110:0/3551014830 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4c6405a0b0 msgr2=0x7f4c6405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:14.026 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.025+0000 7f4c89737700 1 --2- 172.21.15.110:0/3551014830 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4c6405a0b0 0x7f4c6405c570 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f4c84144490 tx=0x7f4c74009040).stop 2021-03-25T14:17:14.026 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.025+0000 7f4c89737700 1 -- 172.21.15.110:0/3551014830 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c84060e00 msgr2=0x7f4c84148e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:14.026 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.025+0000 7f4c89737700 1 --2- 172.21.15.110:0/3551014830 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c84060e00 0x7f4c84148e20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f4c840ba930 tx=0x7f4c78016000).stop 2021-03-25T14:17:14.027 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.026+0000 7f4c89737700 1 -- 172.21.15.110:0/3551014830 shutdown_connections 2021-03-25T14:17:14.027 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.026+0000 7f4c89737700 1 --2- 172.21.15.110:0/3551014830 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4c6405a0b0 0x7f4c6405c570 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:14.027 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.026+0000 7f4c89737700 1 --2- 172.21.15.110:0/3551014830 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c8414da00 0x7f4c84140550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:14.027 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.026+0000 7f4c89737700 1 --2- 172.21.15.110:0/3551014830 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c84060e00 0x7f4c84148e20 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:14.027 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.026+0000 7f4c89737700 1 --2- 172.21.15.110:0/3551014830 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c84068440 0x7f4c84142670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:14.027 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.026+0000 7f4c89737700 1 -- 172.21.15.110:0/3551014830 >> 172.21.15.110:0/3551014830 conn(0x7f4c84061d50 msgr2=0x7f4c840b7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:14.027 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.026+0000 7f4c89737700 1 -- 172.21.15.110:0/3551014830 shutdown_connections 2021-03-25T14:17:14.027 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.026+0000 7f4c89737700 1 -- 172.21.15.110:0/3551014830 wait complete. 2021-03-25T14:17:14.028 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs2_data' created 2021-03-25T14:17:14.040 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2021-03-25T14:17:14.153 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.153+0000 7f7044983700 1 Processor -- start 2021-03-25T14:17:14.154 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.153+0000 7f7044983700 1 -- start start 2021-03-25T14:17:14.157 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.153+0000 7f7044983700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f704014d470 0x7f704014d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:14.157 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.153+0000 7f7044983700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f704014cc90 0x7f70401493c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:14.157 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.154+0000 7f7044983700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f70401498b0 0x7f70400685d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:14.157 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.154+0000 7f7044983700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70400691b0 con 0x7f70401498b0 2021-03-25T14:17:14.157 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.154+0000 7f7044983700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70400bc2b0 con 0x7f704014d470 2021-03-25T14:17:14.157 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.154+0000 7f7044983700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7040149dd0 con 0x7f704014cc90 2021-03-25T14:17:14.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.154+0000 7f703ed9d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f70401498b0 0x7f70400685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:14.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.154+0000 7f703ed9d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f70401498b0 0x7f70400685d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49514/0 (socket says 172.21.15.110:49514) 2021-03-25T14:17:14.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.154+0000 7f703ed9d700 1 -- 172.21.15.110:0/3918253856 learned_addr learned my addr 172.21.15.110:0/3918253856 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:14.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.154+0000 7f703e59c700 1 --2- 172.21.15.110:0/3918253856 >> v2:172.21.15.174:3300/0 conn(0x7f704014d470 0x7f704014d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:14.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.154+0000 7f703dd9b700 1 --2- 172.21.15.110:0/3918253856 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f704014cc90 0x7f70401493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:14.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.154+0000 7f703ed9d700 1 -- 172.21.15.110:0/3918253856 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f704014cc90 msgr2=0x7f70401493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:14.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.154+0000 7f703ed9d700 1 --2- 172.21.15.110:0/3918253856 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f704014cc90 0x7f70401493c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:14.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.154+0000 7f703ed9d700 1 -- 172.21.15.110:0/3918253856 >> v2:172.21.15.174:3300/0 conn(0x7f704014d470 msgr2=0x7f704014d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:14.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.154+0000 7f703ed9d700 1 --2- 172.21.15.110:0/3918253856 >> v2:172.21.15.174:3300/0 conn(0x7f704014d470 0x7f704014d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:14.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.154+0000 7f703ed9d700 1 -- 172.21.15.110:0/3918253856 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f704014a070 con 0x7f70401498b0 2021-03-25T14:17:14.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.154+0000 7f703e59c700 1 --2- 172.21.15.110:0/3918253856 >> v2:172.21.15.174:3300/0 conn(0x7f704014d470 0x7f704014d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:17:14.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.154+0000 7f703ed9d700 1 --2- 172.21.15.110:0/3918253856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70401498b0 0x7f70400685d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f7040061fa0 tx=0x7f70380092d0).ready entity=mon.0 client_cookie=9c586f2c72765447 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:14.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.154+0000 7f703d59a700 1 -- 172.21.15.110:0/3918253856 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703800bbf0 con 0x7f70401498b0 2021-03-25T14:17:14.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.154+0000 7f703d59a700 1 -- 172.21.15.110:0/3918253856 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703800bd50 con 0x7f70401498b0 2021-03-25T14:17:14.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.154+0000 7f703d59a700 1 -- 172.21.15.110:0/3918253856 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7038011610 con 0x7f70401498b0 2021-03-25T14:17:14.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.155+0000 7f7044983700 1 -- 172.21.15.110:0/3918253856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70401498b0 msgr2=0x7f70400685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:14.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.155+0000 7f7044983700 1 --2- 172.21.15.110:0/3918253856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70401498b0 0x7f70400685d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f7040061fa0 tx=0x7f70380092d0).stop 2021-03-25T14:17:14.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.155+0000 7f7044983700 1 -- 172.21.15.110:0/3918253856 shutdown_connections 2021-03-25T14:17:14.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.155+0000 7f7044983700 1 --2- 172.21.15.110:0/3918253856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70401498b0 0x7f70400685d0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:14.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.155+0000 7f7044983700 1 --2- 172.21.15.110:0/3918253856 >> v2:172.21.15.174:3300/0 conn(0x7f704014d470 0x7f704014d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:14.159 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.155+0000 7f7044983700 1 --2- 172.21.15.110:0/3918253856 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f704014cc90 0x7f70401493c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:14.160 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.155+0000 7f7044983700 1 -- 172.21.15.110:0/3918253856 >> 172.21.15.110:0/3918253856 conn(0x7f7040060c40 msgr2=0x7f7040061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:14.160 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.155+0000 7f7044983700 1 -- 172.21.15.110:0/3918253856 shutdown_connections 2021-03-25T14:17:14.160 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.155+0000 7f7044983700 1 -- 172.21.15.110:0/3918253856 wait complete. 2021-03-25T14:17:14.160 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.156+0000 7f7044983700 1 Processor -- start 2021-03-25T14:17:14.160 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.156+0000 7f7044983700 1 -- start start 2021-03-25T14:17:14.163 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.157+0000 7f7044983700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70401498b0 0x7f70400a5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:14.163 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.157+0000 7f7044983700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f704014cc90 0x7f7040144aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:14.163 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.157+0000 7f7044983700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f704014d470 0x7f704015c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:14.163 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.157+0000 7f7044983700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7040145c20 con 0x7f704014d470 2021-03-25T14:17:14.163 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.157+0000 7f7044983700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704015cd50 con 0x7f704014cc90 2021-03-25T14:17:14.163 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.157+0000 7f7044983700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f704015cab0 con 0x7f70401498b0 2021-03-25T14:17:14.163 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.157+0000 7f703ed9d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f704014d470 0x7f704015c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:14.164 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.157+0000 7f703ed9d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f704014d470 0x7f704015c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49520/0 (socket says 172.21.15.110:49520) 2021-03-25T14:17:14.164 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.157+0000 7f703ed9d700 1 -- 172.21.15.110:0/558278639 learned_addr learned my addr 172.21.15.110:0/558278639 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:14.164 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.157+0000 7f703dd9b700 1 --2- 172.21.15.110:0/558278639 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f704014cc90 0x7f7040144aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:14.164 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.157+0000 7f703e59c700 1 --2- 172.21.15.110:0/558278639 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70401498b0 0x7f70400a5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:14.164 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.157+0000 7f703ed9d700 1 -- 172.21.15.110:0/558278639 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70401498b0 msgr2=0x7f70400a5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:14.164 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.157+0000 7f703ed9d700 1 --2- 172.21.15.110:0/558278639 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70401498b0 0x7f70400a5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:14.164 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.157+0000 7f703ed9d700 1 -- 172.21.15.110:0/558278639 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f704014cc90 msgr2=0x7f7040144aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:14.164 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.157+0000 7f703ed9d700 1 --2- 172.21.15.110:0/558278639 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f704014cc90 0x7f7040144aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:14.164 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.157+0000 7f703ed9d700 1 -- 172.21.15.110:0/558278639 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7040145e80 con 0x7f704014d470 2021-03-25T14:17:14.164 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.157+0000 7f703dd9b700 1 --2- 172.21.15.110:0/558278639 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f704014cc90 0x7f7040144aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:14.164 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.157+0000 7f703e59c700 1 --2- 172.21.15.110:0/558278639 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70401498b0 0x7f70400a5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:14.165 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.157+0000 7f703ed9d700 1 --2- 172.21.15.110:0/558278639 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f704014d470 0x7f704015c060 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f7038009130 tx=0x7f7038017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:14.165 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.157+0000 7f702e7fc700 1 -- 172.21.15.110:0/558278639 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7038009ea0 con 0x7f704014d470 2021-03-25T14:17:14.165 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.157+0000 7f702e7fc700 1 -- 172.21.15.110:0/558278639 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703800bec0 con 0x7f704014d470 2021-03-25T14:17:14.165 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.157+0000 7f7044983700 1 -- 172.21.15.110:0/558278639 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7040144f90 con 0x7f704014d470 2021-03-25T14:17:14.165 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.157+0000 7f702e7fc700 1 -- 172.21.15.110:0/558278639 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7038010e10 con 0x7f704014d470 2021-03-25T14:17:14.165 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.157+0000 7f7044983700 1 -- 172.21.15.110:0/558278639 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70400b7240 con 0x7f704014d470 2021-03-25T14:17:14.165 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.158+0000 7f7044983700 1 -- 172.21.15.110:0/558278639 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f704005d7b0 con 0x7f704014d470 2021-03-25T14:17:14.165 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.159+0000 7f702e7fc700 1 -- 172.21.15.110:0/558278639 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f703800f070 con 0x7f704014d470 2021-03-25T14:17:14.165 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.159+0000 7f702e7fc700 1 --2- 172.21.15.110:0/558278639 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f701c05a0b0 0x7f701c05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:14.165 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.159+0000 7f702e7fc700 1 -- 172.21.15.110:0/558278639 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 7132+0+0 (secure 0 0 0) 0x7f7038075e60 con 0x7f704014d470 2021-03-25T14:17:14.166 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.159+0000 7f703e59c700 1 --2- 172.21.15.110:0/558278639 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f701c05a0b0 0x7f701c05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:14.166 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.159+0000 7f703e59c700 1 --2- 172.21.15.110:0/558278639 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f701c05a0b0 0x7f701c05c570 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f703400a900 tx=0x7f7034008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:14.166 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.163+0000 7f702e7fc700 1 -- 172.21.15.110:0/558278639 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f70380493e0 con 0x7f704014d470 2021-03-25T14:17:14.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.349+0000 7f7044983700 1 -- 172.21.15.110:0/558278639 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7f704014ca70 con 0x7f704014d470 2021-03-25T14:17:14.354 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.353+0000 7f702e7fc700 1 -- 172.21.15.110:0/558278639 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 8 and data pool 9 v17) v1 ==== 175+0+0 (secure 0 0 0) 0x7f703804ca00 con 0x7f704014d470 2021-03-25T14:17:14.357 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.356+0000 7f7044983700 1 -- 172.21.15.110:0/558278639 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f701c05a0b0 msgr2=0x7f701c05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:14.357 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.356+0000 7f7044983700 1 --2- 172.21.15.110:0/558278639 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f701c05a0b0 0x7f701c05c570 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f703400a900 tx=0x7f7034008040).stop 2021-03-25T14:17:14.357 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.356+0000 7f7044983700 1 -- 172.21.15.110:0/558278639 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f704014d470 msgr2=0x7f704015c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:14.357 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.356+0000 7f7044983700 1 --2- 172.21.15.110:0/558278639 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f704014d470 0x7f704015c060 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f7038009130 tx=0x7f7038017000).stop 2021-03-25T14:17:14.358 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.356+0000 7f7044983700 1 -- 172.21.15.110:0/558278639 shutdown_connections 2021-03-25T14:17:14.358 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.356+0000 7f7044983700 1 --2- 172.21.15.110:0/558278639 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f701c05a0b0 0x7f701c05c570 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:14.358 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.356+0000 7f7044983700 1 --2- 172.21.15.110:0/558278639 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f704014d470 0x7f704015c060 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:14.358 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.357+0000 7f7044983700 1 --2- 172.21.15.110:0/558278639 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70401498b0 0x7f70400a5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:14.358 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.357+0000 7f7044983700 1 --2- 172.21.15.110:0/558278639 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f704014cc90 0x7f7040144aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:14.358 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.357+0000 7f7044983700 1 -- 172.21.15.110:0/558278639 >> 172.21.15.110:0/558278639 conn(0x7f7040060c40 msgr2=0x7f70400bf760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:14.359 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.358+0000 7f7044983700 1 -- 172.21.15.110:0/558278639 shutdown_connections 2021-03-25T14:17:14.359 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.358+0000 7f7044983700 1 -- 172.21.15.110:0/558278639 wait complete. 2021-03-25T14:17:14.360 INFO:teuthology.orchestra.run.smithi110.stderr:new fs with metadata pool 8 and data pool 9 2021-03-25T14:17:14.375 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:17:14.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.484+0000 7f0455026700 1 Processor -- start 2021-03-25T14:17:14.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.484+0000 7f0455026700 1 -- start start 2021-03-25T14:17:14.488 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.485+0000 7f0455026700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f04500b99b0 0x7f04500ba4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:14.488 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.485+0000 7f0455026700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0450148fc0 0x7f04500a3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:14.488 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.485+0000 7f0455026700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0450149470 con 0x7f045014a050 2021-03-25T14:17:14.488 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.485+0000 7f0455026700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04500ba9e0 con 0x7f0450148fc0 2021-03-25T14:17:14.488 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.485+0000 7f0455026700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04500babc0 con 0x7f04500b99b0 2021-03-25T14:17:14.488 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.485+0000 7f044f59e700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0450148fc0 0x7f04500a3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:14.489 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.485+0000 7f044e59c700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f045014a050 0x7f04501488b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:42472/0 (socket says 172.21.15.110:42472) 2021-03-25T14:17:14.489 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.485+0000 7f044f59e700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0450148fc0 0x7f04500a3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49538/0 (socket says 172.21.15.110:49538) 2021-03-25T14:17:14.489 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.485+0000 7f044e59c700 1 -- 172.21.15.110:0/3289666702 learned_addr learned my addr 172.21.15.110:0/3289666702 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:14.489 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.485+0000 7f044ed9d700 1 --2- 172.21.15.110:0/3289666702 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f04500b99b0 0x7f04500ba4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:14.489 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.486+0000 7f044f59e700 1 -- 172.21.15.110:0/3289666702 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f04500b99b0 msgr2=0x7f04500ba4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:14.489 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.486+0000 7f044f59e700 1 --2- 172.21.15.110:0/3289666702 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f04500b99b0 0x7f04500ba4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:14.489 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.486+0000 7f044f59e700 1 -- 172.21.15.110:0/3289666702 >> v1:172.21.15.110:6789/0 conn(0x7f045014a050 legacy=0x7f04501488b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:14.489 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.486+0000 7f044f59e700 1 -- 172.21.15.110:0/3289666702 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04500bae60 con 0x7f0450148fc0 2021-03-25T14:17:14.489 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.486+0000 7f044dd9b700 1 -- 172.21.15.110:0/3289666702 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2210696849 0 0) 0x7f0440001110 con 0x7f045014a050 2021-03-25T14:17:14.489 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.486+0000 7f044f59e700 1 --2- 172.21.15.110:0/3289666702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0450148fc0 0x7f04500a3190 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f0448009cc0 tx=0x7f0448009220).ready entity=mon.0 client_cookie=203bd3acee9d19b9 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:14.489 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.486+0000 7f044dd9b700 1 -- 172.21.15.110:0/3289666702 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044800baa0 con 0x7f0450148fc0 2021-03-25T14:17:14.489 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.486+0000 7f044dd9b700 1 -- 172.21.15.110:0/3289666702 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044800bc00 con 0x7f0450148fc0 2021-03-25T14:17:14.490 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.486+0000 7f044dd9b700 1 -- 172.21.15.110:0/3289666702 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0448011400 con 0x7f0450148fc0 2021-03-25T14:17:14.490 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.486+0000 7f0455026700 1 -- 172.21.15.110:0/3289666702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0450148fc0 msgr2=0x7f04500a3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:14.490 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.486+0000 7f0455026700 1 --2- 172.21.15.110:0/3289666702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0450148fc0 0x7f04500a3190 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f0448009cc0 tx=0x7f0448009220).stop 2021-03-25T14:17:14.490 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.486+0000 7f0455026700 1 -- 172.21.15.110:0/3289666702 shutdown_connections 2021-03-25T14:17:14.490 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.486+0000 7f0455026700 1 --2- 172.21.15.110:0/3289666702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0450148fc0 0x7f04500a3190 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:14.490 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.486+0000 7f0455026700 1 --2- 172.21.15.110:0/3289666702 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f04500b99b0 0x7f04500ba4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:14.490 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.486+0000 7f0455026700 1 -- 172.21.15.110:0/3289666702 >> 172.21.15.110:0/3289666702 conn(0x7f0450060c40 msgr2=0x7f0450061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:14.490 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.486+0000 7f0455026700 1 -- 172.21.15.110:0/3289666702 shutdown_connections 2021-03-25T14:17:14.490 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.486+0000 7f0455026700 1 -- 172.21.15.110:0/3289666702 wait complete. 2021-03-25T14:17:14.490 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.487+0000 7f0455026700 1 Processor -- start 2021-03-25T14:17:14.490 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.488+0000 7f0455026700 1 -- start start 2021-03-25T14:17:14.493 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.488+0000 7f0455026700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04500b99b0 0x7f0450159520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:14.493 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.488+0000 7f0455026700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0450148fc0 0x7f04500b4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:14.493 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.488+0000 7f0455026700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f045014a050 0x7f04500b7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:14.493 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.488+0000 7f0455026700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0450063ab0 con 0x7f04500b99b0 2021-03-25T14:17:14.493 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.488+0000 7f0455026700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0450063d50 con 0x7f045014a050 2021-03-25T14:17:14.493 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.488+0000 7f0455026700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0450063ff0 con 0x7f0450148fc0 2021-03-25T14:17:14.493 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.488+0000 7f044ed9d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04500b99b0 0x7f0450159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:14.493 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.488+0000 7f044ed9d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04500b99b0 0x7f0450159520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49540/0 (socket says 172.21.15.110:49540) 2021-03-25T14:17:14.494 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.488+0000 7f044ed9d700 1 -- 172.21.15.110:0/4176646369 learned_addr learned my addr 172.21.15.110:0/4176646369 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:14.494 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.488+0000 7f044e59c700 1 --2- 172.21.15.110:0/4176646369 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0450148fc0 0x7f04500b4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:14.494 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.488+0000 7f044f59e700 1 --2- 172.21.15.110:0/4176646369 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f045014a050 0x7f04500b7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:14.494 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.489+0000 7f044ed9d700 1 -- 172.21.15.110:0/4176646369 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0450148fc0 msgr2=0x7f04500b4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:14.494 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.489+0000 7f044ed9d700 1 --2- 172.21.15.110:0/4176646369 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0450148fc0 0x7f04500b4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:14.494 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.489+0000 7f044ed9d700 1 -- 172.21.15.110:0/4176646369 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f045014a050 msgr2=0x7f04500b7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:14.494 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.489+0000 7f044ed9d700 1 --2- 172.21.15.110:0/4176646369 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f045014a050 0x7f04500b7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:14.494 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.489+0000 7f044ed9d700 1 -- 172.21.15.110:0/4176646369 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0450064290 con 0x7f04500b99b0 2021-03-25T14:17:14.494 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.489+0000 7f044f59e700 1 --2- 172.21.15.110:0/4176646369 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f045014a050 0x7f04500b7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:14.494 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.489+0000 7f044ed9d700 1 --2- 172.21.15.110:0/4176646369 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04500b99b0 0x7f0450159520 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f044400ebd0 tx=0x7f0444006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:14.494 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.489+0000 7f0436ffd700 1 -- 172.21.15.110:0/4176646369 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044400c9b0 con 0x7f04500b99b0 2021-03-25T14:17:14.494 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.489+0000 7f0436ffd700 1 -- 172.21.15.110:0/4176646369 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044400cb10 con 0x7f04500b99b0 2021-03-25T14:17:14.495 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.489+0000 7f0455026700 1 -- 172.21.15.110:0/4176646369 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f045014d280 con 0x7f04500b99b0 2021-03-25T14:17:14.495 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.489+0000 7f0436ffd700 1 -- 172.21.15.110:0/4176646369 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044400ce90 con 0x7f04500b99b0 2021-03-25T14:17:14.495 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.489+0000 7f0455026700 1 -- 172.21.15.110:0/4176646369 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04500b6db0 con 0x7f04500b99b0 2021-03-25T14:17:14.495 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.490+0000 7f0455026700 1 -- 172.21.15.110:0/4176646369 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f045005d7b0 con 0x7f04500b99b0 2021-03-25T14:17:14.495 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.490+0000 7f0436ffd700 1 -- 172.21.15.110:0/4176646369 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f0444012600 con 0x7f04500b99b0 2021-03-25T14:17:14.495 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.490+0000 7f0436ffd700 1 --2- 172.21.15.110:0/4176646369 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f043005a0e0 0x7f043005c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:14.495 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.491+0000 7f0436ffd700 1 -- 172.21.15.110:0/4176646369 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 7250+0+0 (secure 0 0 0) 0x7f04440746c0 con 0x7f04500b99b0 2021-03-25T14:17:14.495 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.491+0000 7f044e59c700 1 --2- 172.21.15.110:0/4176646369 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f043005a0e0 0x7f043005c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:14.495 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.491+0000 7f044e59c700 1 --2- 172.21.15.110:0/4176646369 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f043005a0e0 0x7f043005c5a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f0440007fd0 tx=0x7f0440007c50).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:14.495 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.494+0000 7f0436ffd700 1 -- 172.21.15.110:0/4176646369 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f0444047ab0 con 0x7f04500b99b0 2021-03-25T14:17:14.645 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.644+0000 7f0455026700 1 -- 172.21.15.110:0/4176646369 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0450064420 con 0x7f04500b99b0 2021-03-25T14:17:14.646 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.645+0000 7f0436ffd700 1 -- 172.21.15.110:0/4176646369 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+20277 (secure 0 0 0) 0x7f044404b0d0 con 0x7f04500b99b0 2021-03-25T14:17:14.647 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:14.647 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":41,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:17:14.349737+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2021-03-25T14:17:02.835058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2021-03-25T14:17:03.303869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":8,"pool_name":"cephfs2_metadata","create_time":"2021-03-25T14:17:12.037785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}}},{"pool":9,"pool_name":"cephfs2_data","create_time":"2021-03-25T14:17:13.333853+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs2"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:17:14.648 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.647+0000 7f0455026700 1 -- 172.21.15.110:0/4176646369 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f043005a0e0 msgr2=0x7f043005c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:14.648 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.647+0000 7f0455026700 1 --2- 172.21.15.110:0/4176646369 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f043005a0e0 0x7f043005c5a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f0440007fd0 tx=0x7f0440007c50).stop 2021-03-25T14:17:14.649 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.647+0000 7f0455026700 1 -- 172.21.15.110:0/4176646369 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04500b99b0 msgr2=0x7f0450159520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:14.649 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.647+0000 7f0455026700 1 --2- 172.21.15.110:0/4176646369 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04500b99b0 0x7f0450159520 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f044400ebd0 tx=0x7f0444006dc0).stop 2021-03-25T14:17:14.649 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.647+0000 7f0455026700 1 -- 172.21.15.110:0/4176646369 shutdown_connections 2021-03-25T14:17:14.649 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.647+0000 7f0455026700 1 --2- 172.21.15.110:0/4176646369 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f043005a0e0 0x7f043005c5a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:14.649 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.647+0000 7f0455026700 1 --2- 172.21.15.110:0/4176646369 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f045014a050 0x7f04500b7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:14.649 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.647+0000 7f0455026700 1 --2- 172.21.15.110:0/4176646369 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04500b99b0 0x7f0450159520 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:14.649 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.647+0000 7f0455026700 1 --2- 172.21.15.110:0/4176646369 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0450148fc0 0x7f04500b4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:14.649 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.647+0000 7f0455026700 1 -- 172.21.15.110:0/4176646369 >> 172.21.15.110:0/4176646369 conn(0x7f0450060c40 msgr2=0x7f0450142f40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:14.649 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.647+0000 7f0455026700 1 -- 172.21.15.110:0/4176646369 shutdown_connections 2021-03-25T14:17:14.649 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.647+0000 7f0455026700 1 -- 172.21.15.110:0/4176646369 wait complete. 2021-03-25T14:17:14.660 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:17:14.770 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.769+0000 7f5d62af3700 1 Processor -- start 2021-03-25T14:17:14.770 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.769+0000 7f5d62af3700 1 -- start start 2021-03-25T14:17:14.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.770+0000 7f5d62af3700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5d5c0bcd90 0x7f5d5c14d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:14.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.770+0000 7f5d62af3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5d5c0b7620 0x7f5d5c148ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:14.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.770+0000 7f5d62af3700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d5c0b9140 con 0x7f5d5c0b1340 2021-03-25T14:17:14.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.770+0000 7f5d62af3700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d5c0692a0 con 0x7f5d5c0bcd90 2021-03-25T14:17:14.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.770+0000 7f5d62af3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5c0b93e0 con 0x7f5d5c0b7620 2021-03-25T14:17:14.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.770+0000 7f5d6088f700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5d5c0bcd90 0x7f5d5c14d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:14.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.770+0000 7f5d5bfff700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f5d5c0b1340 0x7f5d5c060c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:42484/0 (socket says 172.21.15.110:42484) 2021-03-25T14:17:14.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.770+0000 7f5d5bfff700 1 -- 172.21.15.110:0/2476282059 learned_addr learned my addr 172.21.15.110:0/2476282059 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:14.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.770+0000 7f5d6088f700 1 -- 172.21.15.110:0/2476282059 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5d5c0b7620 msgr2=0x7f5d5c148ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:14.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.770+0000 7f5d61090700 1 --2- 172.21.15.110:0/2476282059 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5d5c0b7620 0x7f5d5c148ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:14.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.770+0000 7f5d5b7fe700 1 -- 172.21.15.110:0/2476282059 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2791778354 0 0) 0x7f5d5c0b9140 con 0x7f5d5c0b1340 2021-03-25T14:17:14.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.770+0000 7f5d6088f700 1 --2- 172.21.15.110:0/2476282059 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5d5c0b7620 0x7f5d5c148ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:14.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.770+0000 7f5d6088f700 1 -- 172.21.15.110:0/2476282059 >> v1:172.21.15.110:6789/0 conn(0x7f5d5c0b1340 legacy=0x7f5d5c060c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:14.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.770+0000 7f5d6088f700 1 -- 172.21.15.110:0/2476282059 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d5c14cda0 con 0x7f5d5c0bcd90 2021-03-25T14:17:14.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.770+0000 7f5d6088f700 1 --2- 172.21.15.110:0/2476282059 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d5c0bcd90 0x7f5d5c14d780 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f5d5000b9c0 tx=0x7f5d50006e20).ready entity=mon.0 client_cookie=38352e5df61a3e20 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:14.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.771+0000 7f5d5b7fe700 1 -- 172.21.15.110:0/2476282059 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d500097e0 con 0x7f5d5c0bcd90 2021-03-25T14:17:14.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.771+0000 7f5d5b7fe700 1 -- 172.21.15.110:0/2476282059 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d50009940 con 0x7f5d5c0bcd90 2021-03-25T14:17:14.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.771+0000 7f5d5b7fe700 1 -- 172.21.15.110:0/2476282059 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d50009cc0 con 0x7f5d5c0bcd90 2021-03-25T14:17:14.775 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.771+0000 7f5d62af3700 1 -- 172.21.15.110:0/2476282059 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d5c0bcd90 msgr2=0x7f5d5c14d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:14.775 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.771+0000 7f5d62af3700 1 --2- 172.21.15.110:0/2476282059 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d5c0bcd90 0x7f5d5c14d780 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f5d5000b9c0 tx=0x7f5d50006e20).stop 2021-03-25T14:17:14.775 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.771+0000 7f5d62af3700 1 -- 172.21.15.110:0/2476282059 shutdown_connections 2021-03-25T14:17:14.775 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.771+0000 7f5d62af3700 1 --2- 172.21.15.110:0/2476282059 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d5c0bcd90 0x7f5d5c14d780 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:14.775 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.771+0000 7f5d62af3700 1 --2- 172.21.15.110:0/2476282059 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5d5c0b7620 0x7f5d5c148ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:14.775 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.771+0000 7f5d62af3700 1 -- 172.21.15.110:0/2476282059 >> 172.21.15.110:0/2476282059 conn(0x7f5d5c063720 msgr2=0x7f5d5c063b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:14.775 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.771+0000 7f5d62af3700 1 -- 172.21.15.110:0/2476282059 shutdown_connections 2021-03-25T14:17:14.775 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.771+0000 7f5d62af3700 1 -- 172.21.15.110:0/2476282059 wait complete. 2021-03-25T14:17:14.775 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.772+0000 7f5d62af3700 1 Processor -- start 2021-03-25T14:17:14.775 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.772+0000 7f5d62af3700 1 -- start start 2021-03-25T14:17:14.778 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.773+0000 7f5d62af3700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d5c0b1340 0x7f5d5c1448b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:14.778 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.773+0000 7f5d62af3700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d5c0b7620 0x7f5d5c15ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:14.778 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.773+0000 7f5d62af3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5d5c0bcd90 0x7f5d5c15cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:14.778 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.773+0000 7f5d62af3700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5c0b34b0 con 0x7f5d5c0b7620 2021-03-25T14:17:14.778 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.773+0000 7f5d62af3700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5c0b36a0 con 0x7f5d5c0b1340 2021-03-25T14:17:14.778 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.773+0000 7f5d62af3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5c138230 con 0x7f5d5c0bcd90 2021-03-25T14:17:14.779 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.773+0000 7f5d5bfff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d5c0b7620 0x7f5d5c15ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:14.779 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.773+0000 7f5d5bfff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d5c0b7620 0x7f5d5c15ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49558/0 (socket says 172.21.15.110:49558) 2021-03-25T14:17:14.779 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.773+0000 7f5d5bfff700 1 -- 172.21.15.110:0/1364166805 learned_addr learned my addr 172.21.15.110:0/1364166805 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:14.779 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.773+0000 7f5d6088f700 1 --2- 172.21.15.110:0/1364166805 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d5c0b1340 0x7f5d5c1448b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:14.779 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.773+0000 7f5d61090700 1 --2- 172.21.15.110:0/1364166805 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5d5c0bcd90 0x7f5d5c15cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:14.779 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.773+0000 7f5d5bfff700 1 -- 172.21.15.110:0/1364166805 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5d5c0bcd90 msgr2=0x7f5d5c15cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:14.779 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.773+0000 7f5d5bfff700 1 --2- 172.21.15.110:0/1364166805 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5d5c0bcd90 0x7f5d5c15cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:14.779 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.773+0000 7f5d5bfff700 1 -- 172.21.15.110:0/1364166805 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d5c0b1340 msgr2=0x7f5d5c1448b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:14.779 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.773+0000 7f5d5bfff700 1 --2- 172.21.15.110:0/1364166805 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d5c0b1340 0x7f5d5c1448b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:14.779 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.773+0000 7f5d5bfff700 1 -- 172.21.15.110:0/1364166805 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d5c0b4130 con 0x7f5d5c0b7620 2021-03-25T14:17:14.779 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.773+0000 7f5d6088f700 1 --2- 172.21.15.110:0/1364166805 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d5c0b1340 0x7f5d5c1448b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:14.780 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.773+0000 7f5d61090700 1 --2- 172.21.15.110:0/1364166805 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5d5c0bcd90 0x7f5d5c15cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:14.780 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.773+0000 7f5d5bfff700 1 --2- 172.21.15.110:0/1364166805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d5c0b7620 0x7f5d5c15ca20 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f5d4800c710 tx=0x7f5d48007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:14.780 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.774+0000 7f5d58ff9700 1 -- 172.21.15.110:0/1364166805 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d48007320 con 0x7f5d5c0b7620 2021-03-25T14:17:14.780 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.774+0000 7f5d58ff9700 1 -- 172.21.15.110:0/1364166805 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d48007480 con 0x7f5d5c0b7620 2021-03-25T14:17:14.780 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.774+0000 7f5d58ff9700 1 -- 172.21.15.110:0/1364166805 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d48005850 con 0x7f5d5c0b7620 2021-03-25T14:17:14.780 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.774+0000 7f5d62af3700 1 -- 172.21.15.110:0/1364166805 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d5c0b43d0 con 0x7f5d5c0b7620 2021-03-25T14:17:14.780 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.774+0000 7f5d62af3700 1 -- 172.21.15.110:0/1364166805 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d5c144da0 con 0x7f5d5c0b7620 2021-03-25T14:17:14.780 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.774+0000 7f5d62af3700 1 -- 172.21.15.110:0/1364166805 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d5c0b4560 con 0x7f5d5c0b7620 2021-03-25T14:17:14.780 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.775+0000 7f5d58ff9700 1 -- 172.21.15.110:0/1364166805 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f5d48010030 con 0x7f5d5c0b7620 2021-03-25T14:17:14.780 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.775+0000 7f5d58ff9700 1 --2- 172.21.15.110:0/1364166805 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5d3c05a0b0 0x7f5d3c05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:14.780 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.775+0000 7f5d58ff9700 1 -- 172.21.15.110:0/1364166805 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 7250+0+0 (secure 0 0 0) 0x7f5d48073fd0 con 0x7f5d5c0b7620 2021-03-25T14:17:14.780 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.775+0000 7f5d6088f700 1 --2- 172.21.15.110:0/1364166805 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5d3c05a0b0 0x7f5d3c05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:14.780 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.776+0000 7f5d6088f700 1 --2- 172.21.15.110:0/1364166805 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5d3c05a0b0 0x7f5d3c05c570 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f5d50007fd0 tx=0x7f5d50016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:14.781 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.779+0000 7f5d58ff9700 1 -- 172.21.15.110:0/1364166805 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f5d480473c0 con 0x7f5d5c0b7620 2021-03-25T14:17:14.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.930+0000 7f5d62af3700 1 -- 172.21.15.110:0/1364166805 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d5c05d7b0 con 0x7f5d5c0b7620 2021-03-25T14:17:14.931 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.931+0000 7f5d58ff9700 1 -- 172.21.15.110:0/1364166805 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+20277 (secure 0 0 0) 0x7f5d4804a9e0 con 0x7f5d5c0b7620 2021-03-25T14:17:14.932 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:14.932 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":41,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:17:14.349737+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2021-03-25T14:17:02.835058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2021-03-25T14:17:03.303869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":8,"pool_name":"cephfs2_metadata","create_time":"2021-03-25T14:17:12.037785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}}},{"pool":9,"pool_name":"cephfs2_data","create_time":"2021-03-25T14:17:13.333853+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs2"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:17:14.934 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.932+0000 7f5d62af3700 1 -- 172.21.15.110:0/1364166805 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5d3c05a0b0 msgr2=0x7f5d3c05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:14.934 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.932+0000 7f5d62af3700 1 --2- 172.21.15.110:0/1364166805 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5d3c05a0b0 0x7f5d3c05c570 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f5d50007fd0 tx=0x7f5d50016000).stop 2021-03-25T14:17:14.934 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.932+0000 7f5d62af3700 1 -- 172.21.15.110:0/1364166805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d5c0b7620 msgr2=0x7f5d5c15ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:14.934 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.932+0000 7f5d62af3700 1 --2- 172.21.15.110:0/1364166805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d5c0b7620 0x7f5d5c15ca20 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f5d4800c710 tx=0x7f5d48007a90).stop 2021-03-25T14:17:14.934 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.932+0000 7f5d62af3700 1 -- 172.21.15.110:0/1364166805 shutdown_connections 2021-03-25T14:17:14.934 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.932+0000 7f5d62af3700 1 --2- 172.21.15.110:0/1364166805 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5d3c05a0b0 0x7f5d3c05c570 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:14.934 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.932+0000 7f5d62af3700 1 --2- 172.21.15.110:0/1364166805 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d5c0b1340 0x7f5d5c1448b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:14.934 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.932+0000 7f5d62af3700 1 --2- 172.21.15.110:0/1364166805 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5d5c0bcd90 0x7f5d5c15cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:14.934 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.932+0000 7f5d62af3700 1 --2- 172.21.15.110:0/1364166805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d5c0b7620 0x7f5d5c15ca20 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:14.935 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.932+0000 7f5d62af3700 1 -- 172.21.15.110:0/1364166805 >> 172.21.15.110:0/1364166805 conn(0x7f5d5c063720 msgr2=0x7f5d5c147f40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:14.935 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.933+0000 7f5d62af3700 1 -- 172.21.15.110:0/1364166805 shutdown_connections 2021-03-25T14:17:14.935 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:14.933+0000 7f5d62af3700 1 -- 172.21.15.110:0/1364166805 wait complete. 2021-03-25T14:17:14.945 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2021-03-25T14:17:15.059 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.058+0000 7ff6b9bc6700 1 Processor -- start 2021-03-25T14:17:15.079 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.058+0000 7ff6b9bc6700 1 -- start start 2021-03-25T14:17:15.083 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.059+0000 7ff6b9bc6700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff6b4148e40 0x7ff6b41492b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:15.083 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.059+0000 7ff6b9bc6700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b414d9a0 con 0x7ff6b40bd650 2021-03-25T14:17:15.084 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.059+0000 7ff6b9bc6700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b414dc40 con 0x7ff6b414aeb0 2021-03-25T14:17:15.084 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.059+0000 7ff6b9bc6700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b40b3bd0 con 0x7ff6b4148e40 2021-03-25T14:17:15.084 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.059+0000 7ff6b3fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff6b4148e40 0x7ff6b41492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:15.084 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.059+0000 7ff6b37fe700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7ff6b40bd650 0x7ff6b414a310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:42498/0 (socket says 172.21.15.110:42498) 2021-03-25T14:17:15.084 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.059+0000 7ff6b37fe700 1 -- 172.21.15.110:0/3501396357 learned_addr learned my addr 172.21.15.110:0/3501396357 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:15.084 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.059+0000 7ff6b3fff700 1 --2- 172.21.15.110:0/3501396357 >> v2:172.21.15.110:3300/0 conn(0x7ff6b4148e40 0x7ff6b41492b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49566/0 (socket says 172.21.15.110:49566) 2021-03-25T14:17:15.084 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.060+0000 7ff6b3fff700 1 -- 172.21.15.110:0/3501396357 >> v1:172.21.15.174:6789/0 conn(0x7ff6b414aeb0 legacy=0x7ff6b414cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:15.084 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.060+0000 7ff6b3fff700 1 -- 172.21.15.110:0/3501396357 >> v1:172.21.15.110:6789/0 conn(0x7ff6b40bd650 legacy=0x7ff6b414a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:15.084 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.060+0000 7ff6b3fff700 1 -- 172.21.15.110:0/3501396357 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b4149bd0 con 0x7ff6b4148e40 2021-03-25T14:17:15.084 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.060+0000 7ff6b27fc700 1 -- 172.21.15.110:0/3501396357 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 903346843 0 0) 0x7ff6b414d9a0 con 0x7ff6b40bd650 2021-03-25T14:17:15.084 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.060+0000 7ff6b3fff700 1 --2- 172.21.15.110:0/3501396357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6b4148e40 0x7ff6b41492b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7ff6ac009cc0 tx=0x7ff6ac009220).ready entity=mon.0 client_cookie=bce441ece7ba2474 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:15.084 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.060+0000 7ff6b27fc700 1 -- 172.21.15.110:0/3501396357 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac00bbb0 con 0x7ff6b4148e40 2021-03-25T14:17:15.085 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.060+0000 7ff6b27fc700 1 -- 172.21.15.110:0/3501396357 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ac00bd10 con 0x7ff6b4148e40 2021-03-25T14:17:15.085 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.060+0000 7ff6b27fc700 1 -- 172.21.15.110:0/3501396357 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac011610 con 0x7ff6b4148e40 2021-03-25T14:17:15.085 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.060+0000 7ff6b9bc6700 1 -- 172.21.15.110:0/3501396357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6b4148e40 msgr2=0x7ff6b41492b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:15.085 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.060+0000 7ff6b9bc6700 1 --2- 172.21.15.110:0/3501396357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6b4148e40 0x7ff6b41492b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7ff6ac009cc0 tx=0x7ff6ac009220).stop 2021-03-25T14:17:15.085 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.060+0000 7ff6b9bc6700 1 -- 172.21.15.110:0/3501396357 shutdown_connections 2021-03-25T14:17:15.085 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.060+0000 7ff6b9bc6700 1 --2- 172.21.15.110:0/3501396357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6b4148e40 0x7ff6b41492b0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:15.085 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.060+0000 7ff6b9bc6700 1 -- 172.21.15.110:0/3501396357 >> 172.21.15.110:0/3501396357 conn(0x7ff6b40627e0 msgr2=0x7ff6b40bcd80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:15.085 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.061+0000 7ff6b9bc6700 1 -- 172.21.15.110:0/3501396357 shutdown_connections 2021-03-25T14:17:15.085 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.061+0000 7ff6b9bc6700 1 -- 172.21.15.110:0/3501396357 wait complete. 2021-03-25T14:17:15.085 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.062+0000 7ff6b9bc6700 1 Processor -- start 2021-03-25T14:17:15.085 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.062+0000 7ff6b9bc6700 1 -- start start 2021-03-25T14:17:15.085 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.062+0000 7ff6b9bc6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6b40bd650 0x7ff6b40a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:15.086 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.062+0000 7ff6b9bc6700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6b4148e40 0x7ff6b414c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:15.086 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.062+0000 7ff6b9bc6700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6b414aeb0 0x7ff6b4158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:15.086 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.062+0000 7ff6b9bc6700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b40a21d0 con 0x7ff6b4148e40 2021-03-25T14:17:15.086 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.062+0000 7ff6b9bc6700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b40a1f40 con 0x7ff6b414aeb0 2021-03-25T14:17:15.086 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.062+0000 7ff6b9bc6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b415c660 con 0x7ff6b40bd650 2021-03-25T14:17:15.086 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.062+0000 7ff6b2ffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6b4148e40 0x7ff6b414c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:15.086 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.063+0000 7ff6b2ffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6b4148e40 0x7ff6b414c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49570/0 (socket says 172.21.15.110:49570) 2021-03-25T14:17:15.086 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.063+0000 7ff6b2ffd700 1 -- 172.21.15.110:0/277928951 learned_addr learned my addr 172.21.15.110:0/277928951 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:15.086 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.063+0000 7ff6b3fff700 1 --2- 172.21.15.110:0/277928951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6b414aeb0 0x7ff6b4158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:15.086 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.063+0000 7ff6b37fe700 1 --2- 172.21.15.110:0/277928951 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6b40bd650 0x7ff6b40a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:15.086 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.063+0000 7ff6b2ffd700 1 -- 172.21.15.110:0/277928951 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6b40bd650 msgr2=0x7ff6b40a1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:15.086 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.063+0000 7ff6b2ffd700 1 --2- 172.21.15.110:0/277928951 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6b40bd650 0x7ff6b40a1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:15.087 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.063+0000 7ff6b2ffd700 1 -- 172.21.15.110:0/277928951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6b414aeb0 msgr2=0x7ff6b4158f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:15.087 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.063+0000 7ff6b2ffd700 1 --2- 172.21.15.110:0/277928951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6b414aeb0 0x7ff6b4158f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:15.087 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.063+0000 7ff6b2ffd700 1 -- 172.21.15.110:0/277928951 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b415c900 con 0x7ff6b4148e40 2021-03-25T14:17:15.087 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.063+0000 7ff6b37fe700 1 --2- 172.21.15.110:0/277928951 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6b40bd650 0x7ff6b40a1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:15.087 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.063+0000 7ff6b2ffd700 1 --2- 172.21.15.110:0/277928951 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6b4148e40 0x7ff6b414c810 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7ff6a80096e0 tx=0x7ff6a8006da0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:15.087 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.063+0000 7ff69b7fe700 1 -- 172.21.15.110:0/277928951 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a800d4a0 con 0x7ff6b4148e40 2021-03-25T14:17:15.087 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.063+0000 7ff69b7fe700 1 -- 172.21.15.110:0/277928951 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a800d620 con 0x7ff6b4148e40 2021-03-25T14:17:15.087 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.063+0000 7ff6b9bc6700 1 -- 172.21.15.110:0/277928951 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b415cba0 con 0x7ff6b4148e40 2021-03-25T14:17:15.087 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.063+0000 7ff69b7fe700 1 -- 172.21.15.110:0/277928951 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a800d9e0 con 0x7ff6b4148e40 2021-03-25T14:17:15.087 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.063+0000 7ff6b9bc6700 1 -- 172.21.15.110:0/277928951 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b409f840 con 0x7ff6b4148e40 2021-03-25T14:17:15.087 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.064+0000 7ff6b9bc6700 1 -- 172.21.15.110:0/277928951 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6b415d000 con 0x7ff6b4148e40 2021-03-25T14:17:15.087 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.064+0000 7ff69b7fe700 1 -- 172.21.15.110:0/277928951 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7ff6a800f070 con 0x7ff6b4148e40 2021-03-25T14:17:15.088 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.064+0000 7ff69b7fe700 1 --2- 172.21.15.110:0/277928951 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff69405a0b0 0x7ff69405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:15.088 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.065+0000 7ff69b7fe700 1 -- 172.21.15.110:0/277928951 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 7250+0+0 (secure 0 0 0) 0x7ff6a8073920 con 0x7ff6b4148e40 2021-03-25T14:17:15.088 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.065+0000 7ff6b37fe700 1 --2- 172.21.15.110:0/277928951 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff69405a0b0 0x7ff69405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:15.088 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.066+0000 7ff6b37fe700 1 --2- 172.21.15.110:0/277928951 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff69405a0b0 0x7ff69405c570 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7ff6a4001360 tx=0x7ff6a4009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:15.088 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.069+0000 7ff69b7fe700 1 -- 172.21.15.110:0/277928951 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7ff6a8046e20 con 0x7ff6b4148e40 2021-03-25T14:17:15.255 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.254+0000 7ff6b9bc6700 1 -- 172.21.15.110:0/277928951 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff6b414de20 con 0x7ff6b4148e40 2021-03-25T14:17:15.354 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.354+0000 7ff69b7fe700 1 -- 172.21.15.110:0/277928951 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v18) v1 ==== 119+0+0 (secure 0 0 0) 0x7ff6a804a440 con 0x7ff6b4148e40 2021-03-25T14:17:15.356 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.356+0000 7ff6b9bc6700 1 -- 172.21.15.110:0/277928951 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff69405a0b0 msgr2=0x7ff69405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:15.356 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.356+0000 7ff6b9bc6700 1 --2- 172.21.15.110:0/277928951 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff69405a0b0 0x7ff69405c570 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7ff6a4001360 tx=0x7ff6a4009040).stop 2021-03-25T14:17:15.356 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.356+0000 7ff6b9bc6700 1 -- 172.21.15.110:0/277928951 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6b4148e40 msgr2=0x7ff6b414c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:15.357 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.356+0000 7ff6b9bc6700 1 --2- 172.21.15.110:0/277928951 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6b4148e40 0x7ff6b414c810 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7ff6a80096e0 tx=0x7ff6a8006da0).stop 2021-03-25T14:17:15.357 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.356+0000 7ff6b9bc6700 1 -- 172.21.15.110:0/277928951 shutdown_connections 2021-03-25T14:17:15.357 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.356+0000 7ff6b9bc6700 1 --2- 172.21.15.110:0/277928951 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff69405a0b0 0x7ff69405c570 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:15.358 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.356+0000 7ff6b9bc6700 1 --2- 172.21.15.110:0/277928951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6b414aeb0 0x7ff6b4158f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:15.358 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.356+0000 7ff6b9bc6700 1 --2- 172.21.15.110:0/277928951 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6b40bd650 0x7ff6b40a1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:15.358 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.356+0000 7ff6b9bc6700 1 --2- 172.21.15.110:0/277928951 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6b4148e40 0x7ff6b414c810 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:15.358 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.356+0000 7ff6b9bc6700 1 -- 172.21.15.110:0/277928951 >> 172.21.15.110:0/277928951 conn(0x7ff6b40627e0 msgr2=0x7ff6b4064020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:15.358 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.357+0000 7ff6b9bc6700 1 -- 172.21.15.110:0/277928951 shutdown_connections 2021-03-25T14:17:15.358 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.357+0000 7ff6b9bc6700 1 -- 172.21.15.110:0/277928951 wait complete. 2021-03-25T14:17:15.369 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-03-25T14:17:15.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.479+0000 7fbcff59e700 1 Processor -- start 2021-03-25T14:17:15.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.479+0000 7fbcff59e700 1 -- start start 2021-03-25T14:17:15.483 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.480+0000 7fbcff59e700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbd000ba680 0x7fbd000baa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:15.483 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.480+0000 7fbcff59e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbd00148d00 0x7fbd00149150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:15.483 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.480+0000 7fbcff59e700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd000bbcd0 con 0x7fbd000b86d0 2021-03-25T14:17:15.483 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.480+0000 7fbcff59e700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd000bbf70 con 0x7fbd000ba680 2021-03-25T14:17:15.483 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.480+0000 7fbcff59e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd000bc210 con 0x7fbd00148d00 2021-03-25T14:17:15.483 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.480+0000 7fbcfe59c700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbd000ba680 0x7fbd000baa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:15.483 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.480+0000 7fbcfdd9b700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fbd000b86d0 0x7fbd000bcc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:42514/0 (socket says 172.21.15.110:42514) 2021-03-25T14:17:15.483 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.480+0000 7fbcfe59c700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbd000ba680 0x7fbd000baa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49576/0 (socket says 172.21.15.110:49576) 2021-03-25T14:17:15.483 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.480+0000 7fbcfdd9b700 1 -- 172.21.15.110:0/3868706552 learned_addr learned my addr 172.21.15.110:0/3868706552 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:15.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.480+0000 7fbcfed9d700 1 --2- 172.21.15.110:0/3868706552 >> v2:172.21.15.174:3300/0 conn(0x7fbd00148d00 0x7fbd00149150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:15.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.480+0000 7fbcfe59c700 1 -- 172.21.15.110:0/3868706552 >> v2:172.21.15.174:3300/0 conn(0x7fbd00148d00 msgr2=0x7fbd00149150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:15.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.480+0000 7fbcfe59c700 1 --2- 172.21.15.110:0/3868706552 >> v2:172.21.15.174:3300/0 conn(0x7fbd00148d00 0x7fbd00149150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:15.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.480+0000 7fbcfe59c700 1 -- 172.21.15.110:0/3868706552 >> v1:172.21.15.110:6789/0 conn(0x7fbd000b86d0 legacy=0x7fbd000bcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:15.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.480+0000 7fbcfe59c700 1 -- 172.21.15.110:0/3868706552 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd000bc4b0 con 0x7fbd000ba680 2021-03-25T14:17:15.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.480+0000 7fbcfd59a700 1 -- 172.21.15.110:0/3868706552 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1069471406 0 0) 0x7fbd000bbcd0 con 0x7fbd000b86d0 2021-03-25T14:17:15.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.480+0000 7fbcfed9d700 1 --2- 172.21.15.110:0/3868706552 >> v2:172.21.15.174:3300/0 conn(0x7fbd00148d00 0x7fbd00149150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:15.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.480+0000 7fbcfe59c700 1 --2- 172.21.15.110:0/3868706552 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd000ba680 0x7fbd000baa60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7fbd000b81e0 tx=0x7fbcf4006e20).ready entity=mon.0 client_cookie=503e7ab2aada2801 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:15.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.480+0000 7fbcfd59a700 1 -- 172.21.15.110:0/3868706552 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf4009870 con 0x7fbd000ba680 2021-03-25T14:17:15.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.480+0000 7fbcfd59a700 1 -- 172.21.15.110:0/3868706552 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf40099d0 con 0x7fbd000ba680 2021-03-25T14:17:15.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.480+0000 7fbcfd59a700 1 -- 172.21.15.110:0/3868706552 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf4009d50 con 0x7fbd000ba680 2021-03-25T14:17:15.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.481+0000 7fbcff59e700 1 -- 172.21.15.110:0/3868706552 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd000ba680 msgr2=0x7fbd000baa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:15.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.481+0000 7fbcff59e700 1 --2- 172.21.15.110:0/3868706552 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd000ba680 0x7fbd000baa60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7fbd000b81e0 tx=0x7fbcf4006e20).stop 2021-03-25T14:17:15.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.481+0000 7fbcff59e700 1 -- 172.21.15.110:0/3868706552 shutdown_connections 2021-03-25T14:17:15.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.481+0000 7fbcff59e700 1 --2- 172.21.15.110:0/3868706552 >> v2:172.21.15.174:3300/0 conn(0x7fbd00148d00 0x7fbd00149150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:15.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.481+0000 7fbcff59e700 1 --2- 172.21.15.110:0/3868706552 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd000ba680 0x7fbd000baa60 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:15.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.481+0000 7fbcff59e700 1 -- 172.21.15.110:0/3868706552 >> 172.21.15.110:0/3868706552 conn(0x7fbd00060c40 msgr2=0x7fbd00061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:15.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.481+0000 7fbcff59e700 1 -- 172.21.15.110:0/3868706552 shutdown_connections 2021-03-25T14:17:15.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.481+0000 7fbcff59e700 1 -- 172.21.15.110:0/3868706552 wait complete. 2021-03-25T14:17:15.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.482+0000 7fbcff59e700 1 Processor -- start 2021-03-25T14:17:15.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.482+0000 7fbcff59e700 1 -- start start 2021-03-25T14:17:15.489 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.483+0000 7fbcff59e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd000b86d0 0x7fbd00145aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:15.489 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.483+0000 7fbcff59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd000ba680 0x7fbd00063fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:15.489 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.483+0000 7fbcff59e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd00148d00 0x7fbd000644d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:15.489 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.483+0000 7fbcff59e700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0014bae0 con 0x7fbd000b86d0 2021-03-25T14:17:15.489 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.483+0000 7fbcff59e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd000b5f70 con 0x7fbd00148d00 2021-03-25T14:17:15.489 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.483+0000 7fbcff59e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd00159ea0 con 0x7fbd000ba680 2021-03-25T14:17:15.489 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.483+0000 7fbcfe59c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd000b86d0 0x7fbd00145aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:15.489 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.483+0000 7fbcfe59c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd000b86d0 0x7fbd00145aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49582/0 (socket says 172.21.15.110:49582) 2021-03-25T14:17:15.489 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.483+0000 7fbcfe59c700 1 -- 172.21.15.110:0/3510560673 learned_addr learned my addr 172.21.15.110:0/3510560673 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:15.489 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.483+0000 7fbcfed9d700 1 --2- 172.21.15.110:0/3510560673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd00148d00 0x7fbd000644d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:15.490 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.483+0000 7fbcfdd9b700 1 --2- 172.21.15.110:0/3510560673 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd000ba680 0x7fbd00063fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:15.490 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.483+0000 7fbcfe59c700 1 -- 172.21.15.110:0/3510560673 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd000ba680 msgr2=0x7fbd00063fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:15.490 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.483+0000 7fbcfe59c700 1 --2- 172.21.15.110:0/3510560673 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd000ba680 0x7fbd00063fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:15.490 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.483+0000 7fbcfe59c700 1 -- 172.21.15.110:0/3510560673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd00148d00 msgr2=0x7fbd000644d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:15.490 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.483+0000 7fbcfe59c700 1 --2- 172.21.15.110:0/3510560673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd00148d00 0x7fbd000644d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:15.490 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.483+0000 7fbcfe59c700 1 -- 172.21.15.110:0/3510560673 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0015a140 con 0x7fbd000b86d0 2021-03-25T14:17:15.490 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.483+0000 7fbcfed9d700 1 --2- 172.21.15.110:0/3510560673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd00148d00 0x7fbd000644d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:17:15.490 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.483+0000 7fbcfdd9b700 1 --2- 172.21.15.110:0/3510560673 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd000ba680 0x7fbd00063fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:17:15.490 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.483+0000 7fbcfe59c700 1 --2- 172.21.15.110:0/3510560673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd000b86d0 0x7fbd00145aa0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7fbd0005d4a0 tx=0x7fbcf4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:15.490 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.483+0000 7fbcee7fc700 1 -- 172.21.15.110:0/3510560673 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf4011e70 con 0x7fbd000b86d0 2021-03-25T14:17:15.490 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.483+0000 7fbcee7fc700 1 -- 172.21.15.110:0/3510560673 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf401d430 con 0x7fbd000b86d0 2021-03-25T14:17:15.490 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.483+0000 7fbcee7fc700 1 -- 172.21.15.110:0/3510560673 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf401d7d0 con 0x7fbd000b86d0 2021-03-25T14:17:15.491 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.483+0000 7fbcff59e700 1 -- 172.21.15.110:0/3510560673 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd000b61a0 con 0x7fbd000b86d0 2021-03-25T14:17:15.491 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.483+0000 7fbcff59e700 1 -- 172.21.15.110:0/3510560673 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd0014b760 con 0x7fbd000b86d0 2021-03-25T14:17:15.491 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.484+0000 7fbcff59e700 1 -- 172.21.15.110:0/3510560673 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd000a10b0 con 0x7fbd000b86d0 2021-03-25T14:17:15.491 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.485+0000 7fbcee7fc700 1 -- 172.21.15.110:0/3510560673 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fbcf400f070 con 0x7fbd000b86d0 2021-03-25T14:17:15.491 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.485+0000 7fbcee7fc700 1 --2- 172.21.15.110:0/3510560673 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fbcdc05a0b0 0x7fbcdc05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:15.491 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.485+0000 7fbcee7fc700 1 -- 172.21.15.110:0/3510560673 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 7250+0+0 (secure 0 0 0) 0x7fbcf4075c10 con 0x7fbd000b86d0 2021-03-25T14:17:15.491 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.485+0000 7fbcfdd9b700 1 --2- 172.21.15.110:0/3510560673 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fbcdc05a0b0 0x7fbcdc05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:15.491 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.485+0000 7fbcfdd9b700 1 --2- 172.21.15.110:0/3510560673 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fbcdc05a0b0 0x7fbcdc05c570 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fbd000a3590 tx=0x7fbcf0009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:15.491 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.489+0000 7fbcee7fc700 1 -- 172.21.15.110:0/3510560673 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fbcf4049110 con 0x7fbd000b86d0 2021-03-25T14:17:15.675 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.674+0000 7fbcff59e700 1 -- 172.21.15.110:0/3510560673 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd00061840 con 0x7fbd000b86d0 2021-03-25T14:17:15.676 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.675+0000 7fbcee7fc700 1 -- 172.21.15.110:0/3510560673 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3775 (secure 0 0 0) 0x7fbcf404c730 con 0x7fbd000b86d0 2021-03-25T14:17:15.676 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:15.676 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4804,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6834/4176268149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4176268149},{"type":"v1","addr":"172.21.15.174:6834","nonce":4176268149}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":12},{"gid":4807,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/1554277551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6833","nonce":1554277551},{"type":"v1","addr":"172.21.15.174:6835","nonce":1554277551}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":13}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-03-25T14:17:04.328765+0000","modified":"2021-03-25T14:17:05.329972+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6837/503424314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":503424314},{"type":"v1","addr":"172.21.15.110:6837","nonce":503424314}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-03-25T14:17:14.349898+0000","modified":"2021-03-25T14:17:15.351276+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5025},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5025":{"gid":5025,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.110:6836/2267546898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2267546898},{"type":"v1","addr":"172.21.15.110:6836","nonce":2267546898}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs2","balancer":"","standby_count_wanted":0},"id":3}]} 2021-03-25T14:17:15.677 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.676+0000 7fbcff59e700 1 -- 172.21.15.110:0/3510560673 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fbcdc05a0b0 msgr2=0x7fbcdc05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:15.678 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.676+0000 7fbcff59e700 1 --2- 172.21.15.110:0/3510560673 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fbcdc05a0b0 0x7fbcdc05c570 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fbd000a3590 tx=0x7fbcf0009040).stop 2021-03-25T14:17:15.678 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.676+0000 7fbcff59e700 1 -- 172.21.15.110:0/3510560673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd000b86d0 msgr2=0x7fbd00145aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:15.678 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.676+0000 7fbcff59e700 1 --2- 172.21.15.110:0/3510560673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd000b86d0 0x7fbd00145aa0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7fbd0005d4a0 tx=0x7fbcf4016000).stop 2021-03-25T14:17:15.678 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.676+0000 7fbcff59e700 1 -- 172.21.15.110:0/3510560673 shutdown_connections 2021-03-25T14:17:15.678 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.676+0000 7fbcff59e700 1 --2- 172.21.15.110:0/3510560673 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fbcdc05a0b0 0x7fbcdc05c570 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:15.678 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.676+0000 7fbcff59e700 1 --2- 172.21.15.110:0/3510560673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd00148d00 0x7fbd000644d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:15.678 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.676+0000 7fbcff59e700 1 --2- 172.21.15.110:0/3510560673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd000b86d0 0x7fbd00145aa0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:15.678 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.676+0000 7fbcff59e700 1 --2- 172.21.15.110:0/3510560673 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd000ba680 0x7fbd00063fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:15.678 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.676+0000 7fbcff59e700 1 -- 172.21.15.110:0/3510560673 >> 172.21.15.110:0/3510560673 conn(0x7fbd00060c40 msgr2=0x7fbd000bdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:15.678 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.676+0000 7fbcff59e700 1 -- 172.21.15.110:0/3510560673 shutdown_connections 2021-03-25T14:17:15.679 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.676+0000 7fbcff59e700 1 -- 172.21.15.110:0/3510560673 wait complete. 2021-03-25T14:17:15.679 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 18 2021-03-25T14:17:15.689 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:17:15.798 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.798+0000 7ff10ac9e700 1 Processor -- start 2021-03-25T14:17:15.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.798+0000 7ff10ac9e700 1 -- start start 2021-03-25T14:17:15.801 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.798+0000 7ff10ac9e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff1040672a0 0x7ff104068d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:15.801 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.798+0000 7ff10ac9e700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff1040c09d0 0x7ff10414ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:15.801 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.799+0000 7ff10ac9e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1040b75b0 con 0x7ff10414d360 2021-03-25T14:17:15.801 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.799+0000 7ff10ac9e700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff104068820 con 0x7ff1040c09d0 2021-03-25T14:17:15.801 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.799+0000 7ff10ac9e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff104069210 con 0x7ff1040672a0 2021-03-25T14:17:15.802 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.799+0000 7ff10949b700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff1040c09d0 0x7ff10414ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:15.802 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.799+0000 7ff10949b700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff1040c09d0 0x7ff10414ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49594/0 (socket says 172.21.15.110:49594) 2021-03-25T14:17:15.802 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.799+0000 7ff10949b700 1 -- 172.21.15.110:0/3231132471 learned_addr learned my addr 172.21.15.110:0/3231132471 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:15.802 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.799+0000 7ff109c9c700 1 --2- 172.21.15.110:0/3231132471 >> v2:172.21.15.174:3300/0 conn(0x7ff1040672a0 0x7ff104068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:15.802 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.799+0000 7ff10949b700 1 -- 172.21.15.110:0/3231132471 >> v2:172.21.15.174:3300/0 conn(0x7ff1040672a0 msgr2=0x7ff104068d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:15.802 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.799+0000 7ff10949b700 1 --2- 172.21.15.110:0/3231132471 >> v2:172.21.15.174:3300/0 conn(0x7ff1040672a0 0x7ff104068d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:15.802 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.799+0000 7ff10949b700 1 -- 172.21.15.110:0/3231132471 >> v1:172.21.15.174:6789/0 conn(0x7ff10414d360 legacy=0x7ff104148a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:15.802 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.799+0000 7ff10949b700 1 -- 172.21.15.110:0/3231132471 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff104069430 con 0x7ff1040c09d0 2021-03-25T14:17:15.802 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.799+0000 7ff10949b700 1 --2- 172.21.15.110:0/3231132471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1040c09d0 0x7ff10414ce70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7ff1040644d0 tx=0x7ff0f4006ee0).ready entity=mon.0 client_cookie=38b4af3cd9e8a2c server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:15.802 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.799+0000 7ff108c9a700 1 -- 172.21.15.110:0/3231132471 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f4009890 con 0x7ff1040c09d0 2021-03-25T14:17:15.802 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.799+0000 7ff108c9a700 1 -- 172.21.15.110:0/3231132471 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f40099f0 con 0x7ff1040c09d0 2021-03-25T14:17:15.802 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.799+0000 7ff108c9a700 1 -- 172.21.15.110:0/3231132471 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f4009d70 con 0x7ff1040c09d0 2021-03-25T14:17:15.803 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.800+0000 7ff10ac9e700 1 -- 172.21.15.110:0/3231132471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1040c09d0 msgr2=0x7ff10414ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:15.803 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.800+0000 7ff10ac9e700 1 --2- 172.21.15.110:0/3231132471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1040c09d0 0x7ff10414ce70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7ff1040644d0 tx=0x7ff0f4006ee0).stop 2021-03-25T14:17:15.803 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.800+0000 7ff10ac9e700 1 -- 172.21.15.110:0/3231132471 shutdown_connections 2021-03-25T14:17:15.803 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.800+0000 7ff10ac9e700 1 --2- 172.21.15.110:0/3231132471 >> v2:172.21.15.174:3300/0 conn(0x7ff1040672a0 0x7ff104068d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:15.803 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.800+0000 7ff10ac9e700 1 --2- 172.21.15.110:0/3231132471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1040c09d0 0x7ff10414ce70 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:15.803 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.800+0000 7ff10ac9e700 1 -- 172.21.15.110:0/3231132471 >> 172.21.15.110:0/3231132471 conn(0x7ff1040633a0 msgr2=0x7ff1040663e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:15.803 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.800+0000 7ff10ac9e700 1 -- 172.21.15.110:0/3231132471 shutdown_connections 2021-03-25T14:17:15.803 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.800+0000 7ff10ac9e700 1 -- 172.21.15.110:0/3231132471 wait complete. 2021-03-25T14:17:15.806 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.801+0000 7ff10ac9e700 1 Processor -- start 2021-03-25T14:17:15.806 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.801+0000 7ff10ac9e700 1 -- start start 2021-03-25T14:17:15.806 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.801+0000 7ff10ac9e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff1040672a0 0x7ff10414a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:15.806 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.801+0000 7ff10ac9e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1040c09d0 0x7ff1040b1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:15.806 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.801+0000 7ff10ac9e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff10414d360 0x7ff10415c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:15.806 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.801+0000 7ff10ac9e700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1040b5750 con 0x7ff10414d360 2021-03-25T14:17:15.806 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.801+0000 7ff10ac9e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff104158dd0 con 0x7ff1040672a0 2021-03-25T14:17:15.806 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.801+0000 7ff10ac9e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff104159070 con 0x7ff1040c09d0 2021-03-25T14:17:15.807 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.802+0000 7ff10a49d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff10414d360 0x7ff10415c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:15.807 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.802+0000 7ff10a49d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff10414d360 0x7ff10415c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49600/0 (socket says 172.21.15.110:49600) 2021-03-25T14:17:15.807 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.802+0000 7ff10a49d700 1 -- 172.21.15.110:0/1198414682 learned_addr learned my addr 172.21.15.110:0/1198414682 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:15.807 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.802+0000 7ff109c9c700 1 --2- 172.21.15.110:0/1198414682 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff1040672a0 0x7ff10414a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:15.807 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.802+0000 7ff10949b700 1 --2- 172.21.15.110:0/1198414682 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1040c09d0 0x7ff1040b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:15.807 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.802+0000 7ff10a49d700 1 -- 172.21.15.110:0/1198414682 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1040c09d0 msgr2=0x7ff1040b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:15.807 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.802+0000 7ff10a49d700 1 --2- 172.21.15.110:0/1198414682 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1040c09d0 0x7ff1040b1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:15.807 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.802+0000 7ff10a49d700 1 -- 172.21.15.110:0/1198414682 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff1040672a0 msgr2=0x7ff10414a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:15.807 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.802+0000 7ff10a49d700 1 --2- 172.21.15.110:0/1198414682 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff1040672a0 0x7ff10414a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:15.807 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.802+0000 7ff10a49d700 1 -- 172.21.15.110:0/1198414682 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff104159310 con 0x7ff10414d360 2021-03-25T14:17:15.807 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.802+0000 7ff10a49d700 1 --2- 172.21.15.110:0/1198414682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff10414d360 0x7ff10415c1c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7ff0fc00ca60 tx=0x7ff0fc0013a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:15.807 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.802+0000 7ff0f1ffb700 1 -- 172.21.15.110:0/1198414682 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc00a590 con 0x7ff10414d360 2021-03-25T14:17:15.807 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.802+0000 7ff0f1ffb700 1 -- 172.21.15.110:0/1198414682 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0fc00a6f0 con 0x7ff10414d360 2021-03-25T14:17:15.808 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.802+0000 7ff10ac9e700 1 -- 172.21.15.110:0/1198414682 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1041595b0 con 0x7ff10414d360 2021-03-25T14:17:15.808 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.802+0000 7ff0f1ffb700 1 -- 172.21.15.110:0/1198414682 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc00aa90 con 0x7ff10414d360 2021-03-25T14:17:15.808 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.803+0000 7ff10ac9e700 1 -- 172.21.15.110:0/1198414682 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1041598a0 con 0x7ff10414d360 2021-03-25T14:17:15.808 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.803+0000 7ff10ac9e700 1 -- 172.21.15.110:0/1198414682 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1040b3910 con 0x7ff10414d360 2021-03-25T14:17:15.808 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.804+0000 7ff0f1ffb700 1 -- 172.21.15.110:0/1198414682 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7ff0fc019030 con 0x7ff10414d360 2021-03-25T14:17:15.808 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.804+0000 7ff0f1ffb700 1 --2- 172.21.15.110:0/1198414682 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff0e405a0b0 0x7ff0e405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:15.808 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.804+0000 7ff0f1ffb700 1 -- 172.21.15.110:0/1198414682 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 7250+0+0 (secure 0 0 0) 0x7ff0fc0739f0 con 0x7ff10414d360 2021-03-25T14:17:15.808 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.804+0000 7ff109c9c700 1 --2- 172.21.15.110:0/1198414682 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff0e405a0b0 0x7ff0e405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:15.808 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.804+0000 7ff109c9c700 1 --2- 172.21.15.110:0/1198414682 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff0e405a0b0 0x7ff0e405c570 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7ff10000bb90 tx=0x7ff100006e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:15.809 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.808+0000 7ff0f1ffb700 1 -- 172.21.15.110:0/1198414682 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7ff0fc075e60 con 0x7ff10414d360 2021-03-25T14:17:15.956 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.956+0000 7ff10ac9e700 1 -- 172.21.15.110:0/1198414682 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff10415c030 con 0x7ff10414d360 2021-03-25T14:17:15.957 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.956+0000 7ff0f1ffb700 1 -- 172.21.15.110:0/1198414682 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+20264 (secure 0 0 0) 0x7ff0fc046ef0 con 0x7ff10414d360 2021-03-25T14:17:15.958 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:15.958 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":42,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:17:15.351754+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2021-03-25T14:17:02.835058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2021-03-25T14:17:03.303869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":8,"pool_name":"cephfs2_metadata","create_time":"2021-03-25T14:17:12.037785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}}},{"pool":9,"pool_name":"cephfs2_data","create_time":"2021-03-25T14:17:13.333853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs2"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:17:15.959 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.958+0000 7ff10ac9e700 1 -- 172.21.15.110:0/1198414682 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff0e405a0b0 msgr2=0x7ff0e405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:15.960 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.958+0000 7ff10ac9e700 1 --2- 172.21.15.110:0/1198414682 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff0e405a0b0 0x7ff0e405c570 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7ff10000bb90 tx=0x7ff100006e20).stop 2021-03-25T14:17:15.960 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.958+0000 7ff10ac9e700 1 -- 172.21.15.110:0/1198414682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff10414d360 msgr2=0x7ff10415c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:15.960 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.958+0000 7ff10ac9e700 1 --2- 172.21.15.110:0/1198414682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff10414d360 0x7ff10415c1c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7ff0fc00ca60 tx=0x7ff0fc0013a0).stop 2021-03-25T14:17:15.960 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.958+0000 7ff10ac9e700 1 -- 172.21.15.110:0/1198414682 shutdown_connections 2021-03-25T14:17:15.960 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.958+0000 7ff10ac9e700 1 --2- 172.21.15.110:0/1198414682 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff0e405a0b0 0x7ff0e405c570 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:15.960 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.958+0000 7ff10ac9e700 1 --2- 172.21.15.110:0/1198414682 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff1040672a0 0x7ff10414a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:15.960 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.958+0000 7ff10ac9e700 1 --2- 172.21.15.110:0/1198414682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff10414d360 0x7ff10415c1c0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:15.960 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.958+0000 7ff10ac9e700 1 --2- 172.21.15.110:0/1198414682 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1040c09d0 0x7ff1040b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:15.960 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.958+0000 7ff10ac9e700 1 -- 172.21.15.110:0/1198414682 >> 172.21.15.110:0/1198414682 conn(0x7ff1040633a0 msgr2=0x7ff104148ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:15.960 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.958+0000 7ff10ac9e700 1 -- 172.21.15.110:0/1198414682 shutdown_connections 2021-03-25T14:17:15.960 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:15.958+0000 7ff10ac9e700 1 -- 172.21.15.110:0/1198414682 wait complete. 2021-03-25T14:17:15.971 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2021-03-25T14:17:16.089 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.088+0000 7f6171ba2700 1 Processor -- start 2021-03-25T14:17:16.089 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.088+0000 7f6171ba2700 1 -- start start 2021-03-25T14:17:16.091 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.088+0000 7f6171ba2700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f616c0671d0 0x7f616c0bcef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:16.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.088+0000 7f6171ba2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f616c14a140 0x7f616c131ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:16.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.089+0000 7f6171ba2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f616c068b60 con 0x7f616c0bcb10 2021-03-25T14:17:16.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.089+0000 7f6171ba2700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f616c14a550 con 0x7f616c0671d0 2021-03-25T14:17:16.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.089+0000 7f6171ba2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f616c0a2ad0 con 0x7f616c14a140 2021-03-25T14:17:16.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.089+0000 7f616bfff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f616c0671d0 0x7f616c0bcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:16.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.089+0000 7f616bfff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f616c0671d0 0x7f616c0bcef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49606/0 (socket says 172.21.15.110:49606) 2021-03-25T14:17:16.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.089+0000 7f616bfff700 1 -- 172.21.15.110:0/3416774223 learned_addr learned my addr 172.21.15.110:0/3416774223 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:16.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.089+0000 7f61713a1700 1 --2- 172.21.15.110:0/3416774223 >> v2:172.21.15.174:3300/0 conn(0x7f616c14a140 0x7f616c131ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:16.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.089+0000 7f616bfff700 1 -- 172.21.15.110:0/3416774223 >> v2:172.21.15.174:3300/0 conn(0x7f616c14a140 msgr2=0x7f616c131ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:16.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.089+0000 7f616bfff700 1 --2- 172.21.15.110:0/3416774223 >> v2:172.21.15.174:3300/0 conn(0x7f616c14a140 0x7f616c131ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:16.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.089+0000 7f616bfff700 1 -- 172.21.15.110:0/3416774223 >> v1:172.21.15.174:6789/0 conn(0x7f616c0bcb10 legacy=0x7f616c1317c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:16.093 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.089+0000 7f616bfff700 1 -- 172.21.15.110:0/3416774223 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616c0bd4f0 con 0x7f616c0671d0 2021-03-25T14:17:16.093 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.089+0000 7f61713a1700 1 --2- 172.21.15.110:0/3416774223 >> v2:172.21.15.174:3300/0 conn(0x7f616c14a140 0x7f616c131ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:16.093 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.089+0000 7f616bfff700 1 --2- 172.21.15.110:0/3416774223 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f616c0671d0 0x7f616c0bcef0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f616c067660 tx=0x7f6158006e80).ready entity=mon.0 client_cookie=76695fa52669180c server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:16.093 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.089+0000 7f616b7fe700 1 -- 172.21.15.110:0/3416774223 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6158006030 con 0x7f616c0671d0 2021-03-25T14:17:16.093 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.089+0000 7f616b7fe700 1 -- 172.21.15.110:0/3416774223 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6158006190 con 0x7f616c0671d0 2021-03-25T14:17:16.093 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.089+0000 7f616b7fe700 1 -- 172.21.15.110:0/3416774223 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6158006510 con 0x7f616c0671d0 2021-03-25T14:17:16.093 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.090+0000 7f6171ba2700 1 -- 172.21.15.110:0/3416774223 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f616c0671d0 msgr2=0x7f616c0bcef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:16.093 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.090+0000 7f6171ba2700 1 --2- 172.21.15.110:0/3416774223 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f616c0671d0 0x7f616c0bcef0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f616c067660 tx=0x7f6158006e80).stop 2021-03-25T14:17:16.093 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.090+0000 7f6171ba2700 1 -- 172.21.15.110:0/3416774223 shutdown_connections 2021-03-25T14:17:16.093 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.090+0000 7f6171ba2700 1 --2- 172.21.15.110:0/3416774223 >> v2:172.21.15.174:3300/0 conn(0x7f616c14a140 0x7f616c131ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:16.093 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.090+0000 7f6171ba2700 1 --2- 172.21.15.110:0/3416774223 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f616c0671d0 0x7f616c0bcef0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:16.093 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.090+0000 7f6171ba2700 1 -- 172.21.15.110:0/3416774223 >> 172.21.15.110:0/3416774223 conn(0x7f616c064860 msgr2=0x7f616c0664d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:16.093 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.090+0000 7f6171ba2700 1 -- 172.21.15.110:0/3416774223 shutdown_connections 2021-03-25T14:17:16.094 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.090+0000 7f6171ba2700 1 -- 172.21.15.110:0/3416774223 wait complete. 2021-03-25T14:17:16.094 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.091+0000 7f6171ba2700 1 Processor -- start 2021-03-25T14:17:16.094 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.091+0000 7f6171ba2700 1 -- start start 2021-03-25T14:17:16.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.092+0000 7f6171ba2700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f616c0671d0 0x7f616c0a3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:16.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.092+0000 7f6171ba2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f616c0bcb10 0x7f616c0a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:16.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.092+0000 7f6171ba2700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f616c14a140 0x7f616c0b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:16.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.092+0000 7f6171ba2700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616c0bf400 con 0x7f616c14a140 2021-03-25T14:17:16.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.092+0000 7f6171ba2700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616c0ba100 con 0x7f616c0671d0 2021-03-25T14:17:16.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.092+0000 7f6171ba2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f616c15d020 con 0x7f616c0bcb10 2021-03-25T14:17:16.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.092+0000 7f61713a1700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f616c14a140 0x7f616c0b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:16.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.092+0000 7f61713a1700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f616c14a140 0x7f616c0b8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49614/0 (socket says 172.21.15.110:49614) 2021-03-25T14:17:16.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.092+0000 7f61713a1700 1 -- 172.21.15.110:0/2943734815 learned_addr learned my addr 172.21.15.110:0/2943734815 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:16.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.092+0000 7f6170ba0700 1 --2- 172.21.15.110:0/2943734815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f616c0671d0 0x7f616c0a3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:16.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.092+0000 7f616bfff700 1 --2- 172.21.15.110:0/2943734815 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f616c0bcb10 0x7f616c0a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:16.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.092+0000 7f61713a1700 1 -- 172.21.15.110:0/2943734815 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f616c0bcb10 msgr2=0x7f616c0a3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:16.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.092+0000 7f61713a1700 1 --2- 172.21.15.110:0/2943734815 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f616c0bcb10 0x7f616c0a3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:16.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.092+0000 7f61713a1700 1 -- 172.21.15.110:0/2943734815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f616c0671d0 msgr2=0x7f616c0a3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:16.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.092+0000 7f61713a1700 1 --2- 172.21.15.110:0/2943734815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f616c0671d0 0x7f616c0a3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:16.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.092+0000 7f61713a1700 1 -- 172.21.15.110:0/2943734815 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616c0b9bc0 con 0x7f616c14a140 2021-03-25T14:17:16.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.092+0000 7f6170ba0700 1 --2- 172.21.15.110:0/2943734815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f616c0671d0 0x7f616c0a3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:16.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.092+0000 7f61713a1700 1 --2- 172.21.15.110:0/2943734815 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f616c14a140 0x7f616c0b8af0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f616400ec90 tx=0x7f6164008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:16.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.092+0000 7f6168ff9700 1 -- 172.21.15.110:0/2943734815 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616400ee40 con 0x7f616c14a140 2021-03-25T14:17:16.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.092+0000 7f6171ba2700 1 -- 172.21.15.110:0/2943734815 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f616c0b9e60 con 0x7f616c14a140 2021-03-25T14:17:16.099 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.092+0000 7f6168ff9700 1 -- 172.21.15.110:0/2943734815 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f616400c970 con 0x7f616c14a140 2021-03-25T14:17:16.099 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.092+0000 7f6168ff9700 1 -- 172.21.15.110:0/2943734815 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616400cd10 con 0x7f616c14a140 2021-03-25T14:17:16.099 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.092+0000 7f6171ba2700 1 -- 172.21.15.110:0/2943734815 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f616c0a57f0 con 0x7f616c14a140 2021-03-25T14:17:16.099 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.093+0000 7f6171ba2700 1 -- 172.21.15.110:0/2943734815 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f616c045ae0 con 0x7f616c14a140 2021-03-25T14:17:16.099 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.093+0000 7f6168ff9700 1 -- 172.21.15.110:0/2943734815 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f6164013640 con 0x7f616c14a140 2021-03-25T14:17:16.099 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.094+0000 7f6168ff9700 1 --2- 172.21.15.110:0/2943734815 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f614c05a0e0 0x7f614c05c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:16.099 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.094+0000 7f6168ff9700 1 -- 172.21.15.110:0/2943734815 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 7250+0+0 (secure 0 0 0) 0x7f61640745a0 con 0x7f616c14a140 2021-03-25T14:17:16.099 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.094+0000 7f6170ba0700 1 --2- 172.21.15.110:0/2943734815 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f614c05a0e0 0x7f614c05c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:16.099 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.094+0000 7f6170ba0700 1 --2- 172.21.15.110:0/2943734815 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f614c05a0e0 0x7f614c05c5a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f6160001610 tx=0x7f6160009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:16.099 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.098+0000 7f6168ff9700 1 -- 172.21.15.110:0/2943734815 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f6164047a40 con 0x7f616c14a140 2021-03-25T14:17:16.303 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.302+0000 7f6171ba2700 1 -- 172.21.15.110:0/2943734815 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7f616c0ba2e0 con 0x7f616c14a140 2021-03-25T14:17:16.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.306+0000 7f6168ff9700 1 -- 172.21.15.110:0/2943734815 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v10) v1 ==== 185+0+0 (secure 0 0 0) 0x7f616404b060 con 0x7f616c14a140 2021-03-25T14:17:16.309 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.307+0000 7f6171ba2700 1 -- 172.21.15.110:0/2943734815 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f614c05a0e0 msgr2=0x7f614c05c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:16.309 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.307+0000 7f6171ba2700 1 --2- 172.21.15.110:0/2943734815 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f614c05a0e0 0x7f614c05c5a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f6160001610 tx=0x7f6160009040).stop 2021-03-25T14:17:16.309 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.307+0000 7f6171ba2700 1 -- 172.21.15.110:0/2943734815 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f616c14a140 msgr2=0x7f616c0b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:16.309 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.307+0000 7f6171ba2700 1 --2- 172.21.15.110:0/2943734815 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f616c14a140 0x7f616c0b8af0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f616400ec90 tx=0x7f6164008040).stop 2021-03-25T14:17:16.309 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.308+0000 7f6171ba2700 1 -- 172.21.15.110:0/2943734815 shutdown_connections 2021-03-25T14:17:16.309 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.308+0000 7f6171ba2700 1 --2- 172.21.15.110:0/2943734815 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f614c05a0e0 0x7f614c05c5a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:16.310 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.308+0000 7f6171ba2700 1 --2- 172.21.15.110:0/2943734815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f616c0671d0 0x7f616c0a3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:16.310 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.308+0000 7f6171ba2700 1 --2- 172.21.15.110:0/2943734815 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f616c14a140 0x7f616c0b8af0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:16.310 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.308+0000 7f6171ba2700 1 --2- 172.21.15.110:0/2943734815 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f616c0bcb10 0x7f616c0a3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:16.310 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.308+0000 7f6171ba2700 1 -- 172.21.15.110:0/2943734815 >> 172.21.15.110:0/2943734815 conn(0x7f616c064860 msgr2=0x7f616c148a00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:16.310 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.308+0000 7f6171ba2700 1 -- 172.21.15.110:0/2943734815 shutdown_connections 2021-03-25T14:17:16.310 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:16.308+0000 7f6171ba2700 1 -- 172.21.15.110:0/2943734815 wait complete. 2021-03-25T14:17:16.310 INFO:teuthology.orchestra.run.smithi110.stderr:updated caps for client.1 2021-03-25T14:17:16.320 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2021-03-25T14:17:16.320 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-03-25T14:17:16.320 DEBUG:teuthology.orchestra.run.smithi174:> sudo umount /home/ubuntu/cephtest/mnt.1 2021-03-25T14:17:16.364 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi174.front.sepia.ceph.com 2021-03-25T14:17:16.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:16.365 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-03-25T14:17:16.381 DEBUG:teuthology.orchestra.run.smithi174:> ceph fs ls 2021-03-25T14:17:16.525 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.523+0000 7fa2d65a8700 1 Processor -- start 2021-03-25T14:17:16.525 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.523+0000 7fa2d65a8700 1 -- start start 2021-03-25T14:17:16.528 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.524+0000 7fa2d65a8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2d00a02c0 0x7fa2d00b9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:16.528 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.524+0000 7fa2d65a8700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa2d014d720 0x7fa2d0065970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:16.528 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.524+0000 7fa2d65a8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa2d00b7120 0x7fa2d00ba7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:16.528 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.524+0000 7fa2d65a8700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d0147220 con 0x7fa2d014d720 2021-03-25T14:17:16.528 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.524+0000 7fa2d65a8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d0065e60 con 0x7fa2d00b7120 2021-03-25T14:17:16.528 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.524+0000 7fa2d65a8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d00660f0 con 0x7fa2d00a02c0 2021-03-25T14:17:16.528 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.524+0000 7fa2d4b45700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa2d00b7120 0x7fa2d00ba7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:16.528 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.524+0000 7fa2cffff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2d00a02c0 0x7fa2d00b9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:16.528 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.524+0000 7fa2d4b45700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa2d00b7120 0x7fa2d00ba7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:47150/0 (socket says 172.21.15.174:47150) 2021-03-25T14:17:16.528 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.524+0000 7fa2d4b45700 1 -- 172.21.15.174:0/2783079126 learned_addr learned my addr 172.21.15.174:0/2783079126 (peer_addr_for_me v2:172.21.15.174:0/0) 2021-03-25T14:17:16.528 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.524+0000 7fa2cf7fe700 1 --2- 172.21.15.174:0/2783079126 >> v2:172.21.15.110:3300/0 conn(0x7fa2d014d720 0x7fa2d0065970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:16.528 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.525+0000 7fa2d4b45700 1 -- 172.21.15.174:0/2783079126 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2d00a02c0 msgr2=0x7fa2d00b9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:16.529 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.525+0000 7fa2d4b45700 1 --2- 172.21.15.174:0/2783079126 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2d00a02c0 0x7fa2d00b9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:16.529 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.525+0000 7fa2d4b45700 1 -- 172.21.15.174:0/2783079126 >> v2:172.21.15.110:3300/0 conn(0x7fa2d014d720 msgr2=0x7fa2d0065970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:16.529 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.525+0000 7fa2d4b45700 1 --2- 172.21.15.174:0/2783079126 >> v2:172.21.15.110:3300/0 conn(0x7fa2d014d720 0x7fa2d0065970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:16.529 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.525+0000 7fa2d4b45700 1 -- 172.21.15.174:0/2783079126 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d0066390 con 0x7fa2d00b7120 2021-03-25T14:17:16.529 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.525+0000 7fa2cffff700 1 --2- 172.21.15.174:0/2783079126 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2d00a02c0 0x7fa2d00b9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:17:16.529 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.525+0000 7fa2d4b45700 1 --2- 172.21.15.174:0/2783079126 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2d00b7120 0x7fa2d00ba7e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fa2d00b9650 tx=0x7fa2c80092d0).ready entity=mon.1 client_cookie=9b993ef165843175 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:16.529 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.525+0000 7fa2ceffd700 1 -- 172.21.15.174:0/2783079126 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c800bc80 con 0x7fa2d00b7120 2021-03-25T14:17:16.529 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.525+0000 7fa2ceffd700 1 -- 172.21.15.174:0/2783079126 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c800bde0 con 0x7fa2d00b7120 2021-03-25T14:17:16.529 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.525+0000 7fa2ceffd700 1 -- 172.21.15.174:0/2783079126 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8011610 con 0x7fa2d00b7120 2021-03-25T14:17:16.529 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.525+0000 7fa2d65a8700 1 -- 172.21.15.174:0/2783079126 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2d00b7120 msgr2=0x7fa2d00ba7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:16.529 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.525+0000 7fa2d65a8700 1 --2- 172.21.15.174:0/2783079126 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2d00b7120 0x7fa2d00ba7e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fa2d00b9650 tx=0x7fa2c80092d0).stop 2021-03-25T14:17:16.529 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.525+0000 7fa2d65a8700 1 -- 172.21.15.174:0/2783079126 shutdown_connections 2021-03-25T14:17:16.529 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.525+0000 7fa2d65a8700 1 --2- 172.21.15.174:0/2783079126 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2d00b7120 0x7fa2d00ba7e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:16.530 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.525+0000 7fa2d65a8700 1 --2- 172.21.15.174:0/2783079126 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2d00a02c0 0x7fa2d00b9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:16.530 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.525+0000 7fa2d65a8700 1 --2- 172.21.15.174:0/2783079126 >> v2:172.21.15.110:3300/0 conn(0x7fa2d014d720 0x7fa2d0065970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:16.530 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.525+0000 7fa2d65a8700 1 -- 172.21.15.174:0/2783079126 >> 172.21.15.174:0/2783079126 conn(0x7fa2d0060de0 msgr2=0x7fa2d00611f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:16.530 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.525+0000 7fa2d65a8700 1 -- 172.21.15.174:0/2783079126 shutdown_connections 2021-03-25T14:17:16.530 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.525+0000 7fa2d65a8700 1 -- 172.21.15.174:0/2783079126 wait complete. 2021-03-25T14:17:16.530 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.526+0000 7fa2d65a8700 1 Processor -- start 2021-03-25T14:17:16.532 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.527+0000 7fa2d65a8700 1 -- start start 2021-03-25T14:17:16.533 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.527+0000 7fa2d65a8700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2d00a02c0 0x7fa2d00a1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:16.533 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.527+0000 7fa2d65a8700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2d00b7120 0x7fa2d00a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:16.533 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.527+0000 7fa2d65a8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2d014d720 0x7fa2d015c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:16.533 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.527+0000 7fa2d65a8700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d0148960 con 0x7fa2d00b7120 2021-03-25T14:17:16.533 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.527+0000 7fa2d65a8700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d0148c00 con 0x7fa2d00a02c0 2021-03-25T14:17:16.533 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.527+0000 7fa2d65a8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d0148ea0 con 0x7fa2d014d720 2021-03-25T14:17:16.533 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.527+0000 7fa2d4b45700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2d014d720 0x7fa2d015c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:16.533 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.527+0000 7fa2cffff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2d00a02c0 0x7fa2d00a1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:16.533 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.527+0000 7fa2d4b45700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2d014d720 0x7fa2d015c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:34810/0 (socket says 172.21.15.174:34810) 2021-03-25T14:17:16.533 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.527+0000 7fa2d4b45700 1 -- 172.21.15.174:0/2971780077 learned_addr learned my addr 172.21.15.174:0/2971780077 (peer_addr_for_me v2:172.21.15.174:0/0) 2021-03-25T14:17:16.533 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.527+0000 7fa2cffff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2d00a02c0 0x7fa2d00a1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:47158/0 (socket says 172.21.15.174:47158) 2021-03-25T14:17:16.534 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.528+0000 7fa2cf7fe700 1 --2- 172.21.15.174:0/2971780077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2d00b7120 0x7fa2d00a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:16.534 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.528+0000 7fa2cffff700 1 -- 172.21.15.174:0/2971780077 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2d014d720 msgr2=0x7fa2d015c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:16.534 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.528+0000 7fa2cffff700 1 --2- 172.21.15.174:0/2971780077 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2d014d720 0x7fa2d015c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:16.534 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.528+0000 7fa2cffff700 1 -- 172.21.15.174:0/2971780077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2d00b7120 msgr2=0x7fa2d00a3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:16.534 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.528+0000 7fa2cffff700 1 --2- 172.21.15.174:0/2971780077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2d00b7120 0x7fa2d00a3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:16.534 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.528+0000 7fa2cffff700 1 -- 172.21.15.174:0/2971780077 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d015c3e0 con 0x7fa2d00a02c0 2021-03-25T14:17:16.534 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.528+0000 7fa2d4b45700 1 --2- 172.21.15.174:0/2971780077 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2d014d720 0x7fa2d015c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:17:16.534 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.528+0000 7fa2cf7fe700 1 --2- 172.21.15.174:0/2971780077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2d00b7120 0x7fa2d00a3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:16.534 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.528+0000 7fa2cffff700 1 --2- 172.21.15.174:0/2971780077 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2d00a02c0 0x7fa2d00a1ad0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fa2c000eca0 tx=0x7fa2c0006e20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:16.534 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.528+0000 7fa2b7fff700 1 -- 172.21.15.174:0/2971780077 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c000ca30 con 0x7fa2d00a02c0 2021-03-25T14:17:16.534 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.528+0000 7fa2b7fff700 1 -- 172.21.15.174:0/2971780077 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c000cb90 con 0x7fa2d00a02c0 2021-03-25T14:17:16.534 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.528+0000 7fa2d65a8700 1 -- 172.21.15.174:0/2971780077 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d00a3a60 con 0x7fa2d00a02c0 2021-03-25T14:17:16.535 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.528+0000 7fa2b7fff700 1 -- 172.21.15.174:0/2971780077 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c00123f0 con 0x7fa2d00a02c0 2021-03-25T14:17:16.535 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.528+0000 7fa2d65a8700 1 -- 172.21.15.174:0/2971780077 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d00a0df0 con 0x7fa2d00a02c0 2021-03-25T14:17:16.535 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.529+0000 7fa2d65a8700 1 -- 172.21.15.174:0/2971780077 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d00a1040 con 0x7fa2d00a02c0 2021-03-25T14:17:16.535 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.529+0000 7fa2b7fff700 1 -- 172.21.15.174:0/2971780077 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fa2c00127a0 con 0x7fa2d00a02c0 2021-03-25T14:17:16.535 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.529+0000 7fa2b7fff700 1 --2- 172.21.15.174:0/2971780077 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa2b005a0b0 0x7fa2b005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:16.535 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.530+0000 7fa2b7fff700 1 -- 172.21.15.174:0/2971780077 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 7250+0+0 (secure 0 0 0) 0x7fa2c00746f0 con 0x7fa2d00a02c0 2021-03-25T14:17:16.535 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.530+0000 7fa2cf7fe700 1 --2- 172.21.15.174:0/2971780077 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa2b005a0b0 0x7fa2b005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:16.535 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.530+0000 7fa2cf7fe700 1 --2- 172.21.15.174:0/2971780077 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa2b005a0b0 0x7fa2b005c570 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fa2d00a1fc0 tx=0x7fa2c4008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:16.535 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.534+0000 7fa2b7fff700 1 -- 172.21.15.174:0/2971780077 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fa2c0047bf0 con 0x7fa2d00a02c0 2021-03-25T14:17:16.719 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.717+0000 7fa2d65a8700 1 -- 172.21.15.174:0/2971780077 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa2d0149060 con 0x7fa2d00a02c0 2021-03-25T14:17:16.719 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.717+0000 7fa2b7fff700 1 -- 172.21.15.174:0/2971780077 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+149 (secure 0 0 0) 0x7fa2c004b210 con 0x7fa2d00a02c0 2021-03-25T14:17:16.719 INFO:teuthology.orchestra.run.smithi174.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2021-03-25T14:17:16.719 INFO:teuthology.orchestra.run.smithi174.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2021-03-25T14:17:16.721 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.719+0000 7fa2d65a8700 1 -- 172.21.15.174:0/2971780077 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa2b005a0b0 msgr2=0x7fa2b005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:16.721 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.719+0000 7fa2d65a8700 1 --2- 172.21.15.174:0/2971780077 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa2b005a0b0 0x7fa2b005c570 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fa2d00a1fc0 tx=0x7fa2c4008040).stop 2021-03-25T14:17:16.721 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.719+0000 7fa2d65a8700 1 -- 172.21.15.174:0/2971780077 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2d00a02c0 msgr2=0x7fa2d00a1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:16.721 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.719+0000 7fa2d65a8700 1 --2- 172.21.15.174:0/2971780077 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2d00a02c0 0x7fa2d00a1ad0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fa2c000eca0 tx=0x7fa2c0006e20).stop 2021-03-25T14:17:16.721 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.719+0000 7fa2d65a8700 1 -- 172.21.15.174:0/2971780077 shutdown_connections 2021-03-25T14:17:16.721 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.719+0000 7fa2d65a8700 1 --2- 172.21.15.174:0/2971780077 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa2b005a0b0 0x7fa2b005c570 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:16.721 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.719+0000 7fa2d65a8700 1 --2- 172.21.15.174:0/2971780077 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2d00a02c0 0x7fa2d00a1ad0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:16.721 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.719+0000 7fa2d65a8700 1 --2- 172.21.15.174:0/2971780077 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2d014d720 0x7fa2d015c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:16.721 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.719+0000 7fa2d65a8700 1 --2- 172.21.15.174:0/2971780077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2d00b7120 0x7fa2d00a3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:16.722 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.719+0000 7fa2d65a8700 1 -- 172.21.15.174:0/2971780077 >> 172.21.15.174:0/2971780077 conn(0x7fa2d0060de0 msgr2=0x7fa2d00b8680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:16.722 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.719+0000 7fa2d65a8700 1 -- 172.21.15.174:0/2971780077 shutdown_connections 2021-03-25T14:17:16.722 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:16.719+0000 7fa2d65a8700 1 -- 172.21.15.174:0/2971780077 wait complete. 2021-03-25T14:17:16.731 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2021-03-25T14:17:16.731 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2021-03-25T14:17:16.731 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi174.front.sepia.ceph.com 2021-03-25T14:17:16.731 INFO:tasks.cephfs.mount:self.client.name = client.1 2021-03-25T14:17:16.731 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2021-03-25T14:17:16.731 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2021-03-25T14:17:16.731 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2021-03-25T14:17:16.731 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2021-03-25T14:17:16.731 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2021-03-25T14:17:16.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:16.732 DEBUG:teuthology.orchestra.run.smithi174:> ip addr 2021-03-25T14:17:16.746 INFO:teuthology.orchestra.run.smithi174.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2021-03-25T14:17:16.746 INFO:teuthology.orchestra.run.smithi174.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2021-03-25T14:17:16.746 INFO:teuthology.orchestra.run.smithi174.stdout: inet 127.0.0.1/8 scope host lo 2021-03-25T14:17:16.746 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:16.746 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 ::1/128 scope host 2021-03-25T14:17:16.746 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:16.747 INFO:teuthology.orchestra.run.smithi174.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-03-25T14:17:16.747 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:d9:36:e0 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:17:16.747 INFO:teuthology.orchestra.run.smithi174.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-03-25T14:17:16.747 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:d9:36:e1 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:17:16.747 INFO:teuthology.orchestra.run.smithi174.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-03-25T14:17:16.747 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:88:77:1a brd ff:ff:ff:ff:ff:ff 2021-03-25T14:17:16.747 INFO:teuthology.orchestra.run.smithi174.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2021-03-25T14:17:16.747 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:88:77:1b brd ff:ff:ff:ff:ff:ff 2021-03-25T14:17:16.747 INFO:teuthology.orchestra.run.smithi174.stdout: inet 172.21.15.174/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2021-03-25T14:17:16.747 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft 42565sec preferred_lft 42565sec 2021-03-25T14:17:16.747 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::ec4:7aff:fe88:771b/64 scope link 2021-03-25T14:17:16.747 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:16.748 INFO:teuthology.orchestra.run.smithi174.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2021-03-25T14:17:16.748 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 32:28:39:9e:9c:fe brd ff:ff:ff:ff:ff:ff 2021-03-25T14:17:16.748 INFO:teuthology.orchestra.run.smithi174.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2021-03-25T14:17:16.748 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:16.748 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::2843:d3ff:fe04:eed1/64 scope link 2021-03-25T14:17:16.748 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:16.748 INFO:teuthology.orchestra.run.smithi174.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2021-03-25T14:17:16.748 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 32:28:39:9e:9c:fe brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2021-03-25T14:17:16.748 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::3028:39ff:fe9e:9cfe/64 scope link 2021-03-25T14:17:16.748 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:16.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:16.749 DEBUG:teuthology.orchestra.run.smithi174:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2021-03-25T14:17:16.809 INFO:teuthology.orchestra.run.smithi174.stdout:1 2021-03-25T14:17:16.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:16.810 DEBUG:teuthology.orchestra.run.smithi174:> route 2021-03-25T14:17:16.867 INFO:teuthology.orchestra.run.smithi174.stdout:Kernel IP routing table 2021-03-25T14:17:16.867 INFO:teuthology.orchestra.run.smithi174.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2021-03-25T14:17:16.867 INFO:teuthology.orchestra.run.smithi174.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2021-03-25T14:17:16.867 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2021-03-25T14:17:16.867 INFO:teuthology.orchestra.run.smithi174.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2021-03-25T14:17:16.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:16.868 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec sudo bash -c ' 2021-03-25T14:17:16.868 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2021-03-25T14:17:16.868 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2021-03-25T14:17:16.868 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2021-03-25T14:17:16.868 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2021-03-25T14:17:16.868 DEBUG:teuthology.orchestra.run.smithi174:> ') 2021-03-25T14:17:16.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:16.963 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list 2021-03-25T14:17:16.977 INFO:teuthology.orchestra.run.smithi174.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2021-03-25T14:17:16.978 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2021-03-25T14:17:16.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:16.978 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set brx.0 up 2021-03-25T14:17:17.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:17.041 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p /home/ubuntu/cephtest/mnt.1 2021-03-25T14:17:17.095 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-03-25T14:17:17.095 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs2,norbytes 2021-03-25T14:17:17.173 INFO:teuthology.orchestra.run.smithi174.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs2,norbytes 2021-03-25T14:17:17.173 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs2,norbytes" will pass to kernel. 2021-03-25T14:17:17.221 INFO:teuthology.orchestra.run.smithi174.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs2,norbytes 2021-03-25T14:17:17.221 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs2,norbytes" will pass to kernel. 2021-03-25T14:17:17.223 INFO:tasks.cephfs.kernel_mount:mount command passed 2021-03-25T14:17:17.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:17.223 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2021-03-25T14:17:17.288 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs authorize cephfs client.testuser / rw 2021-03-25T14:17:17.406 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.405+0000 7efe8e59f700 1 Processor -- start 2021-03-25T14:17:17.406 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.405+0000 7efe8e59f700 1 -- start start 2021-03-25T14:17:17.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.406+0000 7efe8e59f700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efe880bd490 0x7efe8814d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:17.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.406+0000 7efe8e59f700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe88068830 con 0x7efe88068ac0 2021-03-25T14:17:17.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.406+0000 7efe8e59f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe880b2e60 con 0x7efe88149390 2021-03-25T14:17:17.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.406+0000 7efe8e59f700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe8814dbf0 con 0x7efe880bd490 2021-03-25T14:17:17.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.406+0000 7efe87fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efe880bd490 0x7efe8814d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:17.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.406+0000 7efe87fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efe880bd490 0x7efe8814d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49618/0 (socket says 172.21.15.110:49618) 2021-03-25T14:17:17.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.406+0000 7efe87fff700 1 -- 172.21.15.110:0/4128166674 learned_addr learned my addr 172.21.15.110:0/4128166674 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:17.410 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.406+0000 7efe877fe700 1 --1- 172.21.15.110:0/4128166674 >> v1:172.21.15.110:6789/0 conn(0x7efe88068ac0 0x7efe88148c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:42556/0 (socket says 172.21.15.110:42556) 2021-03-25T14:17:17.410 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.406+0000 7efe87fff700 1 -- 172.21.15.110:0/4128166674 >> v1:172.21.15.174:6789/0 conn(0x7efe88149390 legacy=0x7efe881498b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:17.410 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.406+0000 7efe86ffd700 1 -- 172.21.15.110:0/4128166674 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2621644311 0 0) 0x7efe88068830 con 0x7efe88068ac0 2021-03-25T14:17:17.410 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.406+0000 7efe87fff700 1 -- 172.21.15.110:0/4128166674 >> v1:172.21.15.110:6789/0 conn(0x7efe88068ac0 legacy=0x7efe88148c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:17.410 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.406+0000 7efe87fff700 1 -- 172.21.15.110:0/4128166674 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe880b3100 con 0x7efe880bd490 2021-03-25T14:17:17.410 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.407+0000 7efe87fff700 1 --2- 172.21.15.110:0/4128166674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe880bd490 0x7efe8814d700 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7efe80009d90 tx=0x7efe800092d0).ready entity=mon.0 client_cookie=3e603caf46e01c83 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:17.410 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.407+0000 7efe86ffd700 1 -- 172.21.15.110:0/4128166674 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8000bc80 con 0x7efe880bd490 2021-03-25T14:17:17.410 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.407+0000 7efe86ffd700 1 -- 172.21.15.110:0/4128166674 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8000bde0 con 0x7efe880bd490 2021-03-25T14:17:17.410 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.407+0000 7efe86ffd700 1 -- 172.21.15.110:0/4128166674 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe80011610 con 0x7efe880bd490 2021-03-25T14:17:17.410 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.407+0000 7efe8e59f700 1 -- 172.21.15.110:0/4128166674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe880bd490 msgr2=0x7efe8814d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:17.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.407+0000 7efe8e59f700 1 --2- 172.21.15.110:0/4128166674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe880bd490 0x7efe8814d700 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7efe80009d90 tx=0x7efe800092d0).stop 2021-03-25T14:17:17.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.407+0000 7efe8e59f700 1 -- 172.21.15.110:0/4128166674 shutdown_connections 2021-03-25T14:17:17.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.407+0000 7efe8e59f700 1 --2- 172.21.15.110:0/4128166674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe880bd490 0x7efe8814d700 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:17.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.407+0000 7efe8e59f700 1 -- 172.21.15.110:0/4128166674 >> 172.21.15.110:0/4128166674 conn(0x7efe88062820 msgr2=0x7efe880bcbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:17.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.407+0000 7efe8e59f700 1 -- 172.21.15.110:0/4128166674 shutdown_connections 2021-03-25T14:17:17.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.407+0000 7efe8e59f700 1 -- 172.21.15.110:0/4128166674 wait complete. 2021-03-25T14:17:17.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.408+0000 7efe8e59f700 1 Processor -- start 2021-03-25T14:17:17.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.408+0000 7efe8e59f700 1 -- start start 2021-03-25T14:17:17.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.409+0000 7efe8e59f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe88068ac0 0x7efe8814c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:17.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.409+0000 7efe8e59f700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe880bd490 0x7efe88146e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:17.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.409+0000 7efe8e59f700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe88149390 0x7efe88147320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:17.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.409+0000 7efe8e59f700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe880a2390 con 0x7efe880bd490 2021-03-25T14:17:17.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.409+0000 7efe8e59f700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe88159e40 con 0x7efe88149390 2021-03-25T14:17:17.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.409+0000 7efe8e59f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe88093ff0 con 0x7efe88068ac0 2021-03-25T14:17:17.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.409+0000 7efe877fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe880bd490 0x7efe88146e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:17.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.409+0000 7efe877fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe880bd490 0x7efe88146e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49624/0 (socket says 172.21.15.110:49624) 2021-03-25T14:17:17.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.409+0000 7efe877fe700 1 -- 172.21.15.110:0/3255054213 learned_addr learned my addr 172.21.15.110:0/3255054213 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:17.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.409+0000 7efe87fff700 1 --2- 172.21.15.110:0/3255054213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe88068ac0 0x7efe8814c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:17.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.409+0000 7efe8cb3c700 1 --2- 172.21.15.110:0/3255054213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe88149390 0x7efe88147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:17.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.410+0000 7efe877fe700 1 -- 172.21.15.110:0/3255054213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe88068ac0 msgr2=0x7efe8814c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:17.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.410+0000 7efe877fe700 1 --2- 172.21.15.110:0/3255054213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe88068ac0 0x7efe8814c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:17.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.410+0000 7efe877fe700 1 -- 172.21.15.110:0/3255054213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe88149390 msgr2=0x7efe88147320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:17.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.410+0000 7efe877fe700 1 --2- 172.21.15.110:0/3255054213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe88149390 0x7efe88147320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:17.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.410+0000 7efe877fe700 1 -- 172.21.15.110:0/3255054213 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe88094290 con 0x7efe880bd490 2021-03-25T14:17:17.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.410+0000 7efe877fe700 1 --2- 172.21.15.110:0/3255054213 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe880bd490 0x7efe88146e30 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7efe7c00c760 tx=0x7efe7c007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:17.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.410+0000 7efe6ffff700 1 -- 172.21.15.110:0/3255054213 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c0072e0 con 0x7efe880bd490 2021-03-25T14:17:17.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.410+0000 7efe6ffff700 1 -- 172.21.15.110:0/3255054213 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7c005560 con 0x7efe880bd490 2021-03-25T14:17:17.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.410+0000 7efe8e59f700 1 -- 172.21.15.110:0/3255054213 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe88094530 con 0x7efe880bd490 2021-03-25T14:17:17.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.410+0000 7efe6ffff700 1 -- 172.21.15.110:0/3255054213 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c005920 con 0x7efe880bd490 2021-03-25T14:17:17.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.410+0000 7efe8e59f700 1 -- 172.21.15.110:0/3255054213 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe88159b30 con 0x7efe880bd490 2021-03-25T14:17:17.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.411+0000 7efe8e59f700 1 -- 172.21.15.110:0/3255054213 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe880946c0 con 0x7efe880bd490 2021-03-25T14:17:17.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.411+0000 7efe6ffff700 1 -- 172.21.15.110:0/3255054213 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7efe7c010070 con 0x7efe880bd490 2021-03-25T14:17:17.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.411+0000 7efe6ffff700 1 --2- 172.21.15.110:0/3255054213 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7efe6805a0b0 0x7efe6805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:17.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.411+0000 7efe6ffff700 1 -- 172.21.15.110:0/3255054213 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 7250+0+0 (secure 0 0 0) 0x7efe7c073730 con 0x7efe880bd490 2021-03-25T14:17:17.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.412+0000 7efe87fff700 1 --2- 172.21.15.110:0/3255054213 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7efe6805a0b0 0x7efe6805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:17.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.412+0000 7efe87fff700 1 --2- 172.21.15.110:0/3255054213 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7efe6805a0b0 0x7efe6805c570 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7efe80009d90 tx=0x7efe80017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:17.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.415+0000 7efe6ffff700 1 -- 172.21.15.110:0/3255054213 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7efe7c046c30 con 0x7efe880bd490 2021-03-25T14:17:17.600 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.599+0000 7efe8e59f700 1 -- 172.21.15.110:0/3255054213 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]} v 0) v1 -- 0x7efe8805d7b0 con 0x7efe880bd490 2021-03-25T14:17:17.603 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.603+0000 7efe6ffff700 1 -- 172.21.15.110:0/3255054213 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]}]=0 v11) v1 ==== 134+0+66 (secure 0 0 0) 0x7efe7c018060 con 0x7efe880bd490 2021-03-25T14:17:17.603 INFO:teuthology.orchestra.run.smithi110.stdout:[client.testuser] 2021-03-25T14:17:17.604 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBtm1xg3jLMIxAARztP29wq9FGk2DzuV2j/qw== 2021-03-25T14:17:17.605 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.604+0000 7efe8e59f700 1 -- 172.21.15.110:0/3255054213 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7efe6805a0b0 msgr2=0x7efe6805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:17.606 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.604+0000 7efe8e59f700 1 --2- 172.21.15.110:0/3255054213 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7efe6805a0b0 0x7efe6805c570 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7efe80009d90 tx=0x7efe80017000).stop 2021-03-25T14:17:17.606 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.604+0000 7efe8e59f700 1 -- 172.21.15.110:0/3255054213 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe880bd490 msgr2=0x7efe88146e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:17.606 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.604+0000 7efe8e59f700 1 --2- 172.21.15.110:0/3255054213 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe880bd490 0x7efe88146e30 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7efe7c00c760 tx=0x7efe7c007a90).stop 2021-03-25T14:17:17.606 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.604+0000 7efe8e59f700 1 -- 172.21.15.110:0/3255054213 shutdown_connections 2021-03-25T14:17:17.606 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.604+0000 7efe8e59f700 1 --2- 172.21.15.110:0/3255054213 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7efe6805a0b0 0x7efe6805c570 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:17.606 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.604+0000 7efe8e59f700 1 --2- 172.21.15.110:0/3255054213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe88149390 0x7efe88147320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:17.606 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.604+0000 7efe8e59f700 1 --2- 172.21.15.110:0/3255054213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe88068ac0 0x7efe8814c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:17.606 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.604+0000 7efe8e59f700 1 --2- 172.21.15.110:0/3255054213 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe880bd490 0x7efe88146e30 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:17.606 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.604+0000 7efe8e59f700 1 -- 172.21.15.110:0/3255054213 >> 172.21.15.110:0/3255054213 conn(0x7efe88062820 msgr2=0x7efe8814a120 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:17.606 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.605+0000 7efe8e59f700 1 -- 172.21.15.110:0/3255054213 shutdown_connections 2021-03-25T14:17:17.606 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:17.605+0000 7efe8e59f700 1 -- 172.21.15.110:0/3255054213 wait complete. 2021-03-25T14:17:17.617 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2021-03-25T14:17:17.631 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.vBJRljgkL9 2021-03-25T14:17:17.631 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2021-03-25T14:17:17.631 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/tmp/tmp.vBJRljgkL9 2021-03-25T14:17:17.715 DEBUG:teuthology.orchestra.run.smithi110:> chmod 644 /tmp/tmp.vBJRljgkL9 2021-03-25T14:17:17.769 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2021-03-25T14:17:17.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-03-25T14:17:17.770 DEBUG:teuthology.orchestra.run.smithi110:> sudo umount /home/ubuntu/cephtest/mnt.0 2021-03-25T14:17:17.844 INFO:tasks.ceph.mds.c.smithi110.stderr:2021-03-25T14:17:17.844+0000 7fd093376700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2021-03-25T14:17:17.845 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi110.front.sepia.ceph.com 2021-03-25T14:17:17.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:17.845 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-03-25T14:17:17.900 DEBUG:teuthology.orchestra.run.smithi110:> ceph fs ls 2021-03-25T14:17:18.040 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.039+0000 7f63741da700 1 Processor -- start 2021-03-25T14:17:18.040 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.039+0000 7f63741da700 1 -- start start 2021-03-25T14:17:18.043 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.040+0000 7f63741da700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f636c0bcda0 0x7f636c1498b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:18.043 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.040+0000 7f63741da700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f636c1433c0 0x7f636c1437f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:18.043 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.040+0000 7f63741da700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f636c0611e0 con 0x7f636c068da0 2021-03-25T14:17:18.043 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.040+0000 7f63741da700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f636c149da0 con 0x7f636c0bcda0 2021-03-25T14:17:18.043 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.040+0000 7f63741da700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f636c061410 con 0x7f636c1433c0 2021-03-25T14:17:18.043 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.040+0000 7f6371f76700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f636c0bcda0 0x7f636c1498b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:18.043 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.040+0000 7f6371f76700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f636c0bcda0 0x7f636c1498b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49630/0 (socket says 172.21.15.110:49630) 2021-03-25T14:17:18.044 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.040+0000 7f6371f76700 1 -- 172.21.15.110:0/1544291733 learned_addr learned my addr 172.21.15.110:0/1544291733 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:18.044 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.040+0000 7f6371f76700 1 -- 172.21.15.110:0/1544291733 >> v2:172.21.15.174:3300/0 conn(0x7f636c1433c0 msgr2=0x7f636c1437f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:18.044 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.040+0000 7f6372777700 1 --2- 172.21.15.110:0/1544291733 >> v2:172.21.15.174:3300/0 conn(0x7f636c1433c0 0x7f636c1437f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:18.044 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.040+0000 7f6371f76700 1 --2- 172.21.15.110:0/1544291733 >> v2:172.21.15.174:3300/0 conn(0x7f636c1433c0 0x7f636c1437f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:18.044 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.040+0000 7f6371f76700 1 -- 172.21.15.110:0/1544291733 >> v1:172.21.15.174:6789/0 conn(0x7f636c068da0 legacy=0x7f636c0643b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:18.044 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.040+0000 7f6371f76700 1 -- 172.21.15.110:0/1544291733 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f636c0616b0 con 0x7f636c0bcda0 2021-03-25T14:17:18.044 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.040+0000 7f6372777700 1 --2- 172.21.15.110:0/1544291733 >> v2:172.21.15.174:3300/0 conn(0x7f636c1433c0 0x7f636c1437f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:17:18.044 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.041+0000 7f6371f76700 1 --2- 172.21.15.110:0/1544291733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f636c0bcda0 0x7f636c1498b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f636c147500 tx=0x7f6368006ee0).ready entity=mon.0 client_cookie=dd4062d767344c3b server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:18.044 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.041+0000 7f6370f74700 1 -- 172.21.15.110:0/1544291733 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6368009800 con 0x7f636c0bcda0 2021-03-25T14:17:18.044 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.041+0000 7f6370f74700 1 -- 172.21.15.110:0/1544291733 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6368009960 con 0x7f636c0bcda0 2021-03-25T14:17:18.044 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.041+0000 7f6370f74700 1 -- 172.21.15.110:0/1544291733 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6368009ce0 con 0x7f636c0bcda0 2021-03-25T14:17:18.044 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.041+0000 7f63741da700 1 -- 172.21.15.110:0/1544291733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f636c0bcda0 msgr2=0x7f636c1498b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:18.044 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.041+0000 7f63741da700 1 --2- 172.21.15.110:0/1544291733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f636c0bcda0 0x7f636c1498b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f636c147500 tx=0x7f6368006ee0).stop 2021-03-25T14:17:18.045 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.041+0000 7f63741da700 1 -- 172.21.15.110:0/1544291733 shutdown_connections 2021-03-25T14:17:18.045 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.041+0000 7f63741da700 1 --2- 172.21.15.110:0/1544291733 >> v2:172.21.15.174:3300/0 conn(0x7f636c1433c0 0x7f636c1437f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:18.045 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.041+0000 7f63741da700 1 --2- 172.21.15.110:0/1544291733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f636c0bcda0 0x7f636c1498b0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:18.045 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.041+0000 7f63741da700 1 -- 172.21.15.110:0/1544291733 >> 172.21.15.110:0/1544291733 conn(0x7f636c0675f0 msgr2=0x7f636c067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:18.045 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.041+0000 7f63741da700 1 -- 172.21.15.110:0/1544291733 shutdown_connections 2021-03-25T14:17:18.045 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.041+0000 7f63741da700 1 -- 172.21.15.110:0/1544291733 wait complete. 2021-03-25T14:17:18.045 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.042+0000 7f63741da700 1 Processor -- start 2021-03-25T14:17:18.045 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.042+0000 7f63741da700 1 -- start start 2021-03-25T14:17:18.048 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.043+0000 7f63741da700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f636c068da0 0x7f636c15ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:18.048 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.043+0000 7f63741da700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f636c0bcda0 0x7f636c0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:18.048 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.043+0000 7f63741da700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f636c1433c0 0x7f636c141770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:18.048 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.043+0000 7f63741da700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636c0b6a00 con 0x7f636c1433c0 2021-03-25T14:17:18.048 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.043+0000 7f63741da700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636c0b6760 con 0x7f636c068da0 2021-03-25T14:17:18.048 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.043+0000 7f63741da700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f636c15c490 con 0x7f636c0bcda0 2021-03-25T14:17:18.048 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.043+0000 7f6372777700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f636c1433c0 0x7f636c141770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:18.048 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.043+0000 7f6372777700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f636c1433c0 0x7f636c141770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49638/0 (socket says 172.21.15.110:49638) 2021-03-25T14:17:18.048 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.043+0000 7f6372777700 1 -- 172.21.15.110:0/3618563762 learned_addr learned my addr 172.21.15.110:0/3618563762 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:18.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.043+0000 7f6371f76700 1 --2- 172.21.15.110:0/3618563762 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f636c068da0 0x7f636c15ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:18.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.043+0000 7f6371775700 1 --2- 172.21.15.110:0/3618563762 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f636c0bcda0 0x7f636c0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:18.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.043+0000 7f6372777700 1 -- 172.21.15.110:0/3618563762 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f636c0bcda0 msgr2=0x7f636c0b6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:18.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.043+0000 7f6372777700 1 --2- 172.21.15.110:0/3618563762 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f636c0bcda0 0x7f636c0b6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:18.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.043+0000 7f6372777700 1 -- 172.21.15.110:0/3618563762 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f636c068da0 msgr2=0x7f636c15ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:18.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.043+0000 7f6372777700 1 --2- 172.21.15.110:0/3618563762 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f636c068da0 0x7f636c15ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:18.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.043+0000 7f6372777700 1 -- 172.21.15.110:0/3618563762 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f636c15c730 con 0x7f636c1433c0 2021-03-25T14:17:18.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.043+0000 7f6372777700 1 --2- 172.21.15.110:0/3618563762 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f636c1433c0 0x7f636c141770 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f636400cb20 tx=0x7f6364008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:18.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.044+0000 7f6359ffb700 1 -- 172.21.15.110:0/3618563762 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63640077e0 con 0x7f636c1433c0 2021-03-25T14:17:18.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.044+0000 7f6359ffb700 1 -- 172.21.15.110:0/3618563762 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6364007940 con 0x7f636c1433c0 2021-03-25T14:17:18.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.044+0000 7f63741da700 1 -- 172.21.15.110:0/3618563762 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f636c15c9d0 con 0x7f636c1433c0 2021-03-25T14:17:18.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.044+0000 7f6359ffb700 1 -- 172.21.15.110:0/3618563762 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6364007cc0 con 0x7f636c1433c0 2021-03-25T14:17:18.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.044+0000 7f63741da700 1 -- 172.21.15.110:0/3618563762 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f636c141c60 con 0x7f636c1433c0 2021-03-25T14:17:18.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.045+0000 7f63741da700 1 -- 172.21.15.110:0/3618563762 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f636c15cb60 con 0x7f636c1433c0 2021-03-25T14:17:18.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.045+0000 7f6359ffb700 1 -- 172.21.15.110:0/3618563762 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f6364011620 con 0x7f636c1433c0 2021-03-25T14:17:18.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.045+0000 7f6359ffb700 1 --2- 172.21.15.110:0/3618563762 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f634c05a0b0 0x7f634c05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:18.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.046+0000 7f6359ffb700 1 -- 172.21.15.110:0/3618563762 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 7250+0+0 (secure 0 0 0) 0x7f6364074550 con 0x7f636c1433c0 2021-03-25T14:17:18.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.046+0000 7f6371f76700 1 --2- 172.21.15.110:0/3618563762 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f634c05a0b0 0x7f634c05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:18.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.046+0000 7f6371f76700 1 --2- 172.21.15.110:0/3618563762 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f634c05a0b0 0x7f634c05c570 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f6368006f20 tx=0x7f6368016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:18.051 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.051+0000 7f6359ffb700 1 -- 172.21.15.110:0/3618563762 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f6364047a50 con 0x7f636c1433c0 2021-03-25T14:17:18.240 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.239+0000 7f63741da700 1 -- 172.21.15.110:0/3618563762 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f636c06aaa0 con 0x7f636c1433c0 2021-03-25T14:17:18.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.240+0000 7f6359ffb700 1 -- 172.21.15.110:0/3618563762 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+149 (secure 0 0 0) 0x7f636404b070 con 0x7f636c1433c0 2021-03-25T14:17:18.241 INFO:teuthology.orchestra.run.smithi110.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2021-03-25T14:17:18.241 INFO:teuthology.orchestra.run.smithi110.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2021-03-25T14:17:18.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.241+0000 7f63741da700 1 -- 172.21.15.110:0/3618563762 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f634c05a0b0 msgr2=0x7f634c05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:18.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.241+0000 7f63741da700 1 --2- 172.21.15.110:0/3618563762 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f634c05a0b0 0x7f634c05c570 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f6368006f20 tx=0x7f6368016000).stop 2021-03-25T14:17:18.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.241+0000 7f63741da700 1 -- 172.21.15.110:0/3618563762 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f636c1433c0 msgr2=0x7f636c141770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:18.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.241+0000 7f63741da700 1 --2- 172.21.15.110:0/3618563762 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f636c1433c0 0x7f636c141770 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f636400cb20 tx=0x7f6364008040).stop 2021-03-25T14:17:18.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.241+0000 7f63741da700 1 -- 172.21.15.110:0/3618563762 shutdown_connections 2021-03-25T14:17:18.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.241+0000 7f63741da700 1 --2- 172.21.15.110:0/3618563762 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f634c05a0b0 0x7f634c05c570 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:18.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.241+0000 7f63741da700 1 --2- 172.21.15.110:0/3618563762 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f636c068da0 0x7f636c15ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:18.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.241+0000 7f63741da700 1 --2- 172.21.15.110:0/3618563762 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f636c1433c0 0x7f636c141770 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:18.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.241+0000 7f63741da700 1 --2- 172.21.15.110:0/3618563762 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f636c0bcda0 0x7f636c0b6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:18.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.241+0000 7f63741da700 1 -- 172.21.15.110:0/3618563762 >> 172.21.15.110:0/3618563762 conn(0x7f636c0675f0 msgr2=0x7f636c149f70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:18.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.241+0000 7f63741da700 1 -- 172.21.15.110:0/3618563762 shutdown_connections 2021-03-25T14:17:18.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:18.241+0000 7f63741da700 1 -- 172.21.15.110:0/3618563762 wait complete. 2021-03-25T14:17:18.252 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2021-03-25T14:17:18.252 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2021-03-25T14:17:18.252 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi110.front.sepia.ceph.com 2021-03-25T14:17:18.252 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2021-03-25T14:17:18.253 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2021-03-25T14:17:18.253 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2021-03-25T14:17:18.253 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2021-03-25T14:17:18.253 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.vBJRljgkL9 2021-03-25T14:17:18.253 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2021-03-25T14:17:18.267 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.S7KE5zMT3s 2021-03-25T14:17:18.267 DEBUG:teuthology.orchestra.run.smithi110:> sudo cp /tmp/tmp.vBJRljgkL9 /tmp/tmp.S7KE5zMT3s 2021-03-25T14:17:18.333 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.S7KE5zMT3s 2021-03-25T14:17:18.455 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.S7KE5zMT3s is 66B 2021-03-25T14:17:18.503 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.S7KE5zMT3s 2021-03-25T14:17:18.517 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQBtm1xg3jLMIxAARztP29wq9FGk2DzuV2j/qw== 2021-03-25T14:17:18.517 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2021-03-25T14:17:18.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:18.517 DEBUG:teuthology.orchestra.run.smithi110:> ip addr 2021-03-25T14:17:18.571 INFO:teuthology.orchestra.run.smithi110.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2021-03-25T14:17:18.571 INFO:teuthology.orchestra.run.smithi110.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2021-03-25T14:17:18.571 INFO:teuthology.orchestra.run.smithi110.stdout: inet 127.0.0.1/8 scope host lo 2021-03-25T14:17:18.571 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:18.571 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 ::1/128 scope host 2021-03-25T14:17:18.571 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:18.571 INFO:teuthology.orchestra.run.smithi110.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-03-25T14:17:18.571 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:14 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:17:18.571 INFO:teuthology.orchestra.run.smithi110.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-03-25T14:17:18.572 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:15 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:17:18.572 INFO:teuthology.orchestra.run.smithi110.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-03-25T14:17:18.572 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:34 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:17:18.572 INFO:teuthology.orchestra.run.smithi110.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2021-03-25T14:17:18.572 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:35 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:17:18.572 INFO:teuthology.orchestra.run.smithi110.stdout: inet 172.21.15.110/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2021-03-25T14:17:18.572 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft 42563sec preferred_lft 42563sec 2021-03-25T14:17:18.572 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::ec4:7aff:fe8f:cc35/64 scope link 2021-03-25T14:17:18.572 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:18.572 INFO:teuthology.orchestra.run.smithi110.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2021-03-25T14:17:18.572 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 1a:d9:4b:2f:6c:02 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:17:18.572 INFO:teuthology.orchestra.run.smithi110.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2021-03-25T14:17:18.573 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:18.573 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::1835:66ff:feca:f994/64 scope link 2021-03-25T14:17:18.573 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:18.573 INFO:teuthology.orchestra.run.smithi110.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2021-03-25T14:17:18.573 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 1a:d9:4b:2f:6c:02 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2021-03-25T14:17:18.573 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::18d9:4bff:fe2f:6c02/64 scope link 2021-03-25T14:17:18.573 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:18.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:18.573 DEBUG:teuthology.orchestra.run.smithi110:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2021-03-25T14:17:18.633 INFO:teuthology.orchestra.run.smithi110.stdout:1 2021-03-25T14:17:18.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:18.635 DEBUG:teuthology.orchestra.run.smithi110:> route 2021-03-25T14:17:18.690 INFO:teuthology.orchestra.run.smithi110.stdout:Kernel IP routing table 2021-03-25T14:17:18.690 INFO:teuthology.orchestra.run.smithi110.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2021-03-25T14:17:18.691 INFO:teuthology.orchestra.run.smithi110.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2021-03-25T14:17:18.691 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2021-03-25T14:17:18.691 INFO:teuthology.orchestra.run.smithi110.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2021-03-25T14:17:18.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:18.691 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec sudo bash -c ' 2021-03-25T14:17:18.691 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2021-03-25T14:17:18.691 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2021-03-25T14:17:18.691 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2021-03-25T14:17:18.691 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2021-03-25T14:17:18.692 DEBUG:teuthology.orchestra.run.smithi110:> ') 2021-03-25T14:17:18.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:18.787 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2021-03-25T14:17:18.801 INFO:teuthology.orchestra.run.smithi110.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2021-03-25T14:17:18.801 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2021-03-25T14:17:18.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:18.802 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set brx.0 up 2021-03-25T14:17:18.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:18.865 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p /home/ubuntu/cephtest/mnt.0 2021-03-25T14:17:18.919 DEBUG:teuthology.orchestra.run.smithi110:> sudo cat /tmp/tmp.vBJRljgkL9 2021-03-25T14:17:18.982 INFO:teuthology.orchestra.run.smithi110.stdout:[client.testuser] 2021-03-25T14:17:18.982 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBtm1xg3jLMIxAARztP29wq9FGk2DzuV2j/qw== 2021-03-25T14:17:18.983 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-03-25T14:17:18.983 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=testuser,secret=AQBtm1xg3jLMIxAARztP29wq9FGk2DzuV2j/qw==,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs2,norbytes 2021-03-25T14:17:19.062 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,name=testuser,secret=AQBtm1xg3jLMIxAARztP29wq9FGk2DzuV2j/qw==,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs2,norbytes 2021-03-25T14:17:19.063 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,name=testuser,mds_namespace=cephfs2,norbytes" will pass to kernel. 2021-03-25T14:17:19.063 INFO:teuthology.orchestra.run.smithi110.stdout:keyring.get_secret failed 2021-03-25T14:17:19.090 INFO:teuthology.orchestra.run.smithi110.stderr:mount error 2 = No such file or directory 2021-03-25T14:17:19.091 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,name=testuser,secret=AQBtm1xg3jLMIxAARztP29wq9FGk2DzuV2j/qw==,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs2,norbytes 2021-03-25T14:17:19.091 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,name=testuser,mds_namespace=cephfs2,norbytes" will pass to kernel. 2021-03-25T14:17:19.093 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-03-25T14:17:19.093 INFO:tasks.cephfs.kernel_mount:mount command failed 2021-03-25T14:17:19.094 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-03-25T14:17:19.094 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-03-25T14:17:19.160 DEBUG:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-03-25T14:17:19.191 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-03-25T14:17:19.191 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2021-03-25T14:17:19.191 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-03-25T14:17:19.191 DEBUG:teuthology.orchestra.run.smithi174:> sudo umount /home/ubuntu/cephtest/mnt.1 2021-03-25T14:17:19.271 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi174.front.sepia.ceph.com 2021-03-25T14:17:19.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:19.272 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-03-25T14:17:19.327 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-03-25T14:17:19.437 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.435+0000 7fdbc6a23700 1 Processor -- start 2021-03-25T14:17:19.437 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.435+0000 7fdbc6a23700 1 -- start start 2021-03-25T14:17:19.440 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.436+0000 7fdbc6a23700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdbc00af140 0x7fdbc00af520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:19.440 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.436+0000 7fdbc6a23700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdbc00b0f80 0x7fdbc00b1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:19.440 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.436+0000 7fdbc6a23700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbc0067d80 con 0x7fdbc01473c0 2021-03-25T14:17:19.440 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.436+0000 7fdbc6a23700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbc00bc1f0 con 0x7fdbc00af140 2021-03-25T14:17:19.440 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.436+0000 7fdbc6a23700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc0067fb0 con 0x7fdbc00b0f80 2021-03-25T14:17:19.440 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.436+0000 7fdbbffff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdbc00af140 0x7fdbc00af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:19.440 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.436+0000 7fdbbffff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdbc00af140 0x7fdbc00af520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49646/0 (socket says 172.21.15.110:49646) 2021-03-25T14:17:19.441 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.436+0000 7fdbbffff700 1 -- 172.21.15.110:0/1543383581 learned_addr learned my addr 172.21.15.110:0/1543383581 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:19.441 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.436+0000 7fdbc4fc0700 1 --2- 172.21.15.110:0/1543383581 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdbc00b0f80 0x7fdbc00b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:19.441 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.436+0000 7fdbbffff700 1 -- 172.21.15.110:0/1543383581 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdbc00b0f80 msgr2=0x7fdbc00b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:19.441 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.436+0000 7fdbbffff700 1 --2- 172.21.15.110:0/1543383581 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdbc00b0f80 0x7fdbc00b1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:19.441 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.436+0000 7fdbbffff700 1 -- 172.21.15.110:0/1543383581 >> v1:172.21.15.174:6789/0 conn(0x7fdbc01473c0 legacy=0x7fdbc00bbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:19.441 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.436+0000 7fdbbffff700 1 -- 172.21.15.110:0/1543383581 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc0068250 con 0x7fdbc00af140 2021-03-25T14:17:19.441 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.436+0000 7fdbbffff700 1 --2- 172.21.15.110:0/1543383581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbc00af140 0x7fdbc00af520 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7fdbb000ba20 tx=0x7fdbb0006ee0).ready entity=mon.0 client_cookie=cc56e5c708b6a29d server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:19.441 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.437+0000 7fdbbeffd700 1 -- 172.21.15.110:0/1543383581 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb00098d0 con 0x7fdbc00af140 2021-03-25T14:17:19.441 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.437+0000 7fdbbeffd700 1 -- 172.21.15.110:0/1543383581 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb0009a30 con 0x7fdbc00af140 2021-03-25T14:17:19.441 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.437+0000 7fdbbeffd700 1 -- 172.21.15.110:0/1543383581 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb0009db0 con 0x7fdbc00af140 2021-03-25T14:17:19.441 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.437+0000 7fdbc6a23700 1 -- 172.21.15.110:0/1543383581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbc00af140 msgr2=0x7fdbc00af520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:19.441 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.437+0000 7fdbc6a23700 1 --2- 172.21.15.110:0/1543383581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbc00af140 0x7fdbc00af520 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7fdbb000ba20 tx=0x7fdbb0006ee0).stop 2021-03-25T14:17:19.442 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.437+0000 7fdbc6a23700 1 -- 172.21.15.110:0/1543383581 shutdown_connections 2021-03-25T14:17:19.442 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.437+0000 7fdbc6a23700 1 --2- 172.21.15.110:0/1543383581 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdbc00b0f80 0x7fdbc00b1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:19.442 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.437+0000 7fdbc6a23700 1 --2- 172.21.15.110:0/1543383581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbc00af140 0x7fdbc00af520 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:19.442 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.437+0000 7fdbc6a23700 1 -- 172.21.15.110:0/1543383581 >> 172.21.15.110:0/1543383581 conn(0x7fdbc0063850 msgr2=0x7fdbc005c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:19.442 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.437+0000 7fdbc6a23700 1 -- 172.21.15.110:0/1543383581 shutdown_connections 2021-03-25T14:17:19.442 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.437+0000 7fdbc6a23700 1 -- 172.21.15.110:0/1543383581 wait complete. 2021-03-25T14:17:19.442 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.438+0000 7fdbc6a23700 1 Processor -- start 2021-03-25T14:17:19.442 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.438+0000 7fdbc6a23700 1 -- start start 2021-03-25T14:17:19.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.439+0000 7fdbc6a23700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbc00af140 0x7fdbc014cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:19.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.439+0000 7fdbc6a23700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbc00b0f80 0x7fdbc0143250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:19.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.439+0000 7fdbc6a23700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdbc00b1e80 0x7fdbc0143740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:19.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.439+0000 7fdbc6a23700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc00b89d0 con 0x7fdbc00af140 2021-03-25T14:17:19.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.439+0000 7fdbc6a23700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc00b7f50 con 0x7fdbc00b0f80 2021-03-25T14:17:19.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.439+0000 7fdbc6a23700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc00b81f0 con 0x7fdbc00b1e80 2021-03-25T14:17:19.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.439+0000 7fdbbffff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbc00af140 0x7fdbc014cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:19.446 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.439+0000 7fdbbffff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbc00af140 0x7fdbc014cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49652/0 (socket says 172.21.15.110:49652) 2021-03-25T14:17:19.446 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.439+0000 7fdbbffff700 1 -- 172.21.15.110:0/3180033559 learned_addr learned my addr 172.21.15.110:0/3180033559 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:19.446 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.439+0000 7fdbbf7fe700 1 --2- 172.21.15.110:0/3180033559 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbc00b0f80 0x7fdbc0143250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:19.446 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.439+0000 7fdbc4fc0700 1 --2- 172.21.15.110:0/3180033559 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdbc00b1e80 0x7fdbc0143740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:19.446 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.439+0000 7fdbbffff700 1 -- 172.21.15.110:0/3180033559 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdbc00b1e80 msgr2=0x7fdbc0143740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:19.446 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.439+0000 7fdbbffff700 1 --2- 172.21.15.110:0/3180033559 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdbc00b1e80 0x7fdbc0143740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:19.446 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.439+0000 7fdbbffff700 1 -- 172.21.15.110:0/3180033559 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbc00b0f80 msgr2=0x7fdbc0143250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:19.446 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.439+0000 7fdbbffff700 1 --2- 172.21.15.110:0/3180033559 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbc00b0f80 0x7fdbc0143250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:19.446 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.439+0000 7fdbbffff700 1 -- 172.21.15.110:0/3180033559 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc00b8490 con 0x7fdbc00af140 2021-03-25T14:17:19.446 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.440+0000 7fdbbffff700 1 --2- 172.21.15.110:0/3180033559 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbc00af140 0x7fdbc014cd80 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7fdbb00093a0 tx=0x7fdbb0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:19.446 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.440+0000 7fdba7fff700 1 -- 172.21.15.110:0/3180033559 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb000be40 con 0x7fdbc00af140 2021-03-25T14:17:19.446 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.440+0000 7fdba7fff700 1 -- 172.21.15.110:0/3180033559 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb0011d80 con 0x7fdbc00af140 2021-03-25T14:17:19.447 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.440+0000 7fdbc6a23700 1 -- 172.21.15.110:0/3180033559 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc00b8730 con 0x7fdbc00af140 2021-03-25T14:17:19.447 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.440+0000 7fdba7fff700 1 -- 172.21.15.110:0/3180033559 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb001c630 con 0x7fdbc00af140 2021-03-25T14:17:19.447 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.440+0000 7fdbc6a23700 1 -- 172.21.15.110:0/3180033559 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc00b9220 con 0x7fdbc00af140 2021-03-25T14:17:19.447 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.441+0000 7fdbc6a23700 1 -- 172.21.15.110:0/3180033559 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbc0159eb0 con 0x7fdbc00af140 2021-03-25T14:17:19.447 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.441+0000 7fdba7fff700 1 -- 172.21.15.110:0/3180033559 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fdbb000f070 con 0x7fdbc00af140 2021-03-25T14:17:19.447 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.441+0000 7fdba7fff700 1 --2- 172.21.15.110:0/3180033559 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fdba005a0b0 0x7fdba005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:19.447 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.441+0000 7fdba7fff700 1 -- 172.21.15.110:0/3180033559 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 7250+0+0 (secure 0 0 0) 0x7fdbb00756f0 con 0x7fdbc00af140 2021-03-25T14:17:19.447 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.441+0000 7fdbbf7fe700 1 --2- 172.21.15.110:0/3180033559 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fdba005a0b0 0x7fdba005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:19.447 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.442+0000 7fdbbf7fe700 1 --2- 172.21.15.110:0/3180033559 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fdba005a0b0 0x7fdba005c570 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fdbc014b590 tx=0x7fdbb4007bc0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:19.448 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.445+0000 7fdba7fff700 1 -- 172.21.15.110:0/3180033559 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fdbb0048bf0 con 0x7fdbc00af140 2021-03-25T14:17:19.632 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.630+0000 7fdbc6a23700 1 -- 172.21.15.110:0/3180033559 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdbc005d7b0 con 0x7fdbc00af140 2021-03-25T14:17:19.633 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.631+0000 7fdba7fff700 1 -- 172.21.15.110:0/3180033559 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3775 (secure 0 0 0) 0x7fdbb004c210 con 0x7fdbc00af140 2021-03-25T14:17:19.633 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:19.633 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4804,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6834/4176268149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4176268149},{"type":"v1","addr":"172.21.15.174:6834","nonce":4176268149}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":12},{"gid":4807,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/1554277551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6833","nonce":1554277551},{"type":"v1","addr":"172.21.15.174:6835","nonce":1554277551}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":13}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-03-25T14:17:04.328765+0000","modified":"2021-03-25T14:17:05.329972+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6837/503424314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":503424314},{"type":"v1","addr":"172.21.15.110:6837","nonce":503424314}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-03-25T14:17:14.349898+0000","modified":"2021-03-25T14:17:15.351276+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5025},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5025":{"gid":5025,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.110:6836/2267546898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2267546898},{"type":"v1","addr":"172.21.15.110:6836","nonce":2267546898}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs2","balancer":"","standby_count_wanted":0},"id":3}]} 2021-03-25T14:17:19.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.632+0000 7fdbc6a23700 1 -- 172.21.15.110:0/3180033559 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fdba005a0b0 msgr2=0x7fdba005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:19.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.632+0000 7fdbc6a23700 1 --2- 172.21.15.110:0/3180033559 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fdba005a0b0 0x7fdba005c570 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fdbc014b590 tx=0x7fdbb4007bc0).stop 2021-03-25T14:17:19.635 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.632+0000 7fdbc6a23700 1 -- 172.21.15.110:0/3180033559 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbc00af140 msgr2=0x7fdbc014cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:19.635 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.632+0000 7fdbc6a23700 1 --2- 172.21.15.110:0/3180033559 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbc00af140 0x7fdbc014cd80 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7fdbb00093a0 tx=0x7fdbb0016000).stop 2021-03-25T14:17:19.635 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.632+0000 7fdbc6a23700 1 -- 172.21.15.110:0/3180033559 shutdown_connections 2021-03-25T14:17:19.635 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.632+0000 7fdbc6a23700 1 --2- 172.21.15.110:0/3180033559 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fdba005a0b0 0x7fdba005c570 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:19.635 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.632+0000 7fdbc6a23700 1 --2- 172.21.15.110:0/3180033559 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdbc00b1e80 0x7fdbc0143740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:19.635 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.632+0000 7fdbc6a23700 1 --2- 172.21.15.110:0/3180033559 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbc00af140 0x7fdbc014cd80 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:19.635 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.632+0000 7fdbc6a23700 1 --2- 172.21.15.110:0/3180033559 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbc00b0f80 0x7fdbc0143250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:19.635 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.632+0000 7fdbc6a23700 1 -- 172.21.15.110:0/3180033559 >> 172.21.15.110:0/3180033559 conn(0x7fdbc0063850 msgr2=0x7fdbc0146350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:19.635 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.633+0000 7fdbc6a23700 1 -- 172.21.15.110:0/3180033559 shutdown_connections 2021-03-25T14:17:19.635 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.633+0000 7fdbc6a23700 1 -- 172.21.15.110:0/3180033559 wait complete. 2021-03-25T14:17:19.636 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 18 2021-03-25T14:17:19.646 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:17:19.756 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.754+0000 7f943ae8d700 1 Processor -- start 2021-03-25T14:17:19.756 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.754+0000 7f943ae8d700 1 -- start start 2021-03-25T14:17:19.759 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.755+0000 7f943ae8d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f94340bcd90 0x7f943414d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:19.759 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.755+0000 7f943ae8d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94340b7620 0x7f9434148ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:19.759 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.755+0000 7f943ae8d700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94340b9140 con 0x7f94340b1340 2021-03-25T14:17:19.759 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.755+0000 7f943ae8d700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94340692a0 con 0x7f94340bcd90 2021-03-25T14:17:19.759 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.755+0000 7f943ae8d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94340b93e0 con 0x7f94340b7620 2021-03-25T14:17:19.759 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.755+0000 7f9438c29700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f94340bcd90 0x7f943414d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:19.759 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.755+0000 7f9433fff700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f94340b1340 0x7f9434060c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:42596/0 (socket says 172.21.15.110:42596) 2021-03-25T14:17:19.759 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.755+0000 7f9433fff700 1 -- 172.21.15.110:0/1866087785 learned_addr learned my addr 172.21.15.110:0/1866087785 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:19.759 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.755+0000 7f943942a700 1 --2- 172.21.15.110:0/1866087785 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94340b7620 0x7f9434148ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:19.760 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.755+0000 7f9438c29700 1 -- 172.21.15.110:0/1866087785 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94340b7620 msgr2=0x7f9434148ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:19.760 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.755+0000 7f9438c29700 1 --2- 172.21.15.110:0/1866087785 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94340b7620 0x7f9434148ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:19.760 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.755+0000 7f9438c29700 1 -- 172.21.15.110:0/1866087785 >> v1:172.21.15.110:6789/0 conn(0x7f94340b1340 legacy=0x7f9434060c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:19.760 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.755+0000 7f94337fe700 1 -- 172.21.15.110:0/1866087785 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3277771434 0 0) 0x7f94340b9140 con 0x7f94340b1340 2021-03-25T14:17:19.760 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.755+0000 7f9438c29700 1 -- 172.21.15.110:0/1866087785 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f943414cda0 con 0x7f94340bcd90 2021-03-25T14:17:19.760 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.755+0000 7f943942a700 1 --2- 172.21.15.110:0/1866087785 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94340b7620 0x7f9434148ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:19.760 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.755+0000 7f9438c29700 1 --2- 172.21.15.110:0/1866087785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94340bcd90 0x7f943414d780 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f942800b9c0 tx=0x7f9428006e20).ready entity=mon.0 client_cookie=bccd49139fbf2ab server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:19.760 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.756+0000 7f94337fe700 1 -- 172.21.15.110:0/1866087785 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94280097e0 con 0x7f94340bcd90 2021-03-25T14:17:19.760 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.756+0000 7f94337fe700 1 -- 172.21.15.110:0/1866087785 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9428009940 con 0x7f94340bcd90 2021-03-25T14:17:19.760 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.756+0000 7f94337fe700 1 -- 172.21.15.110:0/1866087785 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9428009cc0 con 0x7f94340bcd90 2021-03-25T14:17:19.760 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.756+0000 7f943ae8d700 1 -- 172.21.15.110:0/1866087785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94340bcd90 msgr2=0x7f943414d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:19.760 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.756+0000 7f943ae8d700 1 --2- 172.21.15.110:0/1866087785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94340bcd90 0x7f943414d780 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f942800b9c0 tx=0x7f9428006e20).stop 2021-03-25T14:17:19.760 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.756+0000 7f943ae8d700 1 -- 172.21.15.110:0/1866087785 shutdown_connections 2021-03-25T14:17:19.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.756+0000 7f943ae8d700 1 --2- 172.21.15.110:0/1866087785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94340bcd90 0x7f943414d780 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:19.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.756+0000 7f943ae8d700 1 --2- 172.21.15.110:0/1866087785 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94340b7620 0x7f9434148ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:19.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.756+0000 7f943ae8d700 1 -- 172.21.15.110:0/1866087785 >> 172.21.15.110:0/1866087785 conn(0x7f9434063720 msgr2=0x7f9434063b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:19.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.756+0000 7f943ae8d700 1 -- 172.21.15.110:0/1866087785 shutdown_connections 2021-03-25T14:17:19.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.756+0000 7f943ae8d700 1 -- 172.21.15.110:0/1866087785 wait complete. 2021-03-25T14:17:19.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.757+0000 7f943ae8d700 1 Processor -- start 2021-03-25T14:17:19.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.757+0000 7f943ae8d700 1 -- start start 2021-03-25T14:17:19.763 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.758+0000 7f943ae8d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94340b1340 0x7f94340b1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:19.764 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.758+0000 7f943ae8d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94340b7620 0x7f9434146e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:19.764 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.758+0000 7f943ae8d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94340bcd90 0x7f9434159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:19.764 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.758+0000 7f943ae8d700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9434149330 con 0x7f94340bcd90 2021-03-25T14:17:19.764 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.758+0000 7f943ae8d700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9434158bb0 con 0x7f94340b7620 2021-03-25T14:17:19.764 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.758+0000 7f943ae8d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9434146510 con 0x7f94340b1340 2021-03-25T14:17:19.764 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.758+0000 7f943942a700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94340bcd90 0x7f9434159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:19.764 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.758+0000 7f943942a700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94340bcd90 0x7f9434159280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49670/0 (socket says 172.21.15.110:49670) 2021-03-25T14:17:19.764 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.758+0000 7f943942a700 1 -- 172.21.15.110:0/3163431687 learned_addr learned my addr 172.21.15.110:0/3163431687 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:19.764 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.758+0000 7f9433fff700 1 --2- 172.21.15.110:0/3163431687 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94340b7620 0x7f9434146e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:19.764 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.758+0000 7f9438c29700 1 --2- 172.21.15.110:0/3163431687 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94340b1340 0x7f94340b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:19.764 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.758+0000 7f943942a700 1 -- 172.21.15.110:0/3163431687 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94340b1340 msgr2=0x7f94340b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:19.764 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.758+0000 7f943942a700 1 --2- 172.21.15.110:0/3163431687 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94340b1340 0x7f94340b1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:19.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.758+0000 7f943942a700 1 -- 172.21.15.110:0/3163431687 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94340b7620 msgr2=0x7f9434146e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:19.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.758+0000 7f943942a700 1 --2- 172.21.15.110:0/3163431687 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94340b7620 0x7f9434146e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:19.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.758+0000 7f943942a700 1 -- 172.21.15.110:0/3163431687 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9434158de0 con 0x7f94340bcd90 2021-03-25T14:17:19.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.758+0000 7f943942a700 1 --2- 172.21.15.110:0/3163431687 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94340bcd90 0x7f9434159280 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f942c00ec90 tx=0x7f942c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:19.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.759+0000 7f9430ff9700 1 -- 172.21.15.110:0/3163431687 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c00c650 con 0x7f94340bcd90 2021-03-25T14:17:19.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.759+0000 7f9430ff9700 1 -- 172.21.15.110:0/3163431687 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942c00c7b0 con 0x7f94340bcd90 2021-03-25T14:17:19.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.759+0000 7f943ae8d700 1 -- 172.21.15.110:0/3163431687 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94341467b0 con 0x7f94340bcd90 2021-03-25T14:17:19.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.759+0000 7f9430ff9700 1 -- 172.21.15.110:0/3163431687 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c00cb50 con 0x7f94340bcd90 2021-03-25T14:17:19.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.759+0000 7f943ae8d700 1 -- 172.21.15.110:0/3163431687 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9434147320 con 0x7f94340bcd90 2021-03-25T14:17:19.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.760+0000 7f943ae8d700 1 -- 172.21.15.110:0/3163431687 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f943405d7b0 con 0x7f94340bcd90 2021-03-25T14:17:19.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.760+0000 7f9430ff9700 1 -- 172.21.15.110:0/3163431687 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f942c01d460 con 0x7f94340bcd90 2021-03-25T14:17:19.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.760+0000 7f9430ff9700 1 --2- 172.21.15.110:0/3163431687 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f941405a0b0 0x7f941405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:19.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.760+0000 7f9430ff9700 1 -- 172.21.15.110:0/3163431687 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 7250+0+0 (secure 0 0 0) 0x7f942c0741f0 con 0x7f94340bcd90 2021-03-25T14:17:19.766 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.760+0000 7f9438c29700 1 --2- 172.21.15.110:0/3163431687 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f941405a0b0 0x7f941405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:19.766 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.761+0000 7f9438c29700 1 --2- 172.21.15.110:0/3163431687 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f941405a0b0 0x7f941405c570 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f942800b170 tx=0x7f9428016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:19.766 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.764+0000 7f9430ff9700 1 -- 172.21.15.110:0/3163431687 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f942c047690 con 0x7f94340bcd90 2021-03-25T14:17:19.917 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.915+0000 7f943ae8d700 1 -- 172.21.15.110:0/3163431687 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94340b3a20 con 0x7f94340bcd90 2021-03-25T14:17:19.918 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.916+0000 7f9430ff9700 1 -- 172.21.15.110:0/3163431687 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+20264 (secure 0 0 0) 0x7f942c04acb0 con 0x7f94340bcd90 2021-03-25T14:17:19.918 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:19.919 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":42,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:17:15.351754+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2021-03-25T14:17:02.835058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2021-03-25T14:17:03.303869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":8,"pool_name":"cephfs2_metadata","create_time":"2021-03-25T14:17:12.037785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}}},{"pool":9,"pool_name":"cephfs2_data","create_time":"2021-03-25T14:17:13.333853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs2"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:17:19.920 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.918+0000 7f943ae8d700 1 -- 172.21.15.110:0/3163431687 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f941405a0b0 msgr2=0x7f941405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:19.921 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.918+0000 7f943ae8d700 1 --2- 172.21.15.110:0/3163431687 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f941405a0b0 0x7f941405c570 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f942800b170 tx=0x7f9428016000).stop 2021-03-25T14:17:19.921 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.918+0000 7f943ae8d700 1 -- 172.21.15.110:0/3163431687 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94340bcd90 msgr2=0x7f9434159280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:19.921 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.918+0000 7f943ae8d700 1 --2- 172.21.15.110:0/3163431687 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94340bcd90 0x7f9434159280 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f942c00ec90 tx=0x7f942c008040).stop 2021-03-25T14:17:19.921 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.918+0000 7f943ae8d700 1 -- 172.21.15.110:0/3163431687 shutdown_connections 2021-03-25T14:17:19.921 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.918+0000 7f943ae8d700 1 --2- 172.21.15.110:0/3163431687 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f941405a0b0 0x7f941405c570 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:19.921 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.918+0000 7f943ae8d700 1 --2- 172.21.15.110:0/3163431687 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94340bcd90 0x7f9434159280 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:19.921 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.918+0000 7f943ae8d700 1 --2- 172.21.15.110:0/3163431687 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94340b1340 0x7f94340b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:19.921 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.918+0000 7f943ae8d700 1 --2- 172.21.15.110:0/3163431687 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94340b7620 0x7f9434146e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:19.921 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.918+0000 7f943ae8d700 1 -- 172.21.15.110:0/3163431687 >> 172.21.15.110:0/3163431687 conn(0x7f9434063720 msgr2=0x7f943414b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:19.921 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.918+0000 7f943ae8d700 1 -- 172.21.15.110:0/3163431687 shutdown_connections 2021-03-25T14:17:19.921 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:19.918+0000 7f943ae8d700 1 -- 172.21.15.110:0/3163431687 wait complete. 2021-03-25T14:17:19.932 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-03-25T14:15:59.047299+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-03-25T14:16:00.537926+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2021-03-25T14:17:02.835058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2021-03-25T14:17:03.303869+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs2_metadata', 'create_time': '2021-03-25T14:17:12.037785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}}, {'pool': 9, 'pool_name': 'cephfs2_data', 'create_time': '2021-03-25T14:17:13.333853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}}] 2021-03-25T14:17:19.932 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-03-25T14:17:20.046 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.044+0000 7f6c91ffe700 1 Processor -- start 2021-03-25T14:17:20.046 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.044+0000 7f6c91ffe700 1 -- start start 2021-03-25T14:17:20.048 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.045+0000 7f6c91ffe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c8c14d470 0x7f6c8c14d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:20.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.045+0000 7f6c91ffe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6c8c0685d0 0x7f6c8c068a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:20.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.045+0000 7f6c91ffe700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c8c0691b0 con 0x7f6c8c14cc90 2021-03-25T14:17:20.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.045+0000 7f6c91ffe700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c8c0bc2b0 con 0x7f6c8c0685d0 2021-03-25T14:17:20.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.045+0000 7f6c91ffe700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c149dd0 con 0x7f6c8c14d470 2021-03-25T14:17:20.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.045+0000 7f6c8bfff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6c8c0685d0 0x7f6c8c068a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:20.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.045+0000 7f6c8bfff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6c8c0685d0 0x7f6c8c068a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.110:48328/0 (socket says 172.21.15.110:48328) 2021-03-25T14:17:20.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.045+0000 7f6c8b7fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c8c14d470 0x7f6c8c14d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:20.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.045+0000 7f6c8bfff700 1 -- 172.21.15.110:0/3564011184 learned_addr learned my addr 172.21.15.110:0/3564011184 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:20.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.045+0000 7f6c8affd700 1 --1- 172.21.15.110:0/3564011184 >> v1:172.21.15.174:6789/0 conn(0x7f6c8c14cc90 0x7f6c8c1493c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.110:50278/0 (socket says 172.21.15.110:50278) 2021-03-25T14:17:20.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.045+0000 7f6c8bfff700 1 -- 172.21.15.110:0/3564011184 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c8c14d470 msgr2=0x7f6c8c14d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:20.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.045+0000 7f6c8bfff700 1 --2- 172.21.15.110:0/3564011184 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c8c14d470 0x7f6c8c14d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:20.049 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.045+0000 7f6c8bfff700 1 -- 172.21.15.110:0/3564011184 >> v1:172.21.15.174:6789/0 conn(0x7f6c8c14cc90 legacy=0x7f6c8c1493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:20.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.046+0000 7f6c8a7fc700 1 -- 172.21.15.110:0/3564011184 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1068899060 0 0) 0x7f6c8c0691b0 con 0x7f6c8c14cc90 2021-03-25T14:17:20.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.046+0000 7f6c8bfff700 1 -- 172.21.15.110:0/3564011184 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8c14a070 con 0x7f6c8c0685d0 2021-03-25T14:17:20.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.046+0000 7f6c8b7fe700 1 --2- 172.21.15.110:0/3564011184 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c8c14d470 0x7f6c8c14d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:17:20.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.046+0000 7f6c8bfff700 1 --2- 172.21.15.110:0/3564011184 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c8c0685d0 0x7f6c8c068a60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f6c84009d90 tx=0x7f6c840092d0).ready entity=mon.1 client_cookie=170bc2dc2e1d8288 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:20.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.046+0000 7f6c8a7fc700 1 -- 172.21.15.110:0/3564011184 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8400bbf0 con 0x7f6c8c0685d0 2021-03-25T14:17:20.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.046+0000 7f6c8a7fc700 1 -- 172.21.15.110:0/3564011184 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c8400bd50 con 0x7f6c8c0685d0 2021-03-25T14:17:20.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.046+0000 7f6c8a7fc700 1 -- 172.21.15.110:0/3564011184 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c84011610 con 0x7f6c8c0685d0 2021-03-25T14:17:20.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.046+0000 7f6c91ffe700 1 -- 172.21.15.110:0/3564011184 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c8c0685d0 msgr2=0x7f6c8c068a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:20.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.046+0000 7f6c91ffe700 1 --2- 172.21.15.110:0/3564011184 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c8c0685d0 0x7f6c8c068a60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f6c84009d90 tx=0x7f6c840092d0).stop 2021-03-25T14:17:20.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.046+0000 7f6c91ffe700 1 -- 172.21.15.110:0/3564011184 shutdown_connections 2021-03-25T14:17:20.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.046+0000 7f6c91ffe700 1 --2- 172.21.15.110:0/3564011184 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c8c0685d0 0x7f6c8c068a60 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:20.050 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.046+0000 7f6c91ffe700 1 --2- 172.21.15.110:0/3564011184 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c8c14d470 0x7f6c8c14d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:20.051 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.046+0000 7f6c91ffe700 1 -- 172.21.15.110:0/3564011184 >> 172.21.15.110:0/3564011184 conn(0x7f6c8c060c40 msgr2=0x7f6c8c061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:20.051 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.046+0000 7f6c91ffe700 1 -- 172.21.15.110:0/3564011184 shutdown_connections 2021-03-25T14:17:20.051 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.046+0000 7f6c91ffe700 1 -- 172.21.15.110:0/3564011184 wait complete. 2021-03-25T14:17:20.053 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.048+0000 7f6c91ffe700 1 Processor -- start 2021-03-25T14:17:20.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.048+0000 7f6c91ffe700 1 -- start start 2021-03-25T14:17:20.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.048+0000 7f6c91ffe700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c8c0685d0 0x7f6c8c0a5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:20.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.048+0000 7f6c91ffe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c8c14cc90 0x7f6c8c0baeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:20.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.048+0000 7f6c91ffe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c8c14d470 0x7f6c8c144ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:20.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.048+0000 7f6c91ffe700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c0a4a60 con 0x7f6c8c14d470 2021-03-25T14:17:20.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.048+0000 7f6c91ffe700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c0a3450 con 0x7f6c8c0685d0 2021-03-25T14:17:20.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.048+0000 7f6c91ffe700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c0a4c50 con 0x7f6c8c14cc90 2021-03-25T14:17:20.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.049+0000 7f6c8bfff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c8c14d470 0x7f6c8c144ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:20.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.049+0000 7f6c8bfff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c8c14d470 0x7f6c8c144ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49684/0 (socket says 172.21.15.110:49684) 2021-03-25T14:17:20.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.049+0000 7f6c8bfff700 1 -- 172.21.15.110:0/1511365912 learned_addr learned my addr 172.21.15.110:0/1511365912 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:20.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.049+0000 7f6c8b7fe700 1 --2- 172.21.15.110:0/1511365912 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c8c0685d0 0x7f6c8c0a5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:20.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.049+0000 7f6c8affd700 1 --2- 172.21.15.110:0/1511365912 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c8c14cc90 0x7f6c8c0baeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:20.055 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.049+0000 7f6c8bfff700 1 -- 172.21.15.110:0/1511365912 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c8c14cc90 msgr2=0x7f6c8c0baeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:20.055 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.049+0000 7f6c8bfff700 1 --2- 172.21.15.110:0/1511365912 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c8c14cc90 0x7f6c8c0baeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:20.055 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.049+0000 7f6c8bfff700 1 -- 172.21.15.110:0/1511365912 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c8c0685d0 msgr2=0x7f6c8c0a5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:20.055 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.049+0000 7f6c8bfff700 1 --2- 172.21.15.110:0/1511365912 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c8c0685d0 0x7f6c8c0a5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:20.055 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.049+0000 7f6c8bfff700 1 -- 172.21.15.110:0/1511365912 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8c0a4ef0 con 0x7f6c8c14d470 2021-03-25T14:17:20.055 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.049+0000 7f6c8bfff700 1 --2- 172.21.15.110:0/1511365912 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c8c14d470 0x7f6c8c144ba0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f6c84009310 tx=0x7f6c84017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:20.055 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.049+0000 7f6c737fe700 1 -- 172.21.15.110:0/1511365912 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8400bec0 con 0x7f6c8c14d470 2021-03-25T14:17:20.055 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.049+0000 7f6c737fe700 1 -- 172.21.15.110:0/1511365912 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c84011e30 con 0x7f6c8c14d470 2021-03-25T14:17:20.055 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.049+0000 7f6c91ffe700 1 -- 172.21.15.110:0/1511365912 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c8c0a5190 con 0x7f6c8c14d470 2021-03-25T14:17:20.055 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.049+0000 7f6c737fe700 1 -- 172.21.15.110:0/1511365912 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c84010c70 con 0x7f6c8c14d470 2021-03-25T14:17:20.055 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.049+0000 7f6c91ffe700 1 -- 172.21.15.110:0/1511365912 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c8c0bb870 con 0x7f6c8c14d470 2021-03-25T14:17:20.055 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.050+0000 7f6c91ffe700 1 -- 172.21.15.110:0/1511365912 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c8c05d7b0 con 0x7f6c8c14d470 2021-03-25T14:17:20.055 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.051+0000 7f6c737fe700 1 -- 172.21.15.110:0/1511365912 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f6c8400f070 con 0x7f6c8c14d470 2021-03-25T14:17:20.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.051+0000 7f6c737fe700 1 --2- 172.21.15.110:0/1511365912 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6c6c05a0b0 0x7f6c6c05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:20.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.051+0000 7f6c737fe700 1 -- 172.21.15.110:0/1511365912 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 7250+0+0 (secure 0 0 0) 0x7f6c84075ea0 con 0x7f6c8c14d470 2021-03-25T14:17:20.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.051+0000 7f6c8b7fe700 1 --2- 172.21.15.110:0/1511365912 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6c6c05a0b0 0x7f6c6c05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:20.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.051+0000 7f6c8b7fe700 1 --2- 172.21.15.110:0/1511365912 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6c6c05a0b0 0x7f6c6c05c570 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f6c8c14e760 tx=0x7f6c7c006e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:20.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.056+0000 7f6c737fe700 1 -- 172.21.15.110:0/1511365912 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f6c840493a0 con 0x7f6c8c14d470 2021-03-25T14:17:20.207 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.205+0000 7f6c91ffe700 1 -- 172.21.15.110:0/1511365912 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f6c8c150010 con 0x7f6c8c14d470 2021-03-25T14:17:20.207 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.206+0000 7f6c737fe700 1 -- 172.21.15.110:0/1511365912 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v42) v1 ==== 110+0+10 (secure 0 0 0) 0x7f6c8404c9c0 con 0x7f6c8c14d470 2021-03-25T14:17:20.208 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 1 2021-03-25T14:17:20.210 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.207+0000 7f6c91ffe700 1 -- 172.21.15.110:0/1511365912 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6c6c05a0b0 msgr2=0x7f6c6c05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:20.210 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.207+0000 7f6c91ffe700 1 --2- 172.21.15.110:0/1511365912 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6c6c05a0b0 0x7f6c6c05c570 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f6c8c14e760 tx=0x7f6c7c006e20).stop 2021-03-25T14:17:20.210 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.207+0000 7f6c91ffe700 1 -- 172.21.15.110:0/1511365912 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c8c14d470 msgr2=0x7f6c8c144ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:20.210 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.207+0000 7f6c91ffe700 1 --2- 172.21.15.110:0/1511365912 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c8c14d470 0x7f6c8c144ba0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f6c84009310 tx=0x7f6c84017000).stop 2021-03-25T14:17:20.210 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.207+0000 7f6c91ffe700 1 -- 172.21.15.110:0/1511365912 shutdown_connections 2021-03-25T14:17:20.210 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.207+0000 7f6c91ffe700 1 --2- 172.21.15.110:0/1511365912 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6c6c05a0b0 0x7f6c6c05c570 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:20.210 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.208+0000 7f6c91ffe700 1 --2- 172.21.15.110:0/1511365912 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c8c0685d0 0x7f6c8c0a5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:20.210 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.208+0000 7f6c91ffe700 1 --2- 172.21.15.110:0/1511365912 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c8c14d470 0x7f6c8c144ba0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:20.210 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.208+0000 7f6c91ffe700 1 --2- 172.21.15.110:0/1511365912 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c8c14cc90 0x7f6c8c0baeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:20.210 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.208+0000 7f6c91ffe700 1 -- 172.21.15.110:0/1511365912 >> 172.21.15.110:0/1511365912 conn(0x7f6c8c060c40 msgr2=0x7f6c8c0bf6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:20.211 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.208+0000 7f6c91ffe700 1 -- 172.21.15.110:0/1511365912 shutdown_connections 2021-03-25T14:17:20.211 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.208+0000 7f6c91ffe700 1 -- 172.21.15.110:0/1511365912 wait complete. 2021-03-25T14:17:20.221 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-03-25T14:17:20.333 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.331+0000 7fd6ecc24700 1 Processor -- start 2021-03-25T14:17:20.333 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.331+0000 7fd6ecc24700 1 -- start start 2021-03-25T14:17:20.336 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.332+0000 7fd6ecc24700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd6e8148c40 0x7fd6e81490c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:20.336 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.332+0000 7fd6ecc24700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e814cea0 con 0x7fd6e80b1500 2021-03-25T14:17:20.336 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.332+0000 7fd6ecc24700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e814d140 con 0x7fd6e81495b0 2021-03-25T14:17:20.336 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.332+0000 7fd6ecc24700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6e8067e90 con 0x7fd6e8148c40 2021-03-25T14:17:20.336 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.332+0000 7fd6e5d9b700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd6e8148c40 0x7fd6e81490c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:20.336 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.332+0000 7fd6e659c700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fd6e80b1500 0x7fd6e8067780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:42624/0 (socket says 172.21.15.110:42624) 2021-03-25T14:17:20.336 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.332+0000 7fd6e659c700 1 -- 172.21.15.110:0/1867227490 learned_addr learned my addr 172.21.15.110:0/1867227490 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:20.336 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.332+0000 7fd6e5d9b700 1 -- 172.21.15.110:0/1867227490 >> v1:172.21.15.174:6789/0 conn(0x7fd6e81495b0 legacy=0x7fd6e81499f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:20.337 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.332+0000 7fd6e5d9b700 1 -- 172.21.15.110:0/1867227490 >> v1:172.21.15.110:6789/0 conn(0x7fd6e80b1500 legacy=0x7fd6e8067780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:20.337 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.332+0000 7fd6e559a700 1 -- 172.21.15.110:0/1867227490 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1176171192 0 0) 0x7fd6e814cea0 con 0x7fd6e80b1500 2021-03-25T14:17:20.337 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.332+0000 7fd6e5d9b700 1 -- 172.21.15.110:0/1867227490 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e814d3e0 con 0x7fd6e8148c40 2021-03-25T14:17:20.337 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.332+0000 7fd6e5d9b700 1 --2- 172.21.15.110:0/1867227490 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6e8148c40 0x7fd6e81490c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7fd6dc00b9c0 tx=0x7fd6dc006e20).ready entity=mon.0 client_cookie=aebcdc9da77f1e74 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:20.337 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.333+0000 7fd6e559a700 1 -- 172.21.15.110:0/1867227490 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc0097a0 con 0x7fd6e8148c40 2021-03-25T14:17:20.337 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.333+0000 7fd6e559a700 1 -- 172.21.15.110:0/1867227490 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6dc009900 con 0x7fd6e8148c40 2021-03-25T14:17:20.337 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.333+0000 7fd6e559a700 1 -- 172.21.15.110:0/1867227490 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc009c80 con 0x7fd6e8148c40 2021-03-25T14:17:20.337 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.333+0000 7fd6ecc24700 1 -- 172.21.15.110:0/1867227490 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6e8148c40 msgr2=0x7fd6e81490c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:20.337 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.333+0000 7fd6ecc24700 1 --2- 172.21.15.110:0/1867227490 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6e8148c40 0x7fd6e81490c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7fd6dc00b9c0 tx=0x7fd6dc006e20).stop 2021-03-25T14:17:20.337 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.333+0000 7fd6ecc24700 1 -- 172.21.15.110:0/1867227490 shutdown_connections 2021-03-25T14:17:20.337 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.333+0000 7fd6ecc24700 1 --2- 172.21.15.110:0/1867227490 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6e8148c40 0x7fd6e81490c0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:20.337 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.333+0000 7fd6ecc24700 1 -- 172.21.15.110:0/1867227490 >> 172.21.15.110:0/1867227490 conn(0x7fd6e80649a0 msgr2=0x7fd6e805c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:20.338 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.333+0000 7fd6ecc24700 1 -- 172.21.15.110:0/1867227490 shutdown_connections 2021-03-25T14:17:20.338 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.333+0000 7fd6ecc24700 1 -- 172.21.15.110:0/1867227490 wait complete. 2021-03-25T14:17:20.338 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.334+0000 7fd6ecc24700 1 Processor -- start 2021-03-25T14:17:20.338 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.334+0000 7fd6ecc24700 1 -- start start 2021-03-25T14:17:20.341 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.335+0000 7fd6ecc24700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd6e80b1500 0x7fd6e8144ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:20.342 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.335+0000 7fd6ecc24700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd6e8148c40 0x7fd6e8145410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:20.342 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.335+0000 7fd6ecc24700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6e81495b0 0x7fd6e8145900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:20.342 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.335+0000 7fd6ecc24700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e8158d20 con 0x7fd6e81495b0 2021-03-25T14:17:20.342 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.335+0000 7fd6ecc24700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e8142880 con 0x7fd6e80b1500 2021-03-25T14:17:20.343 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.335+0000 7fd6ecc24700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e8158f50 con 0x7fd6e8148c40 2021-03-25T14:17:20.343 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.335+0000 7fd6e6d9d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6e81495b0 0x7fd6e8145900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:20.343 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.335+0000 7fd6e6d9d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6e81495b0 0x7fd6e8145900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49696/0 (socket says 172.21.15.110:49696) 2021-03-25T14:17:20.343 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.335+0000 7fd6e6d9d700 1 -- 172.21.15.110:0/581442810 learned_addr learned my addr 172.21.15.110:0/581442810 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:20.343 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.335+0000 7fd6e659c700 1 --2- 172.21.15.110:0/581442810 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd6e80b1500 0x7fd6e8144ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:20.344 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.335+0000 7fd6e5d9b700 1 --2- 172.21.15.110:0/581442810 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd6e8148c40 0x7fd6e8145410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:20.344 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.335+0000 7fd6e6d9d700 1 -- 172.21.15.110:0/581442810 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd6e8148c40 msgr2=0x7fd6e8145410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:20.344 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.335+0000 7fd6e6d9d700 1 --2- 172.21.15.110:0/581442810 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd6e8148c40 0x7fd6e8145410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:20.344 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.335+0000 7fd6e6d9d700 1 -- 172.21.15.110:0/581442810 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd6e80b1500 msgr2=0x7fd6e8144ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:20.344 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.335+0000 7fd6e6d9d700 1 --2- 172.21.15.110:0/581442810 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd6e80b1500 0x7fd6e8144ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:20.344 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.335+0000 7fd6e6d9d700 1 -- 172.21.15.110:0/581442810 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e81591f0 con 0x7fd6e81495b0 2021-03-25T14:17:20.344 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.335+0000 7fd6e6d9d700 1 --2- 172.21.15.110:0/581442810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6e81495b0 0x7fd6e8145900 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7fd6e000cae0 tx=0x7fd6e00023f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:20.344 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.336+0000 7fd6d67fc700 1 -- 172.21.15.110:0/581442810 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e000cea0 con 0x7fd6e81495b0 2021-03-25T14:17:20.344 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.336+0000 7fd6d67fc700 1 -- 172.21.15.110:0/581442810 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e000a7f0 con 0x7fd6e81495b0 2021-03-25T14:17:20.345 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.336+0000 7fd6d67fc700 1 -- 172.21.15.110:0/581442810 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e000ab90 con 0x7fd6e81495b0 2021-03-25T14:17:20.345 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.336+0000 7fd6ecc24700 1 -- 172.21.15.110:0/581442810 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6e8159490 con 0x7fd6e81495b0 2021-03-25T14:17:20.345 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.336+0000 7fd6ecc24700 1 -- 172.21.15.110:0/581442810 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6e80be460 con 0x7fd6e81495b0 2021-03-25T14:17:20.345 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.336+0000 7fd6ecc24700 1 -- 172.21.15.110:0/581442810 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6e8159620 con 0x7fd6e81495b0 2021-03-25T14:17:20.345 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.337+0000 7fd6d67fc700 1 -- 172.21.15.110:0/581442810 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fd6e0010070 con 0x7fd6e81495b0 2021-03-25T14:17:20.345 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.337+0000 7fd6d67fc700 1 --2- 172.21.15.110:0/581442810 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd6c405a0b0 0x7fd6c405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:20.346 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.337+0000 7fd6d67fc700 1 -- 172.21.15.110:0/581442810 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 7250+0+0 (secure 0 0 0) 0x7fd6e0073fb0 con 0x7fd6e81495b0 2021-03-25T14:17:20.346 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.337+0000 7fd6e659c700 1 --2- 172.21.15.110:0/581442810 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd6c405a0b0 0x7fd6c405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:20.346 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.338+0000 7fd6e659c700 1 --2- 172.21.15.110:0/581442810 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd6c405a0b0 0x7fd6c405c570 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fd6d8007fd0 tx=0x7fd6d8007c50).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:20.346 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.342+0000 7fd6d67fc700 1 -- 172.21.15.110:0/581442810 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fd6e004aee0 con 0x7fd6e81495b0 2021-03-25T14:17:20.494 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.492+0000 7fd6ecc24700 1 -- 172.21.15.110:0/581442810 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd6e805d7b0 con 0x7fd6e81495b0 2021-03-25T14:17:20.495 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.493+0000 7fd6d67fc700 1 -- 172.21.15.110:0/581442810 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v42) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd6e00024f0 con 0x7fd6e81495b0 2021-03-25T14:17:20.495 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:17:20.497 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.494+0000 7fd6ecc24700 1 -- 172.21.15.110:0/581442810 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd6c405a0b0 msgr2=0x7fd6c405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:20.497 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.494+0000 7fd6ecc24700 1 --2- 172.21.15.110:0/581442810 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd6c405a0b0 0x7fd6c405c570 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fd6d8007fd0 tx=0x7fd6d8007c50).stop 2021-03-25T14:17:20.497 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.494+0000 7fd6ecc24700 1 -- 172.21.15.110:0/581442810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6e81495b0 msgr2=0x7fd6e8145900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:20.497 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.494+0000 7fd6ecc24700 1 --2- 172.21.15.110:0/581442810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6e81495b0 0x7fd6e8145900 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7fd6e000cae0 tx=0x7fd6e00023f0).stop 2021-03-25T14:17:20.497 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.494+0000 7fd6ecc24700 1 -- 172.21.15.110:0/581442810 shutdown_connections 2021-03-25T14:17:20.497 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.494+0000 7fd6ecc24700 1 --2- 172.21.15.110:0/581442810 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd6c405a0b0 0x7fd6c405c570 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:20.497 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.494+0000 7fd6ecc24700 1 --2- 172.21.15.110:0/581442810 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd6e80b1500 0x7fd6e8144ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:20.497 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.494+0000 7fd6ecc24700 1 --2- 172.21.15.110:0/581442810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6e81495b0 0x7fd6e8145900 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:20.497 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.494+0000 7fd6ecc24700 1 --2- 172.21.15.110:0/581442810 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd6e8148c40 0x7fd6e8145410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:20.497 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.494+0000 7fd6ecc24700 1 -- 172.21.15.110:0/581442810 >> 172.21.15.110:0/581442810 conn(0x7fd6e80649a0 msgr2=0x7fd6e81499b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:20.498 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.494+0000 7fd6ecc24700 1 -- 172.21.15.110:0/581442810 shutdown_connections 2021-03-25T14:17:20.498 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.494+0000 7fd6ecc24700 1 -- 172.21.15.110:0/581442810 wait complete. 2021-03-25T14:17:20.508 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-03-25T14:17:20.620 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.618+0000 7fd479cf2700 1 Processor -- start 2021-03-25T14:17:20.620 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.618+0000 7fd479cf2700 1 -- start start 2021-03-25T14:17:20.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.619+0000 7fd479cf2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd47414cc90 0x7fd47414d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:20.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.619+0000 7fd479cf2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4740685d0 0x7fd474068a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:20.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.619+0000 7fd479cf2700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4740691b0 con 0x7fd47414d470 2021-03-25T14:17:20.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.619+0000 7fd479cf2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4740bc2b0 con 0x7fd47414cc90 2021-03-25T14:17:20.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.619+0000 7fd479cf2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd474149dd0 con 0x7fd4740685d0 2021-03-25T14:17:20.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.619+0000 7fd4737fe700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fd47414d470 0x7fd4741493c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:42638/0 (socket says 172.21.15.110:42638) 2021-03-25T14:17:20.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.619+0000 7fd4737fe700 1 -- 172.21.15.110:0/1346575919 learned_addr learned my addr 172.21.15.110:0/1346575919 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:20.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.619+0000 7fd4727fc700 1 -- 172.21.15.110:0/1346575919 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4280293607 0 0) 0x7fd4740691b0 con 0x7fd47414d470 2021-03-25T14:17:20.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.619+0000 7fd4727fc700 1 -- 172.21.15.110:0/1346575919 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd460003270 con 0x7fd47414d470 2021-03-25T14:17:20.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.619+0000 7fd473fff700 1 --2- 172.21.15.110:0/1346575919 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4740685d0 0x7fd474068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:20.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.619+0000 7fd472ffd700 1 --2- 172.21.15.110:0/1346575919 >> v2:172.21.15.174:3300/0 conn(0x7fd47414cc90 0x7fd47414d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:20.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.620+0000 7fd4727fc700 1 -- 172.21.15.110:0/1346575919 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3842112714 0 0) 0x7fd460003270 con 0x7fd47414d470 2021-03-25T14:17:20.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.620+0000 7fd4727fc700 1 -- 172.21.15.110:0/1346575919 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4740685d0 msgr2=0x7fd474068a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:20.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.620+0000 7fd4727fc700 1 --2- 172.21.15.110:0/1346575919 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4740685d0 0x7fd474068a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:20.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.620+0000 7fd4727fc700 1 -- 172.21.15.110:0/1346575919 >> v2:172.21.15.174:3300/0 conn(0x7fd47414cc90 msgr2=0x7fd47414d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:20.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.620+0000 7fd4727fc700 1 --2- 172.21.15.110:0/1346575919 >> v2:172.21.15.174:3300/0 conn(0x7fd47414cc90 0x7fd47414d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:20.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.620+0000 7fd4727fc700 1 -- 172.21.15.110:0/1346575919 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd47414a070 con 0x7fd47414d470 2021-03-25T14:17:20.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.620+0000 7fd4727fc700 1 -- 172.21.15.110:0/1346575919 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7fd464001520 con 0x7fd47414d470 2021-03-25T14:17:20.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.620+0000 7fd4727fc700 1 -- 172.21.15.110:0/1346575919 >> v1:172.21.15.110:6789/0 conn(0x7fd47414d470 legacy=0x7fd4741493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:20.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.620+0000 7fd4727fc700 1 --2- 172.21.15.110:0/1346575919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd460003760 0x7fd460003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:20.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.620+0000 7fd4727fc700 1 --2- 172.21.15.110:0/1346575919 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4740685d0 0x7fd460004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:20.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.620+0000 7fd4727fc700 1 --2- 172.21.15.110:0/1346575919 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd460004a00 0x7fd460004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:20.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.620+0000 7fd4727fc700 1 -- 172.21.15.110:0/1346575919 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4740bc2b0 con 0x7fd460003760 2021-03-25T14:17:20.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.620+0000 7fd4727fc700 1 -- 172.21.15.110:0/1346575919 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd474149dd0 con 0x7fd460004a00 2021-03-25T14:17:20.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.620+0000 7fd4727fc700 1 -- 172.21.15.110:0/1346575919 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd460004200 con 0x7fd4740685d0 2021-03-25T14:17:20.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.620+0000 7fd472ffd700 1 --2- 172.21.15.110:0/1346575919 >> v2:172.21.15.174:3300/0 conn(0x7fd47414cc90 0x7fd47414d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:20.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.620+0000 7fd4737fe700 1 --2- 172.21.15.110:0/1346575919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd460003760 0x7fd460003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:20.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.620+0000 7fd473fff700 1 --2- 172.21.15.110:0/1346575919 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd460004a00 0x7fd460004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:20.630 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.620+0000 7fd472ffd700 1 --2- 172.21.15.110:0/1346575919 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4740685d0 0x7fd460004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:20.630 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.620+0000 7fd4737fe700 1 -- 172.21.15.110:0/1346575919 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4740685d0 msgr2=0x7fd460004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:20.630 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.620+0000 7fd4737fe700 1 --2- 172.21.15.110:0/1346575919 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4740685d0 0x7fd460004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:20.630 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.620+0000 7fd4737fe700 1 -- 172.21.15.110:0/1346575919 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd460004a00 msgr2=0x7fd460004e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:20.630 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.620+0000 7fd4737fe700 1 --2- 172.21.15.110:0/1346575919 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd460004a00 0x7fd460004e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:20.630 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.620+0000 7fd4737fe700 1 -- 172.21.15.110:0/1346575919 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd460003270 con 0x7fd460003760 2021-03-25T14:17:20.630 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.620+0000 7fd4737fe700 1 --2- 172.21.15.110:0/1346575919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd460003760 0x7fd460003b80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7fd46400c470 tx=0x7fd47414a200).ready entity=mon.0 client_cookie=14407bc159f820dc server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:20.630 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.620+0000 7fd4727fc700 1 -- 172.21.15.110:0/1346575919 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4640070d0 con 0x7fd460003760 2021-03-25T14:17:20.630 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.620+0000 7fd4727fc700 1 -- 172.21.15.110:0/1346575919 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd464007230 con 0x7fd460003760 2021-03-25T14:17:20.630 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.620+0000 7fd4727fc700 1 -- 172.21.15.110:0/1346575919 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd464005620 con 0x7fd460003760 2021-03-25T14:17:20.630 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.621+0000 7fd479cf2700 1 -- 172.21.15.110:0/1346575919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd460003760 msgr2=0x7fd460003b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:20.630 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.621+0000 7fd479cf2700 1 --2- 172.21.15.110:0/1346575919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd460003760 0x7fd460003b80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7fd46400c470 tx=0x7fd47414a200).stop 2021-03-25T14:17:20.631 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.621+0000 7fd473fff700 1 -- 172.21.15.110:0/1346575919 reap_dead start 2021-03-25T14:17:20.631 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.621+0000 7fd479cf2700 1 -- 172.21.15.110:0/1346575919 shutdown_connections 2021-03-25T14:17:20.631 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.621+0000 7fd479cf2700 1 -- 172.21.15.110:0/1346575919 >> 172.21.15.110:0/1346575919 conn(0x7fd474060c40 msgr2=0x7fd474061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:20.631 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.621+0000 7fd479cf2700 1 -- 172.21.15.110:0/1346575919 shutdown_connections 2021-03-25T14:17:20.631 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.621+0000 7fd479cf2700 1 -- 172.21.15.110:0/1346575919 wait complete. 2021-03-25T14:17:20.631 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.622+0000 7fd479cf2700 1 Processor -- start 2021-03-25T14:17:20.631 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.622+0000 7fd479cf2700 1 -- start start 2021-03-25T14:17:20.631 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.623+0000 7fd479cf2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4740bae20 0x7fd4740b88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:20.631 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.623+0000 7fd479cf2700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd474064bc0 0x7fd4740b8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:20.631 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.623+0000 7fd479cf2700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd474144e60 0x7fd4741452e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:20.631 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.623+0000 7fd479cf2700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4740bf7d0 con 0x7fd474064bc0 2021-03-25T14:17:20.631 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.623+0000 7fd479cf2700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4740b92c0 con 0x7fd474144e60 2021-03-25T14:17:20.631 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.623+0000 7fd479cf2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4740a5230 con 0x7fd4740bae20 2021-03-25T14:17:20.632 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.623+0000 7fd472ffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd474064bc0 0x7fd4740b8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:20.632 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.623+0000 7fd472ffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd474064bc0 0x7fd4740b8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49716/0 (socket says 172.21.15.110:49716) 2021-03-25T14:17:20.632 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.623+0000 7fd472ffd700 1 -- 172.21.15.110:0/1722256405 learned_addr learned my addr 172.21.15.110:0/1722256405 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:20.632 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.623+0000 7fd4737fe700 1 --2- 172.21.15.110:0/1722256405 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4740bae20 0x7fd4740b88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:20.632 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.623+0000 7fd473fff700 1 --2- 172.21.15.110:0/1722256405 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd474144e60 0x7fd4741452e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:20.632 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.623+0000 7fd472ffd700 1 -- 172.21.15.110:0/1722256405 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4740bae20 msgr2=0x7fd4740b88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:20.632 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.623+0000 7fd472ffd700 1 --2- 172.21.15.110:0/1722256405 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4740bae20 0x7fd4740b88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:20.632 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.623+0000 7fd472ffd700 1 -- 172.21.15.110:0/1722256405 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd474144e60 msgr2=0x7fd4741452e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:20.632 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.623+0000 7fd472ffd700 1 --2- 172.21.15.110:0/1722256405 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd474144e60 0x7fd4741452e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:20.632 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.623+0000 7fd472ffd700 1 -- 172.21.15.110:0/1722256405 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4740a54d0 con 0x7fd474064bc0 2021-03-25T14:17:20.632 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.623+0000 7fd473fff700 1 --2- 172.21.15.110:0/1722256405 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd474144e60 0x7fd4741452e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:20.632 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.623+0000 7fd472ffd700 1 --2- 172.21.15.110:0/1722256405 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd474064bc0 0x7fd4740b8dd0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fd468010c50 tx=0x7fd468008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:20.632 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.624+0000 7fd45b7fe700 1 -- 172.21.15.110:0/1722256405 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46800e9a0 con 0x7fd474064bc0 2021-03-25T14:17:20.633 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.624+0000 7fd45b7fe700 1 -- 172.21.15.110:0/1722256405 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46800eb00 con 0x7fd474064bc0 2021-03-25T14:17:20.633 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.624+0000 7fd45b7fe700 1 -- 172.21.15.110:0/1722256405 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46800ee80 con 0x7fd474064bc0 2021-03-25T14:17:20.633 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.624+0000 7fd479cf2700 1 -- 172.21.15.110:0/1722256405 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4740b5fb0 con 0x7fd474064bc0 2021-03-25T14:17:20.633 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.624+0000 7fd479cf2700 1 -- 172.21.15.110:0/1722256405 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4740b64f0 con 0x7fd474064bc0 2021-03-25T14:17:20.633 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.625+0000 7fd479cf2700 1 -- 172.21.15.110:0/1722256405 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd47414a250 con 0x7fd474064bc0 2021-03-25T14:17:20.633 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.625+0000 7fd45b7fe700 1 -- 172.21.15.110:0/1722256405 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fd468014680 con 0x7fd474064bc0 2021-03-25T14:17:20.633 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.625+0000 7fd45b7fe700 1 --2- 172.21.15.110:0/1722256405 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd45405a0b0 0x7fd45405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:20.633 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.625+0000 7fd45b7fe700 1 -- 172.21.15.110:0/1722256405 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 7250+0+0 (secure 0 0 0) 0x7fd4680745f0 con 0x7fd474064bc0 2021-03-25T14:17:20.633 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.625+0000 7fd4737fe700 1 --2- 172.21.15.110:0/1722256405 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd45405a0b0 0x7fd45405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:20.633 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.625+0000 7fd4737fe700 1 --2- 172.21.15.110:0/1722256405 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd45405a0b0 0x7fd45405c570 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fd474061c20 tx=0x7fd464013000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:20.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.629+0000 7fd45b7fe700 1 -- 172.21.15.110:0/1722256405 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fd468047af0 con 0x7fd474064bc0 2021-03-25T14:17:20.780 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.778+0000 7fd479cf2700 1 -- 172.21.15.110:0/1722256405 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd47405d7b0 con 0x7fd474064bc0 2021-03-25T14:17:20.780 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.778+0000 7fd45b7fe700 1 -- 172.21.15.110:0/1722256405 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) v1 ==== 104+0+10 (secure 0 0 0) 0x7fd46804b110 con 0x7fd474064bc0 2021-03-25T14:17:20.781 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:17:20.782 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.780+0000 7fd479cf2700 1 -- 172.21.15.110:0/1722256405 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd45405a0b0 msgr2=0x7fd45405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:20.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.780+0000 7fd479cf2700 1 --2- 172.21.15.110:0/1722256405 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd45405a0b0 0x7fd45405c570 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fd474061c20 tx=0x7fd464013000).stop 2021-03-25T14:17:20.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.780+0000 7fd479cf2700 1 -- 172.21.15.110:0/1722256405 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd474064bc0 msgr2=0x7fd4740b8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:20.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.780+0000 7fd479cf2700 1 --2- 172.21.15.110:0/1722256405 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd474064bc0 0x7fd4740b8dd0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fd468010c50 tx=0x7fd468008040).stop 2021-03-25T14:17:20.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.780+0000 7fd479cf2700 1 -- 172.21.15.110:0/1722256405 shutdown_connections 2021-03-25T14:17:20.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.780+0000 7fd479cf2700 1 --2- 172.21.15.110:0/1722256405 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd45405a0b0 0x7fd45405c570 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:20.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.780+0000 7fd479cf2700 1 --2- 172.21.15.110:0/1722256405 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd474144e60 0x7fd4741452e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:20.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.780+0000 7fd479cf2700 1 --2- 172.21.15.110:0/1722256405 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4740bae20 0x7fd4740b88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:20.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.780+0000 7fd479cf2700 1 --2- 172.21.15.110:0/1722256405 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd474064bc0 0x7fd4740b8dd0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:20.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.780+0000 7fd479cf2700 1 -- 172.21.15.110:0/1722256405 >> 172.21.15.110:0/1722256405 conn(0x7fd474060c40 msgr2=0x7fd4740b5290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:20.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.780+0000 7fd479cf2700 1 -- 172.21.15.110:0/1722256405 shutdown_connections 2021-03-25T14:17:20.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.780+0000 7fd479cf2700 1 -- 172.21.15.110:0/1722256405 wait complete. 2021-03-25T14:17:20.794 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-03-25T14:17:20.906 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.904+0000 7fa83d4cf700 1 Processor -- start 2021-03-25T14:17:20.906 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.904+0000 7fa83d4cf700 1 -- start start 2021-03-25T14:17:20.909 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.905+0000 7fa83d4cf700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa83814cc90 0x7fa83814d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:20.909 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.905+0000 7fa83d4cf700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa8380685d0 0x7fa838068a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:20.909 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.905+0000 7fa83d4cf700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8380691b0 con 0x7fa83814d470 2021-03-25T14:17:20.909 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.905+0000 7fa83d4cf700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8380bc2b0 con 0x7fa83814cc90 2021-03-25T14:17:20.909 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.905+0000 7fa83d4cf700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa838149dd0 con 0x7fa8380685d0 2021-03-25T14:17:20.909 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.905+0000 7fa8367fc700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa83814cc90 0x7fa83814d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:20.909 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.905+0000 7fa836ffd700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fa83814d470 0x7fa8381493c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:42658/0 (socket says 172.21.15.110:42658) 2021-03-25T14:17:20.909 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.905+0000 7fa836ffd700 1 -- 172.21.15.110:0/2117320480 learned_addr learned my addr 172.21.15.110:0/2117320480 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:20.910 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.905+0000 7fa8377fe700 1 --2- 172.21.15.110:0/2117320480 >> v2:172.21.15.174:3300/0 conn(0x7fa8380685d0 0x7fa838068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:20.910 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.905+0000 7fa8367fc700 1 -- 172.21.15.110:0/2117320480 >> v2:172.21.15.174:3300/0 conn(0x7fa8380685d0 msgr2=0x7fa838068a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:20.910 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.905+0000 7fa8367fc700 1 --2- 172.21.15.110:0/2117320480 >> v2:172.21.15.174:3300/0 conn(0x7fa8380685d0 0x7fa838068a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:20.910 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.905+0000 7fa8367fc700 1 -- 172.21.15.110:0/2117320480 >> v1:172.21.15.110:6789/0 conn(0x7fa83814d470 legacy=0x7fa8381493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:20.910 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.905+0000 7fa8367fc700 1 -- 172.21.15.110:0/2117320480 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83814a070 con 0x7fa83814cc90 2021-03-25T14:17:20.910 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.905+0000 7fa835ffb700 1 -- 172.21.15.110:0/2117320480 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2539159684 0 0) 0x7fa8380691b0 con 0x7fa83814d470 2021-03-25T14:17:20.910 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.906+0000 7fa8367fc700 1 --2- 172.21.15.110:0/2117320480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa83814cc90 0x7fa83814d850 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7fa8380bc110 tx=0x7fa82c006e20).ready entity=mon.0 client_cookie=97003599c17fb2f3 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:20.910 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.906+0000 7fa835ffb700 1 -- 172.21.15.110:0/2117320480 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c009870 con 0x7fa83814cc90 2021-03-25T14:17:20.910 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.906+0000 7fa835ffb700 1 -- 172.21.15.110:0/2117320480 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82c0099d0 con 0x7fa83814cc90 2021-03-25T14:17:20.910 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.906+0000 7fa835ffb700 1 -- 172.21.15.110:0/2117320480 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c009d50 con 0x7fa83814cc90 2021-03-25T14:17:20.910 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.906+0000 7fa83d4cf700 1 -- 172.21.15.110:0/2117320480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa83814cc90 msgr2=0x7fa83814d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:20.910 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.906+0000 7fa83d4cf700 1 --2- 172.21.15.110:0/2117320480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa83814cc90 0x7fa83814d850 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7fa8380bc110 tx=0x7fa82c006e20).stop 2021-03-25T14:17:20.911 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.906+0000 7fa83d4cf700 1 -- 172.21.15.110:0/2117320480 shutdown_connections 2021-03-25T14:17:20.911 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.906+0000 7fa83d4cf700 1 --2- 172.21.15.110:0/2117320480 >> v2:172.21.15.174:3300/0 conn(0x7fa8380685d0 0x7fa838068a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:20.911 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.906+0000 7fa83d4cf700 1 --2- 172.21.15.110:0/2117320480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa83814cc90 0x7fa83814d850 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:20.911 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.906+0000 7fa83d4cf700 1 -- 172.21.15.110:0/2117320480 >> 172.21.15.110:0/2117320480 conn(0x7fa838060c40 msgr2=0x7fa838061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:20.911 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.906+0000 7fa83d4cf700 1 -- 172.21.15.110:0/2117320480 shutdown_connections 2021-03-25T14:17:20.911 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.906+0000 7fa83d4cf700 1 -- 172.21.15.110:0/2117320480 wait complete. 2021-03-25T14:17:20.911 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.907+0000 7fa83d4cf700 1 Processor -- start 2021-03-25T14:17:20.911 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.907+0000 7fa83d4cf700 1 -- start start 2021-03-25T14:17:20.914 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.908+0000 7fa83d4cf700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8380685d0 0x7fa8380b82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:20.914 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.908+0000 7fa83d4cf700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa83814cc90 0x7fa8380bb020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:20.914 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.908+0000 7fa83d4cf700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa83814d470 0x7fa838159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:20.914 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.908+0000 7fa83d4cf700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8380b8180 con 0x7fa8380685d0 2021-03-25T14:17:20.915 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.908+0000 7fa83d4cf700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8380b97c0 con 0x7fa83814cc90 2021-03-25T14:17:20.915 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.908+0000 7fa83d4cf700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8380b99f0 con 0x7fa83814d470 2021-03-25T14:17:20.915 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.908+0000 7fa836ffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8380685d0 0x7fa8380b82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:20.915 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.908+0000 7fa836ffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8380685d0 0x7fa8380b82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49728/0 (socket says 172.21.15.110:49728) 2021-03-25T14:17:20.915 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.908+0000 7fa836ffd700 1 -- 172.21.15.110:0/2606457684 learned_addr learned my addr 172.21.15.110:0/2606457684 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:20.915 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.908+0000 7fa8377fe700 1 --2- 172.21.15.110:0/2606457684 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa83814d470 0x7fa838159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:20.915 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.908+0000 7fa8367fc700 1 --2- 172.21.15.110:0/2606457684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa83814cc90 0x7fa8380bb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:20.915 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.908+0000 7fa836ffd700 1 -- 172.21.15.110:0/2606457684 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa83814d470 msgr2=0x7fa838159070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:20.915 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.908+0000 7fa836ffd700 1 --2- 172.21.15.110:0/2606457684 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa83814d470 0x7fa838159070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:20.915 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.908+0000 7fa836ffd700 1 -- 172.21.15.110:0/2606457684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa83814cc90 msgr2=0x7fa8380bb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:20.915 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.908+0000 7fa836ffd700 1 --2- 172.21.15.110:0/2606457684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa83814cc90 0x7fa8380bb020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:20.915 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.908+0000 7fa836ffd700 1 -- 172.21.15.110:0/2606457684 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8380b9c90 con 0x7fa8380685d0 2021-03-25T14:17:20.915 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.908+0000 7fa8377fe700 1 --2- 172.21.15.110:0/2606457684 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa83814d470 0x7fa838159070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:20.916 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.908+0000 7fa8367fc700 1 --2- 172.21.15.110:0/2606457684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa83814cc90 0x7fa8380bb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:20.916 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.909+0000 7fa836ffd700 1 --2- 172.21.15.110:0/2606457684 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8380685d0 0x7fa8380b82f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7fa82800c760 tx=0x7fa828007d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:20.916 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.909+0000 7fa81effd700 1 -- 172.21.15.110:0/2606457684 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa828007320 con 0x7fa8380685d0 2021-03-25T14:17:20.916 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.909+0000 7fa81effd700 1 -- 172.21.15.110:0/2606457684 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa828007480 con 0x7fa8380685d0 2021-03-25T14:17:20.916 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.909+0000 7fa83d4cf700 1 -- 172.21.15.110:0/2606457684 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8380b9f30 con 0x7fa8380685d0 2021-03-25T14:17:20.916 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.909+0000 7fa81effd700 1 -- 172.21.15.110:0/2606457684 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa828005830 con 0x7fa8380685d0 2021-03-25T14:17:20.916 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.909+0000 7fa83d4cf700 1 -- 172.21.15.110:0/2606457684 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa838158bd0 con 0x7fa8380685d0 2021-03-25T14:17:20.916 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.910+0000 7fa83d4cf700 1 -- 172.21.15.110:0/2606457684 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa83805d7b0 con 0x7fa8380685d0 2021-03-25T14:17:20.916 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.910+0000 7fa81effd700 1 -- 172.21.15.110:0/2606457684 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fa828010030 con 0x7fa8380685d0 2021-03-25T14:17:20.916 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.910+0000 7fa81effd700 1 --2- 172.21.15.110:0/2606457684 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa81805a0b0 0x7fa81805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:20.916 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.910+0000 7fa81effd700 1 -- 172.21.15.110:0/2606457684 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 7250+0+0 (secure 0 0 0) 0x7fa828073e80 con 0x7fa8380685d0 2021-03-25T14:17:20.916 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.910+0000 7fa8367fc700 1 --2- 172.21.15.110:0/2606457684 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa81805a0b0 0x7fa81805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:20.916 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.911+0000 7fa8367fc700 1 --2- 172.21.15.110:0/2606457684 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa81805a0b0 0x7fa81805c570 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fa82c006e60 tx=0x7fa82c016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:20.917 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:20.914+0000 7fa81effd700 1 -- 172.21.15.110:0/2606457684 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fa828047380 con 0x7fa8380685d0 2021-03-25T14:17:21.066 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.064+0000 7fa83d4cf700 1 -- 172.21.15.110:0/2606457684 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa8380bb5d0 con 0x7fa8380685d0 2021-03-25T14:17:21.066 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.064+0000 7fa81effd700 1 -- 172.21.15.110:0/2606457684 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+10 (secure 0 0 0) 0x7fa82804a9a0 con 0x7fa8380685d0 2021-03-25T14:17:21.066 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:17:21.068 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.066+0000 7fa83d4cf700 1 -- 172.21.15.110:0/2606457684 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa81805a0b0 msgr2=0x7fa81805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:21.068 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.066+0000 7fa83d4cf700 1 --2- 172.21.15.110:0/2606457684 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa81805a0b0 0x7fa81805c570 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fa82c006e60 tx=0x7fa82c016000).stop 2021-03-25T14:17:21.068 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.066+0000 7fa83d4cf700 1 -- 172.21.15.110:0/2606457684 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8380685d0 msgr2=0x7fa8380b82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:21.068 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.066+0000 7fa83d4cf700 1 --2- 172.21.15.110:0/2606457684 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8380685d0 0x7fa8380b82f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7fa82800c760 tx=0x7fa828007d10).stop 2021-03-25T14:17:21.068 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.066+0000 7fa83d4cf700 1 -- 172.21.15.110:0/2606457684 shutdown_connections 2021-03-25T14:17:21.068 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.066+0000 7fa83d4cf700 1 --2- 172.21.15.110:0/2606457684 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa81805a0b0 0x7fa81805c570 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:21.069 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.066+0000 7fa83d4cf700 1 --2- 172.21.15.110:0/2606457684 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa83814d470 0x7fa838159070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:21.069 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.066+0000 7fa83d4cf700 1 --2- 172.21.15.110:0/2606457684 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8380685d0 0x7fa8380b82f0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:21.069 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.066+0000 7fa83d4cf700 1 --2- 172.21.15.110:0/2606457684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa83814cc90 0x7fa8380bb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:21.069 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.066+0000 7fa83d4cf700 1 -- 172.21.15.110:0/2606457684 >> 172.21.15.110:0/2606457684 conn(0x7fa838060c40 msgr2=0x7fa8380b4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:21.069 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.066+0000 7fa83d4cf700 1 -- 172.21.15.110:0/2606457684 shutdown_connections 2021-03-25T14:17:21.069 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.066+0000 7fa83d4cf700 1 -- 172.21.15.110:0/2606457684 wait complete. 2021-03-25T14:17:21.079 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2021-03-25T14:17:21.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.191+0000 7f184ac89700 1 Processor -- start 2021-03-25T14:17:21.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.191+0000 7f184ac89700 1 -- start start 2021-03-25T14:17:21.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.191+0000 7f184ac89700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1844064be0 0x7f1844149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:21.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.191+0000 7f184ac89700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f184414a2b0 0x7f1844065620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:21.196 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.191+0000 7f184ac89700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f184414a6f0 con 0x7f1844064800 2021-03-25T14:17:21.196 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.191+0000 7f184ac89700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f184414cf60 con 0x7f1844064be0 2021-03-25T14:17:21.196 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.191+0000 7f184ac89700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f184414d200 con 0x7f184414a2b0 2021-03-25T14:17:21.196 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.192+0000 7f1843fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1844064be0 0x7f1844149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:21.196 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.192+0000 7f1843fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1844064be0 0x7f1844149dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49738/0 (socket says 172.21.15.110:49738) 2021-03-25T14:17:21.196 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.192+0000 7f1843fff700 1 -- 172.21.15.110:0/717074006 learned_addr learned my addr 172.21.15.110:0/717074006 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:21.196 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.192+0000 7f1849226700 1 --2- 172.21.15.110:0/717074006 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f184414a2b0 0x7f1844065620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:21.196 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.192+0000 7f1843fff700 1 -- 172.21.15.110:0/717074006 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f184414a2b0 msgr2=0x7f1844065620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:21.196 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.192+0000 7f1843fff700 1 --2- 172.21.15.110:0/717074006 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f184414a2b0 0x7f1844065620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:21.196 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.192+0000 7f1843fff700 1 -- 172.21.15.110:0/717074006 >> v1:172.21.15.174:6789/0 conn(0x7f1844064800 legacy=0x7f1844066c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:21.196 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.192+0000 7f1843fff700 1 -- 172.21.15.110:0/717074006 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f184414d4a0 con 0x7f1844064be0 2021-03-25T14:17:21.196 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.192+0000 7f1843fff700 1 --2- 172.21.15.110:0/717074006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1844064be0 0x7f1844149dc0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f184414a880 tx=0x7f1830006ee0).ready entity=mon.0 client_cookie=246cc962b28046a2 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:21.196 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.192+0000 7f18437fe700 1 -- 172.21.15.110:0/717074006 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1830009800 con 0x7f1844064be0 2021-03-25T14:17:21.197 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.192+0000 7f18437fe700 1 -- 172.21.15.110:0/717074006 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1830009960 con 0x7f1844064be0 2021-03-25T14:17:21.197 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.192+0000 7f18437fe700 1 -- 172.21.15.110:0/717074006 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1830009ce0 con 0x7f1844064be0 2021-03-25T14:17:21.197 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.193+0000 7f184ac89700 1 -- 172.21.15.110:0/717074006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1844064be0 msgr2=0x7f1844149dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:21.197 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.193+0000 7f184ac89700 1 --2- 172.21.15.110:0/717074006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1844064be0 0x7f1844149dc0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f184414a880 tx=0x7f1830006ee0).stop 2021-03-25T14:17:21.197 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.193+0000 7f184ac89700 1 -- 172.21.15.110:0/717074006 shutdown_connections 2021-03-25T14:17:21.197 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.193+0000 7f184ac89700 1 --2- 172.21.15.110:0/717074006 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f184414a2b0 0x7f1844065620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:21.197 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.193+0000 7f184ac89700 1 --2- 172.21.15.110:0/717074006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1844064be0 0x7f1844149dc0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:21.197 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.193+0000 7f184ac89700 1 -- 172.21.15.110:0/717074006 >> 172.21.15.110:0/717074006 conn(0x7f1844060c40 msgr2=0x7f1844061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:21.197 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.193+0000 7f184ac89700 1 -- 172.21.15.110:0/717074006 shutdown_connections 2021-03-25T14:17:21.197 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.193+0000 7f184ac89700 1 -- 172.21.15.110:0/717074006 wait complete. 2021-03-25T14:17:21.198 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.194+0000 7f184ac89700 1 Processor -- start 2021-03-25T14:17:21.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.194+0000 7f184ac89700 1 -- start start 2021-03-25T14:17:21.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.194+0000 7f184ac89700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1844064800 0x7f18440ba1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:21.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.195+0000 7f184ac89700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1844064be0 0x7f18440bc370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:21.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.195+0000 7f184ac89700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f184414a2b0 0x7f1844142a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:21.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.195+0000 7f184ac89700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18440bcdd0 con 0x7f184414a2b0 2021-03-25T14:17:21.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.195+0000 7f184ac89700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184415c990 con 0x7f1844064800 2021-03-25T14:17:21.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.195+0000 7f184ac89700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f184415cc30 con 0x7f1844064be0 2021-03-25T14:17:21.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.195+0000 7f1849226700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f184414a2b0 0x7f1844142a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:21.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.195+0000 7f1849226700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f184414a2b0 0x7f1844142a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49746/0 (socket says 172.21.15.110:49746) 2021-03-25T14:17:21.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.195+0000 7f1849226700 1 -- 172.21.15.110:0/3573262512 learned_addr learned my addr 172.21.15.110:0/3573262512 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:21.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.195+0000 7f1843fff700 1 --2- 172.21.15.110:0/3573262512 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1844064be0 0x7f18440bc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:21.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.195+0000 7f1848a25700 1 --2- 172.21.15.110:0/3573262512 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1844064800 0x7f18440ba1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:21.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.195+0000 7f1849226700 1 -- 172.21.15.110:0/3573262512 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1844064be0 msgr2=0x7f18440bc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:21.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.195+0000 7f1849226700 1 --2- 172.21.15.110:0/3573262512 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1844064be0 0x7f18440bc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:21.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.195+0000 7f1849226700 1 -- 172.21.15.110:0/3573262512 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1844064800 msgr2=0x7f18440ba1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:21.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.195+0000 7f1849226700 1 --2- 172.21.15.110:0/3573262512 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1844064800 0x7f18440ba1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:21.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.195+0000 7f1849226700 1 -- 172.21.15.110:0/3573262512 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f184415ced0 con 0x7f184414a2b0 2021-03-25T14:17:21.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.195+0000 7f1848a25700 1 --2- 172.21.15.110:0/3573262512 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1844064800 0x7f18440ba1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:21.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.195+0000 7f1843fff700 1 --2- 172.21.15.110:0/3573262512 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1844064be0 0x7f18440bc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:21.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.195+0000 7f1849226700 1 --2- 172.21.15.110:0/3573262512 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f184414a2b0 0x7f1844142a80 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f183c00db60 tx=0x7f183c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:21.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.195+0000 7f1840ff9700 1 -- 172.21.15.110:0/3573262512 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183c017070 con 0x7f184414a2b0 2021-03-25T14:17:21.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.195+0000 7f1840ff9700 1 -- 172.21.15.110:0/3573262512 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183c00b8e0 con 0x7f184414a2b0 2021-03-25T14:17:21.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.195+0000 7f184ac89700 1 -- 172.21.15.110:0/3573262512 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f184415d170 con 0x7f184414a2b0 2021-03-25T14:17:21.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.195+0000 7f1840ff9700 1 -- 172.21.15.110:0/3573262512 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183c00bc80 con 0x7f184414a2b0 2021-03-25T14:17:21.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.195+0000 7f184ac89700 1 -- 172.21.15.110:0/3573262512 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1844142050 con 0x7f184414a2b0 2021-03-25T14:17:21.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.196+0000 7f184ac89700 1 -- 172.21.15.110:0/3573262512 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f184415d300 con 0x7f184414a2b0 2021-03-25T14:17:21.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.196+0000 7f1840ff9700 1 -- 172.21.15.110:0/3573262512 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f183c013690 con 0x7f184414a2b0 2021-03-25T14:17:21.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.197+0000 7f1840ff9700 1 --2- 172.21.15.110:0/3573262512 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f182405a0b0 0x7f182405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:21.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.197+0000 7f1840ff9700 1 -- 172.21.15.110:0/3573262512 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 7250+0+0 (secure 0 0 0) 0x7f183c074460 con 0x7f184414a2b0 2021-03-25T14:17:21.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.197+0000 7f1848a25700 1 --2- 172.21.15.110:0/3573262512 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f182405a0b0 0x7f182405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:21.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.197+0000 7f1848a25700 1 --2- 172.21.15.110:0/3573262512 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f182405a0b0 0x7f182405c570 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f18380025f0 tx=0x7f1838009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:21.204 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.201+0000 7f1840ff9700 1 -- 172.21.15.110:0/3573262512 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f183c047960 con 0x7f184414a2b0 2021-03-25T14:17:21.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.350+0000 7f184ac89700 1 -- 172.21.15.110:0/3573262512 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f184405d7b0 con 0x7f184414a2b0 2021-03-25T14:17:21.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.350+0000 7f1840ff9700 1 -- 172.21.15.110:0/3573262512 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v42) v1 ==== 105+0+10 (secure 0 0 0) 0x7f183c04af80 con 0x7f184414a2b0 2021-03-25T14:17:21.352 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:17:21.354 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.352+0000 7f184ac89700 1 -- 172.21.15.110:0/3573262512 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f182405a0b0 msgr2=0x7f182405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:21.354 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.352+0000 7f184ac89700 1 --2- 172.21.15.110:0/3573262512 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f182405a0b0 0x7f182405c570 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f18380025f0 tx=0x7f1838009040).stop 2021-03-25T14:17:21.354 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.352+0000 7f184ac89700 1 -- 172.21.15.110:0/3573262512 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f184414a2b0 msgr2=0x7f1844142a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:21.354 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.352+0000 7f184ac89700 1 --2- 172.21.15.110:0/3573262512 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f184414a2b0 0x7f1844142a80 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f183c00db60 tx=0x7f183c008040).stop 2021-03-25T14:17:21.354 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.352+0000 7f184ac89700 1 -- 172.21.15.110:0/3573262512 shutdown_connections 2021-03-25T14:17:21.355 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.352+0000 7f184ac89700 1 --2- 172.21.15.110:0/3573262512 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f182405a0b0 0x7f182405c570 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:21.355 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.352+0000 7f184ac89700 1 --2- 172.21.15.110:0/3573262512 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1844064800 0x7f18440ba1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:21.355 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.352+0000 7f184ac89700 1 --2- 172.21.15.110:0/3573262512 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f184414a2b0 0x7f1844142a80 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:21.355 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.352+0000 7f184ac89700 1 --2- 172.21.15.110:0/3573262512 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1844064be0 0x7f18440bc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:21.355 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.352+0000 7f184ac89700 1 -- 172.21.15.110:0/3573262512 >> 172.21.15.110:0/3573262512 conn(0x7f1844060c40 msgr2=0x7f1844149100 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:21.355 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.352+0000 7f184ac89700 1 -- 172.21.15.110:0/3573262512 shutdown_connections 2021-03-25T14:17:21.355 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.352+0000 7f184ac89700 1 -- 172.21.15.110:0/3573262512 wait complete. 2021-03-25T14:17:21.365 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2021-03-25T14:17:21.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.476+0000 7f8f204b1700 1 Processor -- start 2021-03-25T14:17:21.478 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.476+0000 7f8f204b1700 1 -- start start 2021-03-25T14:17:21.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.477+0000 7f8f204b1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f180b5d00 0x7f8f18145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:21.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.477+0000 7f8f204b1700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8f180648a0 0x7f8f1809db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:21.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.477+0000 7f8f204b1700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f18149c50 con 0x7f8f180b0cc0 2021-03-25T14:17:21.481 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.477+0000 7f8f204b1700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f18067960 con 0x7f8f180648a0 2021-03-25T14:17:21.481 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.477+0000 7f8f204b1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f181461b0 con 0x7f8f180b5d00 2021-03-25T14:17:21.481 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.477+0000 7f8f1ea4e700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8f180648a0 0x7f8f1809db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:21.481 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.477+0000 7f8f1e24d700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f8f180b0cc0 0x7f8f18067250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:42686/0 (socket says 172.21.15.110:42686) 2021-03-25T14:17:21.481 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.477+0000 7f8f1ea4e700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8f180648a0 0x7f8f1809db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49752/0 (socket says 172.21.15.110:49752) 2021-03-25T14:17:21.481 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.477+0000 7f8f1e24d700 1 -- 172.21.15.110:0/2462588050 learned_addr learned my addr 172.21.15.110:0/2462588050 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:21.481 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.477+0000 7f8f1ea4e700 1 -- 172.21.15.110:0/2462588050 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f180b5d00 msgr2=0x7f8f18145cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:21.481 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.477+0000 7f8f1ea4e700 1 --2- 172.21.15.110:0/2462588050 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f180b5d00 0x7f8f18145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:21.481 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.477+0000 7f8f1ea4e700 1 -- 172.21.15.110:0/2462588050 >> v1:172.21.15.110:6789/0 conn(0x7f8f180b0cc0 legacy=0x7f8f18067250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:21.481 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.477+0000 7f8f1d24b700 1 -- 172.21.15.110:0/2462588050 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2476292372 0 0) 0x7f8f18149c50 con 0x7f8f180b0cc0 2021-03-25T14:17:21.481 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.477+0000 7f8f1ea4e700 1 -- 172.21.15.110:0/2462588050 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f18149e80 con 0x7f8f180648a0 2021-03-25T14:17:21.481 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.477+0000 7f8f1ea4e700 1 --2- 172.21.15.110:0/2462588050 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f180648a0 0x7f8f1809db40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f8f10009cc0 tx=0x7f8f10009220).ready entity=mon.0 client_cookie=81194e47c4618722 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:21.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.478+0000 7f8f1d24b700 1 -- 172.21.15.110:0/2462588050 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1000bc80 con 0x7f8f180648a0 2021-03-25T14:17:21.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.478+0000 7f8f1d24b700 1 -- 172.21.15.110:0/2462588050 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f1000bde0 con 0x7f8f180648a0 2021-03-25T14:17:21.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.478+0000 7f8f1d24b700 1 -- 172.21.15.110:0/2462588050 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f10011630 con 0x7f8f180648a0 2021-03-25T14:17:21.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.478+0000 7f8f204b1700 1 -- 172.21.15.110:0/2462588050 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f180648a0 msgr2=0x7f8f1809db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:21.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.478+0000 7f8f204b1700 1 --2- 172.21.15.110:0/2462588050 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f180648a0 0x7f8f1809db40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f8f10009cc0 tx=0x7f8f10009220).stop 2021-03-25T14:17:21.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.478+0000 7f8f204b1700 1 -- 172.21.15.110:0/2462588050 shutdown_connections 2021-03-25T14:17:21.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.478+0000 7f8f204b1700 1 --2- 172.21.15.110:0/2462588050 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f180648a0 0x7f8f1809db40 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:21.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.478+0000 7f8f204b1700 1 --2- 172.21.15.110:0/2462588050 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f180b5d00 0x7f8f18145cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:21.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.478+0000 7f8f204b1700 1 -- 172.21.15.110:0/2462588050 >> 172.21.15.110:0/2462588050 conn(0x7f8f180664e0 msgr2=0x7f8f180668f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:21.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.478+0000 7f8f204b1700 1 -- 172.21.15.110:0/2462588050 shutdown_connections 2021-03-25T14:17:21.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.478+0000 7f8f204b1700 1 -- 172.21.15.110:0/2462588050 wait complete. 2021-03-25T14:17:21.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.479+0000 7f8f204b1700 1 Processor -- start 2021-03-25T14:17:21.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.479+0000 7f8f204b1700 1 -- start start 2021-03-25T14:17:21.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.480+0000 7f8f204b1700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f180648a0 0x7f8f181489a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:21.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.480+0000 7f8f204b1700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f180b0cc0 0x7f8f180a0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:21.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.480+0000 7f8f204b1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f180b5d00 0x7f8f181471e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:21.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.480+0000 7f8f204b1700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1809e3e0 con 0x7f8f180648a0 2021-03-25T14:17:21.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.480+0000 7f8f204b1700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f180a1820 con 0x7f8f180b0cc0 2021-03-25T14:17:21.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.480+0000 7f8f204b1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f18148e90 con 0x7f8f180b5d00 2021-03-25T14:17:21.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.480+0000 7f8f1e24d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f180648a0 0x7f8f181489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:21.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.480+0000 7f8f1e24d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f180648a0 0x7f8f181489a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49756/0 (socket says 172.21.15.110:49756) 2021-03-25T14:17:21.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.480+0000 7f8f1e24d700 1 -- 172.21.15.110:0/3001828619 learned_addr learned my addr 172.21.15.110:0/3001828619 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:21.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.480+0000 7f8f1ea4e700 1 --2- 172.21.15.110:0/3001828619 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f180b5d00 0x7f8f181471e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:21.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.480+0000 7f8f1da4c700 1 --2- 172.21.15.110:0/3001828619 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f180b0cc0 0x7f8f180a0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:21.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.480+0000 7f8f1e24d700 1 -- 172.21.15.110:0/3001828619 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f180b5d00 msgr2=0x7f8f181471e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:21.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.480+0000 7f8f1e24d700 1 --2- 172.21.15.110:0/3001828619 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f180b5d00 0x7f8f181471e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:21.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.480+0000 7f8f1e24d700 1 -- 172.21.15.110:0/3001828619 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f180b0cc0 msgr2=0x7f8f180a0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:21.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.480+0000 7f8f1e24d700 1 --2- 172.21.15.110:0/3001828619 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f180b0cc0 0x7f8f180a0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:21.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.480+0000 7f8f1e24d700 1 -- 172.21.15.110:0/3001828619 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f181490b0 con 0x7f8f180648a0 2021-03-25T14:17:21.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.480+0000 7f8f1ea4e700 1 --2- 172.21.15.110:0/3001828619 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f180b5d00 0x7f8f181471e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:21.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.480+0000 7f8f1da4c700 1 --2- 172.21.15.110:0/3001828619 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f180b0cc0 0x7f8f180a0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:21.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.480+0000 7f8f1e24d700 1 --2- 172.21.15.110:0/3001828619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f180648a0 0x7f8f181489a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f8f1400c7c0 tx=0x7f8f14007af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:21.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.481+0000 7f8f067fc700 1 -- 172.21.15.110:0/3001828619 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f14007320 con 0x7f8f180648a0 2021-03-25T14:17:21.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.481+0000 7f8f067fc700 1 -- 172.21.15.110:0/3001828619 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f14007480 con 0x7f8f180648a0 2021-03-25T14:17:21.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.481+0000 7f8f204b1700 1 -- 172.21.15.110:0/3001828619 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f18158d50 con 0x7f8f180648a0 2021-03-25T14:17:21.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.481+0000 7f8f067fc700 1 -- 172.21.15.110:0/3001828619 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f14005830 con 0x7f8f180648a0 2021-03-25T14:17:21.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.481+0000 7f8f204b1700 1 -- 172.21.15.110:0/3001828619 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f18159530 con 0x7f8f180648a0 2021-03-25T14:17:21.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.481+0000 7f8f204b1700 1 -- 172.21.15.110:0/3001828619 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f1805d7b0 con 0x7f8f180648a0 2021-03-25T14:17:21.488 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.482+0000 7f8f067fc700 1 -- 172.21.15.110:0/3001828619 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f8f14010030 con 0x7f8f180648a0 2021-03-25T14:17:21.488 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.482+0000 7f8f067fc700 1 --2- 172.21.15.110:0/3001828619 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f8ef805a0e0 0x7f8ef805c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:21.488 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.482+0000 7f8f067fc700 1 -- 172.21.15.110:0/3001828619 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 7250+0+0 (secure 0 0 0) 0x7f8f14073e60 con 0x7f8f180648a0 2021-03-25T14:17:21.488 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.482+0000 7f8f1da4c700 1 --2- 172.21.15.110:0/3001828619 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f8ef805a0e0 0x7f8ef805c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:21.488 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.482+0000 7f8f1da4c700 1 --2- 172.21.15.110:0/3001828619 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f8ef805a0e0 0x7f8ef805c5a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f8f18147170 tx=0x7f8f08008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:21.488 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.486+0000 7f8f067fc700 1 -- 172.21.15.110:0/3001828619 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f8f14047360 con 0x7f8f180648a0 2021-03-25T14:17:21.638 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.636+0000 7f8f204b1700 1 -- 172.21.15.110:0/3001828619 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f8f180b77b0 con 0x7f8f180648a0 2021-03-25T14:17:21.638 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.636+0000 7f8f067fc700 1 -- 172.21.15.110:0/3001828619 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v42) v1 ==== 101+0+10 (secure 0 0 0) 0x7f8f1404a980 con 0x7f8f180648a0 2021-03-25T14:17:21.638 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:17:21.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.638+0000 7f8f204b1700 1 -- 172.21.15.110:0/3001828619 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f8ef805a0e0 msgr2=0x7f8ef805c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:21.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.638+0000 7f8f204b1700 1 --2- 172.21.15.110:0/3001828619 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f8ef805a0e0 0x7f8ef805c5a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f8f18147170 tx=0x7f8f08008040).stop 2021-03-25T14:17:21.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.638+0000 7f8f204b1700 1 -- 172.21.15.110:0/3001828619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f180648a0 msgr2=0x7f8f181489a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:21.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.638+0000 7f8f204b1700 1 --2- 172.21.15.110:0/3001828619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f180648a0 0x7f8f181489a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f8f1400c7c0 tx=0x7f8f14007af0).stop 2021-03-25T14:17:21.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.638+0000 7f8f204b1700 1 -- 172.21.15.110:0/3001828619 shutdown_connections 2021-03-25T14:17:21.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.638+0000 7f8f204b1700 1 --2- 172.21.15.110:0/3001828619 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f8ef805a0e0 0x7f8ef805c5a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:21.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.638+0000 7f8f204b1700 1 --2- 172.21.15.110:0/3001828619 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f180b5d00 0x7f8f181471e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:21.641 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.638+0000 7f8f204b1700 1 --2- 172.21.15.110:0/3001828619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f180648a0 0x7f8f181489a0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:21.641 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.638+0000 7f8f204b1700 1 --2- 172.21.15.110:0/3001828619 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f180b0cc0 0x7f8f180a0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:21.641 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.638+0000 7f8f204b1700 1 -- 172.21.15.110:0/3001828619 >> 172.21.15.110:0/3001828619 conn(0x7f8f180664e0 msgr2=0x7f8f180b6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:21.641 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.638+0000 7f8f204b1700 1 -- 172.21.15.110:0/3001828619 shutdown_connections 2021-03-25T14:17:21.641 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.638+0000 7f8f204b1700 1 -- 172.21.15.110:0/3001828619 wait complete. 2021-03-25T14:17:21.651 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-03-25T14:17:21.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.759+0000 7fa73b60c700 1 Processor -- start 2021-03-25T14:17:21.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.759+0000 7fa73b60c700 1 -- start start 2021-03-25T14:17:21.764 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.760+0000 7fa73b60c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7340b99b0 0x7fa7340ba4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:21.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.760+0000 7fa73b60c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa734148fc0 0x7fa7340a3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:21.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.760+0000 7fa73b60c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa734149470 con 0x7fa73414a050 2021-03-25T14:17:21.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.760+0000 7fa73b60c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7340ba9e0 con 0x7fa734148fc0 2021-03-25T14:17:21.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.760+0000 7fa73b60c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7340babc0 con 0x7fa7340b99b0 2021-03-25T14:17:21.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.760+0000 7fa7393a8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7340b99b0 0x7fa7340ba4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:21.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.760+0000 7fa739ba9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa734148fc0 0x7fa7340a3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:21.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.760+0000 7fa7393a8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7340b99b0 0x7fa7340ba4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.110:42166/0 (socket says 172.21.15.110:42166) 2021-03-25T14:17:21.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.760+0000 7fa738ba7700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fa73414a050 0x7fa7341488b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.110:50366/0 (socket says 172.21.15.110:50366) 2021-03-25T14:17:21.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.760+0000 7fa739ba9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa734148fc0 0x7fa7340a3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.110:48418/0 (socket says 172.21.15.110:48418) 2021-03-25T14:17:21.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.760+0000 7fa7393a8700 1 -- 172.21.15.110:0/4008058147 learned_addr learned my addr 172.21.15.110:0/4008058147 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:21.765 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.761+0000 7fa739ba9700 1 -- 172.21.15.110:0/4008058147 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7340b99b0 msgr2=0x7fa7340ba4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:21.766 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.761+0000 7fa739ba9700 1 --2- 172.21.15.110:0/4008058147 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7340b99b0 0x7fa7340ba4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:21.766 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.761+0000 7fa739ba9700 1 -- 172.21.15.110:0/4008058147 >> v1:172.21.15.174:6789/0 conn(0x7fa73414a050 legacy=0x7fa7341488b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:21.766 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.761+0000 7fa739ba9700 1 -- 172.21.15.110:0/4008058147 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7340bae60 con 0x7fa734148fc0 2021-03-25T14:17:21.766 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.761+0000 7fa727fff700 1 -- 172.21.15.110:0/4008058147 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4049009511 0 0) 0x7fa728001110 con 0x7fa73414a050 2021-03-25T14:17:21.766 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.761+0000 7fa7393a8700 1 --2- 172.21.15.110:0/4008058147 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7340b99b0 0x7fa7340ba4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:17:21.766 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.761+0000 7fa739ba9700 1 --2- 172.21.15.110:0/4008058147 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa734148fc0 0x7fa7340a3190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fa72c009cc0 tx=0x7fa72c009220).ready entity=mon.1 client_cookie=b38592e13ec89f05 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:21.766 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.761+0000 7fa727fff700 1 -- 172.21.15.110:0/4008058147 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c00baa0 con 0x7fa734148fc0 2021-03-25T14:17:21.766 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.761+0000 7fa727fff700 1 -- 172.21.15.110:0/4008058147 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72c00bc00 con 0x7fa734148fc0 2021-03-25T14:17:21.766 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.761+0000 7fa727fff700 1 -- 172.21.15.110:0/4008058147 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c011400 con 0x7fa734148fc0 2021-03-25T14:17:21.766 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.761+0000 7fa73b60c700 1 -- 172.21.15.110:0/4008058147 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa734148fc0 msgr2=0x7fa7340a3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:21.766 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.761+0000 7fa73b60c700 1 --2- 172.21.15.110:0/4008058147 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa734148fc0 0x7fa7340a3190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fa72c009cc0 tx=0x7fa72c009220).stop 2021-03-25T14:17:21.767 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.761+0000 7fa73b60c700 1 -- 172.21.15.110:0/4008058147 shutdown_connections 2021-03-25T14:17:21.767 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.761+0000 7fa73b60c700 1 --2- 172.21.15.110:0/4008058147 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa734148fc0 0x7fa7340a3190 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:21.767 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.761+0000 7fa73b60c700 1 --2- 172.21.15.110:0/4008058147 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7340b99b0 0x7fa7340ba4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:21.767 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.761+0000 7fa73b60c700 1 -- 172.21.15.110:0/4008058147 >> 172.21.15.110:0/4008058147 conn(0x7fa734060c40 msgr2=0x7fa734061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:21.767 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.762+0000 7fa73b60c700 1 -- 172.21.15.110:0/4008058147 shutdown_connections 2021-03-25T14:17:21.767 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.762+0000 7fa73b60c700 1 -- 172.21.15.110:0/4008058147 wait complete. 2021-03-25T14:17:21.767 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.763+0000 7fa73b60c700 1 Processor -- start 2021-03-25T14:17:21.767 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.763+0000 7fa73b60c700 1 -- start start 2021-03-25T14:17:21.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.763+0000 7fa73b60c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7340b99b0 0x7fa734063700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:21.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.763+0000 7fa73b60c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa734148fc0 0x7fa7340b7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:21.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.763+0000 7fa73b60c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa73414a050 0x7fa7340b6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:21.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.763+0000 7fa73b60c700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7340b7820 con 0x7fa73414a050 2021-03-25T14:17:21.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.763+0000 7fa73b60c700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa734063d10 con 0x7fa7340b99b0 2021-03-25T14:17:21.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.763+0000 7fa73b60c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7340b4db0 con 0x7fa734148fc0 2021-03-25T14:17:21.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.764+0000 7fa739ba9700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa73414a050 0x7fa7340b6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:21.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.764+0000 7fa7393a8700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7340b99b0 0x7fa734063700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:21.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.764+0000 7fa7393a8700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7340b99b0 0x7fa734063700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.110:48420/0 (socket says 172.21.15.110:48420) 2021-03-25T14:17:21.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.764+0000 7fa7393a8700 1 -- 172.21.15.110:0/1015972343 learned_addr learned my addr 172.21.15.110:0/1015972343 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:21.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.764+0000 7fa739ba9700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa73414a050 0x7fa7340b6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49772/0 (socket says 172.21.15.110:49772) 2021-03-25T14:17:21.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.764+0000 7fa738ba7700 1 --2- 172.21.15.110:0/1015972343 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa734148fc0 0x7fa7340b7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:21.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.764+0000 7fa7393a8700 1 -- 172.21.15.110:0/1015972343 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa734148fc0 msgr2=0x7fa7340b7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:21.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.764+0000 7fa7393a8700 1 --2- 172.21.15.110:0/1015972343 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa734148fc0 0x7fa7340b7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:21.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.764+0000 7fa7393a8700 1 -- 172.21.15.110:0/1015972343 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa73414a050 msgr2=0x7fa7340b6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:21.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.764+0000 7fa7393a8700 1 --2- 172.21.15.110:0/1015972343 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa73414a050 0x7fa7340b6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:21.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.764+0000 7fa7393a8700 1 -- 172.21.15.110:0/1015972343 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7340b5050 con 0x7fa7340b99b0 2021-03-25T14:17:21.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.764+0000 7fa739ba9700 1 --2- 172.21.15.110:0/1015972343 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa73414a050 0x7fa7340b6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:17:21.773 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.764+0000 7fa7393a8700 1 --2- 172.21.15.110:0/1015972343 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7340b99b0 0x7fa734063700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fa73000ed40 tx=0x7fa730008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:21.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.764+0000 7fa7257fa700 1 -- 172.21.15.110:0/1015972343 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73000eea0 con 0x7fa7340b99b0 2021-03-25T14:17:21.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.764+0000 7fa7257fa700 1 -- 172.21.15.110:0/1015972343 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73000cbc0 con 0x7fa7340b99b0 2021-03-25T14:17:21.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.764+0000 7fa73b60c700 1 -- 172.21.15.110:0/1015972343 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa73415cb00 con 0x7fa7340b99b0 2021-03-25T14:17:21.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.764+0000 7fa7257fa700 1 -- 172.21.15.110:0/1015972343 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7300123f0 con 0x7fa7340b99b0 2021-03-25T14:17:21.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.764+0000 7fa73b60c700 1 -- 172.21.15.110:0/1015972343 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7340b6c00 con 0x7fa7340b99b0 2021-03-25T14:17:21.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.765+0000 7fa73b60c700 1 -- 172.21.15.110:0/1015972343 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa73415cce0 con 0x7fa7340b99b0 2021-03-25T14:17:21.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.765+0000 7fa7257fa700 1 -- 172.21.15.110:0/1015972343 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fa730022070 con 0x7fa7340b99b0 2021-03-25T14:17:21.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.766+0000 7fa7257fa700 1 --2- 172.21.15.110:0/1015972343 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa71405a0b0 0x7fa71405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:21.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.766+0000 7fa7257fa700 1 -- 172.21.15.110:0/1015972343 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 7250+0+0 (secure 0 0 0) 0x7fa730074920 con 0x7fa7340b99b0 2021-03-25T14:17:21.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.766+0000 7fa738ba7700 1 --2- 172.21.15.110:0/1015972343 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa71405a0b0 0x7fa71405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:21.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.766+0000 7fa738ba7700 1 --2- 172.21.15.110:0/1015972343 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa71405a0b0 0x7fa71405c570 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7fa734145670 tx=0x7fa728007bf0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:21.775 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.770+0000 7fa7257fa700 1 -- 172.21.15.110:0/1015972343 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fa730047d10 con 0x7fa7340b99b0 2021-03-25T14:17:21.956 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.954+0000 7fa73b60c700 1 -- 172.21.15.110:0/1015972343 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa73405d7b0 con 0x7fa7340b99b0 2021-03-25T14:17:21.987 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.955+0000 7fa7257fa700 1 -- 172.21.15.110:0/1015972343 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3775 (secure 0 0 0) 0x7fa730016070 con 0x7fa7340b99b0 2021-03-25T14:17:21.987 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:21.987 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4804,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6834/4176268149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4176268149},{"type":"v1","addr":"172.21.15.174:6834","nonce":4176268149}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":12},{"gid":4807,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/1554277551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6833","nonce":1554277551},{"type":"v1","addr":"172.21.15.174:6835","nonce":1554277551}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":13}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-03-25T14:17:04.328765+0000","modified":"2021-03-25T14:17:05.329972+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6837/503424314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":503424314},{"type":"v1","addr":"172.21.15.110:6837","nonce":503424314}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-03-25T14:17:14.349898+0000","modified":"2021-03-25T14:17:15.351276+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5025},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5025":{"gid":5025,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.110:6836/2267546898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2267546898},{"type":"v1","addr":"172.21.15.110:6836","nonce":2267546898}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs2","balancer":"","standby_count_wanted":0},"id":3}]} 2021-03-25T14:17:21.989 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.957+0000 7fa73b60c700 1 -- 172.21.15.110:0/1015972343 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa71405a0b0 msgr2=0x7fa71405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:21.989 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.957+0000 7fa73b60c700 1 --2- 172.21.15.110:0/1015972343 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa71405a0b0 0x7fa71405c570 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7fa734145670 tx=0x7fa728007bf0).stop 2021-03-25T14:17:21.989 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.957+0000 7fa73b60c700 1 -- 172.21.15.110:0/1015972343 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7340b99b0 msgr2=0x7fa734063700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:21.989 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.957+0000 7fa73b60c700 1 --2- 172.21.15.110:0/1015972343 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7340b99b0 0x7fa734063700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fa73000ed40 tx=0x7fa730008040).stop 2021-03-25T14:17:21.989 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.957+0000 7fa73b60c700 1 -- 172.21.15.110:0/1015972343 shutdown_connections 2021-03-25T14:17:21.989 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.957+0000 7fa73b60c700 1 --2- 172.21.15.110:0/1015972343 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa71405a0b0 0x7fa71405c570 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:21.989 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.957+0000 7fa73b60c700 1 --2- 172.21.15.110:0/1015972343 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7340b99b0 0x7fa734063700 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:21.989 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.957+0000 7fa73b60c700 1 --2- 172.21.15.110:0/1015972343 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa73414a050 0x7fa7340b6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:21.989 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.957+0000 7fa73b60c700 1 --2- 172.21.15.110:0/1015972343 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa734148fc0 0x7fa7340b7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:21.989 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.957+0000 7fa73b60c700 1 -- 172.21.15.110:0/1015972343 >> 172.21.15.110:0/1015972343 conn(0x7fa734060c40 msgr2=0x7fa7340b9d90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:21.989 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.957+0000 7fa73b60c700 1 -- 172.21.15.110:0/1015972343 shutdown_connections 2021-03-25T14:17:21.990 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:21.957+0000 7fa73b60c700 1 -- 172.21.15.110:0/1015972343 wait complete. 2021-03-25T14:17:21.990 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 18 2021-03-25T14:17:21.990 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:17:22.103 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.101+0000 7f67001ca700 1 Processor -- start 2021-03-25T14:17:22.103 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.101+0000 7f67001ca700 1 -- start start 2021-03-25T14:17:22.106 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.102+0000 7f67001ca700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66f80b1340 0x7f66f814d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:22.106 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.102+0000 7f67001ca700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f66f80b7620 0x7f66f8148ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:22.106 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.102+0000 7f67001ca700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f80b9140 con 0x7f66f80bcd90 2021-03-25T14:17:22.106 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.102+0000 7f67001ca700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66f80692a0 con 0x7f66f80b7620 2021-03-25T14:17:22.106 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.102+0000 7f67001ca700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f80b93e0 con 0x7f66f80b1340 2021-03-25T14:17:22.106 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.102+0000 7f66fe767700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f66f80b7620 0x7f66f8148ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:22.106 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.102+0000 7f66fe767700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f66f80b7620 0x7f66f8148ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49782/0 (socket says 172.21.15.110:49782) 2021-03-25T14:17:22.106 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.102+0000 7f66fe767700 1 -- 172.21.15.110:0/1558211600 learned_addr learned my addr 172.21.15.110:0/1558211600 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:22.106 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.102+0000 7f66fd765700 1 --2- 172.21.15.110:0/1558211600 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66f80b1340 0x7f66f814d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:22.107 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.102+0000 7f66fe767700 1 -- 172.21.15.110:0/1558211600 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66f80b1340 msgr2=0x7f66f814d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:22.107 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.102+0000 7f66fe767700 1 --2- 172.21.15.110:0/1558211600 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66f80b1340 0x7f66f814d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:22.107 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.102+0000 7f66fe767700 1 -- 172.21.15.110:0/1558211600 >> v1:172.21.15.174:6789/0 conn(0x7f66f80bcd90 legacy=0x7f66f8060c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:22.107 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.102+0000 7f66fe767700 1 -- 172.21.15.110:0/1558211600 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f814cda0 con 0x7f66f80b7620 2021-03-25T14:17:22.107 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.102+0000 7f66fe767700 1 --2- 172.21.15.110:0/1558211600 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66f80b7620 0x7f66f8148ab0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f66f0009d90 tx=0x7f66f00092d0).ready entity=mon.0 client_cookie=903bb0053c55cfef server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:22.107 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.102+0000 7f66fcf64700 1 -- 172.21.15.110:0/1558211600 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f000bbb0 con 0x7f66f80b7620 2021-03-25T14:17:22.107 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.103+0000 7f66fcf64700 1 -- 172.21.15.110:0/1558211600 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f000bd10 con 0x7f66f80b7620 2021-03-25T14:17:22.107 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.103+0000 7f66fcf64700 1 -- 172.21.15.110:0/1558211600 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f0011610 con 0x7f66f80b7620 2021-03-25T14:17:22.107 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.103+0000 7f67001ca700 1 -- 172.21.15.110:0/1558211600 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66f80b7620 msgr2=0x7f66f8148ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:22.107 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.103+0000 7f67001ca700 1 --2- 172.21.15.110:0/1558211600 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66f80b7620 0x7f66f8148ab0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f66f0009d90 tx=0x7f66f00092d0).stop 2021-03-25T14:17:22.107 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.103+0000 7f67001ca700 1 -- 172.21.15.110:0/1558211600 shutdown_connections 2021-03-25T14:17:22.107 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.103+0000 7f67001ca700 1 --2- 172.21.15.110:0/1558211600 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66f80b7620 0x7f66f8148ab0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:22.107 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.103+0000 7f67001ca700 1 --2- 172.21.15.110:0/1558211600 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66f80b1340 0x7f66f814d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:22.107 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.103+0000 7f67001ca700 1 -- 172.21.15.110:0/1558211600 >> 172.21.15.110:0/1558211600 conn(0x7f66f8063720 msgr2=0x7f66f8063b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:22.108 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.103+0000 7f67001ca700 1 -- 172.21.15.110:0/1558211600 shutdown_connections 2021-03-25T14:17:22.108 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.103+0000 7f67001ca700 1 -- 172.21.15.110:0/1558211600 wait complete. 2021-03-25T14:17:22.108 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.104+0000 7f67001ca700 1 Processor -- start 2021-03-25T14:17:22.108 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.104+0000 7f67001ca700 1 -- start start 2021-03-25T14:17:22.111 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.105+0000 7f67001ca700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66f80b1340 0x7f66f814a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:22.111 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.105+0000 7f67001ca700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66f80b7620 0x7f66f8148880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:22.111 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.105+0000 7f67001ca700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66f80bcd90 0x7f66f8148d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:22.111 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.105+0000 7f67001ca700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f80b7090 con 0x7f66f80b1340 2021-03-25T14:17:22.111 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.105+0000 7f67001ca700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f81470a0 con 0x7f66f80bcd90 2021-03-25T14:17:22.111 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.105+0000 7f67001ca700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f80b4130 con 0x7f66f80b7620 2021-03-25T14:17:22.111 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.105+0000 7f66fdf66700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66f80b1340 0x7f66f814a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:22.111 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.105+0000 7f66fdf66700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66f80b1340 0x7f66f814a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49784/0 (socket says 172.21.15.110:49784) 2021-03-25T14:17:22.111 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.105+0000 7f66fdf66700 1 -- 172.21.15.110:0/3242668142 learned_addr learned my addr 172.21.15.110:0/3242668142 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:22.111 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.105+0000 7f66fd765700 1 --2- 172.21.15.110:0/3242668142 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66f80b7620 0x7f66f8148880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:22.111 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.105+0000 7f66fe767700 1 --2- 172.21.15.110:0/3242668142 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66f80bcd90 0x7f66f8148d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:22.111 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.105+0000 7f66fdf66700 1 -- 172.21.15.110:0/3242668142 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66f80b7620 msgr2=0x7f66f8148880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:22.112 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.105+0000 7f66fdf66700 1 --2- 172.21.15.110:0/3242668142 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66f80b7620 0x7f66f8148880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:22.112 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.105+0000 7f66fdf66700 1 -- 172.21.15.110:0/3242668142 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66f80bcd90 msgr2=0x7f66f8148d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:22.112 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.105+0000 7f66fdf66700 1 --2- 172.21.15.110:0/3242668142 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66f80bcd90 0x7f66f8148d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:22.112 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.105+0000 7f66fdf66700 1 -- 172.21.15.110:0/3242668142 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f80b66b0 con 0x7f66f80b1340 2021-03-25T14:17:22.112 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.105+0000 7f66fd765700 1 --2- 172.21.15.110:0/3242668142 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66f80b7620 0x7f66f8148880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:22.112 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.105+0000 7f66fdf66700 1 --2- 172.21.15.110:0/3242668142 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66f80b1340 0x7f66f814a040 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f66e800c760 tx=0x7f66e8007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:22.112 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.105+0000 7f66e5ffb700 1 -- 172.21.15.110:0/3242668142 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e8010510 con 0x7f66f80b1340 2021-03-25T14:17:22.112 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.106+0000 7f66e5ffb700 1 -- 172.21.15.110:0/3242668142 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e8010690 con 0x7f66f80b1340 2021-03-25T14:17:22.112 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.106+0000 7f67001ca700 1 -- 172.21.15.110:0/3242668142 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f80b6950 con 0x7f66f80b1340 2021-03-25T14:17:22.112 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.106+0000 7f66e5ffb700 1 -- 172.21.15.110:0/3242668142 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e8010a50 con 0x7f66f80b1340 2021-03-25T14:17:22.112 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.106+0000 7f67001ca700 1 -- 172.21.15.110:0/3242668142 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f814ad80 con 0x7f66f80b1340 2021-03-25T14:17:22.112 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.107+0000 7f67001ca700 1 -- 172.21.15.110:0/3242668142 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66f80b6db0 con 0x7f66f80b1340 2021-03-25T14:17:22.113 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.107+0000 7f66e5ffb700 1 -- 172.21.15.110:0/3242668142 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f66e8010070 con 0x7f66f80b1340 2021-03-25T14:17:22.113 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.107+0000 7f66e5ffb700 1 --2- 172.21.15.110:0/3242668142 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f66d805a0b0 0x7f66d805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:22.113 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.107+0000 7f66e5ffb700 1 -- 172.21.15.110:0/3242668142 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 7250+0+0 (secure 0 0 0) 0x7f66e8073e40 con 0x7f66f80b1340 2021-03-25T14:17:22.113 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.107+0000 7f66fd765700 1 --2- 172.21.15.110:0/3242668142 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f66d805a0b0 0x7f66d805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:22.113 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.108+0000 7f66fd765700 1 --2- 172.21.15.110:0/3242668142 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f66d805a0b0 0x7f66d805c570 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f66f80b3190 tx=0x7f66f4008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:22.113 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.111+0000 7f66e5ffb700 1 -- 172.21.15.110:0/3242668142 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f66e8047340 con 0x7f66f80b1340 2021-03-25T14:17:22.261 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.259+0000 7f67001ca700 1 -- 172.21.15.110:0/3242668142 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66f805d7b0 con 0x7f66f80b1340 2021-03-25T14:17:22.262 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.260+0000 7f66e5ffb700 1 -- 172.21.15.110:0/3242668142 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+20264 (secure 0 0 0) 0x7f66e8073020 con 0x7f66f80b1340 2021-03-25T14:17:22.262 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:22.262 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":42,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:17:15.351754+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2021-03-25T14:17:02.835058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2021-03-25T14:17:03.303869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":8,"pool_name":"cephfs2_metadata","create_time":"2021-03-25T14:17:12.037785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}}},{"pool":9,"pool_name":"cephfs2_data","create_time":"2021-03-25T14:17:13.333853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs2"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:17:22.264 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.262+0000 7f67001ca700 1 -- 172.21.15.110:0/3242668142 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f66d805a0b0 msgr2=0x7f66d805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:22.264 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.262+0000 7f67001ca700 1 --2- 172.21.15.110:0/3242668142 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f66d805a0b0 0x7f66d805c570 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f66f80b3190 tx=0x7f66f4008040).stop 2021-03-25T14:17:22.264 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.262+0000 7f67001ca700 1 -- 172.21.15.110:0/3242668142 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66f80b1340 msgr2=0x7f66f814a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:22.264 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.262+0000 7f67001ca700 1 --2- 172.21.15.110:0/3242668142 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66f80b1340 0x7f66f814a040 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f66e800c760 tx=0x7f66e8007c60).stop 2021-03-25T14:17:22.264 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.262+0000 7f67001ca700 1 -- 172.21.15.110:0/3242668142 shutdown_connections 2021-03-25T14:17:22.264 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.262+0000 7f67001ca700 1 --2- 172.21.15.110:0/3242668142 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f66d805a0b0 0x7f66d805c570 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:22.264 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.262+0000 7f67001ca700 1 --2- 172.21.15.110:0/3242668142 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66f80bcd90 0x7f66f8148d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:22.264 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.262+0000 7f67001ca700 1 --2- 172.21.15.110:0/3242668142 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66f80b1340 0x7f66f814a040 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:22.264 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.262+0000 7f67001ca700 1 --2- 172.21.15.110:0/3242668142 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66f80b7620 0x7f66f8148880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:22.265 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.262+0000 7f67001ca700 1 -- 172.21.15.110:0/3242668142 >> 172.21.15.110:0/3242668142 conn(0x7f66f8063720 msgr2=0x7f66f80bb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:22.265 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.262+0000 7f67001ca700 1 -- 172.21.15.110:0/3242668142 shutdown_connections 2021-03-25T14:17:22.265 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.262+0000 7f67001ca700 1 -- 172.21.15.110:0/3242668142 wait complete. 2021-03-25T14:17:22.275 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2021-03-25T14:17:22.275 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-03-25T14:17:22.386 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.384+0000 7f5c713d8700 1 Processor -- start 2021-03-25T14:17:22.387 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.385+0000 7f5c713d8700 1 -- start start 2021-03-25T14:17:22.392 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.385+0000 7f5c713d8700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5c6c0b6470 0x7f5c6c0bb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:22.392 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.385+0000 7f5c713d8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c6c14d700 0x7f5c6c0bb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:22.392 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.385+0000 7f5c713d8700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c6c14dc40 con 0x7f5c6c0bf5c0 2021-03-25T14:17:22.392 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.385+0000 7f5c713d8700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c6c0a2a30 con 0x7f5c6c0b6470 2021-03-25T14:17:22.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.385+0000 7f5c713d8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c0bbce0 con 0x7f5c6c14d700 2021-03-25T14:17:22.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.385+0000 7f5c6bfff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5c6c0b6470 0x7f5c6c0bb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:22.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.385+0000 7f5c70bd7700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f5c6c0bf5c0 0x7f5c6c148cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:42732/0 (socket says 172.21.15.110:42732) 2021-03-25T14:17:22.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.385+0000 7f5c70bd7700 1 -- 172.21.15.110:0/2881835139 learned_addr learned my addr 172.21.15.110:0/2881835139 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:22.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.386+0000 7f5c6bfff700 1 -- 172.21.15.110:0/2881835139 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c6c14d700 msgr2=0x7f5c6c0bb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:22.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.386+0000 7f5c6b7fe700 1 --2- 172.21.15.110:0/2881835139 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c6c14d700 0x7f5c6c0bb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:22.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.386+0000 7f5c6bfff700 1 --2- 172.21.15.110:0/2881835139 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c6c14d700 0x7f5c6c0bb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:22.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.386+0000 7f5c6affd700 1 -- 172.21.15.110:0/2881835139 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 529844949 0 0) 0x7f5c6c14dc40 con 0x7f5c6c0bf5c0 2021-03-25T14:17:22.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.386+0000 7f5c6bfff700 1 -- 172.21.15.110:0/2881835139 >> v1:172.21.15.110:6789/0 conn(0x7f5c6c0bf5c0 legacy=0x7f5c6c148cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:22.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.386+0000 7f5c6bfff700 1 -- 172.21.15.110:0/2881835139 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c6c149930 con 0x7f5c6c0b6470 2021-03-25T14:17:22.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.386+0000 7f5c6b7fe700 1 --2- 172.21.15.110:0/2881835139 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c6c14d700 0x7f5c6c0bb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:17:22.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.386+0000 7f5c6bfff700 1 --2- 172.21.15.110:0/2881835139 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c6c0b6470 0x7f5c6c0bb300 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f5c5c00b9c0 tx=0x7f5c5c006e20).ready entity=mon.0 client_cookie=b148c22f7a693345 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:22.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.386+0000 7f5c6affd700 1 -- 172.21.15.110:0/2881835139 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c009870 con 0x7f5c6c0b6470 2021-03-25T14:17:22.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.386+0000 7f5c6affd700 1 -- 172.21.15.110:0/2881835139 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c5c0099d0 con 0x7f5c6c0b6470 2021-03-25T14:17:22.394 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.386+0000 7f5c6affd700 1 -- 172.21.15.110:0/2881835139 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c009d50 con 0x7f5c6c0b6470 2021-03-25T14:17:22.394 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.386+0000 7f5c713d8700 1 -- 172.21.15.110:0/2881835139 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c6c0b6470 msgr2=0x7f5c6c0bb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:22.394 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.386+0000 7f5c713d8700 1 --2- 172.21.15.110:0/2881835139 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c6c0b6470 0x7f5c6c0bb300 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f5c5c00b9c0 tx=0x7f5c5c006e20).stop 2021-03-25T14:17:22.394 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.387+0000 7f5c713d8700 1 -- 172.21.15.110:0/2881835139 shutdown_connections 2021-03-25T14:17:22.394 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.387+0000 7f5c713d8700 1 --2- 172.21.15.110:0/2881835139 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c6c0b6470 0x7f5c6c0bb300 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:22.394 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.387+0000 7f5c713d8700 1 --2- 172.21.15.110:0/2881835139 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c6c14d700 0x7f5c6c0bb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:22.394 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.387+0000 7f5c713d8700 1 -- 172.21.15.110:0/2881835139 >> 172.21.15.110:0/2881835139 conn(0x7f5c6c060c40 msgr2=0x7f5c6c061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:22.394 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.387+0000 7f5c713d8700 1 -- 172.21.15.110:0/2881835139 shutdown_connections 2021-03-25T14:17:22.394 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.387+0000 7f5c713d8700 1 -- 172.21.15.110:0/2881835139 wait complete. 2021-03-25T14:17:22.394 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.388+0000 7f5c713d8700 1 Processor -- start 2021-03-25T14:17:22.394 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.388+0000 7f5c713d8700 1 -- start start 2021-03-25T14:17:22.394 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.388+0000 7f5c713d8700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c6c0b6470 0x7f5c6c13c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:22.394 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.388+0000 7f5c713d8700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c6c0bf5c0 0x7f5c6c13c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:22.394 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.388+0000 7f5c713d8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c6c14d700 0x7f5c6c0a1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:22.395 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.388+0000 7f5c713d8700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c0b96a0 con 0x7f5c6c0b6470 2021-03-25T14:17:22.395 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.388+0000 7f5c713d8700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c13bd10 con 0x7f5c6c0bf5c0 2021-03-25T14:17:22.395 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.388+0000 7f5c713d8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c064c50 con 0x7f5c6c14d700 2021-03-25T14:17:22.395 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.389+0000 7f5c6bfff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c6c0b6470 0x7f5c6c13c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:22.395 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.389+0000 7f5c6bfff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c6c0b6470 0x7f5c6c13c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49798/0 (socket says 172.21.15.110:49798) 2021-03-25T14:17:22.395 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.389+0000 7f5c6bfff700 1 -- 172.21.15.110:0/902387214 learned_addr learned my addr 172.21.15.110:0/902387214 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:22.395 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.389+0000 7f5c70bd7700 1 --2- 172.21.15.110:0/902387214 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c6c14d700 0x7f5c6c0a1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:22.395 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.389+0000 7f5c6bfff700 1 -- 172.21.15.110:0/902387214 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c6c14d700 msgr2=0x7f5c6c0a1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:22.395 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.389+0000 7f5c6bfff700 1 --2- 172.21.15.110:0/902387214 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c6c14d700 0x7f5c6c0a1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:22.395 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.389+0000 7f5c6bfff700 1 -- 172.21.15.110:0/902387214 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c6c0bf5c0 msgr2=0x7f5c6c13c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:22.395 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.389+0000 7f5c6b7fe700 1 --2- 172.21.15.110:0/902387214 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c6c0bf5c0 0x7f5c6c13c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:22.395 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.389+0000 7f5c6bfff700 1 --2- 172.21.15.110:0/902387214 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c6c0bf5c0 0x7f5c6c13c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:22.395 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.389+0000 7f5c6bfff700 1 -- 172.21.15.110:0/902387214 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c6c159db0 con 0x7f5c6c0b6470 2021-03-25T14:17:22.396 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.389+0000 7f5c70bd7700 1 --2- 172.21.15.110:0/902387214 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c6c14d700 0x7f5c6c0a1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:17:22.396 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.389+0000 7f5c6bfff700 1 --2- 172.21.15.110:0/902387214 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c6c0b6470 0x7f5c6c13c190 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f5c5c007fd0 tx=0x7f5c5c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:22.396 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.389+0000 7f5c53fff700 1 -- 172.21.15.110:0/902387214 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c01c420 con 0x7f5c6c0b6470 2021-03-25T14:17:22.396 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.389+0000 7f5c53fff700 1 -- 172.21.15.110:0/902387214 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c5c01c580 con 0x7f5c6c0b6470 2021-03-25T14:17:22.396 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.389+0000 7f5c53fff700 1 -- 172.21.15.110:0/902387214 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c01c920 con 0x7f5c6c0b6470 2021-03-25T14:17:22.396 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.389+0000 7f5c713d8700 1 -- 172.21.15.110:0/902387214 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c6c15a050 con 0x7f5c6c0b6470 2021-03-25T14:17:22.396 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.389+0000 7f5c713d8700 1 -- 172.21.15.110:0/902387214 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c6c0a40f0 con 0x7f5c6c0b6470 2021-03-25T14:17:22.396 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.390+0000 7f5c713d8700 1 -- 172.21.15.110:0/902387214 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c6c045ae0 con 0x7f5c6c0b6470 2021-03-25T14:17:22.396 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.390+0000 7f5c53fff700 1 -- 172.21.15.110:0/902387214 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f5c5c00f070 con 0x7f5c6c0b6470 2021-03-25T14:17:22.396 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.391+0000 7f5c53fff700 1 --2- 172.21.15.110:0/902387214 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5c4c05a0b0 0x7f5c4c05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:22.396 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.391+0000 7f5c53fff700 1 -- 172.21.15.110:0/902387214 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 7250+0+0 (secure 0 0 0) 0x7f5c5c075a30 con 0x7f5c6c0b6470 2021-03-25T14:17:22.396 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.391+0000 7f5c6b7fe700 1 --2- 172.21.15.110:0/902387214 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5c4c05a0b0 0x7f5c4c05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:22.397 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.391+0000 7f5c6b7fe700 1 --2- 172.21.15.110:0/902387214 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5c4c05a0b0 0x7f5c4c05c570 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f5c6c15a270 tx=0x7f5c60008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:22.397 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.394+0000 7f5c53fff700 1 -- 172.21.15.110:0/902387214 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f5c5c048f30 con 0x7f5c6c0b6470 2021-03-25T14:17:22.583 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.581+0000 7f5c713d8700 1 -- 172.21.15.110:0/902387214 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c6c0bd3d0 con 0x7f5c6c0b6470 2021-03-25T14:17:22.583 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.581+0000 7f5c53fff700 1 -- 172.21.15.110:0/902387214 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3775 (secure 0 0 0) 0x7f5c5c04c550 con 0x7f5c6c0b6470 2021-03-25T14:17:22.583 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:22.583 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4804,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6834/4176268149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4176268149},{"type":"v1","addr":"172.21.15.174:6834","nonce":4176268149}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":12},{"gid":4807,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/1554277551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6833","nonce":1554277551},{"type":"v1","addr":"172.21.15.174:6835","nonce":1554277551}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":13}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-03-25T14:17:04.328765+0000","modified":"2021-03-25T14:17:05.329972+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6837/503424314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":503424314},{"type":"v1","addr":"172.21.15.110:6837","nonce":503424314}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-03-25T14:17:14.349898+0000","modified":"2021-03-25T14:17:15.351276+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5025},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5025":{"gid":5025,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.110:6836/2267546898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2267546898},{"type":"v1","addr":"172.21.15.110:6836","nonce":2267546898}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs2","balancer":"","standby_count_wanted":0},"id":3}]} 2021-03-25T14:17:22.585 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.583+0000 7f5c713d8700 1 -- 172.21.15.110:0/902387214 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5c4c05a0b0 msgr2=0x7f5c4c05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:22.585 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.583+0000 7f5c713d8700 1 --2- 172.21.15.110:0/902387214 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5c4c05a0b0 0x7f5c4c05c570 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f5c6c15a270 tx=0x7f5c60008040).stop 2021-03-25T14:17:22.585 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.583+0000 7f5c713d8700 1 -- 172.21.15.110:0/902387214 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c6c0b6470 msgr2=0x7f5c6c13c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:22.585 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.583+0000 7f5c713d8700 1 --2- 172.21.15.110:0/902387214 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c6c0b6470 0x7f5c6c13c190 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f5c5c007fd0 tx=0x7f5c5c016000).stop 2021-03-25T14:17:22.585 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.583+0000 7f5c713d8700 1 -- 172.21.15.110:0/902387214 shutdown_connections 2021-03-25T14:17:22.585 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.583+0000 7f5c713d8700 1 --2- 172.21.15.110:0/902387214 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5c4c05a0b0 0x7f5c4c05c570 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:22.585 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.583+0000 7f5c713d8700 1 --2- 172.21.15.110:0/902387214 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c6c14d700 0x7f5c6c0a1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:22.585 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.583+0000 7f5c713d8700 1 --2- 172.21.15.110:0/902387214 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c6c0b6470 0x7f5c6c13c190 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:22.585 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.583+0000 7f5c713d8700 1 --2- 172.21.15.110:0/902387214 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c6c0bf5c0 0x7f5c6c13c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:22.586 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.583+0000 7f5c713d8700 1 -- 172.21.15.110:0/902387214 >> 172.21.15.110:0/902387214 conn(0x7f5c6c060c40 msgr2=0x7f5c6c0bbe20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:22.586 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.583+0000 7f5c713d8700 1 -- 172.21.15.110:0/902387214 shutdown_connections 2021-03-25T14:17:22.586 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.583+0000 7f5c713d8700 1 -- 172.21.15.110:0/902387214 wait complete. 2021-03-25T14:17:22.586 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 18 2021-03-25T14:17:22.596 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-03-25T14:17:22.707 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.705+0000 7f348942c700 1 Processor -- start 2021-03-25T14:17:22.753 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.705+0000 7f348942c700 1 -- start start 2021-03-25T14:17:22.758 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.706+0000 7f348942c700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3484148fc0 0x7f348414a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:22.758 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.706+0000 7f348942c700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f348414a540 con 0x7f34840b99b0 2021-03-25T14:17:22.758 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.706+0000 7f348942c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34840ba950 con 0x7f34840ba4f0 2021-03-25T14:17:22.758 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.706+0000 7f348942c700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3484149430 con 0x7f3484148fc0 2021-03-25T14:17:22.758 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.706+0000 7f34837fe700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3484148fc0 0x7f348414a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:22.758 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.706+0000 7f34837fe700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3484148fc0 0x7f348414a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49806/0 (socket says 172.21.15.110:49806) 2021-03-25T14:17:22.758 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.706+0000 7f3482ffd700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f34840b99b0 0x7f34841488b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:42742/0 (socket says 172.21.15.110:42742) 2021-03-25T14:17:22.758 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.706+0000 7f34837fe700 1 -- 172.21.15.110:0/868963130 learned_addr learned my addr 172.21.15.110:0/868963130 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:22.759 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.707+0000 7f34837fe700 1 -- 172.21.15.110:0/868963130 >> v1:172.21.15.174:6789/0 conn(0x7f34840ba4f0 legacy=0x7f34840a3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:22.759 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.707+0000 7f34837fe700 1 -- 172.21.15.110:0/868963130 >> v1:172.21.15.110:6789/0 conn(0x7f34840b99b0 legacy=0x7f34841488b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:22.759 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.707+0000 7f34837fe700 1 -- 172.21.15.110:0/868963130 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34840babc0 con 0x7f3484148fc0 2021-03-25T14:17:22.759 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.707+0000 7f3481ffb700 1 -- 172.21.15.110:0/868963130 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2211169503 0 0) 0x7f348414a540 con 0x7f34840b99b0 2021-03-25T14:17:22.759 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.707+0000 7f34837fe700 1 --2- 172.21.15.110:0/868963130 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3484148fc0 0x7f348414a050 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f347c009d90 tx=0x7f347c0092d0).ready entity=mon.0 client_cookie=2579e9cfb7e36e38 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:22.759 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.707+0000 7f3481ffb700 1 -- 172.21.15.110:0/868963130 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347c00bc40 con 0x7f3484148fc0 2021-03-25T14:17:22.759 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.707+0000 7f3481ffb700 1 -- 172.21.15.110:0/868963130 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f347c00bda0 con 0x7f3484148fc0 2021-03-25T14:17:22.759 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.707+0000 7f3481ffb700 1 -- 172.21.15.110:0/868963130 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347c011610 con 0x7f3484148fc0 2021-03-25T14:17:22.759 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.707+0000 7f348942c700 1 -- 172.21.15.110:0/868963130 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3484148fc0 msgr2=0x7f348414a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:22.759 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.707+0000 7f348942c700 1 --2- 172.21.15.110:0/868963130 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3484148fc0 0x7f348414a050 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f347c009d90 tx=0x7f347c0092d0).stop 2021-03-25T14:17:22.759 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.707+0000 7f348942c700 1 -- 172.21.15.110:0/868963130 shutdown_connections 2021-03-25T14:17:22.759 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.707+0000 7f348942c700 1 --2- 172.21.15.110:0/868963130 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3484148fc0 0x7f348414a050 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:22.760 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.707+0000 7f348942c700 1 -- 172.21.15.110:0/868963130 >> 172.21.15.110:0/868963130 conn(0x7f3484060c40 msgr2=0x7f3484061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:22.760 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.707+0000 7f348942c700 1 -- 172.21.15.110:0/868963130 shutdown_connections 2021-03-25T14:17:22.760 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.707+0000 7f348942c700 1 -- 172.21.15.110:0/868963130 wait complete. 2021-03-25T14:17:22.760 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.709+0000 7f348942c700 1 Processor -- start 2021-03-25T14:17:22.760 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.709+0000 7f348942c700 1 -- start start 2021-03-25T14:17:22.760 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.709+0000 7f348942c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34840b99b0 0x7f34840b6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:22.760 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.709+0000 7f348942c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34840ba4f0 0x7f34840b4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:22.760 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.709+0000 7f348942c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3484148fc0 0x7f348414e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:22.760 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.709+0000 7f348942c700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348414f220 con 0x7f34840b99b0 2021-03-25T14:17:22.760 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.709+0000 7f348942c700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348414f4c0 con 0x7f34840ba4f0 2021-03-25T14:17:22.760 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.709+0000 7f348942c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f348414f760 con 0x7f3484148fc0 2021-03-25T14:17:22.760 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.709+0000 7f3482ffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34840b99b0 0x7f34840b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:22.760 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.709+0000 7f3482ffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34840b99b0 0x7f34840b6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49810/0 (socket says 172.21.15.110:49810) 2021-03-25T14:17:22.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.709+0000 7f3482ffd700 1 -- 172.21.15.110:0/2558991138 learned_addr learned my addr 172.21.15.110:0/2558991138 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:22.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.710+0000 7f34837fe700 1 --2- 172.21.15.110:0/2558991138 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3484148fc0 0x7f348414e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:22.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.710+0000 7f34827fc700 1 --2- 172.21.15.110:0/2558991138 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34840ba4f0 0x7f34840b4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:22.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.710+0000 7f3482ffd700 1 -- 172.21.15.110:0/2558991138 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3484148fc0 msgr2=0x7f348414e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:22.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.710+0000 7f3482ffd700 1 --2- 172.21.15.110:0/2558991138 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3484148fc0 0x7f348414e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:22.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.710+0000 7f3482ffd700 1 -- 172.21.15.110:0/2558991138 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34840ba4f0 msgr2=0x7f34840b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:22.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.710+0000 7f3482ffd700 1 --2- 172.21.15.110:0/2558991138 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34840ba4f0 0x7f34840b4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:22.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.710+0000 7f3482ffd700 1 -- 172.21.15.110:0/2558991138 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34840b64c0 con 0x7f34840b99b0 2021-03-25T14:17:22.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.710+0000 7f34827fc700 1 --2- 172.21.15.110:0/2558991138 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34840ba4f0 0x7f34840b4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:22.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.710+0000 7f34837fe700 1 --2- 172.21.15.110:0/2558991138 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3484148fc0 0x7f348414e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:22.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.710+0000 7f3482ffd700 1 --2- 172.21.15.110:0/2558991138 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34840b99b0 0x7f34840b6960 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f347400c760 tx=0x7f3474007a20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:22.761 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.710+0000 7f347affd700 1 -- 172.21.15.110:0/2558991138 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3474007320 con 0x7f34840b99b0 2021-03-25T14:17:22.762 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.710+0000 7f347affd700 1 -- 172.21.15.110:0/2558991138 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34740054f0 con 0x7f34840b99b0 2021-03-25T14:17:22.762 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.710+0000 7f348942c700 1 -- 172.21.15.110:0/2558991138 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34840b61b0 con 0x7f34840b99b0 2021-03-25T14:17:22.762 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.710+0000 7f347affd700 1 -- 172.21.15.110:0/2558991138 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3474005870 con 0x7f34840b99b0 2021-03-25T14:17:22.762 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.710+0000 7f348942c700 1 -- 172.21.15.110:0/2558991138 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3484065260 con 0x7f34840b99b0 2021-03-25T14:17:22.762 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.711+0000 7f348942c700 1 -- 172.21.15.110:0/2558991138 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f348405d7b0 con 0x7f34840b99b0 2021-03-25T14:17:22.762 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.711+0000 7f347affd700 1 -- 172.21.15.110:0/2558991138 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f3474010030 con 0x7f34840b99b0 2021-03-25T14:17:22.762 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.712+0000 7f347affd700 1 --2- 172.21.15.110:0/2558991138 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f346805a0b0 0x7f346805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:22.762 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.712+0000 7f347affd700 1 -- 172.21.15.110:0/2558991138 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 7250+0+0 (secure 0 0 0) 0x7f3474073f60 con 0x7f34840b99b0 2021-03-25T14:17:22.762 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.712+0000 7f34827fc700 1 --2- 172.21.15.110:0/2558991138 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f346805a0b0 0x7f346805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:22.762 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.712+0000 7f34827fc700 1 --2- 172.21.15.110:0/2558991138 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f346805a0b0 0x7f346805c570 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f348414e4a0 tx=0x7f346c009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:22.762 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.715+0000 7f347affd700 1 -- 172.21.15.110:0/2558991138 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f3474047460 con 0x7f34840b99b0 2021-03-25T14:17:22.901 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.899+0000 7f348942c700 1 -- 172.21.15.110:0/2558991138 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f34840a4000 con 0x7f34840b99b0 2021-03-25T14:17:22.901 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.899+0000 7f347affd700 1 -- 172.21.15.110:0/2558991138 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3775 (secure 0 0 0) 0x7f347404aa80 con 0x7f34840b99b0 2021-03-25T14:17:22.902 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:22.902 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4804,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6834/4176268149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4176268149},{"type":"v1","addr":"172.21.15.174:6834","nonce":4176268149}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":12},{"gid":4807,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/1554277551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6833","nonce":1554277551},{"type":"v1","addr":"172.21.15.174:6835","nonce":1554277551}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":13}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-03-25T14:17:04.328765+0000","modified":"2021-03-25T14:17:05.329972+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6837/503424314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":503424314},{"type":"v1","addr":"172.21.15.110:6837","nonce":503424314}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-03-25T14:17:14.349898+0000","modified":"2021-03-25T14:17:15.351276+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5025},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5025":{"gid":5025,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.110:6836/2267546898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2267546898},{"type":"v1","addr":"172.21.15.110:6836","nonce":2267546898}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs2","balancer":"","standby_count_wanted":0},"id":3}]} 2021-03-25T14:17:22.904 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.901+0000 7f348942c700 1 -- 172.21.15.110:0/2558991138 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f346805a0b0 msgr2=0x7f346805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:22.904 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.901+0000 7f348942c700 1 --2- 172.21.15.110:0/2558991138 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f346805a0b0 0x7f346805c570 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f348414e4a0 tx=0x7f346c009040).stop 2021-03-25T14:17:22.904 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.901+0000 7f348942c700 1 -- 172.21.15.110:0/2558991138 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34840b99b0 msgr2=0x7f34840b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:22.905 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.901+0000 7f348942c700 1 --2- 172.21.15.110:0/2558991138 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34840b99b0 0x7f34840b6960 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f347400c760 tx=0x7f3474007a20).stop 2021-03-25T14:17:22.905 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.901+0000 7f348942c700 1 -- 172.21.15.110:0/2558991138 shutdown_connections 2021-03-25T14:17:22.905 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.901+0000 7f348942c700 1 --2- 172.21.15.110:0/2558991138 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f346805a0b0 0x7f346805c570 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:22.905 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.901+0000 7f348942c700 1 --2- 172.21.15.110:0/2558991138 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3484148fc0 0x7f348414e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:22.905 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.901+0000 7f348942c700 1 --2- 172.21.15.110:0/2558991138 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34840b99b0 0x7f34840b6960 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:22.905 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.901+0000 7f348942c700 1 --2- 172.21.15.110:0/2558991138 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34840ba4f0 0x7f34840b4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:22.905 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.901+0000 7f348942c700 1 -- 172.21.15.110:0/2558991138 >> 172.21.15.110:0/2558991138 conn(0x7f3484060c40 msgr2=0x7f3484145f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:22.905 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.901+0000 7f348942c700 1 -- 172.21.15.110:0/2558991138 shutdown_connections 2021-03-25T14:17:22.905 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:22.901+0000 7f348942c700 1 -- 172.21.15.110:0/2558991138 wait complete. 2021-03-25T14:17:22.905 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 18 2021-03-25T14:17:22.914 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:17:23.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.022+0000 7f8a09501700 1 Processor -- start 2021-03-25T14:17:23.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.022+0000 7f8a09501700 1 -- start start 2021-03-25T14:17:23.028 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.023+0000 7f8a09501700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8a040b9730 0x7f8a0414cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:23.028 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.023+0000 7f8a09501700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8a040667d0 0x7f8a0414d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:23.028 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.023+0000 7f8a09501700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a040a1f20 0x7f8a0414d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:23.028 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.023+0000 7f8a09501700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a0414db10 con 0x7f8a040667d0 2021-03-25T14:17:23.028 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.023+0000 7f8a09501700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a040a1b90 con 0x7f8a040b9730 2021-03-25T14:17:23.028 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.023+0000 7f8a09501700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a04064680 con 0x7f8a040a1f20 2021-03-25T14:17:23.028 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.023+0000 7f8a027fc700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8a040667d0 0x7f8a0414d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:23.028 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.023+0000 7f8a027fc700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8a040667d0 0x7f8a0414d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49816/0 (socket says 172.21.15.110:49816) 2021-03-25T14:17:23.028 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.023+0000 7f8a027fc700 1 -- 172.21.15.110:0/1999073813 learned_addr learned my addr 172.21.15.110:0/1999073813 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:23.028 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.024+0000 7f8a037fe700 1 --2- 172.21.15.110:0/1999073813 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a040a1f20 0x7f8a0414d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:23.028 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.024+0000 7f8a02ffd700 1 --2- 172.21.15.110:0/1999073813 >> v2:172.21.15.174:3300/0 conn(0x7f8a040b9730 0x7f8a0414cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:23.029 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.024+0000 7f8a027fc700 1 -- 172.21.15.110:0/1999073813 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a040a1f20 msgr2=0x7f8a0414d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:23.029 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.024+0000 7f8a027fc700 1 --2- 172.21.15.110:0/1999073813 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a040a1f20 0x7f8a0414d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:23.029 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.024+0000 7f8a027fc700 1 -- 172.21.15.110:0/1999073813 >> v2:172.21.15.174:3300/0 conn(0x7f8a040b9730 msgr2=0x7f8a0414cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:23.029 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.024+0000 7f8a027fc700 1 --2- 172.21.15.110:0/1999073813 >> v2:172.21.15.174:3300/0 conn(0x7f8a040b9730 0x7f8a0414cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:23.029 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.024+0000 7f8a027fc700 1 -- 172.21.15.110:0/1999073813 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a04064840 con 0x7f8a040667d0 2021-03-25T14:17:23.029 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.024+0000 7f8a02ffd700 1 --2- 172.21.15.110:0/1999073813 >> v2:172.21.15.174:3300/0 conn(0x7f8a040b9730 0x7f8a0414cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:17:23.029 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.024+0000 7f8a027fc700 1 --2- 172.21.15.110:0/1999073813 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a040667d0 0x7f8a0414d130 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7f8a0406a7a0 tx=0x7f89f8006ee0).ready entity=mon.0 client_cookie=e8c59df468f78714 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:23.029 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.024+0000 7f8a01ffb700 1 -- 172.21.15.110:0/1999073813 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f8009850 con 0x7f8a040667d0 2021-03-25T14:17:23.029 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.024+0000 7f8a01ffb700 1 -- 172.21.15.110:0/1999073813 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f80099b0 con 0x7f8a040667d0 2021-03-25T14:17:23.029 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.024+0000 7f8a01ffb700 1 -- 172.21.15.110:0/1999073813 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f8009d30 con 0x7f8a040667d0 2021-03-25T14:17:23.029 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.024+0000 7f8a09501700 1 -- 172.21.15.110:0/1999073813 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a040667d0 msgr2=0x7f8a0414d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:23.029 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.024+0000 7f8a09501700 1 --2- 172.21.15.110:0/1999073813 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a040667d0 0x7f8a0414d130 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7f8a0406a7a0 tx=0x7f89f8006ee0).stop 2021-03-25T14:17:23.030 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.024+0000 7f8a09501700 1 -- 172.21.15.110:0/1999073813 shutdown_connections 2021-03-25T14:17:23.030 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.024+0000 7f8a09501700 1 --2- 172.21.15.110:0/1999073813 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a040a1f20 0x7f8a0414d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:23.030 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.024+0000 7f8a09501700 1 --2- 172.21.15.110:0/1999073813 >> v2:172.21.15.174:3300/0 conn(0x7f8a040b9730 0x7f8a0414cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:23.030 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.024+0000 7f8a09501700 1 --2- 172.21.15.110:0/1999073813 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a040667d0 0x7f8a0414d130 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:23.030 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.024+0000 7f8a09501700 1 -- 172.21.15.110:0/1999073813 >> 172.21.15.110:0/1999073813 conn(0x7f8a040bce50 msgr2=0x7f8a040b8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:23.030 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.024+0000 7f8a09501700 1 -- 172.21.15.110:0/1999073813 shutdown_connections 2021-03-25T14:17:23.030 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.025+0000 7f8a09501700 1 -- 172.21.15.110:0/1999073813 wait complete. 2021-03-25T14:17:23.030 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.026+0000 7f8a09501700 1 Processor -- start 2021-03-25T14:17:23.030 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.026+0000 7f8a09501700 1 -- start start 2021-03-25T14:17:23.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.026+0000 7f8a09501700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a040667d0 0x7f8a0415c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:23.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.026+0000 7f8a09501700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a040a1f20 0x7f8a0414ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:23.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.026+0000 7f8a09501700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a040b9730 0x7f8a04158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:23.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.026+0000 7f8a09501700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0415cdc0 con 0x7f8a040a1f20 2021-03-25T14:17:23.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.026+0000 7f8a09501700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a040b5d60 con 0x7f8a040667d0 2021-03-25T14:17:23.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.026+0000 7f8a09501700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a040b6000 con 0x7f8a040b9730 2021-03-25T14:17:23.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.026+0000 7f8a027fc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a040a1f20 0x7f8a0414ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:23.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.026+0000 7f8a027fc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a040a1f20 0x7f8a0414ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49820/0 (socket says 172.21.15.110:49820) 2021-03-25T14:17:23.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.026+0000 7f8a027fc700 1 -- 172.21.15.110:0/1596681619 learned_addr learned my addr 172.21.15.110:0/1596681619 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:23.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.027+0000 7f8a037fe700 1 --2- 172.21.15.110:0/1596681619 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a040b9730 0x7f8a04158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:23.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.027+0000 7f8a02ffd700 1 --2- 172.21.15.110:0/1596681619 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a040667d0 0x7f8a0415c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:23.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.027+0000 7f8a027fc700 1 -- 172.21.15.110:0/1596681619 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a040b9730 msgr2=0x7f8a04158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:23.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.027+0000 7f8a027fc700 1 --2- 172.21.15.110:0/1596681619 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a040b9730 0x7f8a04158920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:23.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.027+0000 7f8a027fc700 1 -- 172.21.15.110:0/1596681619 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a040667d0 msgr2=0x7f8a0415c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:23.035 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.027+0000 7f8a027fc700 1 --2- 172.21.15.110:0/1596681619 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a040667d0 0x7f8a0415c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:23.035 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.027+0000 7f8a027fc700 1 -- 172.21.15.110:0/1596681619 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a0415bef0 con 0x7f8a040a1f20 2021-03-25T14:17:23.035 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.027+0000 7f8a037fe700 1 --2- 172.21.15.110:0/1596681619 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a040b9730 0x7f8a04158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:23.035 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.027+0000 7f8a027fc700 1 --2- 172.21.15.110:0/1596681619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a040a1f20 0x7f8a0414ee90 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f89f8006f20 tx=0x7f89f8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:23.035 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.027+0000 7f89eaffd700 1 -- 172.21.15.110:0/1596681619 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f8011dc0 con 0x7f8a040a1f20 2021-03-25T14:17:23.035 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.027+0000 7f89eaffd700 1 -- 172.21.15.110:0/1596681619 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f801c420 con 0x7f8a040a1f20 2021-03-25T14:17:23.035 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.027+0000 7f8a09501700 1 -- 172.21.15.110:0/1596681619 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a0415c190 con 0x7f8a040a1f20 2021-03-25T14:17:23.035 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.027+0000 7f89eaffd700 1 -- 172.21.15.110:0/1596681619 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f801c7c0 con 0x7f8a040a1f20 2021-03-25T14:17:23.035 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.027+0000 7f8a09501700 1 -- 172.21.15.110:0/1596681619 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a04117530 con 0x7f8a040a1f20 2021-03-25T14:17:23.035 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.028+0000 7f8a09501700 1 -- 172.21.15.110:0/1596681619 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a0415c5f0 con 0x7f8a040a1f20 2021-03-25T14:17:23.035 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.028+0000 7f89eaffd700 1 -- 172.21.15.110:0/1596681619 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f89f800f070 con 0x7f8a040a1f20 2021-03-25T14:17:23.035 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.028+0000 7f89eaffd700 1 --2- 172.21.15.110:0/1596681619 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f89e405a0b0 0x7f89e405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:23.035 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.029+0000 7f89eaffd700 1 -- 172.21.15.110:0/1596681619 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 7250+0+0 (secure 0 0 0) 0x7f89f80758f0 con 0x7f8a040a1f20 2021-03-25T14:17:23.036 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.029+0000 7f8a02ffd700 1 --2- 172.21.15.110:0/1596681619 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f89e405a0b0 0x7f89e405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:23.036 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.029+0000 7f8a02ffd700 1 --2- 172.21.15.110:0/1596681619 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f89e405a0b0 0x7f89e405c570 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f89f4006fd0 tx=0x7f89f4008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:23.036 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.032+0000 7f89eaffd700 1 -- 172.21.15.110:0/1596681619 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f89f8048df0 con 0x7f8a040a1f20 2021-03-25T14:17:23.188 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.186+0000 7f8a09501700 1 -- 172.21.15.110:0/1596681619 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a0405d7b0 con 0x7f8a040a1f20 2021-03-25T14:17:23.189 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.187+0000 7f89eaffd700 1 -- 172.21.15.110:0/1596681619 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+20264 (secure 0 0 0) 0x7f89f804c410 con 0x7f8a040a1f20 2021-03-25T14:17:23.189 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:23.190 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":42,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:17:15.351754+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2021-03-25T14:17:02.835058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2021-03-25T14:17:03.303869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":8,"pool_name":"cephfs2_metadata","create_time":"2021-03-25T14:17:12.037785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}}},{"pool":9,"pool_name":"cephfs2_data","create_time":"2021-03-25T14:17:13.333853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs2"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:17:23.191 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.189+0000 7f8a09501700 1 -- 172.21.15.110:0/1596681619 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f89e405a0b0 msgr2=0x7f89e405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:23.191 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.189+0000 7f8a09501700 1 --2- 172.21.15.110:0/1596681619 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f89e405a0b0 0x7f89e405c570 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f89f4006fd0 tx=0x7f89f4008040).stop 2021-03-25T14:17:23.192 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.189+0000 7f8a09501700 1 -- 172.21.15.110:0/1596681619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a040a1f20 msgr2=0x7f8a0414ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:23.192 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.189+0000 7f8a09501700 1 --2- 172.21.15.110:0/1596681619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a040a1f20 0x7f8a0414ee90 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f89f8006f20 tx=0x7f89f8016000).stop 2021-03-25T14:17:23.192 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.189+0000 7f8a09501700 1 -- 172.21.15.110:0/1596681619 shutdown_connections 2021-03-25T14:17:23.192 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.189+0000 7f8a09501700 1 --2- 172.21.15.110:0/1596681619 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f89e405a0b0 0x7f89e405c570 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:23.192 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.189+0000 7f8a09501700 1 --2- 172.21.15.110:0/1596681619 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a040667d0 0x7f8a0415c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:23.192 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.189+0000 7f8a09501700 1 --2- 172.21.15.110:0/1596681619 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a040b9730 0x7f8a04158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:23.192 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.189+0000 7f8a09501700 1 --2- 172.21.15.110:0/1596681619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a040a1f20 0x7f8a0414ee90 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:23.192 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.189+0000 7f8a09501700 1 -- 172.21.15.110:0/1596681619 >> 172.21.15.110:0/1596681619 conn(0x7f8a040bce50 msgr2=0x7f8a040b9fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:23.193 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.189+0000 7f8a09501700 1 -- 172.21.15.110:0/1596681619 shutdown_connections 2021-03-25T14:17:23.193 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.189+0000 7f8a09501700 1 -- 172.21.15.110:0/1596681619 wait complete. 2021-03-25T14:17:23.203 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-03-25T14:17:23.314 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.312+0000 7f162c3f9700 1 Processor -- start 2021-03-25T14:17:23.314 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.312+0000 7f162c3f9700 1 -- start start 2021-03-25T14:17:23.321 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.313+0000 7f162c3f9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f16240be5a0 0x7f162409d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:23.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.313+0000 7f162c3f9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16240b9ba0 0x7f1624143270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:23.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.313+0000 7f162c3f9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f162414d0e0 con 0x7f1624143760 2021-03-25T14:17:23.412 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.313+0000 7f162c3f9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f162414d380 con 0x7f16240be5a0 2021-03-25T14:17:23.412 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.313+0000 7f162c3f9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162414d620 con 0x7f16240b9ba0 2021-03-25T14:17:23.412 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.313+0000 7f1629994700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16240b9ba0 0x7f1624143270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:23.412 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.313+0000 7f162a195700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f16240be5a0 0x7f162409d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:23.412 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.313+0000 7f162a996700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f1624143760 0x7f1624149a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.110:50432/0 (socket says 172.21.15.110:50432) 2021-03-25T14:17:23.412 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.313+0000 7f162a996700 1 -- 172.21.15.110:0/1654798572 learned_addr learned my addr 172.21.15.110:0/1654798572 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:23.412 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.314+0000 7f1629994700 1 -- 172.21.15.110:0/1654798572 >> v2:172.21.15.174:3300/0 conn(0x7f16240be5a0 msgr2=0x7f162409d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:23.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.314+0000 7f1629994700 1 --2- 172.21.15.110:0/1654798572 >> v2:172.21.15.174:3300/0 conn(0x7f16240be5a0 0x7f162409d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:23.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.314+0000 7f1629994700 1 -- 172.21.15.110:0/1654798572 >> v1:172.21.15.174:6789/0 conn(0x7f1624143760 legacy=0x7f1624149a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:23.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.314+0000 7f1629994700 1 -- 172.21.15.110:0/1654798572 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f162414d8c0 con 0x7f16240b9ba0 2021-03-25T14:17:23.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.314+0000 7f162a195700 1 --2- 172.21.15.110:0/1654798572 >> v2:172.21.15.174:3300/0 conn(0x7f16240be5a0 0x7f162409d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:17:23.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.314+0000 7f1629994700 1 --2- 172.21.15.110:0/1654798572 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16240b9ba0 0x7f1624143270 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f161800b9c0 tx=0x7f1618006e20).ready entity=mon.2 client_cookie=5b93c807181862b server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:23.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.314+0000 7f1629193700 1 -- 172.21.15.110:0/1654798572 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1618009870 con 0x7f16240b9ba0 2021-03-25T14:17:23.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.314+0000 7f1629193700 1 -- 172.21.15.110:0/1654798572 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16180099d0 con 0x7f16240b9ba0 2021-03-25T14:17:23.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.314+0000 7f1629193700 1 -- 172.21.15.110:0/1654798572 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1618009d50 con 0x7f16240b9ba0 2021-03-25T14:17:23.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.314+0000 7f162c3f9700 1 -- 172.21.15.110:0/1654798572 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16240b9ba0 msgr2=0x7f1624143270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:23.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.314+0000 7f162c3f9700 1 --2- 172.21.15.110:0/1654798572 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16240b9ba0 0x7f1624143270 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f161800b9c0 tx=0x7f1618006e20).stop 2021-03-25T14:17:23.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.315+0000 7f162c3f9700 1 -- 172.21.15.110:0/1654798572 shutdown_connections 2021-03-25T14:17:23.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.315+0000 7f162c3f9700 1 --2- 172.21.15.110:0/1654798572 >> v2:172.21.15.174:3300/0 conn(0x7f16240be5a0 0x7f162409d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:23.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.315+0000 7f162c3f9700 1 --2- 172.21.15.110:0/1654798572 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16240b9ba0 0x7f1624143270 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:23.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.315+0000 7f162c3f9700 1 -- 172.21.15.110:0/1654798572 >> 172.21.15.110:0/1654798572 conn(0x7f16240616d0 msgr2=0x7f16240bdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:23.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.315+0000 7f162c3f9700 1 -- 172.21.15.110:0/1654798572 shutdown_connections 2021-03-25T14:17:23.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.315+0000 7f162c3f9700 1 -- 172.21.15.110:0/1654798572 wait complete. 2021-03-25T14:17:23.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.316+0000 7f162c3f9700 1 Processor -- start 2021-03-25T14:17:23.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.316+0000 7f162c3f9700 1 -- start start 2021-03-25T14:17:23.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.316+0000 7f162c3f9700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16240b9ba0 0x7f1624144150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:23.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.316+0000 7f162c3f9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16240be5a0 0x7f1624147610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:23.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.316+0000 7f162c3f9700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1624143760 0x7f1624141f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:23.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.316+0000 7f162c3f9700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162415cac0 con 0x7f1624143760 2021-03-25T14:17:23.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.316+0000 7f162c3f9700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1624144640 con 0x7f16240b9ba0 2021-03-25T14:17:23.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.316+0000 7f162c3f9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162415cd20 con 0x7f16240be5a0 2021-03-25T14:17:23.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.317+0000 7f162a996700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1624143760 0x7f1624141f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:23.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.317+0000 7f162a996700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1624143760 0x7f1624141f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49836/0 (socket says 172.21.15.110:49836) 2021-03-25T14:17:23.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.317+0000 7f162a996700 1 -- 172.21.15.110:0/1782113063 learned_addr learned my addr 172.21.15.110:0/1782113063 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:23.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.317+0000 7f1629994700 1 --2- 172.21.15.110:0/1782113063 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16240be5a0 0x7f1624147610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:23.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.317+0000 7f162a195700 1 --2- 172.21.15.110:0/1782113063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16240b9ba0 0x7f1624144150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:23.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.317+0000 7f162a996700 1 -- 172.21.15.110:0/1782113063 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16240be5a0 msgr2=0x7f1624147610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:23.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.317+0000 7f162a996700 1 --2- 172.21.15.110:0/1782113063 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16240be5a0 0x7f1624147610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:23.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.317+0000 7f162a996700 1 -- 172.21.15.110:0/1782113063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16240b9ba0 msgr2=0x7f1624144150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:23.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.317+0000 7f162a996700 1 --2- 172.21.15.110:0/1782113063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16240b9ba0 0x7f1624144150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:23.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.317+0000 7f162a996700 1 -- 172.21.15.110:0/1782113063 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f162415cfc0 con 0x7f1624143760 2021-03-25T14:17:23.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.317+0000 7f162a996700 1 --2- 172.21.15.110:0/1782113063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1624143760 0x7f1624141f40 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f161c00ca90 tx=0x7f161c007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:23.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.317+0000 7f16167fc700 1 -- 172.21.15.110:0/1782113063 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c005bb0 con 0x7f1624143760 2021-03-25T14:17:23.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.317+0000 7f16167fc700 1 -- 172.21.15.110:0/1782113063 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161c005d10 con 0x7f1624143760 2021-03-25T14:17:23.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.317+0000 7f16167fc700 1 -- 172.21.15.110:0/1782113063 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c007320 con 0x7f1624143760 2021-03-25T14:17:23.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.317+0000 7f162c3f9700 1 -- 172.21.15.110:0/1782113063 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f162415d260 con 0x7f1624143760 2021-03-25T14:17:23.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.317+0000 7f162c3f9700 1 -- 172.21.15.110:0/1782113063 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1624147b00 con 0x7f1624143760 2021-03-25T14:17:23.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.318+0000 7f162c3f9700 1 -- 172.21.15.110:0/1782113063 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f162415d3f0 con 0x7f1624143760 2021-03-25T14:17:23.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.318+0000 7f16167fc700 1 -- 172.21.15.110:0/1782113063 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f161c010030 con 0x7f1624143760 2021-03-25T14:17:23.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.319+0000 7f16167fc700 1 --2- 172.21.15.110:0/1782113063 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f160405a0b0 0x7f160405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:23.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.319+0000 7f16167fc700 1 -- 172.21.15.110:0/1782113063 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 7250+0+0 (secure 0 0 0) 0x7f161c074190 con 0x7f1624143760 2021-03-25T14:17:23.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.319+0000 7f162a195700 1 --2- 172.21.15.110:0/1782113063 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f160405a0b0 0x7f160405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:23.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.319+0000 7f162a195700 1 --2- 172.21.15.110:0/1782113063 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f160405a0b0 0x7f160405c570 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f162000bcc0 tx=0x7f1620008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:23.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.322+0000 7f16167fc700 1 -- 172.21.15.110:0/1782113063 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f161c047690 con 0x7f1624143760 2021-03-25T14:17:23.508 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:23.506+0000 7f162c3f9700 1 -- 172.21.15.110:0/1782113063 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f162405d7b0 con 0x7f1624143760 2021-03-25T14:17:24.059 INFO:tasks.ceph.mon.a.smithi110.stderr:2021-03-25T14:17:24.057+0000 7f2dd9594700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-03-25T14:17:24.063 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.061+0000 7f16167fc700 1 -- 172.21.15.110:0/1782113063 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) v1 ==== 161+0+0 (secure 0 0 0) 0x7f161c04acb0 con 0x7f1624143760 2021-03-25T14:17:24.064 INFO:tasks.ceph.mds.a.smithi110.stderr: -594> 2021-03-25T14:17:08.810+0000 7f4fae97d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2021-03-25T14:17:24.065 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.063+0000 7f162c3f9700 1 -- 172.21.15.110:0/1782113063 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f160405a0b0 msgr2=0x7f160405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:24.066 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.063+0000 7f162c3f9700 1 --2- 172.21.15.110:0/1782113063 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f160405a0b0 0x7f160405c570 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f162000bcc0 tx=0x7f1620008040).stop 2021-03-25T14:17:24.066 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.063+0000 7f162c3f9700 1 -- 172.21.15.110:0/1782113063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1624143760 msgr2=0x7f1624141f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:24.066 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.063+0000 7f162c3f9700 1 --2- 172.21.15.110:0/1782113063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1624143760 0x7f1624141f40 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f161c00ca90 tx=0x7f161c007f70).stop 2021-03-25T14:17:24.066 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.063+0000 7f162c3f9700 1 -- 172.21.15.110:0/1782113063 shutdown_connections 2021-03-25T14:17:24.066 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.063+0000 7f162c3f9700 1 --2- 172.21.15.110:0/1782113063 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f160405a0b0 0x7f160405c570 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:24.066 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.063+0000 7f162c3f9700 1 --2- 172.21.15.110:0/1782113063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16240b9ba0 0x7f1624144150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:24.066 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.063+0000 7f162c3f9700 1 --2- 172.21.15.110:0/1782113063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1624143760 0x7f1624141f40 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:24.066 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.063+0000 7f162c3f9700 1 --2- 172.21.15.110:0/1782113063 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16240be5a0 0x7f1624147610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:24.066 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.063+0000 7f162c3f9700 1 -- 172.21.15.110:0/1782113063 >> 172.21.15.110:0/1782113063 conn(0x7f16240616d0 msgr2=0x7f16240bdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:24.066 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.063+0000 7f162c3f9700 1 -- 172.21.15.110:0/1782113063 shutdown_connections 2021-03-25T14:17:24.066 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.063+0000 7f162c3f9700 1 -- 172.21.15.110:0/1782113063 wait complete. 2021-03-25T14:17:24.067 INFO:teuthology.orchestra.run.smithi110.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-03-25T14:17:24.079 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-03-25T14:17:24.084 INFO:tasks.ceph.mds.a.smithi110.stdout:starting mds.a at 2021-03-25T14:17:24.192 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.190+0000 7fcfe853e700 1 Processor -- start 2021-03-25T14:17:24.192 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.190+0000 7fcfe853e700 1 -- start start 2021-03-25T14:17:24.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.191+0000 7fcfe853e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcfe014ce50 0x7fcfe014d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:24.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.191+0000 7fcfe853e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfe0068d50 0x7fcfe014d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:24.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.191+0000 7fcfe853e700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcfe00b57a0 0x7fcfe00b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:24.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.191+0000 7fcfe853e700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe00b6990 con 0x7fcfe00b57a0 2021-03-25T14:17:24.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.191+0000 7fcfe853e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe00692d0 con 0x7fcfe014ce50 2021-03-25T14:17:24.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.191+0000 7fcfe853e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe00b6450 con 0x7fcfe0068d50 2021-03-25T14:17:24.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.191+0000 7fcfe6adb700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcfe00b57a0 0x7fcfe00b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:24.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.191+0000 7fcfe6adb700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcfe00b57a0 0x7fcfe00b5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49858/0 (socket says 172.21.15.110:49858) 2021-03-25T14:17:24.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.191+0000 7fcfe6adb700 1 -- 172.21.15.110:0/1307454345 learned_addr learned my addr 172.21.15.110:0/1307454345 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:24.196 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.191+0000 7fcfe5ad9700 1 --2- 172.21.15.110:0/1307454345 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfe0068d50 0x7fcfe014d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:24.196 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.191+0000 7fcfe62da700 1 --2- 172.21.15.110:0/1307454345 >> v2:172.21.15.174:3300/0 conn(0x7fcfe014ce50 0x7fcfe014d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:24.196 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.191+0000 7fcfe6adb700 1 -- 172.21.15.110:0/1307454345 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfe0068d50 msgr2=0x7fcfe014d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:24.196 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.191+0000 7fcfe6adb700 1 --2- 172.21.15.110:0/1307454345 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfe0068d50 0x7fcfe014d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:24.196 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.191+0000 7fcfe6adb700 1 -- 172.21.15.110:0/1307454345 >> v2:172.21.15.174:3300/0 conn(0x7fcfe014ce50 msgr2=0x7fcfe014d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:24.196 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.191+0000 7fcfe6adb700 1 --2- 172.21.15.110:0/1307454345 >> v2:172.21.15.174:3300/0 conn(0x7fcfe014ce50 0x7fcfe014d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:24.196 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.191+0000 7fcfe6adb700 1 -- 172.21.15.110:0/1307454345 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe00b66f0 con 0x7fcfe00b57a0 2021-03-25T14:17:24.196 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.191+0000 7fcfe5ad9700 1 --2- 172.21.15.110:0/1307454345 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfe0068d50 0x7fcfe014d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:17:24.196 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.191+0000 7fcfe62da700 1 --2- 172.21.15.110:0/1307454345 >> v2:172.21.15.174:3300/0 conn(0x7fcfe014ce50 0x7fcfe014d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:17:24.196 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.191+0000 7fcfe6adb700 1 --2- 172.21.15.110:0/1307454345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfe00b57a0 0x7fcfe00b5c30 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7fcfe0060560 tx=0x7fcfd80092d0).ready entity=mon.0 client_cookie=455e374f438ab796 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:24.196 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.192+0000 7fcfe52d8700 1 -- 172.21.15.110:0/1307454345 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd800bbf0 con 0x7fcfe00b57a0 2021-03-25T14:17:24.196 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.192+0000 7fcfe52d8700 1 -- 172.21.15.110:0/1307454345 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd800bd50 con 0x7fcfe00b57a0 2021-03-25T14:17:24.196 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.192+0000 7fcfe52d8700 1 -- 172.21.15.110:0/1307454345 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8011610 con 0x7fcfe00b57a0 2021-03-25T14:17:24.196 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.192+0000 7fcfe853e700 1 -- 172.21.15.110:0/1307454345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfe00b57a0 msgr2=0x7fcfe00b5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:24.197 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.192+0000 7fcfe853e700 1 --2- 172.21.15.110:0/1307454345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfe00b57a0 0x7fcfe00b5c30 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7fcfe0060560 tx=0x7fcfd80092d0).stop 2021-03-25T14:17:24.197 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.192+0000 7fcfe853e700 1 -- 172.21.15.110:0/1307454345 shutdown_connections 2021-03-25T14:17:24.197 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.192+0000 7fcfe853e700 1 --2- 172.21.15.110:0/1307454345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfe00b57a0 0x7fcfe00b5c30 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:24.197 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.192+0000 7fcfe853e700 1 --2- 172.21.15.110:0/1307454345 >> v2:172.21.15.174:3300/0 conn(0x7fcfe014ce50 0x7fcfe014d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:24.197 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.192+0000 7fcfe853e700 1 --2- 172.21.15.110:0/1307454345 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfe0068d50 0x7fcfe014d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:24.197 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.192+0000 7fcfe853e700 1 -- 172.21.15.110:0/1307454345 >> 172.21.15.110:0/1307454345 conn(0x7fcfe00bc430 msgr2=0x7fcfe00bc840 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:24.197 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.192+0000 7fcfe853e700 1 -- 172.21.15.110:0/1307454345 shutdown_connections 2021-03-25T14:17:24.197 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.192+0000 7fcfe853e700 1 -- 172.21.15.110:0/1307454345 wait complete. 2021-03-25T14:17:24.197 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.193+0000 7fcfe853e700 1 Processor -- start 2021-03-25T14:17:24.197 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.193+0000 7fcfe853e700 1 -- start start 2021-03-25T14:17:24.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.194+0000 7fcfe853e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcfe0068d50 0x7fcfe014ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:24.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.194+0000 7fcfe853e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfe00b57a0 0x7fcfe01504b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:24.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.194+0000 7fcfe853e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfe014ce50 0x7fcfe0158a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:24.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.194+0000 7fcfe853e700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe014f5f0 con 0x7fcfe014ce50 2021-03-25T14:17:24.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.194+0000 7fcfe853e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe014e9e0 con 0x7fcfe0068d50 2021-03-25T14:17:24.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.194+0000 7fcfe853e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe015ce90 con 0x7fcfe00b57a0 2021-03-25T14:17:24.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.194+0000 7fcfe6adb700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfe014ce50 0x7fcfe0158a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:24.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.194+0000 7fcfe6adb700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfe014ce50 0x7fcfe0158a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49862/0 (socket says 172.21.15.110:49862) 2021-03-25T14:17:24.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.194+0000 7fcfe6adb700 1 -- 172.21.15.110:0/686730655 learned_addr learned my addr 172.21.15.110:0/686730655 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:24.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.194+0000 7fcfe5ad9700 1 --2- 172.21.15.110:0/686730655 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfe00b57a0 0x7fcfe01504b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:24.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.194+0000 7fcfe62da700 1 --2- 172.21.15.110:0/686730655 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcfe0068d50 0x7fcfe014ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:24.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.194+0000 7fcfe6adb700 1 -- 172.21.15.110:0/686730655 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfe00b57a0 msgr2=0x7fcfe01504b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:24.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.194+0000 7fcfe6adb700 1 --2- 172.21.15.110:0/686730655 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfe00b57a0 0x7fcfe01504b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:24.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.194+0000 7fcfe6adb700 1 -- 172.21.15.110:0/686730655 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcfe0068d50 msgr2=0x7fcfe014ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:24.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.194+0000 7fcfe6adb700 1 --2- 172.21.15.110:0/686730655 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcfe0068d50 0x7fcfe014ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:24.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.194+0000 7fcfe6adb700 1 -- 172.21.15.110:0/686730655 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe014e4a0 con 0x7fcfe014ce50 2021-03-25T14:17:24.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.194+0000 7fcfe5ad9700 1 --2- 172.21.15.110:0/686730655 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfe00b57a0 0x7fcfe01504b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:24.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.194+0000 7fcfe6adb700 1 --2- 172.21.15.110:0/686730655 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfe014ce50 0x7fcfe0158a90 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7fcfd8009130 tx=0x7fcfd8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:24.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.194+0000 7fcfce7fc700 1 -- 172.21.15.110:0/686730655 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8009ea0 con 0x7fcfe014ce50 2021-03-25T14:17:24.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.195+0000 7fcfce7fc700 1 -- 172.21.15.110:0/686730655 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd800bec0 con 0x7fcfe014ce50 2021-03-25T14:17:24.202 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.195+0000 7fcfce7fc700 1 -- 172.21.15.110:0/686730655 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8010df0 con 0x7fcfe014ce50 2021-03-25T14:17:24.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.195+0000 7fcfe853e700 1 -- 172.21.15.110:0/686730655 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe014e740 con 0x7fcfe014ce50 2021-03-25T14:17:24.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.195+0000 7fcfe853e700 1 -- 172.21.15.110:0/686730655 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe014c8a0 con 0x7fcfe014ce50 2021-03-25T14:17:24.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.195+0000 7fcfe853e700 1 -- 172.21.15.110:0/686730655 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe014c5c0 con 0x7fcfe014ce50 2021-03-25T14:17:24.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.196+0000 7fcfce7fc700 1 -- 172.21.15.110:0/686730655 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fcfd800f070 con 0x7fcfe014ce50 2021-03-25T14:17:24.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.196+0000 7fcfce7fc700 1 --2- 172.21.15.110:0/686730655 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fcfc005a0b0 0x7fcfc005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:24.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.196+0000 7fcfce7fc700 1 -- 172.21.15.110:0/686730655 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7336+0+0 (secure 0 0 0) 0x7fcfd8076030 con 0x7fcfe014ce50 2021-03-25T14:17:24.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.196+0000 7fcfe62da700 1 --2- 172.21.15.110:0/686730655 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fcfc005a0b0 0x7fcfc005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:24.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.196+0000 7fcfe62da700 1 --2- 172.21.15.110:0/686730655 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fcfc005a0b0 0x7fcfc005c570 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fcfdc006fd0 tx=0x7fcfdc008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:24.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.200+0000 7fcfce7fc700 1 -- 172.21.15.110:0/686730655 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fcfd80494e0 con 0x7fcfe014ce50 2021-03-25T14:17:24.386 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:24.384+0000 7fcfe853e700 1 -- 172.21.15.110:0/686730655 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcfe005d7b0 con 0x7fcfe014ce50 2021-03-25T14:17:25.066 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.064+0000 7fcfce7fc700 1 -- 172.21.15.110:0/686730655 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcfd804cb00 con 0x7fcfe014ce50 2021-03-25T14:17:25.068 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.066+0000 7fcfe853e700 1 -- 172.21.15.110:0/686730655 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fcfc005a0b0 msgr2=0x7fcfc005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:25.068 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.066+0000 7fcfe853e700 1 --2- 172.21.15.110:0/686730655 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fcfc005a0b0 0x7fcfc005c570 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fcfdc006fd0 tx=0x7fcfdc008040).stop 2021-03-25T14:17:25.068 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.066+0000 7fcfe853e700 1 -- 172.21.15.110:0/686730655 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfe014ce50 msgr2=0x7fcfe0158a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:25.069 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.066+0000 7fcfe853e700 1 --2- 172.21.15.110:0/686730655 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfe014ce50 0x7fcfe0158a90 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7fcfd8009130 tx=0x7fcfd8017000).stop 2021-03-25T14:17:25.069 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.066+0000 7fcfe853e700 1 -- 172.21.15.110:0/686730655 shutdown_connections 2021-03-25T14:17:25.069 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.066+0000 7fcfe853e700 1 --2- 172.21.15.110:0/686730655 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fcfc005a0b0 0x7fcfc005c570 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:25.069 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.066+0000 7fcfe853e700 1 --2- 172.21.15.110:0/686730655 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcfe0068d50 0x7fcfe014ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:25.069 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.066+0000 7fcfe853e700 1 --2- 172.21.15.110:0/686730655 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfe014ce50 0x7fcfe0158a90 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:25.069 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.066+0000 7fcfe853e700 1 --2- 172.21.15.110:0/686730655 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfe00b57a0 0x7fcfe01504b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:25.069 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.066+0000 7fcfe853e700 1 -- 172.21.15.110:0/686730655 >> 172.21.15.110:0/686730655 conn(0x7fcfe00bc430 msgr2=0x7fcfe014d230 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:25.069 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.066+0000 7fcfe853e700 1 -- 172.21.15.110:0/686730655 shutdown_connections 2021-03-25T14:17:25.069 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.066+0000 7fcfe853e700 1 -- 172.21.15.110:0/686730655 wait complete. 2021-03-25T14:17:25.080 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-03-25T14:17:25.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.234+0000 7f77edc94700 1 Processor -- start 2021-03-25T14:17:25.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.234+0000 7f77edc94700 1 -- start start 2021-03-25T14:17:25.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.234+0000 7f77edc94700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f77e80bdbd0 0x7f77e80bdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:25.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.234+0000 7f77edc94700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77e8066430 0x7f77e8149710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:25.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.234+0000 7f77edc94700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f77e80bab70 0x7f77e80bb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:25.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.234+0000 7f77edc94700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e8149fa0 con 0x7f77e80bdbd0 2021-03-25T14:17:25.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.234+0000 7f77edc94700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e814a240 con 0x7f77e80bab70 2021-03-25T14:17:25.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.234+0000 7f77edc94700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e814a4e0 con 0x7f77e8066430 2021-03-25T14:17:25.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.235+0000 7f77e77fe700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f77e80bdbd0 0x7f77e80bdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:25.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.235+0000 7f77e77fe700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f77e80bdbd0 0x7f77e80bdfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49870/0 (socket says 172.21.15.110:49870) 2021-03-25T14:17:25.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.235+0000 7f77e77fe700 1 -- 172.21.15.110:0/147339670 learned_addr learned my addr 172.21.15.110:0/147339670 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:25.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.235+0000 7f77e7fff700 1 --2- 172.21.15.110:0/147339670 >> v2:172.21.15.174:3300/0 conn(0x7f77e80bab70 0x7f77e80bb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:25.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.235+0000 7f77e6ffd700 1 --2- 172.21.15.110:0/147339670 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77e8066430 0x7f77e8149710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:25.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.235+0000 7f77e77fe700 1 -- 172.21.15.110:0/147339670 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77e8066430 msgr2=0x7f77e8149710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:25.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.235+0000 7f77e77fe700 1 --2- 172.21.15.110:0/147339670 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77e8066430 0x7f77e8149710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:25.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.235+0000 7f77e77fe700 1 -- 172.21.15.110:0/147339670 >> v2:172.21.15.174:3300/0 conn(0x7f77e80bab70 msgr2=0x7f77e80bb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:25.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.235+0000 7f77e77fe700 1 --2- 172.21.15.110:0/147339670 >> v2:172.21.15.174:3300/0 conn(0x7f77e80bab70 0x7f77e80bb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:25.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.235+0000 7f77e77fe700 1 -- 172.21.15.110:0/147339670 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e814ad90 con 0x7f77e80bdbd0 2021-03-25T14:17:25.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.235+0000 7f77e7fff700 1 --2- 172.21.15.110:0/147339670 >> v2:172.21.15.174:3300/0 conn(0x7f77e80bab70 0x7f77e80bb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:17:25.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.235+0000 7f77e77fe700 1 --2- 172.21.15.110:0/147339670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77e80bdbd0 0x7f77e80bdfb0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f77e80668b0 tx=0x7f77e0006ee0).ready entity=mon.0 client_cookie=aaade7a753d22789 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:25.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.235+0000 7f77e67fc700 1 -- 172.21.15.110:0/147339670 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e0009840 con 0x7f77e80bdbd0 2021-03-25T14:17:25.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.235+0000 7f77e67fc700 1 -- 172.21.15.110:0/147339670 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e00099a0 con 0x7f77e80bdbd0 2021-03-25T14:17:25.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.235+0000 7f77e67fc700 1 -- 172.21.15.110:0/147339670 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e0009d20 con 0x7f77e80bdbd0 2021-03-25T14:17:25.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.236+0000 7f77edc94700 1 -- 172.21.15.110:0/147339670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77e80bdbd0 msgr2=0x7f77e80bdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:25.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.236+0000 7f77edc94700 1 --2- 172.21.15.110:0/147339670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77e80bdbd0 0x7f77e80bdfb0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f77e80668b0 tx=0x7f77e0006ee0).stop 2021-03-25T14:17:25.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.236+0000 7f77edc94700 1 -- 172.21.15.110:0/147339670 shutdown_connections 2021-03-25T14:17:25.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.236+0000 7f77edc94700 1 --2- 172.21.15.110:0/147339670 >> v2:172.21.15.174:3300/0 conn(0x7f77e80bab70 0x7f77e80bb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:25.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.236+0000 7f77edc94700 1 --2- 172.21.15.110:0/147339670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77e80bdbd0 0x7f77e80bdfb0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:25.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.236+0000 7f77edc94700 1 --2- 172.21.15.110:0/147339670 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77e8066430 0x7f77e8149710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:25.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.236+0000 7f77edc94700 1 -- 172.21.15.110:0/147339670 >> 172.21.15.110:0/147339670 conn(0x7f77e8068730 msgr2=0x7f77e8068b40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:25.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.236+0000 7f77edc94700 1 -- 172.21.15.110:0/147339670 shutdown_connections 2021-03-25T14:17:25.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.236+0000 7f77edc94700 1 -- 172.21.15.110:0/147339670 wait complete. 2021-03-25T14:17:25.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.237+0000 7f77edc94700 1 Processor -- start 2021-03-25T14:17:25.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.237+0000 7f77edc94700 1 -- start start 2021-03-25T14:17:25.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.238+0000 7f77edc94700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77e8066430 0x7f77e80b5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:25.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.238+0000 7f77edc94700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77e80bab70 0x7f77e80b6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:25.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.238+0000 7f77edc94700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77e80bdbd0 0x7f77e80a2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:25.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.238+0000 7f77edc94700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e80b6730 con 0x7f77e80bab70 2021-03-25T14:17:25.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.238+0000 7f77edc94700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e81598c0 con 0x7f77e80bdbd0 2021-03-25T14:17:25.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.238+0000 7f77edc94700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e814b0f0 con 0x7f77e8066430 2021-03-25T14:17:25.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.238+0000 7f77e6ffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77e80bab70 0x7f77e80b6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:25.245 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.238+0000 7f77e6ffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77e80bab70 0x7f77e80b6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49878/0 (socket says 172.21.15.110:49878) 2021-03-25T14:17:25.245 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.238+0000 7f77e6ffd700 1 -- 172.21.15.110:0/572103937 learned_addr learned my addr 172.21.15.110:0/572103937 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:25.245 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.238+0000 7f77e6ffd700 1 -- 172.21.15.110:0/572103937 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77e8066430 msgr2=0x7f77e80b5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:25.245 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.238+0000 7f77e7fff700 1 --2- 172.21.15.110:0/572103937 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77e80bdbd0 0x7f77e80a2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:25.245 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.238+0000 7f77e77fe700 1 --2- 172.21.15.110:0/572103937 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77e8066430 0x7f77e80b5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:25.245 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.238+0000 7f77e6ffd700 1 --2- 172.21.15.110:0/572103937 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77e8066430 0x7f77e80b5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:25.245 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.238+0000 7f77e6ffd700 1 -- 172.21.15.110:0/572103937 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77e80bdbd0 msgr2=0x7f77e80a2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:25.245 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.238+0000 7f77e6ffd700 1 --2- 172.21.15.110:0/572103937 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77e80bdbd0 0x7f77e80a2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:25.245 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.238+0000 7f77e6ffd700 1 -- 172.21.15.110:0/572103937 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e814b390 con 0x7f77e80bab70 2021-03-25T14:17:25.245 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.238+0000 7f77e77fe700 1 --2- 172.21.15.110:0/572103937 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77e8066430 0x7f77e80b5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:17:25.245 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.238+0000 7f77e7fff700 1 --2- 172.21.15.110:0/572103937 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77e80bdbd0 0x7f77e80a2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:17:25.245 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.238+0000 7f77e6ffd700 1 --2- 172.21.15.110:0/572103937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77e80bab70 0x7f77e80b6240 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f77d000cbd0 tx=0x7f77d0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:25.245 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.238+0000 7f77df7fe700 1 -- 172.21.15.110:0/572103937 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d000a9e0 con 0x7f77e80bab70 2021-03-25T14:17:25.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.238+0000 7f77df7fe700 1 -- 172.21.15.110:0/572103937 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d000ab40 con 0x7f77e80bab70 2021-03-25T14:17:25.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.238+0000 7f77edc94700 1 -- 172.21.15.110:0/572103937 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77e814b630 con 0x7f77e80bab70 2021-03-25T14:17:25.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.238+0000 7f77df7fe700 1 -- 172.21.15.110:0/572103937 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d0011410 con 0x7f77e80bab70 2021-03-25T14:17:25.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.238+0000 7f77edc94700 1 -- 172.21.15.110:0/572103937 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e8159510 con 0x7f77e80bab70 2021-03-25T14:17:25.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.239+0000 7f77edc94700 1 -- 172.21.15.110:0/572103937 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77e814b7c0 con 0x7f77e80bab70 2021-03-25T14:17:25.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.240+0000 7f77df7fe700 1 -- 172.21.15.110:0/572103937 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f77d00117c0 con 0x7f77e80bab70 2021-03-25T14:17:25.247 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.240+0000 7f77df7fe700 1 --2- 172.21.15.110:0/572103937 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f77cc05a0b0 0x7f77cc05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:25.247 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.240+0000 7f77df7fe700 1 -- 172.21.15.110:0/572103937 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7336+0+0 (secure 0 0 0) 0x7f77d0074830 con 0x7f77e80bab70 2021-03-25T14:17:25.247 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.240+0000 7f77e77fe700 1 --2- 172.21.15.110:0/572103937 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f77cc05a0b0 0x7f77cc05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:25.247 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.240+0000 7f77e77fe700 1 --2- 172.21.15.110:0/572103937 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f77cc05a0b0 0x7f77cc05c570 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f77e0006f20 tx=0x7f77e0016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:25.248 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.244+0000 7f77df7fe700 1 -- 172.21.15.110:0/572103937 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f77d0047ce0 con 0x7f77e80bab70 2021-03-25T14:17:25.397 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:25.395+0000 7f77edc94700 1 -- 172.21.15.110:0/572103937 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f77e805d7b0 con 0x7f77e80bab70 2021-03-25T14:17:26.070 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.068+0000 7f77df7fe700 1 -- 172.21.15.110:0/572103937 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v44) v1 ==== 181+0+0 (secure 0 0 0) 0x7f77d004b300 con 0x7f77e80bab70 2021-03-25T14:17:26.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.070+0000 7f77edc94700 1 -- 172.21.15.110:0/572103937 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f77cc05a0b0 msgr2=0x7f77cc05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:26.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.070+0000 7f77edc94700 1 --2- 172.21.15.110:0/572103937 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f77cc05a0b0 0x7f77cc05c570 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f77e0006f20 tx=0x7f77e0016000).stop 2021-03-25T14:17:26.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.070+0000 7f77edc94700 1 -- 172.21.15.110:0/572103937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77e80bab70 msgr2=0x7f77e80b6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:26.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.070+0000 7f77edc94700 1 --2- 172.21.15.110:0/572103937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77e80bab70 0x7f77e80b6240 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f77d000cbd0 tx=0x7f77d0008040).stop 2021-03-25T14:17:26.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.071+0000 7f77edc94700 1 -- 172.21.15.110:0/572103937 shutdown_connections 2021-03-25T14:17:26.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.071+0000 7f77edc94700 1 --2- 172.21.15.110:0/572103937 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f77cc05a0b0 0x7f77cc05c570 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:26.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.071+0000 7f77edc94700 1 --2- 172.21.15.110:0/572103937 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77e80bdbd0 0x7f77e80a2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:26.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.071+0000 7f77edc94700 1 --2- 172.21.15.110:0/572103937 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77e8066430 0x7f77e80b5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:26.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.071+0000 7f77edc94700 1 --2- 172.21.15.110:0/572103937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77e80bab70 0x7f77e80b6240 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:26.074 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.071+0000 7f77edc94700 1 -- 172.21.15.110:0/572103937 >> 172.21.15.110:0/572103937 conn(0x7f77e8068730 msgr2=0x7f77e80bc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:26.074 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.071+0000 7f77edc94700 1 -- 172.21.15.110:0/572103937 shutdown_connections 2021-03-25T14:17:26.074 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.071+0000 7f77edc94700 1 -- 172.21.15.110:0/572103937 wait complete. 2021-03-25T14:17:26.074 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs_metadata' removed 2021-03-25T14:17:26.089 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-03-25T14:17:26.208 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.206+0000 7f7f2586f700 1 Processor -- start 2021-03-25T14:17:26.208 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.206+0000 7f7f2586f700 1 -- start start 2021-03-25T14:17:26.215 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.207+0000 7f7f2586f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7f200bcd20 0x7f7f20067ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:26.215 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.207+0000 7f7f2586f700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f20067400 con 0x7f7f200bab40 2021-03-25T14:17:26.215 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.207+0000 7f7f2586f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f20061350 con 0x7f7f200bc3a0 2021-03-25T14:17:26.215 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.207+0000 7f7f2586f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f20149a10 con 0x7f7f200bcd20 2021-03-25T14:17:26.215 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.207+0000 7f7f1e7fc700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f7f200bab40 0x7f7f20060c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:42824/0 (socket says 172.21.15.110:42824) 2021-03-25T14:17:26.216 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.207+0000 7f7f1e7fc700 1 -- 172.21.15.110:0/2441800566 learned_addr learned my addr 172.21.15.110:0/2441800566 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:26.216 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.207+0000 7f7f1effd700 1 --2- 172.21.15.110:0/2441800566 >> v2:172.21.15.174:3300/0 conn(0x7f7f200bcd20 0x7f7f20067ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:26.216 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.207+0000 7f7f1dffb700 1 -- 172.21.15.110:0/2441800566 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3405943832 0 0) 0x7f7f20067400 con 0x7f7f200bab40 2021-03-25T14:17:26.216 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.207+0000 7f7f1dffb700 1 -- 172.21.15.110:0/2441800566 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f0c003270 con 0x7f7f200bab40 2021-03-25T14:17:26.216 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.208+0000 7f7f1dffb700 1 -- 172.21.15.110:0/2441800566 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3868400145 0 0) 0x7f7f0c003270 con 0x7f7f200bab40 2021-03-25T14:17:26.216 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.208+0000 7f7f1dffb700 1 -- 172.21.15.110:0/2441800566 >> v2:172.21.15.174:3300/0 conn(0x7f7f200bcd20 msgr2=0x7f7f20067ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:26.216 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.208+0000 7f7f1dffb700 1 --2- 172.21.15.110:0/2441800566 >> v2:172.21.15.174:3300/0 conn(0x7f7f200bcd20 0x7f7f20067ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:26.216 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.208+0000 7f7f1dffb700 1 -- 172.21.15.110:0/2441800566 >> v1:172.21.15.174:6789/0 conn(0x7f7f200bc3a0 legacy=0x7f7f200a5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:26.216 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.208+0000 7f7f1dffb700 1 -- 172.21.15.110:0/2441800566 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f200b5410 con 0x7f7f200bab40 2021-03-25T14:17:26.216 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.208+0000 7f7f1dffb700 1 -- 172.21.15.110:0/2441800566 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f7f140016a0 con 0x7f7f200bab40 2021-03-25T14:17:26.216 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.208+0000 7f7f1dffb700 1 -- 172.21.15.110:0/2441800566 >> v1:172.21.15.110:6789/0 conn(0x7f7f200bab40 legacy=0x7f7f20060c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:26.217 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.208+0000 7f7f1dffb700 1 --2- 172.21.15.110:0/2441800566 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f0c003760 0x7f7f0c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:26.217 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.208+0000 7f7f1dffb700 1 --2- 172.21.15.110:0/2441800566 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f0c004510 0x7f7f0c004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:26.217 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.208+0000 7f7f1dffb700 1 --2- 172.21.15.110:0/2441800566 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f0c004e80 0x7f7f0c00b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:26.217 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.208+0000 7f7f1dffb700 1 -- 172.21.15.110:0/2441800566 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f20149a10 con 0x7f7f0c004e80 2021-03-25T14:17:26.217 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.208+0000 7f7f1dffb700 1 -- 172.21.15.110:0/2441800566 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c004200 con 0x7f7f0c004510 2021-03-25T14:17:26.217 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.208+0000 7f7f1dffb700 1 -- 172.21.15.110:0/2441800566 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c00bc50 con 0x7f7f0c003760 2021-03-25T14:17:26.217 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.208+0000 7f7f1f7fe700 1 --2- 172.21.15.110:0/2441800566 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f0c004e80 0x7f7f0c00b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:26.217 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.208+0000 7f7f1effd700 1 --2- 172.21.15.110:0/2441800566 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f0c003760 0x7f7f0c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:26.217 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.208+0000 7f7f1e7fc700 1 --2- 172.21.15.110:0/2441800566 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f0c004510 0x7f7f0c004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:26.217 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.208+0000 7f7f1f7fe700 1 -- 172.21.15.110:0/2441800566 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f0c003760 msgr2=0x7f7f0c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:26.217 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.208+0000 7f7f1f7fe700 1 --2- 172.21.15.110:0/2441800566 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f0c003760 0x7f7f0c003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:26.217 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.208+0000 7f7f1f7fe700 1 -- 172.21.15.110:0/2441800566 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f0c004510 msgr2=0x7f7f0c004990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:26.218 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.208+0000 7f7f1f7fe700 1 --2- 172.21.15.110:0/2441800566 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f0c004510 0x7f7f0c004990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:26.218 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.208+0000 7f7f1f7fe700 1 -- 172.21.15.110:0/2441800566 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0c003270 con 0x7f7f0c004e80 2021-03-25T14:17:26.218 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.208+0000 7f7f1effd700 1 --2- 172.21.15.110:0/2441800566 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f0c003760 0x7f7f0c003b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:26.218 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.208+0000 7f7f1e7fc700 1 --2- 172.21.15.110:0/2441800566 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f0c004510 0x7f7f0c004990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:26.218 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.208+0000 7f7f1f7fe700 1 -- 172.21.15.110:0/2441800566 reap_dead start 2021-03-25T14:17:26.218 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.208+0000 7f7f1f7fe700 1 --2- 172.21.15.110:0/2441800566 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f0c004e80 0x7f7f0c00b760 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f7f18001fd0 tx=0x7f7f18007f20).ready entity=mon.0 client_cookie=1d28c3fdca1400fc server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:26.218 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.208+0000 7f7f1dffb700 1 -- 172.21.15.110:0/2441800566 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1800c9e0 con 0x7f7f0c004e80 2021-03-25T14:17:26.218 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.208+0000 7f7f1dffb700 1 -- 172.21.15.110:0/2441800566 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1800cb40 con 0x7f7f0c004e80 2021-03-25T14:17:26.218 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.208+0000 7f7f1dffb700 1 -- 172.21.15.110:0/2441800566 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f18013410 con 0x7f7f0c004e80 2021-03-25T14:17:26.218 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.209+0000 7f7f2586f700 1 -- 172.21.15.110:0/2441800566 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f0c004e80 msgr2=0x7f7f0c00b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:26.218 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.209+0000 7f7f2586f700 1 --2- 172.21.15.110:0/2441800566 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f0c004e80 0x7f7f0c00b760 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f7f18001fd0 tx=0x7f7f18007f20).stop 2021-03-25T14:17:26.218 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.209+0000 7f7f2586f700 1 -- 172.21.15.110:0/2441800566 shutdown_connections 2021-03-25T14:17:26.219 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.209+0000 7f7f2586f700 1 --2- 172.21.15.110:0/2441800566 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f0c004e80 0x7f7f0c00b760 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:26.219 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.209+0000 7f7f2586f700 1 -- 172.21.15.110:0/2441800566 >> 172.21.15.110:0/2441800566 conn(0x7f7f20063090 msgr2=0x7f7f200634a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:26.219 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.209+0000 7f7f2586f700 1 -- 172.21.15.110:0/2441800566 shutdown_connections 2021-03-25T14:17:26.219 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.209+0000 7f7f2586f700 1 -- 172.21.15.110:0/2441800566 wait complete. 2021-03-25T14:17:26.219 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.210+0000 7f7f2586f700 1 Processor -- start 2021-03-25T14:17:26.219 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.210+0000 7f7f2586f700 1 -- start start 2021-03-25T14:17:26.219 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.211+0000 7f7f2586f700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f0c004e80 0x7f7f200bfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:26.219 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.211+0000 7f7f2586f700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f200a28d0 0x7f7f20159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:26.219 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.211+0000 7f7f2586f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f20159870 0x7f7f200b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:26.219 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.211+0000 7f7f2586f700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f200a2ec0 con 0x7f7f200a28d0 2021-03-25T14:17:26.219 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.211+0000 7f7f2586f700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f200a3160 con 0x7f7f0c004e80 2021-03-25T14:17:26.219 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.211+0000 7f7f2586f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f200a3400 con 0x7f7f20159870 2021-03-25T14:17:26.220 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.211+0000 7f7f1e7fc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f200a28d0 0x7f7f20159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:26.220 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.211+0000 7f7f1e7fc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f200a28d0 0x7f7f20159380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49898/0 (socket says 172.21.15.110:49898) 2021-03-25T14:17:26.220 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.211+0000 7f7f1e7fc700 1 -- 172.21.15.110:0/3977979981 learned_addr learned my addr 172.21.15.110:0/3977979981 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:26.220 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.211+0000 7f7f1effd700 1 --2- 172.21.15.110:0/3977979981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f0c004e80 0x7f7f200bfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:26.220 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.211+0000 7f7f1f7fe700 1 --2- 172.21.15.110:0/3977979981 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f20159870 0x7f7f200b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:26.220 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.211+0000 7f7f1e7fc700 1 -- 172.21.15.110:0/3977979981 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f20159870 msgr2=0x7f7f200b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:26.220 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.211+0000 7f7f1e7fc700 1 --2- 172.21.15.110:0/3977979981 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f20159870 0x7f7f200b5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:26.220 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.211+0000 7f7f1e7fc700 1 -- 172.21.15.110:0/3977979981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f0c004e80 msgr2=0x7f7f200bfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:26.220 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.211+0000 7f7f1e7fc700 1 --2- 172.21.15.110:0/3977979981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f0c004e80 0x7f7f200bfbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:26.220 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.211+0000 7f7f1e7fc700 1 -- 172.21.15.110:0/3977979981 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f20158ee0 con 0x7f7f200a28d0 2021-03-25T14:17:26.220 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.211+0000 7f7f1e7fc700 1 --2- 172.21.15.110:0/3977979981 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f200a28d0 0x7f7f20159380 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f7f1400ea80 tx=0x7f7f14009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:26.221 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.212+0000 7f7f06ffd700 1 -- 172.21.15.110:0/3977979981 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f14007110 con 0x7f7f200a28d0 2021-03-25T14:17:26.221 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.212+0000 7f7f06ffd700 1 -- 172.21.15.110:0/3977979981 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f14010040 con 0x7f7f200a28d0 2021-03-25T14:17:26.221 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.212+0000 7f7f2586f700 1 -- 172.21.15.110:0/3977979981 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f20158b90 con 0x7f7f200a28d0 2021-03-25T14:17:26.221 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.212+0000 7f7f06ffd700 1 -- 172.21.15.110:0/3977979981 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1400a640 con 0x7f7f200a28d0 2021-03-25T14:17:26.221 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.212+0000 7f7f2586f700 1 -- 172.21.15.110:0/3977979981 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f200b61a0 con 0x7f7f200a28d0 2021-03-25T14:17:26.221 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.212+0000 7f7f2586f700 1 -- 172.21.15.110:0/3977979981 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f20158d20 con 0x7f7f200a28d0 2021-03-25T14:17:26.221 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.213+0000 7f7f06ffd700 1 -- 172.21.15.110:0/3977979981 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f7f1401b020 con 0x7f7f200a28d0 2021-03-25T14:17:26.221 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.213+0000 7f7f06ffd700 1 --2- 172.21.15.110:0/3977979981 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f7f0005a0e0 0x7f7f0005c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:26.221 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.213+0000 7f7f06ffd700 1 -- 172.21.15.110:0/3977979981 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6898+0+0 (secure 0 0 0) 0x7f7f14073690 con 0x7f7f200a28d0 2021-03-25T14:17:26.221 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.213+0000 7f7f1effd700 1 --2- 172.21.15.110:0/3977979981 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f7f0005a0e0 0x7f7f0005c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:26.221 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.214+0000 7f7f1effd700 1 --2- 172.21.15.110:0/3977979981 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f7f0005a0e0 0x7f7f0005c5a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f7f10006df0 tx=0x7f7f10008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:26.222 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.217+0000 7f7f06ffd700 1 -- 172.21.15.110:0/3977979981 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f7f14046cf0 con 0x7f7f200a28d0 2021-03-25T14:17:26.369 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:26.367+0000 7f7f2586f700 1 -- 172.21.15.110:0/3977979981 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7f20159070 con 0x7f7f200a28d0 2021-03-25T14:17:27.072 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.070+0000 7f7f06ffd700 1 -- 172.21.15.110:0/3977979981 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v45) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7f1404a310 con 0x7f7f200a28d0 2021-03-25T14:17:27.075 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.072+0000 7f7f2586f700 1 -- 172.21.15.110:0/3977979981 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f7f0005a0e0 msgr2=0x7f7f0005c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:27.075 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.072+0000 7f7f2586f700 1 --2- 172.21.15.110:0/3977979981 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f7f0005a0e0 0x7f7f0005c5a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f7f10006df0 tx=0x7f7f10008040).stop 2021-03-25T14:17:27.075 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.072+0000 7f7f2586f700 1 -- 172.21.15.110:0/3977979981 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f200a28d0 msgr2=0x7f7f20159380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:27.075 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.072+0000 7f7f2586f700 1 --2- 172.21.15.110:0/3977979981 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f200a28d0 0x7f7f20159380 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f7f1400ea80 tx=0x7f7f14009040).stop 2021-03-25T14:17:27.075 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.073+0000 7f7f2586f700 1 -- 172.21.15.110:0/3977979981 shutdown_connections 2021-03-25T14:17:27.075 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.073+0000 7f7f2586f700 1 --2- 172.21.15.110:0/3977979981 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f7f0005a0e0 0x7f7f0005c5a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:27.075 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.073+0000 7f7f2586f700 1 --2- 172.21.15.110:0/3977979981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f0c004e80 0x7f7f200bfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:27.075 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.073+0000 7f7f2586f700 1 --2- 172.21.15.110:0/3977979981 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f20159870 0x7f7f200b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:27.075 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.073+0000 7f7f2586f700 1 --2- 172.21.15.110:0/3977979981 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f200a28d0 0x7f7f20159380 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:27.076 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.073+0000 7f7f2586f700 1 -- 172.21.15.110:0/3977979981 >> 172.21.15.110:0/3977979981 conn(0x7f7f20063090 msgr2=0x7f7f2014bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:27.076 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.073+0000 7f7f2586f700 1 -- 172.21.15.110:0/3977979981 shutdown_connections 2021-03-25T14:17:27.076 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.073+0000 7f7f2586f700 1 -- 172.21.15.110:0/3977979981 wait complete. 2021-03-25T14:17:27.076 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs_data' removed 2021-03-25T14:17:27.088 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:17:27.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.199+0000 7f4f49073700 1 Processor -- start 2021-03-25T14:17:27.201 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.199+0000 7f4f49073700 1 -- start start 2021-03-25T14:17:27.204 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.199+0000 7f4f49073700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4f440ba680 0x7f4f440baa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:27.204 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.199+0000 7f4f49073700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4f44148d00 0x7f4f44149150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:27.204 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.199+0000 7f4f49073700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f440bbcd0 con 0x7f4f440b86d0 2021-03-25T14:17:27.204 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.199+0000 7f4f49073700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f440bbf70 con 0x7f4f440ba680 2021-03-25T14:17:27.204 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.199+0000 7f4f49073700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f440bc210 con 0x7f4f44148d00 2021-03-25T14:17:27.204 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.200+0000 7f4f43fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4f440ba680 0x7f4f440baa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:27.205 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.200+0000 7f4f43fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4f440ba680 0x7f4f440baa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49904/0 (socket says 172.21.15.110:49904) 2021-03-25T14:17:27.205 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.200+0000 7f4f43fff700 1 -- 172.21.15.110:0/1661872608 learned_addr learned my addr 172.21.15.110:0/1661872608 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:27.205 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.200+0000 7f4f48872700 1 --2- 172.21.15.110:0/1661872608 >> v2:172.21.15.174:3300/0 conn(0x7f4f44148d00 0x7f4f44149150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:27.205 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.200+0000 7f4f43fff700 1 -- 172.21.15.110:0/1661872608 >> v2:172.21.15.174:3300/0 conn(0x7f4f44148d00 msgr2=0x7f4f44149150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:27.205 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.200+0000 7f4f43fff700 1 --2- 172.21.15.110:0/1661872608 >> v2:172.21.15.174:3300/0 conn(0x7f4f44148d00 0x7f4f44149150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:27.205 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.200+0000 7f4f43fff700 1 -- 172.21.15.110:0/1661872608 >> v1:172.21.15.174:6789/0 conn(0x7f4f440b86d0 legacy=0x7f4f440bcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:27.205 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.200+0000 7f4f43fff700 1 -- 172.21.15.110:0/1661872608 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f440bc4b0 con 0x7f4f440ba680 2021-03-25T14:17:27.206 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.200+0000 7f4f43fff700 1 --2- 172.21.15.110:0/1661872608 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f440ba680 0x7f4f440baa60 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f4f440b81e0 tx=0x7f4f34006ee0).ready entity=mon.0 client_cookie=497919df353fe96c server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:27.206 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.200+0000 7f4f42ffd700 1 -- 172.21.15.110:0/1661872608 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f34009890 con 0x7f4f440ba680 2021-03-25T14:17:27.206 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.200+0000 7f4f42ffd700 1 -- 172.21.15.110:0/1661872608 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f340099f0 con 0x7f4f440ba680 2021-03-25T14:17:27.206 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.200+0000 7f4f42ffd700 1 -- 172.21.15.110:0/1661872608 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f34009d70 con 0x7f4f440ba680 2021-03-25T14:17:27.206 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.201+0000 7f4f49073700 1 -- 172.21.15.110:0/1661872608 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f440ba680 msgr2=0x7f4f440baa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:27.206 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.201+0000 7f4f49073700 1 --2- 172.21.15.110:0/1661872608 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f440ba680 0x7f4f440baa60 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f4f440b81e0 tx=0x7f4f34006ee0).stop 2021-03-25T14:17:27.206 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.201+0000 7f4f49073700 1 -- 172.21.15.110:0/1661872608 shutdown_connections 2021-03-25T14:17:27.206 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.201+0000 7f4f49073700 1 --2- 172.21.15.110:0/1661872608 >> v2:172.21.15.174:3300/0 conn(0x7f4f44148d00 0x7f4f44149150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:27.207 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.201+0000 7f4f49073700 1 --2- 172.21.15.110:0/1661872608 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f440ba680 0x7f4f440baa60 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:27.207 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.201+0000 7f4f49073700 1 -- 172.21.15.110:0/1661872608 >> 172.21.15.110:0/1661872608 conn(0x7f4f44060c40 msgr2=0x7f4f44061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:27.207 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.201+0000 7f4f49073700 1 -- 172.21.15.110:0/1661872608 shutdown_connections 2021-03-25T14:17:27.207 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.201+0000 7f4f49073700 1 -- 172.21.15.110:0/1661872608 wait complete. 2021-03-25T14:17:27.207 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.202+0000 7f4f49073700 1 Processor -- start 2021-03-25T14:17:27.207 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.202+0000 7f4f49073700 1 -- start start 2021-03-25T14:17:27.210 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.203+0000 7f4f49073700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f440b86d0 0x7f4f44146f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:27.210 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.203+0000 7f4f49073700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4f440ba680 0x7f4f440632c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:27.210 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.203+0000 7f4f49073700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f44148d00 0x7f4f44158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:27.210 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.203+0000 7f4f49073700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f440b9ae0 con 0x7f4f44148d00 2021-03-25T14:17:27.210 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.203+0000 7f4f49073700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f440b9340 con 0x7f4f440ba680 2021-03-25T14:17:27.210 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.203+0000 7f4f49073700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f440b95e0 con 0x7f4f440b86d0 2021-03-25T14:17:27.210 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.203+0000 7f4f48872700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f44148d00 0x7f4f44158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:27.211 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.203+0000 7f4f48872700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f44148d00 0x7f4f44158d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49914/0 (socket says 172.21.15.110:49914) 2021-03-25T14:17:27.211 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.203+0000 7f4f48872700 1 -- 172.21.15.110:0/269944920 learned_addr learned my addr 172.21.15.110:0/269944920 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:27.211 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.203+0000 7f4f43fff700 1 --2- 172.21.15.110:0/269944920 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f440b86d0 0x7f4f44146f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:27.211 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.203+0000 7f4f48872700 1 -- 172.21.15.110:0/269944920 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f440b86d0 msgr2=0x7f4f44146f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:27.211 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.203+0000 7f4f48872700 1 --2- 172.21.15.110:0/269944920 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f440b86d0 0x7f4f44146f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:27.211 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.203+0000 7f4f48872700 1 -- 172.21.15.110:0/269944920 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4f440ba680 msgr2=0x7f4f440632c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:27.211 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.203+0000 7f4f437fe700 1 --2- 172.21.15.110:0/269944920 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4f440ba680 0x7f4f440632c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:27.211 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.203+0000 7f4f48872700 1 --2- 172.21.15.110:0/269944920 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4f440ba680 0x7f4f440632c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:27.211 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.203+0000 7f4f48872700 1 -- 172.21.15.110:0/269944920 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f4415c460 con 0x7f4f44148d00 2021-03-25T14:17:27.211 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.203+0000 7f4f48872700 1 --2- 172.21.15.110:0/269944920 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f44148d00 0x7f4f44158d60 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f4f3c00db40 tx=0x7f4f3c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:27.211 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.203+0000 7f4f2bfff700 1 -- 172.21.15.110:0/269944920 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c009910 con 0x7f4f44148d00 2021-03-25T14:17:27.211 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.203+0000 7f4f2bfff700 1 -- 172.21.15.110:0/269944920 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3c009a70 con 0x7f4f44148d00 2021-03-25T14:17:27.211 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.203+0000 7f4f49073700 1 -- 172.21.15.110:0/269944920 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f4415c700 con 0x7f4f44148d00 2021-03-25T14:17:27.212 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.203+0000 7f4f2bfff700 1 -- 172.21.15.110:0/269944920 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c009df0 con 0x7f4f44148d00 2021-03-25T14:17:27.212 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.203+0000 7f4f49073700 1 -- 172.21.15.110:0/269944920 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f4415cc40 con 0x7f4f44148d00 2021-03-25T14:17:27.212 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.204+0000 7f4f49073700 1 -- 172.21.15.110:0/269944920 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f44045ae0 con 0x7f4f44148d00 2021-03-25T14:17:27.212 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.205+0000 7f4f2bfff700 1 -- 172.21.15.110:0/269944920 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f4f3c013690 con 0x7f4f44148d00 2021-03-25T14:17:27.212 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.205+0000 7f4f2bfff700 1 --2- 172.21.15.110:0/269944920 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4f2405a0b0 0x7f4f2405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:27.212 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.205+0000 7f4f2bfff700 1 -- 172.21.15.110:0/269944920 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f4f3c0747f0 con 0x7f4f44148d00 2021-03-25T14:17:27.212 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.205+0000 7f4f43fff700 1 --2- 172.21.15.110:0/269944920 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4f2405a0b0 0x7f4f2405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:27.212 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.205+0000 7f4f43fff700 1 --2- 172.21.15.110:0/269944920 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4f2405a0b0 0x7f4f2405c570 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f4f3400b1d0 tx=0x7f4f34016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:27.213 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.209+0000 7f4f2bfff700 1 -- 172.21.15.110:0/269944920 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f4f3c047fd0 con 0x7f4f44148d00 2021-03-25T14:17:27.361 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.360+0000 7f4f49073700 1 -- 172.21.15.110:0/269944920 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f440bda30 con 0x7f4f44148d00 2021-03-25T14:17:27.362 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.361+0000 7f4f2bfff700 1 -- 172.21.15.110:0/269944920 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+17242 (secure 0 0 0) 0x7f4f3c04b5f0 con 0x7f4f44148d00 2021-03-25T14:17:27.363 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:27.363 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":45,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:17:27.068212+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs2_metadata","create_time":"2021-03-25T14:17:12.037785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}}},{"pool":9,"pool_name":"cephfs2_data","create_time":"2021-03-25T14:17:13.333853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs2"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:6837/503424314":"2021-03-26T14:17:23.508494+0000","172.21.15.110:6835/503424314":"2021-03-26T14:17:23.508494+0000"},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:17:27.364 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.362+0000 7f4f49073700 1 -- 172.21.15.110:0/269944920 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4f2405a0b0 msgr2=0x7f4f2405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:27.365 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.362+0000 7f4f49073700 1 --2- 172.21.15.110:0/269944920 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4f2405a0b0 0x7f4f2405c570 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f4f3400b1d0 tx=0x7f4f34016000).stop 2021-03-25T14:17:27.365 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.362+0000 7f4f49073700 1 -- 172.21.15.110:0/269944920 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f44148d00 msgr2=0x7f4f44158d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:27.365 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.362+0000 7f4f49073700 1 --2- 172.21.15.110:0/269944920 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f44148d00 0x7f4f44158d60 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f4f3c00db40 tx=0x7f4f3c008040).stop 2021-03-25T14:17:27.365 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.362+0000 7f4f49073700 1 -- 172.21.15.110:0/269944920 shutdown_connections 2021-03-25T14:17:27.365 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.362+0000 7f4f49073700 1 --2- 172.21.15.110:0/269944920 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4f2405a0b0 0x7f4f2405c570 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:27.365 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.362+0000 7f4f49073700 1 --2- 172.21.15.110:0/269944920 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f44148d00 0x7f4f44158d60 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:27.365 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.362+0000 7f4f49073700 1 --2- 172.21.15.110:0/269944920 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f440b86d0 0x7f4f44146f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:27.365 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.362+0000 7f4f49073700 1 --2- 172.21.15.110:0/269944920 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4f440ba680 0x7f4f440632c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:27.365 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.362+0000 7f4f49073700 1 -- 172.21.15.110:0/269944920 >> 172.21.15.110:0/269944920 conn(0x7f4f44060c40 msgr2=0x7f4f44145ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:27.365 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.362+0000 7f4f49073700 1 -- 172.21.15.110:0/269944920 shutdown_connections 2021-03-25T14:17:27.365 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.362+0000 7f4f49073700 1 -- 172.21.15.110:0/269944920 wait complete. 2021-03-25T14:17:27.376 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-03-25T14:15:59.047299+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-03-25T14:16:00.537926+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 8, 'pool_name': 'cephfs2_metadata', 'create_time': '2021-03-25T14:17:12.037785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}}, {'pool': 9, 'pool_name': 'cephfs2_data', 'create_time': '2021-03-25T14:17:13.333853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}}] 2021-03-25T14:17:27.376 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-03-25T14:17:27.489 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.487+0000 7f3e1d4dc700 1 Processor -- start 2021-03-25T14:17:27.489 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.487+0000 7f3e1d4dc700 1 -- start start 2021-03-25T14:17:27.497 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.488+0000 7f3e1d4dc700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3e180b7760 0x7f3e18068260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:27.497 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.488+0000 7f3e1d4dc700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3e180b6860 0x7f3e18149db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:27.497 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.488+0000 7f3e1d4dc700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e18068b00 con 0x7f3e1814a2a0 2021-03-25T14:17:27.498 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.488+0000 7f3e1d4dc700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e180b2200 con 0x7f3e180b7760 2021-03-25T14:17:27.498 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.488+0000 7f3e1d4dc700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e18067800 con 0x7f3e180b6860 2021-03-25T14:17:27.498 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.488+0000 7f3e16ffd700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3e180b7760 0x7f3e18068260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:27.498 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.488+0000 7f3e177fe700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f3e1814a2a0 0x7f3e180b83d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:42854/0 (socket says 172.21.15.110:42854) 2021-03-25T14:17:27.498 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.488+0000 7f3e177fe700 1 -- 172.21.15.110:0/1787664242 learned_addr learned my addr 172.21.15.110:0/1787664242 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:27.499 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.488+0000 7f3e167fc700 1 --2- 172.21.15.110:0/1787664242 >> v2:172.21.15.174:3300/0 conn(0x7f3e180b6860 0x7f3e18149db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:27.499 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.488+0000 7f3e16ffd700 1 -- 172.21.15.110:0/1787664242 >> v2:172.21.15.174:3300/0 conn(0x7f3e180b6860 msgr2=0x7f3e18149db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:27.499 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.488+0000 7f3e16ffd700 1 --2- 172.21.15.110:0/1787664242 >> v2:172.21.15.174:3300/0 conn(0x7f3e180b6860 0x7f3e18149db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:27.499 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.488+0000 7f3e16ffd700 1 -- 172.21.15.110:0/1787664242 >> v1:172.21.15.110:6789/0 conn(0x7f3e1814a2a0 legacy=0x7f3e180b83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:27.499 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.488+0000 7f3e16ffd700 1 -- 172.21.15.110:0/1787664242 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e18067aa0 con 0x7f3e180b7760 2021-03-25T14:17:27.500 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.488+0000 7f3e15ffb700 1 -- 172.21.15.110:0/1787664242 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 654405287 0 0) 0x7f3e18068b00 con 0x7f3e1814a2a0 2021-03-25T14:17:27.500 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.488+0000 7f3e16ffd700 1 --2- 172.21.15.110:0/1787664242 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e180b7760 0x7f3e18068260 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f3e180bca30 tx=0x7f3e08006e20).ready entity=mon.0 client_cookie=6443018e452bcc22 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:27.500 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.489+0000 7f3e15ffb700 1 -- 172.21.15.110:0/1787664242 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e080097e0 con 0x7f3e180b7760 2021-03-25T14:17:27.500 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.489+0000 7f3e15ffb700 1 -- 172.21.15.110:0/1787664242 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e08009940 con 0x7f3e180b7760 2021-03-25T14:17:27.501 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.489+0000 7f3e15ffb700 1 -- 172.21.15.110:0/1787664242 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e08009cc0 con 0x7f3e180b7760 2021-03-25T14:17:27.501 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.489+0000 7f3e1d4dc700 1 -- 172.21.15.110:0/1787664242 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e180b7760 msgr2=0x7f3e18068260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:27.501 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.489+0000 7f3e1d4dc700 1 --2- 172.21.15.110:0/1787664242 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e180b7760 0x7f3e18068260 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f3e180bca30 tx=0x7f3e08006e20).stop 2021-03-25T14:17:27.501 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.489+0000 7f3e1d4dc700 1 -- 172.21.15.110:0/1787664242 shutdown_connections 2021-03-25T14:17:27.502 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.489+0000 7f3e1d4dc700 1 --2- 172.21.15.110:0/1787664242 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e180b7760 0x7f3e18068260 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:27.502 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.489+0000 7f3e1d4dc700 1 --2- 172.21.15.110:0/1787664242 >> v2:172.21.15.174:3300/0 conn(0x7f3e180b6860 0x7f3e18149db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:27.502 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.489+0000 7f3e1d4dc700 1 -- 172.21.15.110:0/1787664242 >> 172.21.15.110:0/1787664242 conn(0x7f3e180664e0 msgr2=0x7f3e180668f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:27.502 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.489+0000 7f3e1d4dc700 1 -- 172.21.15.110:0/1787664242 shutdown_connections 2021-03-25T14:17:27.502 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.489+0000 7f3e1d4dc700 1 -- 172.21.15.110:0/1787664242 wait complete. 2021-03-25T14:17:27.502 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.490+0000 7f3e1d4dc700 1 Processor -- start 2021-03-25T14:17:27.503 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.490+0000 7f3e1d4dc700 1 -- start start 2021-03-25T14:17:27.503 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.491+0000 7f3e1d4dc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e180b6860 0x7f3e1815aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:27.503 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.491+0000 7f3e1d4dc700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3e180b7760 0x7f3e18146a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:27.503 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.491+0000 7f3e1d4dc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3e1814a2a0 0x7f3e181472c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:27.503 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.491+0000 7f3e1d4dc700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e180a09b0 con 0x7f3e180b6860 2021-03-25T14:17:27.503 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.491+0000 7f3e1d4dc700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1815a040 con 0x7f3e180b7760 2021-03-25T14:17:27.503 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.491+0000 7f3e1d4dc700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1815a2e0 con 0x7f3e1814a2a0 2021-03-25T14:17:27.504 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.491+0000 7f3e16ffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e180b6860 0x7f3e1815aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:27.504 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.491+0000 7f3e16ffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e180b6860 0x7f3e1815aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49922/0 (socket says 172.21.15.110:49922) 2021-03-25T14:17:27.504 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.491+0000 7f3e16ffd700 1 -- 172.21.15.110:0/4288302857 learned_addr learned my addr 172.21.15.110:0/4288302857 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:27.504 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.491+0000 7f3e16ffd700 1 -- 172.21.15.110:0/4288302857 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3e1814a2a0 msgr2=0x7f3e181472c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:27.504 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.491+0000 7f3e16ffd700 1 --2- 172.21.15.110:0/4288302857 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3e1814a2a0 0x7f3e181472c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:27.504 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.491+0000 7f3e16ffd700 1 -- 172.21.15.110:0/4288302857 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3e180b7760 msgr2=0x7f3e18146a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:27.504 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.491+0000 7f3e16ffd700 1 --2- 172.21.15.110:0/4288302857 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3e180b7760 0x7f3e18146a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:27.504 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.491+0000 7f3e16ffd700 1 -- 172.21.15.110:0/4288302857 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e1815a580 con 0x7f3e180b6860 2021-03-25T14:17:27.504 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.492+0000 7f3e16ffd700 1 --2- 172.21.15.110:0/4288302857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e180b6860 0x7f3e1815aa20 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f3e08006e60 tx=0x7f3e08016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:27.504 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.492+0000 7f3dfeffd700 1 -- 172.21.15.110:0/4288302857 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e08011e70 con 0x7f3e180b6860 2021-03-25T14:17:27.504 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.492+0000 7f3dfeffd700 1 -- 172.21.15.110:0/4288302857 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0801d430 con 0x7f3e180b6860 2021-03-25T14:17:27.504 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.492+0000 7f3e1d4dc700 1 -- 172.21.15.110:0/4288302857 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e18092ee0 con 0x7f3e180b6860 2021-03-25T14:17:27.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.492+0000 7f3dfeffd700 1 -- 172.21.15.110:0/4288302857 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0801d7b0 con 0x7f3e180b6860 2021-03-25T14:17:27.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.492+0000 7f3e1d4dc700 1 -- 172.21.15.110:0/4288302857 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e18146f10 con 0x7f3e180b6860 2021-03-25T14:17:27.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.493+0000 7f3e1d4dc700 1 -- 172.21.15.110:0/4288302857 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e1815a710 con 0x7f3e180b6860 2021-03-25T14:17:27.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.493+0000 7f3dfeffd700 1 -- 172.21.15.110:0/4288302857 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f3e08024030 con 0x7f3e180b6860 2021-03-25T14:17:27.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.493+0000 7f3dfeffd700 1 --2- 172.21.15.110:0/4288302857 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3df805a0b0 0x7f3df805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:27.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.493+0000 7f3dfeffd700 1 -- 172.21.15.110:0/4288302857 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f3e08074f90 con 0x7f3e180b6860 2021-03-25T14:17:27.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.493+0000 7f3e167fc700 1 --2- 172.21.15.110:0/4288302857 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3df805a0b0 0x7f3df805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:27.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.494+0000 7f3e167fc700 1 --2- 172.21.15.110:0/4288302857 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3df805a0b0 0x7f3df805c570 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f3e180b6c60 tx=0x7f3e0c008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:27.506 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.497+0000 7f3dfeffd700 1 -- 172.21.15.110:0/4288302857 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f3e08048820 con 0x7f3e180b6860 2021-03-25T14:17:27.654 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.652+0000 7f3e1d4dc700 1 -- 172.21.15.110:0/4288302857 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3e1805d7b0 con 0x7f3e180b6860 2021-03-25T14:17:27.654 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.652+0000 7f3dfeffd700 1 -- 172.21.15.110:0/4288302857 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v45) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3e08022030 con 0x7f3e180b6860 2021-03-25T14:17:27.654 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 1 2021-03-25T14:17:27.656 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.654+0000 7f3e1d4dc700 1 -- 172.21.15.110:0/4288302857 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3df805a0b0 msgr2=0x7f3df805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:27.656 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.654+0000 7f3e1d4dc700 1 --2- 172.21.15.110:0/4288302857 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3df805a0b0 0x7f3df805c570 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f3e180b6c60 tx=0x7f3e0c008040).stop 2021-03-25T14:17:27.656 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.654+0000 7f3e1d4dc700 1 -- 172.21.15.110:0/4288302857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e180b6860 msgr2=0x7f3e1815aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:27.657 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.654+0000 7f3e1d4dc700 1 --2- 172.21.15.110:0/4288302857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e180b6860 0x7f3e1815aa20 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f3e08006e60 tx=0x7f3e08016000).stop 2021-03-25T14:17:27.657 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.654+0000 7f3e1d4dc700 1 -- 172.21.15.110:0/4288302857 shutdown_connections 2021-03-25T14:17:27.657 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.654+0000 7f3e1d4dc700 1 --2- 172.21.15.110:0/4288302857 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3df805a0b0 0x7f3df805c570 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:27.657 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.654+0000 7f3e1d4dc700 1 --2- 172.21.15.110:0/4288302857 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3e1814a2a0 0x7f3e181472c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:27.657 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.654+0000 7f3e1d4dc700 1 --2- 172.21.15.110:0/4288302857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e180b6860 0x7f3e1815aa20 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:27.657 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.654+0000 7f3e1d4dc700 1 --2- 172.21.15.110:0/4288302857 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3e180b7760 0x7f3e18146a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:27.657 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.654+0000 7f3e1d4dc700 1 -- 172.21.15.110:0/4288302857 >> 172.21.15.110:0/4288302857 conn(0x7f3e180664e0 msgr2=0x7f3e180b99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:27.657 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.654+0000 7f3e1d4dc700 1 -- 172.21.15.110:0/4288302857 shutdown_connections 2021-03-25T14:17:27.657 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.654+0000 7f3e1d4dc700 1 -- 172.21.15.110:0/4288302857 wait complete. 2021-03-25T14:17:27.667 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-03-25T14:17:27.780 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.778+0000 7f5ad7667700 1 Processor -- start 2021-03-25T14:17:27.780 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.778+0000 7f5ad7667700 1 -- start start 2021-03-25T14:17:27.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.779+0000 7f5ad7667700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ad00b4100 0x7f5ad0149340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:27.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.779+0000 7f5ad7667700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5ad00b47a0 0x7f5ad00b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:27.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.779+0000 7f5ad7667700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ad00b4c30 con 0x7f5ad00be3a0 2021-03-25T14:17:27.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.779+0000 7f5ad7667700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad0149960 con 0x7f5ad00b47a0 2021-03-25T14:17:27.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.779+0000 7f5ad7667700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad0149c00 con 0x7f5ad00b4100 2021-03-25T14:17:27.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.779+0000 7f5ad5c04700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5ad00b47a0 0x7f5ad00b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:27.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.779+0000 7f5ad5c04700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5ad00b47a0 0x7f5ad00b8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49932/0 (socket says 172.21.15.110:49932) 2021-03-25T14:17:27.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.779+0000 7f5ad5403700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f5ad00be3a0 0x7f5ad0148c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.110:50532/0 (socket says 172.21.15.110:50532) 2021-03-25T14:17:27.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.779+0000 7f5ad5c04700 1 -- 172.21.15.110:0/3385463144 learned_addr learned my addr 172.21.15.110:0/3385463144 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:27.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.779+0000 7f5ad4c02700 1 --2- 172.21.15.110:0/3385463144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ad00b4100 0x7f5ad0149340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:27.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.779+0000 7f5ad5c04700 1 -- 172.21.15.110:0/3385463144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ad00b4100 msgr2=0x7f5ad0149340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:27.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.779+0000 7f5ad5c04700 1 --2- 172.21.15.110:0/3385463144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ad00b4100 0x7f5ad0149340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:27.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.779+0000 7f5ad5c04700 1 -- 172.21.15.110:0/3385463144 >> v1:172.21.15.174:6789/0 conn(0x7f5ad00be3a0 legacy=0x7f5ad0148c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:27.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.779+0000 7f5ad5c04700 1 -- 172.21.15.110:0/3385463144 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad0149ea0 con 0x7f5ad00b47a0 2021-03-25T14:17:27.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.779+0000 7f5ad5c04700 1 --2- 172.21.15.110:0/3385463144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ad00b47a0 0x7f5ad00b8cc0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f5ac8009d90 tx=0x7f5ac80092d0).ready entity=mon.0 client_cookie=8b83b79f3b0bcb9c server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:27.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.780+0000 7f5abffff700 1 -- 172.21.15.110:0/3385463144 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac800bbf0 con 0x7f5ad00b47a0 2021-03-25T14:17:27.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.780+0000 7f5abffff700 1 -- 172.21.15.110:0/3385463144 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac800bd50 con 0x7f5ad00b47a0 2021-03-25T14:17:27.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.780+0000 7f5abffff700 1 -- 172.21.15.110:0/3385463144 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac8011610 con 0x7f5ad00b47a0 2021-03-25T14:17:27.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.780+0000 7f5ad7667700 1 -- 172.21.15.110:0/3385463144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ad00b47a0 msgr2=0x7f5ad00b8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:27.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.780+0000 7f5ad7667700 1 --2- 172.21.15.110:0/3385463144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ad00b47a0 0x7f5ad00b8cc0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f5ac8009d90 tx=0x7f5ac80092d0).stop 2021-03-25T14:17:27.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.780+0000 7f5ad7667700 1 -- 172.21.15.110:0/3385463144 shutdown_connections 2021-03-25T14:17:27.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.780+0000 7f5ad7667700 1 --2- 172.21.15.110:0/3385463144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ad00b47a0 0x7f5ad00b8cc0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:27.785 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.780+0000 7f5ad7667700 1 --2- 172.21.15.110:0/3385463144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ad00b4100 0x7f5ad0149340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:27.785 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.780+0000 7f5ad7667700 1 -- 172.21.15.110:0/3385463144 >> 172.21.15.110:0/3385463144 conn(0x7f5ad00686f0 msgr2=0x7f5ad0068b00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:27.785 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.780+0000 7f5ad7667700 1 -- 172.21.15.110:0/3385463144 shutdown_connections 2021-03-25T14:17:27.785 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.780+0000 7f5ad7667700 1 -- 172.21.15.110:0/3385463144 wait complete. 2021-03-25T14:17:27.788 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.782+0000 7f5ad7667700 1 Processor -- start 2021-03-25T14:17:27.788 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.782+0000 7f5ad7667700 1 -- start start 2021-03-25T14:17:27.788 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.782+0000 7f5ad7667700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ad00b4100 0x7f5ad00a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:27.788 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.782+0000 7f5ad7667700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ad00b47a0 0x7f5ad00b91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:27.788 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.782+0000 7f5ad7667700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ad00be3a0 0x7f5ad0158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:27.788 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.782+0000 7f5ad7667700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad00a33b0 con 0x7f5ad00be3a0 2021-03-25T14:17:27.788 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.782+0000 7f5ad7667700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad00a2660 con 0x7f5ad00b4100 2021-03-25T14:17:27.788 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.782+0000 7f5ad7667700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad015bdd0 con 0x7f5ad00b47a0 2021-03-25T14:17:27.788 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.782+0000 7f5ad5c04700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ad00be3a0 0x7f5ad0158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:27.789 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.783+0000 7f5ad5c04700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ad00be3a0 0x7f5ad0158830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49938/0 (socket says 172.21.15.110:49938) 2021-03-25T14:17:27.789 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.783+0000 7f5ad5c04700 1 -- 172.21.15.110:0/3605858871 learned_addr learned my addr 172.21.15.110:0/3605858871 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:27.789 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.783+0000 7f5ad5403700 1 --2- 172.21.15.110:0/3605858871 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ad00b4100 0x7f5ad00a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:27.789 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.783+0000 7f5ad4c02700 1 --2- 172.21.15.110:0/3605858871 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ad00b47a0 0x7f5ad00b91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:27.789 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.783+0000 7f5ad5c04700 1 -- 172.21.15.110:0/3605858871 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ad00b47a0 msgr2=0x7f5ad00b91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:27.789 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.783+0000 7f5ad5c04700 1 --2- 172.21.15.110:0/3605858871 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ad00b47a0 0x7f5ad00b91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:27.789 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.783+0000 7f5ad5c04700 1 -- 172.21.15.110:0/3605858871 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ad00b4100 msgr2=0x7f5ad00a1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:27.789 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.783+0000 7f5ad5c04700 1 --2- 172.21.15.110:0/3605858871 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ad00b4100 0x7f5ad00a1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:27.789 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.783+0000 7f5ad5c04700 1 -- 172.21.15.110:0/3605858871 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad015c070 con 0x7f5ad00be3a0 2021-03-25T14:17:27.789 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.783+0000 7f5ad5c04700 1 --2- 172.21.15.110:0/3605858871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ad00be3a0 0x7f5ad0158830 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f5ac8009310 tx=0x7f5ac8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:27.789 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.783+0000 7f5abd7fa700 1 -- 172.21.15.110:0/3605858871 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac800bbf0 con 0x7f5ad00be3a0 2021-03-25T14:17:27.789 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.783+0000 7f5abd7fa700 1 -- 172.21.15.110:0/3605858871 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac800bec0 con 0x7f5ad00be3a0 2021-03-25T14:17:27.790 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.783+0000 7f5abd7fa700 1 -- 172.21.15.110:0/3605858871 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac8011650 con 0x7f5ad00be3a0 2021-03-25T14:17:27.790 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.783+0000 7f5ad7667700 1 -- 172.21.15.110:0/3605858871 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad015c310 con 0x7f5ad00be3a0 2021-03-25T14:17:27.790 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.783+0000 7f5ad7667700 1 -- 172.21.15.110:0/3605858871 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad00bd0e0 con 0x7f5ad00be3a0 2021-03-25T14:17:27.790 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.784+0000 7f5ad7667700 1 -- 172.21.15.110:0/3605858871 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ad015c770 con 0x7f5ad00be3a0 2021-03-25T14:17:27.790 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.784+0000 7f5abd7fa700 1 -- 172.21.15.110:0/3605858871 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f5ac800f070 con 0x7f5ad00be3a0 2021-03-25T14:17:27.790 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.784+0000 7f5abd7fa700 1 --2- 172.21.15.110:0/3605858871 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5ab005a0b0 0x7f5ab005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:27.790 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.785+0000 7f5abd7fa700 1 -- 172.21.15.110:0/3605858871 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f5ac8075950 con 0x7f5ad00be3a0 2021-03-25T14:17:27.790 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.785+0000 7f5ad5403700 1 --2- 172.21.15.110:0/3605858871 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5ab005a0b0 0x7f5ab005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:27.790 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.785+0000 7f5ad5403700 1 --2- 172.21.15.110:0/3605858871 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5ab005a0b0 0x7f5ab005c570 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f5acc007f70 tx=0x7f5acc000bc0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:27.791 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.788+0000 7f5abd7fa700 1 -- 172.21.15.110:0/3605858871 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f5ac8049130 con 0x7f5ad00be3a0 2021-03-25T14:17:27.938 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.936+0000 7f5ad7667700 1 -- 172.21.15.110:0/3605858871 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5ad005d7b0 con 0x7f5ad00be3a0 2021-03-25T14:17:27.939 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.937+0000 7f5abd7fa700 1 -- 172.21.15.110:0/3605858871 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v45) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5ac804c750 con 0x7f5ad00be3a0 2021-03-25T14:17:27.939 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:17:27.940 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.938+0000 7f5ad7667700 1 -- 172.21.15.110:0/3605858871 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5ab005a0b0 msgr2=0x7f5ab005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:27.940 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.938+0000 7f5ad7667700 1 --2- 172.21.15.110:0/3605858871 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5ab005a0b0 0x7f5ab005c570 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f5acc007f70 tx=0x7f5acc000bc0).stop 2021-03-25T14:17:27.941 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.938+0000 7f5ad7667700 1 -- 172.21.15.110:0/3605858871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ad00be3a0 msgr2=0x7f5ad0158830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:27.941 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.938+0000 7f5ad7667700 1 --2- 172.21.15.110:0/3605858871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ad00be3a0 0x7f5ad0158830 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f5ac8009310 tx=0x7f5ac8017000).stop 2021-03-25T14:17:27.941 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.938+0000 7f5ad7667700 1 -- 172.21.15.110:0/3605858871 shutdown_connections 2021-03-25T14:17:27.941 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.938+0000 7f5ad7667700 1 --2- 172.21.15.110:0/3605858871 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5ab005a0b0 0x7f5ab005c570 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:27.941 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.938+0000 7f5ad7667700 1 --2- 172.21.15.110:0/3605858871 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ad00b4100 0x7f5ad00a1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:27.941 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.938+0000 7f5ad7667700 1 --2- 172.21.15.110:0/3605858871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ad00be3a0 0x7f5ad0158830 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:27.941 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.938+0000 7f5ad7667700 1 --2- 172.21.15.110:0/3605858871 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ad00b47a0 0x7f5ad00b91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:27.941 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.938+0000 7f5ad7667700 1 -- 172.21.15.110:0/3605858871 >> 172.21.15.110:0/3605858871 conn(0x7f5ad00686f0 msgr2=0x7f5ad0146ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:27.941 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.938+0000 7f5ad7667700 1 -- 172.21.15.110:0/3605858871 shutdown_connections 2021-03-25T14:17:27.941 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:27.938+0000 7f5ad7667700 1 -- 172.21.15.110:0/3605858871 wait complete. 2021-03-25T14:17:27.952 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2021-03-25T14:17:28.064 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.062+0000 7f6d2b8ea700 1 Processor -- start 2021-03-25T14:17:28.064 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.062+0000 7f6d2b8ea700 1 -- start start 2021-03-25T14:17:28.067 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.063+0000 7f6d2b8ea700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6d240b5d00 0x7f6d24145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:28.067 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.063+0000 7f6d2b8ea700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6d240648a0 0x7f6d2409db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:28.067 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.063+0000 7f6d2b8ea700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d24149c50 con 0x7f6d240b0cc0 2021-03-25T14:17:28.067 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.063+0000 7f6d2b8ea700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d24067960 con 0x7f6d240648a0 2021-03-25T14:17:28.067 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.063+0000 7f6d2b8ea700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d241461b0 con 0x7f6d240b5d00 2021-03-25T14:17:28.067 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.063+0000 7f6d29e87700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6d240648a0 0x7f6d2409db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:28.067 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.063+0000 7f6d29686700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f6d240b0cc0 0x7f6d24067250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:42880/0 (socket says 172.21.15.110:42880) 2021-03-25T14:17:28.067 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.063+0000 7f6d29686700 1 -- 172.21.15.110:0/3774810936 learned_addr learned my addr 172.21.15.110:0/3774810936 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:28.067 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.063+0000 7f6d28e85700 1 --2- 172.21.15.110:0/3774810936 >> v2:172.21.15.174:3300/0 conn(0x7f6d240b5d00 0x7f6d24145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:28.068 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.063+0000 7f6d29e87700 1 -- 172.21.15.110:0/3774810936 >> v2:172.21.15.174:3300/0 conn(0x7f6d240b5d00 msgr2=0x7f6d24145cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:28.068 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.063+0000 7f6d29e87700 1 --2- 172.21.15.110:0/3774810936 >> v2:172.21.15.174:3300/0 conn(0x7f6d240b5d00 0x7f6d24145cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:28.068 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.063+0000 7f6d29e87700 1 -- 172.21.15.110:0/3774810936 >> v1:172.21.15.110:6789/0 conn(0x7f6d240b0cc0 legacy=0x7f6d24067250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:28.068 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.063+0000 7f6d29e87700 1 -- 172.21.15.110:0/3774810936 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d24149e80 con 0x7f6d240648a0 2021-03-25T14:17:28.068 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.063+0000 7f6d13fff700 1 -- 172.21.15.110:0/3774810936 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3015777774 0 0) 0x7f6d24149c50 con 0x7f6d240b0cc0 2021-03-25T14:17:28.068 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.063+0000 7f6d29e87700 1 --2- 172.21.15.110:0/3774810936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d240648a0 0x7f6d2409db40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f6d240a1db0 tx=0x7f6d1c009220).ready entity=mon.0 client_cookie=489ab0b0a522b597 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:28.068 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.064+0000 7f6d13fff700 1 -- 172.21.15.110:0/3774810936 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c009ea0 con 0x7f6d240648a0 2021-03-25T14:17:28.068 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.064+0000 7f6d13fff700 1 -- 172.21.15.110:0/3774810936 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1c00bc80 con 0x7f6d240648a0 2021-03-25T14:17:28.068 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.064+0000 7f6d13fff700 1 -- 172.21.15.110:0/3774810936 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c011400 con 0x7f6d240648a0 2021-03-25T14:17:28.068 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.064+0000 7f6d2b8ea700 1 -- 172.21.15.110:0/3774810936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d240648a0 msgr2=0x7f6d2409db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:28.068 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.064+0000 7f6d2b8ea700 1 --2- 172.21.15.110:0/3774810936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d240648a0 0x7f6d2409db40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f6d240a1db0 tx=0x7f6d1c009220).stop 2021-03-25T14:17:28.068 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.064+0000 7f6d2b8ea700 1 -- 172.21.15.110:0/3774810936 shutdown_connections 2021-03-25T14:17:28.069 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.064+0000 7f6d2b8ea700 1 --2- 172.21.15.110:0/3774810936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d240648a0 0x7f6d2409db40 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:28.069 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.064+0000 7f6d2b8ea700 1 --2- 172.21.15.110:0/3774810936 >> v2:172.21.15.174:3300/0 conn(0x7f6d240b5d00 0x7f6d24145cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:28.069 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.064+0000 7f6d2b8ea700 1 -- 172.21.15.110:0/3774810936 >> 172.21.15.110:0/3774810936 conn(0x7f6d240664e0 msgr2=0x7f6d240668f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:28.069 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.064+0000 7f6d2b8ea700 1 -- 172.21.15.110:0/3774810936 shutdown_connections 2021-03-25T14:17:28.069 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.064+0000 7f6d2b8ea700 1 -- 172.21.15.110:0/3774810936 wait complete. 2021-03-25T14:17:28.069 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.065+0000 7f6d2b8ea700 1 Processor -- start 2021-03-25T14:17:28.069 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.065+0000 7f6d2b8ea700 1 -- start start 2021-03-25T14:17:28.072 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.066+0000 7f6d2b8ea700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d240648a0 0x7f6d2409dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:28.072 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.066+0000 7f6d2b8ea700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6d240b0cc0 0x7f6d240a0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:28.072 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.066+0000 7f6d2b8ea700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d240b5d00 0x7f6d240b9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:28.072 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.066+0000 7f6d2b8ea700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d240b43b0 con 0x7f6d240648a0 2021-03-25T14:17:28.072 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.066+0000 7f6d2b8ea700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d240b45a0 con 0x7f6d240b5d00 2021-03-25T14:17:28.072 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.066+0000 7f6d2b8ea700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d240b4840 con 0x7f6d240b0cc0 2021-03-25T14:17:28.072 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.066+0000 7f6d29686700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d240648a0 0x7f6d2409dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:28.072 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.066+0000 7f6d29686700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d240648a0 0x7f6d2409dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49950/0 (socket says 172.21.15.110:49950) 2021-03-25T14:17:28.072 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.066+0000 7f6d29686700 1 -- 172.21.15.110:0/2646510958 learned_addr learned my addr 172.21.15.110:0/2646510958 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:28.072 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.066+0000 7f6d28e85700 1 --2- 172.21.15.110:0/2646510958 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6d240b0cc0 0x7f6d240a0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:28.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.066+0000 7f6d29e87700 1 --2- 172.21.15.110:0/2646510958 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d240b5d00 0x7f6d240b9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:28.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.066+0000 7f6d29686700 1 -- 172.21.15.110:0/2646510958 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6d240b0cc0 msgr2=0x7f6d240a0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:28.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.066+0000 7f6d29686700 1 --2- 172.21.15.110:0/2646510958 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6d240b0cc0 0x7f6d240a0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:28.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.066+0000 7f6d29686700 1 -- 172.21.15.110:0/2646510958 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d240b5d00 msgr2=0x7f6d240b9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:28.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.066+0000 7f6d29686700 1 --2- 172.21.15.110:0/2646510958 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d240b5d00 0x7f6d240b9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:28.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.066+0000 7f6d29686700 1 -- 172.21.15.110:0/2646510958 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d240b4ae0 con 0x7f6d240648a0 2021-03-25T14:17:28.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.066+0000 7f6d29e87700 1 --2- 172.21.15.110:0/2646510958 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d240b5d00 0x7f6d240b9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:28.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.066+0000 7f6d28e85700 1 --2- 172.21.15.110:0/2646510958 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6d240b0cc0 0x7f6d240a0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:28.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.067+0000 7f6d29686700 1 --2- 172.21.15.110:0/2646510958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d240648a0 0x7f6d2409dbd0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f6d2000c7c0 tx=0x7f6d20007af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:28.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.067+0000 7f6d117fa700 1 -- 172.21.15.110:0/2646510958 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d20007320 con 0x7f6d240648a0 2021-03-25T14:17:28.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.067+0000 7f6d117fa700 1 -- 172.21.15.110:0/2646510958 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d20007480 con 0x7f6d240648a0 2021-03-25T14:17:28.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.067+0000 7f6d2b8ea700 1 -- 172.21.15.110:0/2646510958 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d240b4d80 con 0x7f6d240648a0 2021-03-25T14:17:28.074 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.067+0000 7f6d117fa700 1 -- 172.21.15.110:0/2646510958 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d20005830 con 0x7f6d240648a0 2021-03-25T14:17:28.074 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.067+0000 7f6d2b8ea700 1 -- 172.21.15.110:0/2646510958 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d240a13f0 con 0x7f6d240648a0 2021-03-25T14:17:28.074 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.068+0000 7f6d2b8ea700 1 -- 172.21.15.110:0/2646510958 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d240b4f10 con 0x7f6d240648a0 2021-03-25T14:17:28.074 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.068+0000 7f6d117fa700 1 -- 172.21.15.110:0/2646510958 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f6d20010030 con 0x7f6d240648a0 2021-03-25T14:17:28.074 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.068+0000 7f6d117fa700 1 --2- 172.21.15.110:0/2646510958 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6d0405a0b0 0x7f6d0405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:28.074 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.068+0000 7f6d117fa700 1 -- 172.21.15.110:0/2646510958 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f6d20073cc0 con 0x7f6d240648a0 2021-03-25T14:17:28.074 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.068+0000 7f6d28e85700 1 --2- 172.21.15.110:0/2646510958 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6d0405a0b0 0x7f6d0405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:28.074 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.069+0000 7f6d28e85700 1 --2- 172.21.15.110:0/2646510958 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6d0405a0b0 0x7f6d0405c570 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f6d240a1950 tx=0x7f6d14008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:28.074 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.072+0000 7f6d117fa700 1 -- 172.21.15.110:0/2646510958 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f6d200474a0 con 0x7f6d240648a0 2021-03-25T14:17:28.223 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.221+0000 7f6d2b8ea700 1 -- 172.21.15.110:0/2646510958 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6d2405d7b0 con 0x7f6d240648a0 2021-03-25T14:17:28.223 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.221+0000 7f6d117fa700 1 -- 172.21.15.110:0/2646510958 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v45) v1 ==== 105+0+10 (secure 0 0 0) 0x7f6d2004aac0 con 0x7f6d240648a0 2021-03-25T14:17:28.224 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:17:28.225 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.223+0000 7f6d2b8ea700 1 -- 172.21.15.110:0/2646510958 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6d0405a0b0 msgr2=0x7f6d0405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:28.225 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.223+0000 7f6d2b8ea700 1 --2- 172.21.15.110:0/2646510958 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6d0405a0b0 0x7f6d0405c570 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f6d240a1950 tx=0x7f6d14008040).stop 2021-03-25T14:17:28.225 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.223+0000 7f6d2b8ea700 1 -- 172.21.15.110:0/2646510958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d240648a0 msgr2=0x7f6d2409dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:28.225 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.223+0000 7f6d2b8ea700 1 --2- 172.21.15.110:0/2646510958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d240648a0 0x7f6d2409dbd0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f6d2000c7c0 tx=0x7f6d20007af0).stop 2021-03-25T14:17:28.226 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.223+0000 7f6d2b8ea700 1 -- 172.21.15.110:0/2646510958 shutdown_connections 2021-03-25T14:17:28.226 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.223+0000 7f6d2b8ea700 1 --2- 172.21.15.110:0/2646510958 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6d0405a0b0 0x7f6d0405c570 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:28.226 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.223+0000 7f6d2b8ea700 1 --2- 172.21.15.110:0/2646510958 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d240b5d00 0x7f6d240b9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:28.226 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.223+0000 7f6d2b8ea700 1 --2- 172.21.15.110:0/2646510958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d240648a0 0x7f6d2409dbd0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:28.226 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.223+0000 7f6d2b8ea700 1 --2- 172.21.15.110:0/2646510958 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6d240b0cc0 0x7f6d240a0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:28.226 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.223+0000 7f6d2b8ea700 1 -- 172.21.15.110:0/2646510958 >> 172.21.15.110:0/2646510958 conn(0x7f6d240664e0 msgr2=0x7f6d241464b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:28.226 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.223+0000 7f6d2b8ea700 1 -- 172.21.15.110:0/2646510958 shutdown_connections 2021-03-25T14:17:28.226 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.223+0000 7f6d2b8ea700 1 -- 172.21.15.110:0/2646510958 wait complete. 2021-03-25T14:17:28.237 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2021-03-25T14:17:28.350 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.348+0000 7f80efb12700 1 Processor -- start 2021-03-25T14:17:28.350 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.348+0000 7f80efb12700 1 -- start start 2021-03-25T14:17:28.357 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.349+0000 7f80efb12700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80e80b4100 0x7f80e8149340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:28.357 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.349+0000 7f80efb12700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f80e80b47a0 0x7f80e80b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:28.357 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.349+0000 7f80efb12700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80e80b4c30 con 0x7f80e80be3a0 2021-03-25T14:17:28.358 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.349+0000 7f80efb12700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80e8149960 con 0x7f80e80b47a0 2021-03-25T14:17:28.358 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.349+0000 7f80efb12700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e8149c00 con 0x7f80e80b4100 2021-03-25T14:17:28.358 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.349+0000 7f80ed0ad700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80e80b4100 0x7f80e8149340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:28.358 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.349+0000 7f80ee0af700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f80e80b47a0 0x7f80e80b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:28.358 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.349+0000 7f80ed8ae700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f80e80be3a0 0x7f80e8148c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.110:50562/0 (socket says 172.21.15.110:50562) 2021-03-25T14:17:28.358 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.349+0000 7f80ed8ae700 1 -- 172.21.15.110:0/1001555827 learned_addr learned my addr 172.21.15.110:0/1001555827 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:28.358 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.349+0000 7f80ee0af700 1 -- 172.21.15.110:0/1001555827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80e80b4100 msgr2=0x7f80e8149340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:28.358 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.349+0000 7f80ee0af700 1 --2- 172.21.15.110:0/1001555827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80e80b4100 0x7f80e8149340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:28.358 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.349+0000 7f80ee0af700 1 -- 172.21.15.110:0/1001555827 >> v1:172.21.15.174:6789/0 conn(0x7f80e80be3a0 legacy=0x7f80e8148c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:28.359 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.349+0000 7f80ec8ac700 1 -- 172.21.15.110:0/1001555827 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1291260379 0 0) 0x7f80e80b4c30 con 0x7f80e80be3a0 2021-03-25T14:17:28.359 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.349+0000 7f80ee0af700 1 -- 172.21.15.110:0/1001555827 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e8149ea0 con 0x7f80e80b47a0 2021-03-25T14:17:28.359 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.349+0000 7f80ed0ad700 1 --2- 172.21.15.110:0/1001555827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80e80b4100 0x7f80e8149340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:17:28.359 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.349+0000 7f80ee0af700 1 --2- 172.21.15.110:0/1001555827 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80e80b47a0 0x7f80e80b8cc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f80e0009cc0 tx=0x7f80e0009220).ready entity=mon.1 client_cookie=41ecd6023ffa2ccc server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:28.359 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.350+0000 7f80ec8ac700 1 -- 172.21.15.110:0/1001555827 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e000ba10 con 0x7f80e80b47a0 2021-03-25T14:17:28.359 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.350+0000 7f80ec8ac700 1 -- 172.21.15.110:0/1001555827 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e000bb70 con 0x7f80e80b47a0 2021-03-25T14:17:28.359 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.350+0000 7f80ec8ac700 1 -- 172.21.15.110:0/1001555827 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e0011400 con 0x7f80e80b47a0 2021-03-25T14:17:28.359 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.350+0000 7f80efb12700 1 -- 172.21.15.110:0/1001555827 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80e80b47a0 msgr2=0x7f80e80b8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:28.359 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.350+0000 7f80efb12700 1 --2- 172.21.15.110:0/1001555827 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80e80b47a0 0x7f80e80b8cc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f80e0009cc0 tx=0x7f80e0009220).stop 2021-03-25T14:17:28.359 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.350+0000 7f80efb12700 1 -- 172.21.15.110:0/1001555827 shutdown_connections 2021-03-25T14:17:28.359 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.350+0000 7f80efb12700 1 --2- 172.21.15.110:0/1001555827 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80e80b47a0 0x7f80e80b8cc0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:28.359 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.350+0000 7f80efb12700 1 --2- 172.21.15.110:0/1001555827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80e80b4100 0x7f80e8149340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:28.360 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.350+0000 7f80efb12700 1 -- 172.21.15.110:0/1001555827 >> 172.21.15.110:0/1001555827 conn(0x7f80e80686f0 msgr2=0x7f80e8068b00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:28.360 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.350+0000 7f80efb12700 1 -- 172.21.15.110:0/1001555827 shutdown_connections 2021-03-25T14:17:28.360 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.350+0000 7f80efb12700 1 -- 172.21.15.110:0/1001555827 wait complete. 2021-03-25T14:17:28.360 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.351+0000 7f80efb12700 1 Processor -- start 2021-03-25T14:17:28.360 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.351+0000 7f80efb12700 1 -- start start 2021-03-25T14:17:28.360 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.352+0000 7f80efb12700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80e80b4100 0x7f80e80b6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:28.360 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.352+0000 7f80efb12700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80e80b47a0 0x7f80e80bd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:28.360 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.352+0000 7f80efb12700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80e80be3a0 0x7f80e80b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:28.360 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.352+0000 7f80efb12700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e80a32f0 con 0x7f80e80b47a0 2021-03-25T14:17:28.360 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.352+0000 7f80efb12700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e80b5cb0 con 0x7f80e80be3a0 2021-03-25T14:17:28.360 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.352+0000 7f80efb12700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e80b6050 con 0x7f80e80b4100 2021-03-25T14:17:28.360 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.352+0000 7f80ed0ad700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80e80b47a0 0x7f80e80bd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:28.360 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.352+0000 7f80ed0ad700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80e80b47a0 0x7f80e80bd1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49966/0 (socket says 172.21.15.110:49966) 2021-03-25T14:17:28.361 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.352+0000 7f80ed0ad700 1 -- 172.21.15.110:0/144763398 learned_addr learned my addr 172.21.15.110:0/144763398 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:28.361 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.352+0000 7f80ed8ae700 1 --2- 172.21.15.110:0/144763398 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80e80b4100 0x7f80e80b6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:28.361 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.352+0000 7f80ee0af700 1 --2- 172.21.15.110:0/144763398 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80e80be3a0 0x7f80e80b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:28.361 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.352+0000 7f80ed0ad700 1 -- 172.21.15.110:0/144763398 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80e80b4100 msgr2=0x7f80e80b6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:28.361 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.352+0000 7f80ed0ad700 1 --2- 172.21.15.110:0/144763398 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80e80b4100 0x7f80e80b6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:28.361 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.352+0000 7f80ed0ad700 1 -- 172.21.15.110:0/144763398 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80e80be3a0 msgr2=0x7f80e80b7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:28.361 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.352+0000 7f80ed0ad700 1 --2- 172.21.15.110:0/144763398 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80e80be3a0 0x7f80e80b7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:28.361 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.352+0000 7f80ed0ad700 1 -- 172.21.15.110:0/144763398 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e80a1080 con 0x7f80e80b47a0 2021-03-25T14:17:28.361 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.353+0000 7f80ed0ad700 1 --2- 172.21.15.110:0/144763398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80e80b47a0 0x7f80e80bd1e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f80e400ef20 tx=0x7f80e4006e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:28.361 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.353+0000 7f80d5ffb700 1 -- 172.21.15.110:0/144763398 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e400cbc0 con 0x7f80e80b47a0 2021-03-25T14:17:28.361 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.353+0000 7f80d5ffb700 1 -- 172.21.15.110:0/144763398 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e400cd20 con 0x7f80e80b47a0 2021-03-25T14:17:28.361 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.353+0000 7f80efb12700 1 -- 172.21.15.110:0/144763398 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e80b5a10 con 0x7f80e80b47a0 2021-03-25T14:17:28.362 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.353+0000 7f80d5ffb700 1 -- 172.21.15.110:0/144763398 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e4012600 con 0x7f80e80b47a0 2021-03-25T14:17:28.362 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.353+0000 7f80efb12700 1 -- 172.21.15.110:0/144763398 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e80b62b0 con 0x7f80e80b47a0 2021-03-25T14:17:28.362 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.354+0000 7f80efb12700 1 -- 172.21.15.110:0/144763398 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80e8061430 con 0x7f80e80b47a0 2021-03-25T14:17:28.362 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.354+0000 7f80d5ffb700 1 -- 172.21.15.110:0/144763398 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f80e4012970 con 0x7f80e80b47a0 2021-03-25T14:17:28.362 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.354+0000 7f80d5ffb700 1 --2- 172.21.15.110:0/144763398 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f80c805a0b0 0x7f80c805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:28.362 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.354+0000 7f80d5ffb700 1 -- 172.21.15.110:0/144763398 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f80e4074480 con 0x7f80e80b47a0 2021-03-25T14:17:28.362 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.354+0000 7f80ed8ae700 1 --2- 172.21.15.110:0/144763398 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f80c805a0b0 0x7f80c805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:28.362 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.355+0000 7f80ed8ae700 1 --2- 172.21.15.110:0/144763398 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f80c805a0b0 0x7f80c805c570 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f80d8007fd0 tx=0x7f80d8007c50).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:28.363 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.358+0000 7f80d5ffb700 1 -- 172.21.15.110:0/144763398 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f80e4047c60 con 0x7f80e80b47a0 2021-03-25T14:17:28.510 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.508+0000 7f80efb12700 1 -- 172.21.15.110:0/144763398 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f80e80b6440 con 0x7f80e80b47a0 2021-03-25T14:17:28.510 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.508+0000 7f80d5ffb700 1 -- 172.21.15.110:0/144763398 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v45) v1 ==== 101+0+10 (secure 0 0 0) 0x7f80e404b280 con 0x7f80e80b47a0 2021-03-25T14:17:28.510 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:17:28.512 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.510+0000 7f80efb12700 1 -- 172.21.15.110:0/144763398 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f80c805a0b0 msgr2=0x7f80c805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:28.512 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.510+0000 7f80efb12700 1 --2- 172.21.15.110:0/144763398 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f80c805a0b0 0x7f80c805c570 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f80d8007fd0 tx=0x7f80d8007c50).stop 2021-03-25T14:17:28.512 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.510+0000 7f80efb12700 1 -- 172.21.15.110:0/144763398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80e80b47a0 msgr2=0x7f80e80bd1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:28.512 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.510+0000 7f80efb12700 1 --2- 172.21.15.110:0/144763398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80e80b47a0 0x7f80e80bd1e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f80e400ef20 tx=0x7f80e4006e20).stop 2021-03-25T14:17:28.512 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.510+0000 7f80efb12700 1 -- 172.21.15.110:0/144763398 shutdown_connections 2021-03-25T14:17:28.512 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.510+0000 7f80efb12700 1 --2- 172.21.15.110:0/144763398 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f80c805a0b0 0x7f80c805c570 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:28.512 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.510+0000 7f80efb12700 1 --2- 172.21.15.110:0/144763398 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80e80be3a0 0x7f80e80b7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:28.512 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.510+0000 7f80efb12700 1 --2- 172.21.15.110:0/144763398 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80e80b4100 0x7f80e80b6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:28.513 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.510+0000 7f80efb12700 1 --2- 172.21.15.110:0/144763398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80e80b47a0 0x7f80e80bd1e0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:28.513 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.510+0000 7f80efb12700 1 -- 172.21.15.110:0/144763398 >> 172.21.15.110:0/144763398 conn(0x7f80e80686f0 msgr2=0x7f80e8146d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:28.513 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.510+0000 7f80efb12700 1 -- 172.21.15.110:0/144763398 shutdown_connections 2021-03-25T14:17:28.513 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.510+0000 7f80efb12700 1 -- 172.21.15.110:0/144763398 wait complete. 2021-03-25T14:17:28.523 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-03-25T14:17:28.633 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.631+0000 7f927ecc5700 1 Processor -- start 2021-03-25T14:17:28.633 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.631+0000 7f927ecc5700 1 -- start start 2021-03-25T14:17:28.641 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.632+0000 7f927ecc5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92780b1720 0x7f9278149cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:28.641 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.632+0000 7f927ecc5700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9278067510 con 0x7f92780b1340 2021-03-25T14:17:28.641 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.632+0000 7f927ecc5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92780677b0 con 0x7f927814a1e0 2021-03-25T14:17:28.641 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.632+0000 7f927ecc5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9278067a50 con 0x7f92780b1720 2021-03-25T14:17:28.641 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.632+0000 7f927ca61700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f92780b1340 0x7f9278066420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:42908/0 (socket says 172.21.15.110:42908) 2021-03-25T14:17:28.641 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.632+0000 7f927ca61700 1 -- 172.21.15.110:0/479189254 learned_addr learned my addr 172.21.15.110:0/479189254 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:28.641 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.632+0000 7f9277fff700 1 --2- 172.21.15.110:0/479189254 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92780b1720 0x7f9278149cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:28.642 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.632+0000 7f92777fe700 1 -- 172.21.15.110:0/479189254 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2280567398 0 0) 0x7f9278067510 con 0x7f92780b1340 2021-03-25T14:17:28.642 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.632+0000 7f92777fe700 1 -- 172.21.15.110:0/479189254 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f925c003270 con 0x7f92780b1340 2021-03-25T14:17:28.642 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.632+0000 7f92777fe700 1 -- 172.21.15.110:0/479189254 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 315334617 0 0) 0x7f92780677b0 con 0x7f927814a1e0 2021-03-25T14:17:28.642 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.632+0000 7f92777fe700 1 -- 172.21.15.110:0/479189254 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9278067510 con 0x7f927814a1e0 2021-03-25T14:17:28.642 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.632+0000 7f92777fe700 1 -- 172.21.15.110:0/479189254 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1319964995 0 0) 0x7f925c003270 con 0x7f92780b1340 2021-03-25T14:17:28.642 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.632+0000 7f92777fe700 1 -- 172.21.15.110:0/479189254 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92780b1720 msgr2=0x7f9278149cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:28.642 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.632+0000 7f92777fe700 1 --2- 172.21.15.110:0/479189254 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92780b1720 0x7f9278149cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:28.642 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.632+0000 7f92777fe700 1 -- 172.21.15.110:0/479189254 >> v1:172.21.15.174:6789/0 conn(0x7f927814a1e0 legacy=0x7f927814cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:28.642 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.632+0000 7f92777fe700 1 -- 172.21.15.110:0/479189254 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9278067cf0 con 0x7f92780b1340 2021-03-25T14:17:28.642 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.632+0000 7f92777fe700 1 -- 172.21.15.110:0/479189254 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f926c001520 con 0x7f92780b1340 2021-03-25T14:17:28.642 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.632+0000 7f9277fff700 1 --2- 172.21.15.110:0/479189254 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92780b1720 0x7f9278149cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:17:28.642 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.633+0000 7f92777fe700 1 -- 172.21.15.110:0/479189254 >> v1:172.21.15.110:6789/0 conn(0x7f92780b1340 legacy=0x7f9278066420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:28.643 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.633+0000 7f92777fe700 1 --2- 172.21.15.110:0/479189254 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92780b1720 0x7f925c003920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:28.643 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.633+0000 7f92777fe700 1 --2- 172.21.15.110:0/479189254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f925c003e60 0x7f925c004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:28.643 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.633+0000 7f92777fe700 1 --2- 172.21.15.110:0/479189254 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f925c004a00 0x7f925c004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:28.643 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.633+0000 7f92777fe700 1 -- 172.21.15.110:0/479189254 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9278067a50 con 0x7f925c004a00 2021-03-25T14:17:28.643 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.633+0000 7f92777fe700 1 -- 172.21.15.110:0/479189254 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925c0053d0 con 0x7f925c003e60 2021-03-25T14:17:28.643 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.633+0000 7f92777fe700 1 -- 172.21.15.110:0/479189254 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f925c00b7e0 con 0x7f92780b1720 2021-03-25T14:17:28.643 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.633+0000 7f927d262700 1 --2- 172.21.15.110:0/479189254 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f925c004a00 0x7f925c004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:28.643 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.633+0000 7f927ca61700 1 --2- 172.21.15.110:0/479189254 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92780b1720 0x7f925c003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:28.643 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.633+0000 7f9277fff700 1 --2- 172.21.15.110:0/479189254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f925c003e60 0x7f925c004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:28.643 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.633+0000 7f927d262700 1 -- 172.21.15.110:0/479189254 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92780b1720 msgr2=0x7f925c003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:28.643 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.633+0000 7f927d262700 1 --2- 172.21.15.110:0/479189254 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92780b1720 0x7f925c003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:28.643 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.633+0000 7f927d262700 1 -- 172.21.15.110:0/479189254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f925c003e60 msgr2=0x7f925c004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:28.643 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.633+0000 7f927d262700 1 --2- 172.21.15.110:0/479189254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f925c003e60 0x7f925c004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:28.644 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.633+0000 7f927d262700 1 -- 172.21.15.110:0/479189254 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f925c003270 con 0x7f925c004a00 2021-03-25T14:17:28.644 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.633+0000 7f927ca61700 1 --2- 172.21.15.110:0/479189254 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92780b1720 0x7f925c003920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:28.644 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.633+0000 7f927d262700 1 --2- 172.21.15.110:0/479189254 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f925c004a00 0x7f925c004e80 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f9270002040 tx=0x7f9270007f40).ready entity=mon.0 client_cookie=5367a2c0243ea7a6 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:28.644 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.633+0000 7f92777fe700 1 -- 172.21.15.110:0/479189254 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927000cbf0 con 0x7f925c004a00 2021-03-25T14:17:28.644 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.633+0000 7f92777fe700 1 -- 172.21.15.110:0/479189254 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f927000cd50 con 0x7f925c004a00 2021-03-25T14:17:28.644 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.633+0000 7f92777fe700 1 -- 172.21.15.110:0/479189254 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9270006ab0 con 0x7f925c004a00 2021-03-25T14:17:28.644 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.634+0000 7f927ecc5700 1 -- 172.21.15.110:0/479189254 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f925c004a00 msgr2=0x7f925c004e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:28.644 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.634+0000 7f927ecc5700 1 --2- 172.21.15.110:0/479189254 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f925c004a00 0x7f925c004e80 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f9270002040 tx=0x7f9270007f40).stop 2021-03-25T14:17:28.644 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.634+0000 7f927d262700 1 -- 172.21.15.110:0/479189254 reap_dead start 2021-03-25T14:17:28.644 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.634+0000 7f927ecc5700 1 -- 172.21.15.110:0/479189254 shutdown_connections 2021-03-25T14:17:28.644 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.634+0000 7f927ecc5700 1 -- 172.21.15.110:0/479189254 >> 172.21.15.110:0/479189254 conn(0x7f92780649a0 msgr2=0x7f927805c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:28.644 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.634+0000 7f927ecc5700 1 -- 172.21.15.110:0/479189254 shutdown_connections 2021-03-25T14:17:28.644 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.634+0000 7f927ecc5700 1 -- 172.21.15.110:0/479189254 wait complete. 2021-03-25T14:17:28.645 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.635+0000 7f927ecc5700 1 Processor -- start 2021-03-25T14:17:28.645 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.635+0000 7f927ecc5700 1 -- start start 2021-03-25T14:17:28.645 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.636+0000 7f927ecc5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f927814ab50 0x7f9278159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:28.645 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.636+0000 7f927ecc5700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9278145710 0x7f92780c01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:28.645 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.636+0000 7f927ecc5700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9278159780 0x7f92780c06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:28.645 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.636+0000 7f927ecc5700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927814b7e0 con 0x7f9278159780 2021-03-25T14:17:28.645 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.636+0000 7f927ecc5700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9278146490 con 0x7f9278145710 2021-03-25T14:17:28.645 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.636+0000 7f927ecc5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9278146730 con 0x7f927814ab50 2021-03-25T14:17:28.645 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.636+0000 7f927d262700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9278159780 0x7f92780c06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:28.645 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.636+0000 7f927d262700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9278159780 0x7f92780c06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49986/0 (socket says 172.21.15.110:49986) 2021-03-25T14:17:28.645 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.636+0000 7f927d262700 1 -- 172.21.15.110:0/2979294428 learned_addr learned my addr 172.21.15.110:0/2979294428 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:28.645 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.636+0000 7f927ca61700 1 --2- 172.21.15.110:0/2979294428 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f927814ab50 0x7f9278159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:28.646 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.636+0000 7f9277fff700 1 --2- 172.21.15.110:0/2979294428 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9278145710 0x7f92780c01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:28.646 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.636+0000 7f927d262700 1 -- 172.21.15.110:0/2979294428 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f927814ab50 msgr2=0x7f9278159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:28.646 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.636+0000 7f927d262700 1 --2- 172.21.15.110:0/2979294428 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f927814ab50 0x7f9278159290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:28.646 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.636+0000 7f927d262700 1 -- 172.21.15.110:0/2979294428 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9278145710 msgr2=0x7f92780c01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:28.646 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.636+0000 7f927d262700 1 --2- 172.21.15.110:0/2979294428 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9278145710 0x7f92780c01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:28.646 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.636+0000 7f927d262700 1 -- 172.21.15.110:0/2979294428 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92780bfa70 con 0x7f9278159780 2021-03-25T14:17:28.646 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.636+0000 7f927d262700 1 --2- 172.21.15.110:0/2979294428 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9278159780 0x7f92780c06a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f9270007fa0 tx=0x7f9270016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:28.646 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.636+0000 7f9274ff9700 1 -- 172.21.15.110:0/2979294428 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92700072c0 con 0x7f9278159780 2021-03-25T14:17:28.646 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.636+0000 7f9274ff9700 1 -- 172.21.15.110:0/2979294428 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9270007420 con 0x7f9278159780 2021-03-25T14:17:28.646 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.636+0000 7f927ecc5700 1 -- 172.21.15.110:0/2979294428 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92780bfd10 con 0x7f9278159780 2021-03-25T14:17:28.647 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.636+0000 7f9274ff9700 1 -- 172.21.15.110:0/2979294428 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92700077a0 con 0x7f9278159780 2021-03-25T14:17:28.647 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.636+0000 7f927ecc5700 1 -- 172.21.15.110:0/2979294428 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92781469d0 con 0x7f9278159780 2021-03-25T14:17:28.647 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.637+0000 7f927ecc5700 1 -- 172.21.15.110:0/2979294428 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f927805d7b0 con 0x7f9278159780 2021-03-25T14:17:28.647 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.637+0000 7f9274ff9700 1 -- 172.21.15.110:0/2979294428 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f9270025030 con 0x7f9278159780 2021-03-25T14:17:28.647 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.638+0000 7f9274ff9700 1 --2- 172.21.15.110:0/2979294428 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f925805a0b0 0x7f925805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:28.647 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.638+0000 7f9274ff9700 1 -- 172.21.15.110:0/2979294428 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f9270075280 con 0x7f9278159780 2021-03-25T14:17:28.647 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.638+0000 7f927ca61700 1 --2- 172.21.15.110:0/2979294428 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f925805a0b0 0x7f925805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:28.647 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.638+0000 7f927ca61700 1 --2- 172.21.15.110:0/2979294428 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f925805a0b0 0x7f925805c570 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f926c001430 tx=0x7f926c009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:28.648 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.641+0000 7f9274ff9700 1 -- 172.21.15.110:0/2979294428 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f9270048b10 con 0x7f9278159780 2021-03-25T14:17:28.830 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.828+0000 7f927ecc5700 1 -- 172.21.15.110:0/2979294428 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92780bc2a0 con 0x7f9278159780 2021-03-25T14:17:28.830 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.828+0000 7f9274ff9700 1 -- 172.21.15.110:0/2979294428 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+2852 (secure 0 0 0) 0x7f9270023070 con 0x7f9278159780 2021-03-25T14:17:28.830 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:28.830 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4804,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6834/4176268149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4176268149},{"type":"v1","addr":"172.21.15.174:6834","nonce":4176268149}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":12},{"gid":4807,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/1554277551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6833","nonce":1554277551},{"type":"v1","addr":"172.21.15.174:6835","nonce":1554277551}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":13},{"gid":5451,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1204817763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1204817763},{"type":"v1","addr":"172.21.15.110:6837","nonce":1204817763}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":20}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-03-25T14:17:14.349898+0000","modified":"2021-03-25T14:17:15.351276+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5025},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5025":{"gid":5025,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.110:6836/2267546898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2267546898},{"type":"v1","addr":"172.21.15.110:6836","nonce":2267546898}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs2","balancer":"","standby_count_wanted":0},"id":3}]} 2021-03-25T14:17:28.832 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.830+0000 7f927ecc5700 1 -- 172.21.15.110:0/2979294428 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f925805a0b0 msgr2=0x7f925805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:28.832 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.830+0000 7f927ecc5700 1 --2- 172.21.15.110:0/2979294428 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f925805a0b0 0x7f925805c570 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f926c001430 tx=0x7f926c009040).stop 2021-03-25T14:17:28.832 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.830+0000 7f927ecc5700 1 -- 172.21.15.110:0/2979294428 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9278159780 msgr2=0x7f92780c06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:28.832 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.830+0000 7f927ecc5700 1 --2- 172.21.15.110:0/2979294428 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9278159780 0x7f92780c06a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f9270007fa0 tx=0x7f9270016000).stop 2021-03-25T14:17:28.832 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.830+0000 7f927ecc5700 1 -- 172.21.15.110:0/2979294428 shutdown_connections 2021-03-25T14:17:28.833 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.830+0000 7f927ecc5700 1 --2- 172.21.15.110:0/2979294428 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f925805a0b0 0x7f925805c570 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:28.833 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.830+0000 7f927ecc5700 1 --2- 172.21.15.110:0/2979294428 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9278159780 0x7f92780c06a0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:28.833 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.830+0000 7f927ecc5700 1 --2- 172.21.15.110:0/2979294428 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f927814ab50 0x7f9278159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:28.833 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.830+0000 7f927ecc5700 1 --2- 172.21.15.110:0/2979294428 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9278145710 0x7f92780c01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:28.833 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.830+0000 7f927ecc5700 1 -- 172.21.15.110:0/2979294428 >> 172.21.15.110:0/2979294428 conn(0x7f92780649a0 msgr2=0x7f9278142ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:28.833 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.830+0000 7f927ecc5700 1 -- 172.21.15.110:0/2979294428 shutdown_connections 2021-03-25T14:17:28.833 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.830+0000 7f927ecc5700 1 -- 172.21.15.110:0/2979294428 wait complete. 2021-03-25T14:17:28.833 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 20 2021-03-25T14:17:28.843 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:17:28.953 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.951+0000 7fb03b310700 1 Processor -- start 2021-03-25T14:17:28.954 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.952+0000 7fb03b310700 1 -- start start 2021-03-25T14:17:28.957 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.952+0000 7fb03b310700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb0340bbca0 0x7fb034067840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:28.957 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.952+0000 7fb03b310700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb034068ac0 0x7fb0340acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:28.957 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.952+0000 7fb03b310700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0340afee0 con 0x7fb0340ad420 2021-03-25T14:17:28.957 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.952+0000 7fb03b310700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0340ad8b0 con 0x7fb034068ac0 2021-03-25T14:17:28.957 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.952+0000 7fb03b310700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb034145d40 con 0x7fb0340bbca0 2021-03-25T14:17:28.957 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.953+0000 7fb0390ac700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb0340bbca0 0x7fb034067840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:28.957 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.953+0000 7fb0398ad700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fb0340ad420 0x7fb034148fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.110:50598/0 (socket says 172.21.15.110:50598) 2021-03-25T14:17:28.958 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.953+0000 7fb0398ad700 1 -- 172.21.15.110:0/4221266131 learned_addr learned my addr 172.21.15.110:0/4221266131 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:28.958 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.953+0000 7fb0388ab700 1 --2- 172.21.15.110:0/4221266131 >> v2:172.21.15.174:3300/0 conn(0x7fb034068ac0 0x7fb0340acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:28.958 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.953+0000 7fb023fff700 1 -- 172.21.15.110:0/4221266131 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3086084362 0 0) 0x7fb0340afee0 con 0x7fb0340ad420 2021-03-25T14:17:28.958 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.953+0000 7fb023fff700 1 -- 172.21.15.110:0/4221266131 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb01c003270 con 0x7fb0340ad420 2021-03-25T14:17:28.958 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.953+0000 7fb0388ab700 1 -- 172.21.15.110:0/4221266131 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb0340bbca0 msgr2=0x7fb034067840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:28.958 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.953+0000 7fb0388ab700 1 --2- 172.21.15.110:0/4221266131 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb0340bbca0 0x7fb034067840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:28.958 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.953+0000 7fb0388ab700 1 -- 172.21.15.110:0/4221266131 >> v1:172.21.15.174:6789/0 conn(0x7fb0340ad420 legacy=0x7fb034148fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:28.958 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.953+0000 7fb0388ab700 1 -- 172.21.15.110:0/4221266131 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb034145b10 con 0x7fb034068ac0 2021-03-25T14:17:28.959 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.953+0000 7fb0390ac700 1 --2- 172.21.15.110:0/4221266131 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb0340bbca0 0x7fb034067840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:17:28.959 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.953+0000 7fb0388ab700 1 --2- 172.21.15.110:0/4221266131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb034068ac0 0x7fb0340acf30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fb02400aa50 tx=0x7fb024007f30).ready entity=mon.1 client_cookie=c0e3390d87e3bcbf server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:28.959 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.953+0000 7fb023fff700 1 -- 172.21.15.110:0/4221266131 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02400ae90 con 0x7fb034068ac0 2021-03-25T14:17:28.959 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.953+0000 7fb023fff700 1 -- 172.21.15.110:0/4221266131 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02400c8f0 con 0x7fb034068ac0 2021-03-25T14:17:28.959 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.953+0000 7fb023fff700 1 -- 172.21.15.110:0/4221266131 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02400cc70 con 0x7fb034068ac0 2021-03-25T14:17:28.959 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.954+0000 7fb03b310700 1 -- 172.21.15.110:0/4221266131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb034068ac0 msgr2=0x7fb0340acf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:28.959 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.954+0000 7fb03b310700 1 --2- 172.21.15.110:0/4221266131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb034068ac0 0x7fb0340acf30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fb02400aa50 tx=0x7fb024007f30).stop 2021-03-25T14:17:28.959 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.954+0000 7fb03b310700 1 -- 172.21.15.110:0/4221266131 shutdown_connections 2021-03-25T14:17:28.959 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.954+0000 7fb03b310700 1 --2- 172.21.15.110:0/4221266131 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb0340bbca0 0x7fb034067840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:28.959 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.954+0000 7fb03b310700 1 --2- 172.21.15.110:0/4221266131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb034068ac0 0x7fb0340acf30 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:28.959 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.954+0000 7fb03b310700 1 -- 172.21.15.110:0/4221266131 >> 172.21.15.110:0/4221266131 conn(0x7fb034063850 msgr2=0x7fb03405c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:28.959 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.954+0000 7fb03b310700 1 -- 172.21.15.110:0/4221266131 shutdown_connections 2021-03-25T14:17:28.960 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.954+0000 7fb03b310700 1 -- 172.21.15.110:0/4221266131 wait complete. 2021-03-25T14:17:28.960 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.955+0000 7fb03b310700 1 Processor -- start 2021-03-25T14:17:28.960 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.955+0000 7fb03b310700 1 -- start start 2021-03-25T14:17:28.963 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.956+0000 7fb03b310700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb034068ac0 0x7fb0340b9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:28.963 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.956+0000 7fb03b310700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb0340ad420 0x7fb0341422e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:28.963 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.956+0000 7fb03b310700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb0340bbca0 0x7fb0341427d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:28.963 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.956+0000 7fb03b310700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0340b4680 con 0x7fb034068ac0 2021-03-25T14:17:28.963 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.956+0000 7fb03b310700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0340b48e0 con 0x7fb0340ad420 2021-03-25T14:17:28.963 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.956+0000 7fb03b310700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0340b4b80 con 0x7fb0340bbca0 2021-03-25T14:17:28.963 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.956+0000 7fb0390ac700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb034068ac0 0x7fb0340b9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:28.963 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.956+0000 7fb0390ac700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb034068ac0 0x7fb0340b9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50000/0 (socket says 172.21.15.110:50000) 2021-03-25T14:17:28.963 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.956+0000 7fb0390ac700 1 -- 172.21.15.110:0/2067629589 learned_addr learned my addr 172.21.15.110:0/2067629589 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:28.963 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.956+0000 7fb0398ad700 1 --2- 172.21.15.110:0/2067629589 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb0340bbca0 0x7fb0341427d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:28.964 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.956+0000 7fb0388ab700 1 --2- 172.21.15.110:0/2067629589 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb0340ad420 0x7fb0341422e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:28.964 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.956+0000 7fb0390ac700 1 -- 172.21.15.110:0/2067629589 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb0340bbca0 msgr2=0x7fb0341427d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:28.964 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.956+0000 7fb0390ac700 1 --2- 172.21.15.110:0/2067629589 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb0340bbca0 0x7fb0341427d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:28.964 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.956+0000 7fb0390ac700 1 -- 172.21.15.110:0/2067629589 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb0340ad420 msgr2=0x7fb0341422e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:28.964 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.956+0000 7fb0390ac700 1 --2- 172.21.15.110:0/2067629589 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb0340ad420 0x7fb0341422e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:28.964 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.956+0000 7fb0390ac700 1 -- 172.21.15.110:0/2067629589 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0340b4e20 con 0x7fb034068ac0 2021-03-25T14:17:28.964 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.956+0000 7fb0398ad700 1 --2- 172.21.15.110:0/2067629589 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb0340bbca0 0x7fb0341427d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:17:28.964 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.956+0000 7fb0390ac700 1 --2- 172.21.15.110:0/2067629589 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb034068ac0 0x7fb0340b9b60 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7fb03000ed10 tx=0x7fb030006e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:28.964 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.956+0000 7fb0217fa700 1 -- 172.21.15.110:0/2067629589 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03000cbe0 con 0x7fb034068ac0 2021-03-25T14:17:28.964 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.956+0000 7fb0217fa700 1 -- 172.21.15.110:0/2067629589 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03000cd40 con 0x7fb034068ac0 2021-03-25T14:17:28.964 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.956+0000 7fb03b310700 1 -- 172.21.15.110:0/2067629589 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb034142cc0 con 0x7fb034068ac0 2021-03-25T14:17:28.964 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.956+0000 7fb0217fa700 1 -- 172.21.15.110:0/2067629589 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb030012600 con 0x7fb034068ac0 2021-03-25T14:17:28.964 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.956+0000 7fb03b310700 1 -- 172.21.15.110:0/2067629589 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0340ba050 con 0x7fb034068ac0 2021-03-25T14:17:28.965 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.957+0000 7fb03b310700 1 -- 172.21.15.110:0/2067629589 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb03405d7b0 con 0x7fb034068ac0 2021-03-25T14:17:28.965 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.958+0000 7fb0217fa700 1 -- 172.21.15.110:0/2067629589 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fb030012970 con 0x7fb034068ac0 2021-03-25T14:17:28.965 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.958+0000 7fb0217fa700 1 --2- 172.21.15.110:0/2067629589 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb01405a0b0 0x7fb01405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:28.965 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.958+0000 7fb0217fa700 1 -- 172.21.15.110:0/2067629589 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6516+0+0 (secure 0 0 0) 0x7fb0300745b0 con 0x7fb034068ac0 2021-03-25T14:17:28.965 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.958+0000 7fb0388ab700 1 --2- 172.21.15.110:0/2067629589 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb01405a0b0 0x7fb01405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:28.965 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.958+0000 7fb0388ab700 1 --2- 172.21.15.110:0/2067629589 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb01405a0b0 0x7fb01405c570 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fb02400aa50 tx=0x7fb024018000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:28.965 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:28.962+0000 7fb0217fa700 1 -- 172.21.15.110:0/2067629589 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fb030047d90 con 0x7fb034068ac0 2021-03-25T14:17:29.115 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.113+0000 7fb03b310700 1 -- 172.21.15.110:0/2067629589 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0340b4fb0 con 0x7fb034068ac0 2021-03-25T14:17:29.116 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.114+0000 7fb0217fa700 1 -- 172.21.15.110:0/2067629589 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+17242 (secure 0 0 0) 0x7fb03004b3b0 con 0x7fb034068ac0 2021-03-25T14:17:29.116 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:29.117 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":45,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:17:27.068212+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs2_metadata","create_time":"2021-03-25T14:17:12.037785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}}},{"pool":9,"pool_name":"cephfs2_data","create_time":"2021-03-25T14:17:13.333853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs2"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:6837/503424314":"2021-03-26T14:17:23.508494+0000","172.21.15.110:6835/503424314":"2021-03-26T14:17:23.508494+0000"},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:17:29.118 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.116+0000 7fb03b310700 1 -- 172.21.15.110:0/2067629589 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb01405a0b0 msgr2=0x7fb01405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:29.118 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.116+0000 7fb03b310700 1 --2- 172.21.15.110:0/2067629589 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb01405a0b0 0x7fb01405c570 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fb02400aa50 tx=0x7fb024018000).stop 2021-03-25T14:17:29.118 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.116+0000 7fb03b310700 1 -- 172.21.15.110:0/2067629589 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb034068ac0 msgr2=0x7fb0340b9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:29.118 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.116+0000 7fb03b310700 1 --2- 172.21.15.110:0/2067629589 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb034068ac0 0x7fb0340b9b60 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7fb03000ed10 tx=0x7fb030006e20).stop 2021-03-25T14:17:29.118 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.116+0000 7fb03b310700 1 -- 172.21.15.110:0/2067629589 shutdown_connections 2021-03-25T14:17:29.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.116+0000 7fb03b310700 1 --2- 172.21.15.110:0/2067629589 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb01405a0b0 0x7fb01405c570 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:29.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.116+0000 7fb03b310700 1 --2- 172.21.15.110:0/2067629589 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb0340bbca0 0x7fb0341427d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:29.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.116+0000 7fb03b310700 1 --2- 172.21.15.110:0/2067629589 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb034068ac0 0x7fb0340b9b60 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:29.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.116+0000 7fb03b310700 1 --2- 172.21.15.110:0/2067629589 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb0340ad420 0x7fb0341422e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:29.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.116+0000 7fb03b310700 1 -- 172.21.15.110:0/2067629589 >> 172.21.15.110:0/2067629589 conn(0x7fb034063850 msgr2=0x7fb034144110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:29.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.116+0000 7fb03b310700 1 -- 172.21.15.110:0/2067629589 shutdown_connections 2021-03-25T14:17:29.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.116+0000 7fb03b310700 1 -- 172.21.15.110:0/2067629589 wait complete. 2021-03-25T14:17:29.130 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2021-03-25T14:17:29.130 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-03-25T14:17:29.239 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.237+0000 7f763541c700 1 Processor -- start 2021-03-25T14:17:29.240 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.237+0000 7f763541c700 1 -- start start 2021-03-25T14:17:29.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.238+0000 7f763541c700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f76300bbca0 0x7f7630067840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:29.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.238+0000 7f763541c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7630068ac0 0x7f76300acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:29.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.238+0000 7f763541c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f76300ad420 0x7f7630148fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:29.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.238+0000 7f763541c700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76300ad890 con 0x7f76300bbca0 2021-03-25T14:17:29.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.238+0000 7f763541c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76300afee0 con 0x7f76300ad420 2021-03-25T14:17:29.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.238+0000 7f763541c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7630145b10 con 0x7f7630068ac0 2021-03-25T14:17:29.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.238+0000 7f762effd700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f76300bbca0 0x7f7630067840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:29.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.238+0000 7f762effd700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f76300bbca0 0x7f7630067840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50006/0 (socket says 172.21.15.110:50006) 2021-03-25T14:17:29.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.238+0000 7f762effd700 1 -- 172.21.15.110:0/1543303060 learned_addr learned my addr 172.21.15.110:0/1543303060 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:29.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.239+0000 7f762e7fc700 1 --2- 172.21.15.110:0/1543303060 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7630068ac0 0x7f76300acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:29.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.239+0000 7f762f7fe700 1 --2- 172.21.15.110:0/1543303060 >> v2:172.21.15.174:3300/0 conn(0x7f76300ad420 0x7f7630148fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:29.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.239+0000 7f762effd700 1 -- 172.21.15.110:0/1543303060 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7630068ac0 msgr2=0x7f76300acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:29.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.239+0000 7f762effd700 1 --2- 172.21.15.110:0/1543303060 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7630068ac0 0x7f76300acf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:29.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.239+0000 7f762effd700 1 -- 172.21.15.110:0/1543303060 >> v2:172.21.15.174:3300/0 conn(0x7f76300ad420 msgr2=0x7f7630148fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:29.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.239+0000 7f762effd700 1 --2- 172.21.15.110:0/1543303060 >> v2:172.21.15.174:3300/0 conn(0x7f76300ad420 0x7f7630148fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:29.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.239+0000 7f762effd700 1 -- 172.21.15.110:0/1543303060 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7630145d40 con 0x7f76300bbca0 2021-03-25T14:17:29.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.239+0000 7f762effd700 1 --2- 172.21.15.110:0/1543303060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76300bbca0 0x7f7630067840 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f76300bcba0 tx=0x7f7620006ee0).ready entity=mon.0 client_cookie=e97ce05064e5ca68 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:29.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.239+0000 7f762dffb700 1 -- 172.21.15.110:0/1543303060 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762000be60 con 0x7f76300bbca0 2021-03-25T14:17:29.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.239+0000 7f762dffb700 1 -- 172.21.15.110:0/1543303060 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7620009890 con 0x7f76300bbca0 2021-03-25T14:17:29.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.239+0000 7f762dffb700 1 -- 172.21.15.110:0/1543303060 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7620009c10 con 0x7f76300bbca0 2021-03-25T14:17:29.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.239+0000 7f763541c700 1 -- 172.21.15.110:0/1543303060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76300bbca0 msgr2=0x7f7630067840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:29.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.239+0000 7f763541c700 1 --2- 172.21.15.110:0/1543303060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76300bbca0 0x7f7630067840 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f76300bcba0 tx=0x7f7620006ee0).stop 2021-03-25T14:17:29.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.240+0000 7f763541c700 1 -- 172.21.15.110:0/1543303060 shutdown_connections 2021-03-25T14:17:29.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.240+0000 7f763541c700 1 --2- 172.21.15.110:0/1543303060 >> v2:172.21.15.174:3300/0 conn(0x7f76300ad420 0x7f7630148fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:29.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.240+0000 7f763541c700 1 --2- 172.21.15.110:0/1543303060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76300bbca0 0x7f7630067840 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:29.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.240+0000 7f763541c700 1 --2- 172.21.15.110:0/1543303060 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7630068ac0 0x7f76300acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:29.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.240+0000 7f763541c700 1 -- 172.21.15.110:0/1543303060 >> 172.21.15.110:0/1543303060 conn(0x7f7630063850 msgr2=0x7f763005c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:29.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.240+0000 7f763541c700 1 -- 172.21.15.110:0/1543303060 shutdown_connections 2021-03-25T14:17:29.245 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.240+0000 7f763541c700 1 -- 172.21.15.110:0/1543303060 wait complete. 2021-03-25T14:17:29.245 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.241+0000 7f763541c700 1 Processor -- start 2021-03-25T14:17:29.245 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.241+0000 7f763541c700 1 -- start start 2021-03-25T14:17:29.247 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.241+0000 7f763541c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7630068ac0 0x7f763015c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:29.248 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.241+0000 7f763541c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f76300ad420 0x7f76300b1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:29.248 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.241+0000 7f763541c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76300bbca0 0x7f76301372c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:29.248 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.241+0000 7f763541c700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7630141380 con 0x7f76300bbca0 2021-03-25T14:17:29.248 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.241+0000 7f763541c700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7630142f80 con 0x7f76300ad420 2021-03-25T14:17:29.248 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.241+0000 7f763541c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76301431e0 con 0x7f7630068ac0 2021-03-25T14:17:29.248 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.242+0000 7f762f7fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76300bbca0 0x7f76301372c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:29.248 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.242+0000 7f762f7fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76300bbca0 0x7f76301372c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50014/0 (socket says 172.21.15.110:50014) 2021-03-25T14:17:29.248 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.242+0000 7f762f7fe700 1 -- 172.21.15.110:0/78547604 learned_addr learned my addr 172.21.15.110:0/78547604 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:29.248 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.242+0000 7f762effd700 1 --2- 172.21.15.110:0/78547604 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7630068ac0 0x7f763015c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:29.248 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.242+0000 7f762e7fc700 1 --2- 172.21.15.110:0/78547604 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f76300ad420 0x7f76300b1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:29.248 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.242+0000 7f762f7fe700 1 -- 172.21.15.110:0/78547604 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7630068ac0 msgr2=0x7f763015c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:29.248 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.242+0000 7f762f7fe700 1 --2- 172.21.15.110:0/78547604 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7630068ac0 0x7f763015c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:29.249 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.242+0000 7f762f7fe700 1 -- 172.21.15.110:0/78547604 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f76300ad420 msgr2=0x7f76300b1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:29.249 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.242+0000 7f762f7fe700 1 --2- 172.21.15.110:0/78547604 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f76300ad420 0x7f76300b1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:29.249 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.242+0000 7f762f7fe700 1 -- 172.21.15.110:0/78547604 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7630143480 con 0x7f76300bbca0 2021-03-25T14:17:29.249 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.242+0000 7f762f7fe700 1 --2- 172.21.15.110:0/78547604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76300bbca0 0x7f76301372c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f762800ef50 tx=0x7f7628009220).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:29.249 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.242+0000 7f7616ffd700 1 -- 172.21.15.110:0/78547604 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762800cc30 con 0x7f76300bbca0 2021-03-25T14:17:29.249 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.242+0000 7f7616ffd700 1 -- 172.21.15.110:0/78547604 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762800cd90 con 0x7f76300bbca0 2021-03-25T14:17:29.249 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.242+0000 7f763541c700 1 -- 172.21.15.110:0/78547604 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7630141ef0 con 0x7f76300bbca0 2021-03-25T14:17:29.249 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.242+0000 7f7616ffd700 1 -- 172.21.15.110:0/78547604 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7628012620 con 0x7f76300bbca0 2021-03-25T14:17:29.249 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.242+0000 7f763541c700 1 -- 172.21.15.110:0/78547604 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f763015cd50 con 0x7f76300bbca0 2021-03-25T14:17:29.249 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.243+0000 7f763541c700 1 -- 172.21.15.110:0/78547604 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7630142350 con 0x7f76300bbca0 2021-03-25T14:17:29.249 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.243+0000 7f7616ffd700 1 -- 172.21.15.110:0/78547604 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f7628022070 con 0x7f76300bbca0 2021-03-25T14:17:29.249 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.244+0000 7f7616ffd700 1 --2- 172.21.15.110:0/78547604 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f761005a0b0 0x7f761005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:29.249 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.244+0000 7f7616ffd700 1 -- 172.21.15.110:0/78547604 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f76280747a0 con 0x7f76300bbca0 2021-03-25T14:17:29.250 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.244+0000 7f762effd700 1 --2- 172.21.15.110:0/78547604 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f761005a0b0 0x7f761005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:29.250 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.244+0000 7f762effd700 1 --2- 172.21.15.110:0/78547604 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f761005a0b0 0x7f761005c570 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f7620006f20 tx=0x7f7620016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:29.250 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.247+0000 7f7616ffd700 1 -- 172.21.15.110:0/78547604 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f7628047f80 con 0x7f76300bbca0 2021-03-25T14:17:29.434 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.432+0000 7f763541c700 1 -- 172.21.15.110:0/78547604 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7630142550 con 0x7f76300bbca0 2021-03-25T14:17:29.434 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.433+0000 7f7616ffd700 1 -- 172.21.15.110:0/78547604 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+2852 (secure 0 0 0) 0x7f7628016070 con 0x7f76300bbca0 2021-03-25T14:17:29.435 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:29.435 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4804,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6834/4176268149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4176268149},{"type":"v1","addr":"172.21.15.174:6834","nonce":4176268149}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":12},{"gid":4807,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/1554277551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6833","nonce":1554277551},{"type":"v1","addr":"172.21.15.174:6835","nonce":1554277551}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":13},{"gid":5451,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1204817763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1204817763},{"type":"v1","addr":"172.21.15.110:6837","nonce":1204817763}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":20}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-03-25T14:17:14.349898+0000","modified":"2021-03-25T14:17:15.351276+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5025},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5025":{"gid":5025,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.110:6836/2267546898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2267546898},{"type":"v1","addr":"172.21.15.110:6836","nonce":2267546898}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs2","balancer":"","standby_count_wanted":0},"id":3}]} 2021-03-25T14:17:29.436 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.434+0000 7f763541c700 1 -- 172.21.15.110:0/78547604 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f761005a0b0 msgr2=0x7f761005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:29.436 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.434+0000 7f763541c700 1 --2- 172.21.15.110:0/78547604 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f761005a0b0 0x7f761005c570 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f7620006f20 tx=0x7f7620016000).stop 2021-03-25T14:17:29.436 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.434+0000 7f763541c700 1 -- 172.21.15.110:0/78547604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76300bbca0 msgr2=0x7f76301372c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:29.437 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.434+0000 7f763541c700 1 --2- 172.21.15.110:0/78547604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76300bbca0 0x7f76301372c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f762800ef50 tx=0x7f7628009220).stop 2021-03-25T14:17:29.437 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.434+0000 7f763541c700 1 -- 172.21.15.110:0/78547604 shutdown_connections 2021-03-25T14:17:29.437 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.434+0000 7f763541c700 1 --2- 172.21.15.110:0/78547604 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f761005a0b0 0x7f761005c570 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:29.437 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.434+0000 7f763541c700 1 --2- 172.21.15.110:0/78547604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76300bbca0 0x7f76301372c0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:29.437 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.434+0000 7f763541c700 1 --2- 172.21.15.110:0/78547604 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7630068ac0 0x7f763015c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:29.437 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.434+0000 7f763541c700 1 --2- 172.21.15.110:0/78547604 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f76300ad420 0x7f76300b1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:29.437 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.434+0000 7f763541c700 1 -- 172.21.15.110:0/78547604 >> 172.21.15.110:0/78547604 conn(0x7f7630063850 msgr2=0x7f7630145110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:29.437 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.434+0000 7f763541c700 1 -- 172.21.15.110:0/78547604 shutdown_connections 2021-03-25T14:17:29.437 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.434+0000 7f763541c700 1 -- 172.21.15.110:0/78547604 wait complete. 2021-03-25T14:17:29.438 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 20 2021-03-25T14:17:29.448 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-03-25T14:17:29.558 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.557+0000 7fea8d893700 1 Processor -- start 2021-03-25T14:17:29.559 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.557+0000 7fea8d893700 1 -- start start 2021-03-25T14:17:29.565 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.557+0000 7fea8d893700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fea880bbca0 0x7fea88067840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:29.566 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.557+0000 7fea8d893700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fea88068ac0 0x7fea880acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:29.566 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.557+0000 7fea8d893700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea880afee0 con 0x7fea880ad420 2021-03-25T14:17:29.566 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.557+0000 7fea8d893700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea880ad8b0 con 0x7fea88068ac0 2021-03-25T14:17:29.566 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.557+0000 7fea8d893700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea88145d40 con 0x7fea880bbca0 2021-03-25T14:17:29.566 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.558+0000 7fea86ffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fea880bbca0 0x7fea88067840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:29.566 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.558+0000 7fea867fc700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fea88068ac0 0x7fea880acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:29.567 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.558+0000 7fea877fe700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fea880ad420 0x7fea88148fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.110:50622/0 (socket says 172.21.15.110:50622) 2021-03-25T14:17:29.567 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.558+0000 7fea877fe700 1 -- 172.21.15.110:0/586540385 learned_addr learned my addr 172.21.15.110:0/586540385 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:29.567 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.558+0000 7fea85ffb700 1 -- 172.21.15.110:0/586540385 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1399459732 0 0) 0x7fea880afee0 con 0x7fea880ad420 2021-03-25T14:17:29.567 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.558+0000 7fea85ffb700 1 -- 172.21.15.110:0/586540385 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea74003270 con 0x7fea880ad420 2021-03-25T14:17:29.567 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.558+0000 7fea86ffd700 1 -- 172.21.15.110:0/586540385 >> v2:172.21.15.174:3300/0 conn(0x7fea88068ac0 msgr2=0x7fea880acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:29.567 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.558+0000 7fea86ffd700 1 --2- 172.21.15.110:0/586540385 >> v2:172.21.15.174:3300/0 conn(0x7fea88068ac0 0x7fea880acf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:29.567 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.558+0000 7fea86ffd700 1 -- 172.21.15.110:0/586540385 >> v1:172.21.15.174:6789/0 conn(0x7fea880ad420 legacy=0x7fea88148fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:29.568 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.558+0000 7fea86ffd700 1 -- 172.21.15.110:0/586540385 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea88145b10 con 0x7fea880bbca0 2021-03-25T14:17:29.568 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.558+0000 7fea86ffd700 1 --2- 172.21.15.110:0/586540385 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fea880bbca0 0x7fea88067840 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fea7800b9c0 tx=0x7fea78006e20).ready entity=mon.2 client_cookie=e8b1337a709451bb server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:29.568 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.558+0000 7fea85ffb700 1 -- 172.21.15.110:0/586540385 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea78009690 con 0x7fea880bbca0 2021-03-25T14:17:29.568 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.558+0000 7fea85ffb700 1 -- 172.21.15.110:0/586540385 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea780097f0 con 0x7fea880bbca0 2021-03-25T14:17:29.568 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.558+0000 7fea85ffb700 1 -- 172.21.15.110:0/586540385 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea78009b70 con 0x7fea880bbca0 2021-03-25T14:17:29.568 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.559+0000 7fea8d893700 1 -- 172.21.15.110:0/586540385 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fea880bbca0 msgr2=0x7fea88067840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:29.568 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.559+0000 7fea8d893700 1 --2- 172.21.15.110:0/586540385 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fea880bbca0 0x7fea88067840 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fea7800b9c0 tx=0x7fea78006e20).stop 2021-03-25T14:17:29.568 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.559+0000 7fea8d893700 1 -- 172.21.15.110:0/586540385 shutdown_connections 2021-03-25T14:17:29.568 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.559+0000 7fea8d893700 1 --2- 172.21.15.110:0/586540385 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fea880bbca0 0x7fea88067840 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:29.568 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.559+0000 7fea8d893700 1 --2- 172.21.15.110:0/586540385 >> v2:172.21.15.174:3300/0 conn(0x7fea88068ac0 0x7fea880acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:29.568 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.559+0000 7fea8d893700 1 -- 172.21.15.110:0/586540385 >> 172.21.15.110:0/586540385 conn(0x7fea88063850 msgr2=0x7fea8805c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:29.568 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.559+0000 7fea8d893700 1 -- 172.21.15.110:0/586540385 shutdown_connections 2021-03-25T14:17:29.569 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.559+0000 7fea8d893700 1 -- 172.21.15.110:0/586540385 wait complete. 2021-03-25T14:17:29.569 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.560+0000 7fea8d893700 1 Processor -- start 2021-03-25T14:17:29.569 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.560+0000 7fea8d893700 1 -- start start 2021-03-25T14:17:29.569 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.561+0000 7fea8d893700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fea88068ac0 0x7fea880b9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:29.569 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.561+0000 7fea8d893700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea880ad420 0x7fea8814b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:29.569 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.561+0000 7fea8d893700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea880bbca0 0x7fea88137350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:29.569 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.561+0000 7fea8d893700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea8815cef0 con 0x7fea880bbca0 2021-03-25T14:17:29.569 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.561+0000 7fea8d893700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea8815bfd0 con 0x7fea880ad420 2021-03-25T14:17:29.569 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.561+0000 7fea8d893700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea8815c270 con 0x7fea88068ac0 2021-03-25T14:17:29.569 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.561+0000 7fea877fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea880bbca0 0x7fea88137350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:29.569 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.561+0000 7fea877fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea880bbca0 0x7fea88137350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50030/0 (socket says 172.21.15.110:50030) 2021-03-25T14:17:29.569 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.561+0000 7fea877fe700 1 -- 172.21.15.110:0/791292837 learned_addr learned my addr 172.21.15.110:0/791292837 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:29.570 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.561+0000 7fea867fc700 1 --2- 172.21.15.110:0/791292837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea880ad420 0x7fea8814b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:29.570 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.561+0000 7fea86ffd700 1 --2- 172.21.15.110:0/791292837 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fea88068ac0 0x7fea880b9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:29.570 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.561+0000 7fea877fe700 1 -- 172.21.15.110:0/791292837 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fea88068ac0 msgr2=0x7fea880b9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:29.570 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.561+0000 7fea877fe700 1 --2- 172.21.15.110:0/791292837 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fea88068ac0 0x7fea880b9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:29.570 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.561+0000 7fea877fe700 1 -- 172.21.15.110:0/791292837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea880ad420 msgr2=0x7fea8814b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:29.570 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.561+0000 7fea877fe700 1 --2- 172.21.15.110:0/791292837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea880ad420 0x7fea8814b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:29.570 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.561+0000 7fea877fe700 1 -- 172.21.15.110:0/791292837 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea8815c510 con 0x7fea880bbca0 2021-03-25T14:17:29.570 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.561+0000 7fea877fe700 1 --2- 172.21.15.110:0/791292837 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea880bbca0 0x7fea88137350 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7fea80005950 tx=0x7fea80007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:29.570 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.561+0000 7fea6effd700 1 -- 172.21.15.110:0/791292837 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea80005bb0 con 0x7fea880bbca0 2021-03-25T14:17:29.571 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.562+0000 7fea6effd700 1 -- 172.21.15.110:0/791292837 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea80005d10 con 0x7fea880bbca0 2021-03-25T14:17:29.571 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.562+0000 7fea8d893700 1 -- 172.21.15.110:0/791292837 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea8815c7b0 con 0x7fea880bbca0 2021-03-25T14:17:29.571 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.562+0000 7fea6effd700 1 -- 172.21.15.110:0/791292837 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea80007320 con 0x7fea880bbca0 2021-03-25T14:17:29.571 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.562+0000 7fea8d893700 1 -- 172.21.15.110:0/791292837 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea880ba2a0 con 0x7fea880bbca0 2021-03-25T14:17:29.571 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.563+0000 7fea8d893700 1 -- 172.21.15.110:0/791292837 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea8815cc10 con 0x7fea880bbca0 2021-03-25T14:17:29.571 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.563+0000 7fea6effd700 1 -- 172.21.15.110:0/791292837 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fea80010030 con 0x7fea880bbca0 2021-03-25T14:17:29.571 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.563+0000 7fea6effd700 1 --2- 172.21.15.110:0/791292837 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fea6805a0b0 0x7fea6805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:29.571 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.563+0000 7fea6effd700 1 -- 172.21.15.110:0/791292837 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6516+0+0 (secure 0 0 0) 0x7fea80073da0 con 0x7fea880bbca0 2021-03-25T14:17:29.571 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.563+0000 7fea86ffd700 1 --2- 172.21.15.110:0/791292837 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fea6805a0b0 0x7fea6805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:29.571 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.563+0000 7fea86ffd700 1 --2- 172.21.15.110:0/791292837 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fea6805a0b0 0x7fea6805c570 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fea78007fd0 tx=0x7fea78016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:29.572 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.567+0000 7fea6effd700 1 -- 172.21.15.110:0/791292837 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fea80047580 con 0x7fea880bbca0 2021-03-25T14:17:29.753 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.751+0000 7fea8d893700 1 -- 172.21.15.110:0/791292837 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea8805d7b0 con 0x7fea880bbca0 2021-03-25T14:17:29.753 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.751+0000 7fea6effd700 1 -- 172.21.15.110:0/791292837 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+2852 (secure 0 0 0) 0x7fea8004aba0 con 0x7fea880bbca0 2021-03-25T14:17:29.754 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:29.754 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4804,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6834/4176268149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4176268149},{"type":"v1","addr":"172.21.15.174:6834","nonce":4176268149}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":12},{"gid":4807,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/1554277551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6833","nonce":1554277551},{"type":"v1","addr":"172.21.15.174:6835","nonce":1554277551}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":13},{"gid":5451,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1204817763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1204817763},{"type":"v1","addr":"172.21.15.110:6837","nonce":1204817763}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":20}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-03-25T14:17:14.349898+0000","modified":"2021-03-25T14:17:15.351276+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5025},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5025":{"gid":5025,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.110:6836/2267546898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2267546898},{"type":"v1","addr":"172.21.15.110:6836","nonce":2267546898}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs2","balancer":"","standby_count_wanted":0},"id":3}]} 2021-03-25T14:17:29.755 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.753+0000 7fea8d893700 1 -- 172.21.15.110:0/791292837 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fea6805a0b0 msgr2=0x7fea6805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:29.755 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.753+0000 7fea8d893700 1 --2- 172.21.15.110:0/791292837 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fea6805a0b0 0x7fea6805c570 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fea78007fd0 tx=0x7fea78016000).stop 2021-03-25T14:17:29.756 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.753+0000 7fea8d893700 1 -- 172.21.15.110:0/791292837 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea880bbca0 msgr2=0x7fea88137350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:29.756 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.753+0000 7fea8d893700 1 --2- 172.21.15.110:0/791292837 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea880bbca0 0x7fea88137350 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7fea80005950 tx=0x7fea80007e50).stop 2021-03-25T14:17:29.756 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.753+0000 7fea8d893700 1 -- 172.21.15.110:0/791292837 shutdown_connections 2021-03-25T14:17:29.756 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.753+0000 7fea8d893700 1 --2- 172.21.15.110:0/791292837 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fea6805a0b0 0x7fea6805c570 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:29.756 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.753+0000 7fea8d893700 1 --2- 172.21.15.110:0/791292837 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea880bbca0 0x7fea88137350 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:29.756 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.753+0000 7fea8d893700 1 --2- 172.21.15.110:0/791292837 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fea88068ac0 0x7fea880b9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:29.756 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.753+0000 7fea8d893700 1 --2- 172.21.15.110:0/791292837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea880ad420 0x7fea8814b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:29.756 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.753+0000 7fea8d893700 1 -- 172.21.15.110:0/791292837 >> 172.21.15.110:0/791292837 conn(0x7fea88063850 msgr2=0x7fea88146de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:29.756 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.753+0000 7fea8d893700 1 -- 172.21.15.110:0/791292837 shutdown_connections 2021-03-25T14:17:29.756 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.753+0000 7fea8d893700 1 -- 172.21.15.110:0/791292837 wait complete. 2021-03-25T14:17:29.756 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 20 2021-03-25T14:17:29.766 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:17:29.875 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.874+0000 7f1370c81700 1 Processor -- start 2021-03-25T14:17:29.876 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.874+0000 7f1370c81700 1 -- start start 2021-03-25T14:17:29.883 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.874+0000 7f1370c81700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f136c0bcd90 0x7f136c14d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:29.883 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.875+0000 7f1370c81700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136c0b9140 con 0x7f136c0b7620 2021-03-25T14:17:29.883 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.875+0000 7f1370c81700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136c0b93e0 con 0x7f136c0b1340 2021-03-25T14:17:29.883 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.875+0000 7f1370c81700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136c0692a0 con 0x7f136c0bcd90 2021-03-25T14:17:29.883 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.875+0000 7f136ad9d700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f136c0b7620 0x7f136c148ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:42970/0 (socket says 172.21.15.110:42970) 2021-03-25T14:17:29.883 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.875+0000 7f136ad9d700 1 -- 172.21.15.110:0/3313886990 learned_addr learned my addr 172.21.15.110:0/3313886990 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:29.883 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.875+0000 7f136a59c700 1 --2- 172.21.15.110:0/3313886990 >> v2:172.21.15.174:3300/0 conn(0x7f136c0bcd90 0x7f136c14d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:29.883 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.875+0000 7f136959a700 1 -- 172.21.15.110:0/3313886990 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3046622103 0 0) 0x7f136c0b9140 con 0x7f136c0b7620 2021-03-25T14:17:29.883 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.875+0000 7f136959a700 1 -- 172.21.15.110:0/3313886990 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f134c003270 con 0x7f136c0b7620 2021-03-25T14:17:29.883 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.875+0000 7f136959a700 1 -- 172.21.15.110:0/3313886990 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2860076777 0 0) 0x7f134c003270 con 0x7f136c0b7620 2021-03-25T14:17:29.883 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.875+0000 7f136959a700 1 -- 172.21.15.110:0/3313886990 >> v2:172.21.15.174:3300/0 conn(0x7f136c0bcd90 msgr2=0x7f136c14d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:29.883 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.875+0000 7f136959a700 1 --2- 172.21.15.110:0/3313886990 >> v2:172.21.15.174:3300/0 conn(0x7f136c0bcd90 0x7f136c14d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:29.884 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.875+0000 7f136959a700 1 -- 172.21.15.110:0/3313886990 >> v1:172.21.15.174:6789/0 conn(0x7f136c0b1340 legacy=0x7f136c060c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:29.884 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.875+0000 7f136959a700 1 -- 172.21.15.110:0/3313886990 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136c14cda0 con 0x7f136c0b7620 2021-03-25T14:17:29.884 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.875+0000 7f136959a700 1 -- 172.21.15.110:0/3313886990 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f13640018a0 con 0x7f136c0b7620 2021-03-25T14:17:29.884 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.875+0000 7f136959a700 1 -- 172.21.15.110:0/3313886990 >> v1:172.21.15.110:6789/0 conn(0x7f136c0b7620 legacy=0x7f136c148ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:29.884 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.875+0000 7f136959a700 1 --2- 172.21.15.110:0/3313886990 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f134c003760 0x7f134c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:29.884 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.875+0000 7f136959a700 1 --2- 172.21.15.110:0/3313886990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f134c004510 0x7f134c004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:29.884 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.875+0000 7f136959a700 1 --2- 172.21.15.110:0/3313886990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f134c004e80 0x7f134c00b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:29.884 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.875+0000 7f136959a700 1 -- 172.21.15.110:0/3313886990 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136c0692a0 con 0x7f134c004510 2021-03-25T14:17:29.884 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.875+0000 7f136959a700 1 -- 172.21.15.110:0/3313886990 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134c004200 con 0x7f134c003760 2021-03-25T14:17:29.884 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.875+0000 7f136959a700 1 -- 172.21.15.110:0/3313886990 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f134c00bc50 con 0x7f134c004e80 2021-03-25T14:17:29.884 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.875+0000 7f1369d9b700 1 --2- 172.21.15.110:0/3313886990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f134c004510 0x7f134c004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:29.884 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.876+0000 7f136a59c700 1 --2- 172.21.15.110:0/3313886990 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f134c003760 0x7f134c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:29.884 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.876+0000 7f136ad9d700 1 --2- 172.21.15.110:0/3313886990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f134c004e80 0x7f134c00b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:29.885 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.876+0000 7f1369d9b700 1 -- 172.21.15.110:0/3313886990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f134c004e80 msgr2=0x7f134c00b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:29.885 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.876+0000 7f1369d9b700 1 --2- 172.21.15.110:0/3313886990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f134c004e80 0x7f134c00b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:29.885 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.876+0000 7f1369d9b700 1 -- 172.21.15.110:0/3313886990 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f134c003760 msgr2=0x7f134c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:29.885 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.876+0000 7f1369d9b700 1 --2- 172.21.15.110:0/3313886990 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f134c003760 0x7f134c003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:29.885 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.876+0000 7f136ad9d700 1 -- 172.21.15.110:0/3313886990 reap_dead start 2021-03-25T14:17:29.885 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.876+0000 7f1369d9b700 1 -- 172.21.15.110:0/3313886990 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f134c003270 con 0x7f134c004510 2021-03-25T14:17:29.885 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.876+0000 7f1369d9b700 1 --2- 172.21.15.110:0/3313886990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f134c004510 0x7f134c004990 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f1354001a70 tx=0x7f1354007ba0).ready entity=mon.0 client_cookie=2f1b0b6874abced server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:29.885 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.876+0000 7f136959a700 1 -- 172.21.15.110:0/3313886990 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135400c650 con 0x7f134c004510 2021-03-25T14:17:29.885 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.876+0000 7f136959a700 1 -- 172.21.15.110:0/3313886990 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135400c7b0 con 0x7f134c004510 2021-03-25T14:17:29.885 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.876+0000 7f136959a700 1 -- 172.21.15.110:0/3313886990 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135400cb70 con 0x7f134c004510 2021-03-25T14:17:29.885 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.876+0000 7f1370c81700 1 -- 172.21.15.110:0/3313886990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f134c004510 msgr2=0x7f134c004990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:29.885 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.876+0000 7f1370c81700 1 --2- 172.21.15.110:0/3313886990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f134c004510 0x7f134c004990 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f1354001a70 tx=0x7f1354007ba0).stop 2021-03-25T14:17:29.886 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.877+0000 7f1370c81700 1 -- 172.21.15.110:0/3313886990 shutdown_connections 2021-03-25T14:17:29.886 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.877+0000 7f1370c81700 1 --2- 172.21.15.110:0/3313886990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f134c004510 0x7f134c004990 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:29.886 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.877+0000 7f1370c81700 1 -- 172.21.15.110:0/3313886990 >> 172.21.15.110:0/3313886990 conn(0x7f136c063720 msgr2=0x7f136c063b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:29.886 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.877+0000 7f1370c81700 1 -- 172.21.15.110:0/3313886990 shutdown_connections 2021-03-25T14:17:29.886 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.877+0000 7f1370c81700 1 -- 172.21.15.110:0/3313886990 wait complete. 2021-03-25T14:17:29.886 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.878+0000 7f1370c81700 1 Processor -- start 2021-03-25T14:17:29.886 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.878+0000 7f1370c81700 1 -- start start 2021-03-25T14:17:29.886 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.878+0000 7f1370c81700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f134c004510 0x7f136c14c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:29.886 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.878+0000 7f1370c81700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f136c149810 0x7f136c1473b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:29.886 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.878+0000 7f1370c81700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f136c14a3f0 0x7f136c1478a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:29.886 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.878+0000 7f1370c81700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136c147d90 con 0x7f136c149810 2021-03-25T14:17:29.886 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.878+0000 7f1370c81700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136c149cb0 con 0x7f134c004510 2021-03-25T14:17:29.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.878+0000 7f1370c81700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f136c148990 con 0x7f136c14a3f0 2021-03-25T14:17:29.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.878+0000 7f1369d9b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f136c149810 0x7f136c1473b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:29.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.878+0000 7f1369d9b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f136c149810 0x7f136c1473b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50048/0 (socket says 172.21.15.110:50048) 2021-03-25T14:17:29.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.878+0000 7f1369d9b700 1 -- 172.21.15.110:0/1090152033 learned_addr learned my addr 172.21.15.110:0/1090152033 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:29.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.878+0000 7f136ad9d700 1 --2- 172.21.15.110:0/1090152033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f136c14a3f0 0x7f136c1478a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:29.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.878+0000 7f136a59c700 1 --2- 172.21.15.110:0/1090152033 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f134c004510 0x7f136c14c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:29.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.879+0000 7f1369d9b700 1 -- 172.21.15.110:0/1090152033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f136c14a3f0 msgr2=0x7f136c1478a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:29.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.879+0000 7f1369d9b700 1 --2- 172.21.15.110:0/1090152033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f136c14a3f0 0x7f136c1478a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:29.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.879+0000 7f1369d9b700 1 -- 172.21.15.110:0/1090152033 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f134c004510 msgr2=0x7f136c14c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:29.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.879+0000 7f1369d9b700 1 --2- 172.21.15.110:0/1090152033 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f134c004510 0x7f136c14c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:29.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.879+0000 7f1369d9b700 1 -- 172.21.15.110:0/1090152033 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136c148c30 con 0x7f136c149810 2021-03-25T14:17:29.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.879+0000 7f136ad9d700 1 --2- 172.21.15.110:0/1090152033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f136c14a3f0 0x7f136c1478a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:29.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.879+0000 7f1369d9b700 1 --2- 172.21.15.110:0/1090152033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f136c149810 0x7f136c1473b0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f1354001e80 tx=0x7f1354016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:29.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.879+0000 7f13627fc700 1 -- 172.21.15.110:0/1090152033 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1354013b50 con 0x7f136c149810 2021-03-25T14:17:29.888 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.879+0000 7f13627fc700 1 -- 172.21.15.110:0/1090152033 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1354013cb0 con 0x7f136c149810 2021-03-25T14:17:29.888 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.879+0000 7f13627fc700 1 -- 172.21.15.110:0/1090152033 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135401f690 con 0x7f136c149810 2021-03-25T14:17:29.888 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.879+0000 7f1370c81700 1 -- 172.21.15.110:0/1090152033 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f136c148ed0 con 0x7f136c149810 2021-03-25T14:17:29.888 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.879+0000 7f1370c81700 1 -- 172.21.15.110:0/1090152033 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f136c14c510 con 0x7f136c149810 2021-03-25T14:17:29.888 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.880+0000 7f1370c81700 1 -- 172.21.15.110:0/1090152033 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f136c062780 con 0x7f136c149810 2021-03-25T14:17:29.888 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.880+0000 7f13627fc700 1 -- 172.21.15.110:0/1090152033 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f1354010030 con 0x7f136c149810 2021-03-25T14:17:29.888 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.880+0000 7f13627fc700 1 --2- 172.21.15.110:0/1090152033 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f135005a0b0 0x7f135005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:29.888 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.880+0000 7f13627fc700 1 -- 172.21.15.110:0/1090152033 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f1354075380 con 0x7f136c149810 2021-03-25T14:17:29.889 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.881+0000 7f136a59c700 1 --2- 172.21.15.110:0/1090152033 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f135005a0b0 0x7f135005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:29.889 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.881+0000 7f136a59c700 1 --2- 172.21.15.110:0/1090152033 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f135005a0b0 0x7f135005c570 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f136c148520 tx=0x7f135c006e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:29.889 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:29.884+0000 7f13627fc700 1 -- 172.21.15.110:0/1090152033 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f1354048b60 con 0x7f136c149810 2021-03-25T14:17:30.039 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.037+0000 7f1370c81700 1 -- 172.21.15.110:0/1090152033 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f136c149060 con 0x7f136c149810 2021-03-25T14:17:30.040 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.038+0000 7f13627fc700 1 -- 172.21.15.110:0/1090152033 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+17242 (secure 0 0 0) 0x7f135404c180 con 0x7f136c149810 2021-03-25T14:17:30.041 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:30.041 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":45,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:17:27.068212+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs2_metadata","create_time":"2021-03-25T14:17:12.037785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}}},{"pool":9,"pool_name":"cephfs2_data","create_time":"2021-03-25T14:17:13.333853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs2"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:6837/503424314":"2021-03-26T14:17:23.508494+0000","172.21.15.110:6835/503424314":"2021-03-26T14:17:23.508494+0000"},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:17:30.042 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.040+0000 7f1370c81700 1 -- 172.21.15.110:0/1090152033 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f135005a0b0 msgr2=0x7f135005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:30.042 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.040+0000 7f1370c81700 1 --2- 172.21.15.110:0/1090152033 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f135005a0b0 0x7f135005c570 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f136c148520 tx=0x7f135c006e20).stop 2021-03-25T14:17:30.042 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.040+0000 7f1370c81700 1 -- 172.21.15.110:0/1090152033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f136c149810 msgr2=0x7f136c1473b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:30.043 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.040+0000 7f1370c81700 1 --2- 172.21.15.110:0/1090152033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f136c149810 0x7f136c1473b0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f1354001e80 tx=0x7f1354016000).stop 2021-03-25T14:17:30.043 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.040+0000 7f1370c81700 1 -- 172.21.15.110:0/1090152033 shutdown_connections 2021-03-25T14:17:30.043 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.040+0000 7f1370c81700 1 --2- 172.21.15.110:0/1090152033 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f135005a0b0 0x7f135005c570 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:30.043 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.040+0000 7f1370c81700 1 --2- 172.21.15.110:0/1090152033 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f134c004510 0x7f136c14c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:30.043 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.040+0000 7f1370c81700 1 --2- 172.21.15.110:0/1090152033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f136c14a3f0 0x7f136c1478a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:30.043 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.040+0000 7f1370c81700 1 --2- 172.21.15.110:0/1090152033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f136c149810 0x7f136c1473b0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:30.043 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.040+0000 7f1370c81700 1 -- 172.21.15.110:0/1090152033 >> 172.21.15.110:0/1090152033 conn(0x7f136c063720 msgr2=0x7f136c14b370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:30.043 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.040+0000 7f1370c81700 1 -- 172.21.15.110:0/1090152033 shutdown_connections 2021-03-25T14:17:30.043 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.040+0000 7f1370c81700 1 -- 172.21.15.110:0/1090152033 wait complete. 2021-03-25T14:17:30.054 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2021-03-25T14:17:30.166 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.164+0000 7f739a8dd700 1 Processor -- start 2021-03-25T14:17:30.167 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.165+0000 7f739a8dd700 1 -- start start 2021-03-25T14:17:30.170 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.165+0000 7f739a8dd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f73940b62b0 0x7f73940b6690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:30.170 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.165+0000 7f739a8dd700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f739414a160 0x7f73940bf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:30.170 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.165+0000 7f739a8dd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f739414d940 0x7f739414ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:30.170 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.165+0000 7f739a8dd700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f739414cd30 con 0x7f739414a160 2021-03-25T14:17:30.170 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.165+0000 7f739a8dd700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f739414cf60 con 0x7f73940b62b0 2021-03-25T14:17:30.170 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.165+0000 7f739a8dd700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f739414d200 con 0x7f739414d940 2021-03-25T14:17:30.170 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.165+0000 7f73990da700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f739414a160 0x7f73940bf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:30.170 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.166+0000 7f73990da700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f739414a160 0x7f73940bf840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50054/0 (socket says 172.21.15.110:50054) 2021-03-25T14:17:30.170 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.166+0000 7f73990da700 1 -- 172.21.15.110:0/2019214691 learned_addr learned my addr 172.21.15.110:0/2019214691 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:30.170 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.166+0000 7f73998db700 1 --2- 172.21.15.110:0/2019214691 >> v2:172.21.15.174:3300/0 conn(0x7f73940b62b0 0x7f73940b6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:30.170 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.166+0000 7f739a0dc700 1 --2- 172.21.15.110:0/2019214691 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f739414d940 0x7f739414ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:30.171 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.166+0000 7f73990da700 1 -- 172.21.15.110:0/2019214691 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f739414d940 msgr2=0x7f739414ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:30.171 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.166+0000 7f73990da700 1 --2- 172.21.15.110:0/2019214691 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f739414d940 0x7f739414ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:30.171 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.166+0000 7f73990da700 1 -- 172.21.15.110:0/2019214691 >> v2:172.21.15.174:3300/0 conn(0x7f73940b62b0 msgr2=0x7f73940b6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:30.171 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.166+0000 7f73990da700 1 --2- 172.21.15.110:0/2019214691 >> v2:172.21.15.174:3300/0 conn(0x7f73940b62b0 0x7f73940b6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:30.171 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.166+0000 7f73990da700 1 -- 172.21.15.110:0/2019214691 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f739414d4a0 con 0x7f739414a160 2021-03-25T14:17:30.171 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.166+0000 7f73998db700 1 --2- 172.21.15.110:0/2019214691 >> v2:172.21.15.174:3300/0 conn(0x7f73940b62b0 0x7f73940b6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:17:30.171 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.166+0000 7f739a0dc700 1 --2- 172.21.15.110:0/2019214691 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f739414d940 0x7f739414ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:17:30.171 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.166+0000 7f73990da700 1 --2- 172.21.15.110:0/2019214691 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f739414a160 0x7f73940bf840 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f7394066050 tx=0x7f7384006ee0).ready entity=mon.0 client_cookie=3238db471ca56e56 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:30.171 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.166+0000 7f73988d9700 1 -- 172.21.15.110:0/2019214691 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73840098d0 con 0x7f739414a160 2021-03-25T14:17:30.171 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.166+0000 7f73988d9700 1 -- 172.21.15.110:0/2019214691 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7384009a30 con 0x7f739414a160 2021-03-25T14:17:30.171 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.166+0000 7f73988d9700 1 -- 172.21.15.110:0/2019214691 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7384009db0 con 0x7f739414a160 2021-03-25T14:17:30.171 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.167+0000 7f739a8dd700 1 -- 172.21.15.110:0/2019214691 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f739414a160 msgr2=0x7f73940bf840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:30.171 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.167+0000 7f739a8dd700 1 --2- 172.21.15.110:0/2019214691 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f739414a160 0x7f73940bf840 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f7394066050 tx=0x7f7384006ee0).stop 2021-03-25T14:17:30.171 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.167+0000 7f739a8dd700 1 -- 172.21.15.110:0/2019214691 shutdown_connections 2021-03-25T14:17:30.172 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.167+0000 7f739a8dd700 1 --2- 172.21.15.110:0/2019214691 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f739414d940 0x7f739414ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:30.172 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.167+0000 7f739a8dd700 1 --2- 172.21.15.110:0/2019214691 >> v2:172.21.15.174:3300/0 conn(0x7f73940b62b0 0x7f73940b6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:30.172 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.167+0000 7f739a8dd700 1 --2- 172.21.15.110:0/2019214691 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f739414a160 0x7f73940bf840 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:30.172 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.167+0000 7f739a8dd700 1 -- 172.21.15.110:0/2019214691 >> 172.21.15.110:0/2019214691 conn(0x7f7394060c40 msgr2=0x7f7394061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:30.172 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.167+0000 7f739a8dd700 1 -- 172.21.15.110:0/2019214691 shutdown_connections 2021-03-25T14:17:30.172 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.167+0000 7f739a8dd700 1 -- 172.21.15.110:0/2019214691 wait complete. 2021-03-25T14:17:30.172 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.168+0000 7f739a8dd700 1 Processor -- start 2021-03-25T14:17:30.172 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.168+0000 7f739a8dd700 1 -- start start 2021-03-25T14:17:30.175 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.168+0000 7f739a8dd700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73940b62b0 0x7f73940bb710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:30.175 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.168+0000 7f739a8dd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f739414a160 0x7f73941595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:30.175 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.168+0000 7f739a8dd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f739414d940 0x7f73940c00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:30.175 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.168+0000 7f739a8dd700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73940bbc00 con 0x7f739414a160 2021-03-25T14:17:30.175 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.168+0000 7f739a8dd700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73940a5940 con 0x7f73940b62b0 2021-03-25T14:17:30.176 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.168+0000 7f739a8dd700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73940a5be0 con 0x7f739414d940 2021-03-25T14:17:30.176 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.168+0000 7f73990da700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f739414a160 0x7f73941595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:30.176 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.169+0000 7f73990da700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f739414a160 0x7f73941595b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50058/0 (socket says 172.21.15.110:50058) 2021-03-25T14:17:30.176 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.169+0000 7f73990da700 1 -- 172.21.15.110:0/1948161722 learned_addr learned my addr 172.21.15.110:0/1948161722 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:30.176 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.169+0000 7f739a0dc700 1 --2- 172.21.15.110:0/1948161722 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f739414d940 0x7f73940c00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:30.176 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.169+0000 7f73998db700 1 --2- 172.21.15.110:0/1948161722 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73940b62b0 0x7f73940bb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:30.176 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.169+0000 7f73990da700 1 -- 172.21.15.110:0/1948161722 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f739414d940 msgr2=0x7f73940c00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:30.176 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.169+0000 7f73990da700 1 --2- 172.21.15.110:0/1948161722 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f739414d940 0x7f73940c00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:30.176 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.169+0000 7f73990da700 1 -- 172.21.15.110:0/1948161722 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73940b62b0 msgr2=0x7f73940bb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:30.176 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.169+0000 7f73990da700 1 --2- 172.21.15.110:0/1948161722 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73940b62b0 0x7f73940bb710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:30.176 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.169+0000 7f73990da700 1 -- 172.21.15.110:0/1948161722 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73940bc4b0 con 0x7f739414a160 2021-03-25T14:17:30.176 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.169+0000 7f73998db700 1 --2- 172.21.15.110:0/1948161722 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73940b62b0 0x7f73940bb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:30.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.169+0000 7f73990da700 1 --2- 172.21.15.110:0/1948161722 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f739414a160 0x7f73941595b0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f73840093a0 tx=0x7f7384016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:30.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.169+0000 7f7381ffb700 1 -- 172.21.15.110:0/1948161722 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7384011e30 con 0x7f739414a160 2021-03-25T14:17:30.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.169+0000 7f7381ffb700 1 -- 172.21.15.110:0/1948161722 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738401c420 con 0x7f739414a160 2021-03-25T14:17:30.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.169+0000 7f739a8dd700 1 -- 172.21.15.110:0/1948161722 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73940bc750 con 0x7f739414a160 2021-03-25T14:17:30.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.169+0000 7f7381ffb700 1 -- 172.21.15.110:0/1948161722 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738401c7a0 con 0x7f739414a160 2021-03-25T14:17:30.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.169+0000 7f739a8dd700 1 -- 172.21.15.110:0/1948161722 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7394159aa0 con 0x7f739414a160 2021-03-25T14:17:30.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.170+0000 7f739a8dd700 1 -- 172.21.15.110:0/1948161722 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f739414a600 con 0x7f739414a160 2021-03-25T14:17:30.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.171+0000 7f7381ffb700 1 -- 172.21.15.110:0/1948161722 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f738400f070 con 0x7f739414a160 2021-03-25T14:17:30.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.171+0000 7f7381ffb700 1 --2- 172.21.15.110:0/1948161722 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f737405a0e0 0x7f737405c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:30.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.171+0000 7f7381ffb700 1 -- 172.21.15.110:0/1948161722 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f7384075710 con 0x7f739414a160 2021-03-25T14:17:30.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.171+0000 7f73998db700 1 --2- 172.21.15.110:0/1948161722 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f737405a0e0 0x7f737405c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:30.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.171+0000 7f73998db700 1 --2- 172.21.15.110:0/1948161722 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f737405a0e0 0x7f737405c5a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f739000a900 tx=0x7f7390008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:30.178 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.175+0000 7f7381ffb700 1 -- 172.21.15.110:0/1948161722 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f7384048de0 con 0x7f739414a160 2021-03-25T14:17:30.358 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:30.357+0000 7f739a8dd700 1 -- 172.21.15.110:0/1948161722 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7f7394045280 con 0x7f739414a160 2021-03-25T14:17:31.087 INFO:tasks.ceph.mon.a.smithi110.stderr:2021-03-25T14:17:31.085+0000 7f2dd9594700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-03-25T14:17:31.093 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.091+0000 7f7381ffb700 1 -- 172.21.15.110:0/1948161722 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7f738404c400 con 0x7f739414a160 2021-03-25T14:17:31.095 INFO:tasks.ceph.mds.c.smithi110.stderr: -460> 2021-03-25T14:17:17.844+0000 7fd093376700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2021-03-25T14:17:31.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.095+0000 7f739a8dd700 1 -- 172.21.15.110:0/1948161722 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f737405a0e0 msgr2=0x7f737405c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:31.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.095+0000 7f739a8dd700 1 --2- 172.21.15.110:0/1948161722 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f737405a0e0 0x7f737405c5a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f739000a900 tx=0x7f7390008040).stop 2021-03-25T14:17:31.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.095+0000 7f739a8dd700 1 -- 172.21.15.110:0/1948161722 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f739414a160 msgr2=0x7f73941595b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:31.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.095+0000 7f739a8dd700 1 --2- 172.21.15.110:0/1948161722 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f739414a160 0x7f73941595b0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f73840093a0 tx=0x7f7384016000).stop 2021-03-25T14:17:31.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.095+0000 7f739a8dd700 1 -- 172.21.15.110:0/1948161722 shutdown_connections 2021-03-25T14:17:31.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.095+0000 7f739a8dd700 1 --2- 172.21.15.110:0/1948161722 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f737405a0e0 0x7f737405c5a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:31.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.095+0000 7f739a8dd700 1 --2- 172.21.15.110:0/1948161722 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73940b62b0 0x7f73940bb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:31.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.095+0000 7f739a8dd700 1 --2- 172.21.15.110:0/1948161722 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f739414d940 0x7f73940c00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:31.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.095+0000 7f739a8dd700 1 --2- 172.21.15.110:0/1948161722 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f739414a160 0x7f73941595b0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:31.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.095+0000 7f739a8dd700 1 -- 172.21.15.110:0/1948161722 >> 172.21.15.110:0/1948161722 conn(0x7f7394060c40 msgr2=0x7f739414b550 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:31.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.095+0000 7f739a8dd700 1 -- 172.21.15.110:0/1948161722 shutdown_connections 2021-03-25T14:17:31.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.095+0000 7f739a8dd700 1 -- 172.21.15.110:0/1948161722 wait complete. 2021-03-25T14:17:31.098 INFO:teuthology.orchestra.run.smithi110.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-03-25T14:17:31.111 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2021-03-25T14:17:31.116 INFO:tasks.ceph.mds.c.smithi110.stdout:starting mds.c at 2021-03-25T14:17:31.227 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.225+0000 7f3bb02ef700 1 Processor -- start 2021-03-25T14:17:31.227 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.225+0000 7f3bb02ef700 1 -- start start 2021-03-25T14:17:31.229 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.226+0000 7f3bb02ef700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3ba814d9a0 0x7f3ba8068f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:31.230 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.226+0000 7f3bb02ef700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3ba80b65c0 0x7f3ba80b6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:31.230 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.226+0000 7f3bb02ef700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ba80ba9a0 con 0x7f3ba8066570 2021-03-25T14:17:31.230 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.226+0000 7f3bb02ef700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ba8069410 con 0x7f3ba80b65c0 2021-03-25T14:17:31.230 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.226+0000 7f3bb02ef700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ba80b76c0 con 0x7f3ba814d9a0 2021-03-25T14:17:31.230 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.226+0000 7f3bae08b700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f3ba8066570 0x7f3ba814d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43020/0 (socket says 172.21.15.110:43020) 2021-03-25T14:17:31.230 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.226+0000 7f3bae88c700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3ba80b65c0 0x7f3ba80b6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:31.230 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.226+0000 7f3bae08b700 1 -- 172.21.15.110:0/54291684 learned_addr learned my addr 172.21.15.110:0/54291684 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:31.230 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.226+0000 7f3bae88c700 1 -- 172.21.15.110:0/54291684 >> v2:172.21.15.174:3300/0 conn(0x7f3ba814d9a0 msgr2=0x7f3ba8068f20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-03-25T14:17:31.230 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.226+0000 7f3bae88c700 1 --2- 172.21.15.110:0/54291684 >> v2:172.21.15.174:3300/0 conn(0x7f3ba814d9a0 0x7f3ba8068f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:31.230 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.227+0000 7f3bae88c700 1 -- 172.21.15.110:0/54291684 >> v1:172.21.15.110:6789/0 conn(0x7f3ba8066570 legacy=0x7f3ba814d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:31.230 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.226+0000 7f3bad089700 1 -- 172.21.15.110:0/54291684 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 787952164 0 0) 0x7f3ba80ba9a0 con 0x7f3ba8066570 2021-03-25T14:17:31.231 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.227+0000 7f3bae88c700 1 -- 172.21.15.110:0/54291684 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba814ce60 con 0x7f3ba80b65c0 2021-03-25T14:17:31.231 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.227+0000 7f3bae88c700 1 --2- 172.21.15.110:0/54291684 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ba80b65c0 0x7f3ba80b6a50 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f3ba80bd060 tx=0x7f3ba0009220).ready entity=mon.0 client_cookie=7e87f029a332b42d server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:31.231 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.227+0000 7f3bad089700 1 -- 172.21.15.110:0/54291684 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0009ea0 con 0x7f3ba80b65c0 2021-03-25T14:17:31.231 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.227+0000 7f3bad089700 1 -- 172.21.15.110:0/54291684 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba000bbf0 con 0x7f3ba80b65c0 2021-03-25T14:17:31.231 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.227+0000 7f3bad089700 1 -- 172.21.15.110:0/54291684 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0011400 con 0x7f3ba80b65c0 2021-03-25T14:17:31.231 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.227+0000 7f3bb02ef700 1 -- 172.21.15.110:0/54291684 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ba80b65c0 msgr2=0x7f3ba80b6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:31.231 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.227+0000 7f3bb02ef700 1 --2- 172.21.15.110:0/54291684 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ba80b65c0 0x7f3ba80b6a50 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f3ba80bd060 tx=0x7f3ba0009220).stop 2021-03-25T14:17:31.231 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.227+0000 7f3bb02ef700 1 -- 172.21.15.110:0/54291684 shutdown_connections 2021-03-25T14:17:31.231 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.227+0000 7f3bb02ef700 1 --2- 172.21.15.110:0/54291684 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ba80b65c0 0x7f3ba80b6a50 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:31.231 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.227+0000 7f3bb02ef700 1 --2- 172.21.15.110:0/54291684 >> v2:172.21.15.174:3300/0 conn(0x7f3ba814d9a0 0x7f3ba8068f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:31.231 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.227+0000 7f3bb02ef700 1 -- 172.21.15.110:0/54291684 >> 172.21.15.110:0/54291684 conn(0x7f3ba8063090 msgr2=0x7f3ba80634a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:31.231 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.227+0000 7f3bb02ef700 1 -- 172.21.15.110:0/54291684 shutdown_connections 2021-03-25T14:17:31.232 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.227+0000 7f3bb02ef700 1 -- 172.21.15.110:0/54291684 wait complete. 2021-03-25T14:17:31.235 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.228+0000 7f3bb02ef700 1 Processor -- start 2021-03-25T14:17:31.235 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.228+0000 7f3bb02ef700 1 -- start start 2021-03-25T14:17:31.235 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.229+0000 7f3bb02ef700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ba8066570 0x7f3ba80c0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:31.235 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.229+0000 7f3bb02ef700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ba80b65c0 0x7f3ba80be630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:31.235 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.229+0000 7f3bb02ef700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ba814d9a0 0x7f3ba81591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:31.235 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.229+0000 7f3bb02ef700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba814e1e0 con 0x7f3ba814d9a0 2021-03-25T14:17:31.235 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.229+0000 7f3bb02ef700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba80bf6b0 con 0x7f3ba8066570 2021-03-25T14:17:31.235 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.229+0000 7f3bb02ef700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba8150790 con 0x7f3ba80b65c0 2021-03-25T14:17:31.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.229+0000 7f3bae88c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ba814d9a0 0x7f3ba81591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:31.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.229+0000 7f3bae88c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ba814d9a0 0x7f3ba81591a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50094/0 (socket says 172.21.15.110:50094) 2021-03-25T14:17:31.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.229+0000 7f3bae88c700 1 -- 172.21.15.110:0/4123012653 learned_addr learned my addr 172.21.15.110:0/4123012653 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:31.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.229+0000 7f3bae08b700 1 --2- 172.21.15.110:0/4123012653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ba8066570 0x7f3ba80c0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:31.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.229+0000 7f3bad88a700 1 --2- 172.21.15.110:0/4123012653 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ba80b65c0 0x7f3ba80be630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:31.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.229+0000 7f3bae88c700 1 -- 172.21.15.110:0/4123012653 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ba80b65c0 msgr2=0x7f3ba80be630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:31.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.229+0000 7f3bae88c700 1 --2- 172.21.15.110:0/4123012653 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ba80b65c0 0x7f3ba80be630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:31.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.229+0000 7f3bae88c700 1 -- 172.21.15.110:0/4123012653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ba8066570 msgr2=0x7f3ba80c0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:31.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.229+0000 7f3bae88c700 1 --2- 172.21.15.110:0/4123012653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ba8066570 0x7f3ba80c0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:31.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.229+0000 7f3bae88c700 1 -- 172.21.15.110:0/4123012653 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba8150a30 con 0x7f3ba814d9a0 2021-03-25T14:17:31.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.230+0000 7f3bae08b700 1 --2- 172.21.15.110:0/4123012653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ba8066570 0x7f3ba80c0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:31.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.230+0000 7f3bae88c700 1 --2- 172.21.15.110:0/4123012653 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ba814d9a0 0x7f3ba81591a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f3ba00090b0 tx=0x7f3ba0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:31.237 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.230+0000 7f3b967fc700 1 -- 172.21.15.110:0/4123012653 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba00104f0 con 0x7f3ba814d9a0 2021-03-25T14:17:31.237 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.230+0000 7f3b967fc700 1 -- 172.21.15.110:0/4123012653 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba001e070 con 0x7f3ba814d9a0 2021-03-25T14:17:31.237 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.230+0000 7f3bb02ef700 1 -- 172.21.15.110:0/4123012653 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba8150cd0 con 0x7f3ba814d9a0 2021-03-25T14:17:31.237 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.230+0000 7f3b967fc700 1 -- 172.21.15.110:0/4123012653 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba00108a0 con 0x7f3ba814d9a0 2021-03-25T14:17:31.237 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.230+0000 7f3bb02ef700 1 -- 172.21.15.110:0/4123012653 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba80beb20 con 0x7f3ba814d9a0 2021-03-25T14:17:31.237 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.231+0000 7f3bb02ef700 1 -- 172.21.15.110:0/4123012653 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ba814cff0 con 0x7f3ba814d9a0 2021-03-25T14:17:31.237 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.231+0000 7f3b967fc700 1 -- 172.21.15.110:0/4123012653 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f3ba0029020 con 0x7f3ba814d9a0 2021-03-25T14:17:31.237 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.231+0000 7f3b967fc700 1 --2- 172.21.15.110:0/4123012653 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3b8805a0b0 0x7f3b8805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:31.237 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.231+0000 7f3b967fc700 1 -- 172.21.15.110:0/4123012653 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6602+0+0 (secure 0 0 0) 0x7f3ba0075e50 con 0x7f3ba814d9a0 2021-03-25T14:17:31.237 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.231+0000 7f3bae08b700 1 --2- 172.21.15.110:0/4123012653 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3b8805a0b0 0x7f3b8805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:31.237 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.232+0000 7f3bae08b700 1 --2- 172.21.15.110:0/4123012653 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3b8805a0b0 0x7f3b8805c570 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f3ba4007fd0 tx=0x7f3ba4009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:31.238 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.235+0000 7f3b967fc700 1 -- 172.21.15.110:0/4123012653 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f3ba00495e0 con 0x7f3ba814d9a0 2021-03-25T14:17:31.424 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:31.422+0000 7f3bb02ef700 1 -- 172.21.15.110:0/4123012653 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3ba8045ae0 con 0x7f3ba814d9a0 2021-03-25T14:17:32.100 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.098+0000 7f3b967fc700 1 -- 172.21.15.110:0/4123012653 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v22) v1 ==== 105+0+0 (secure 0 0 0) 0x7f3ba004cc00 con 0x7f3ba814d9a0 2021-03-25T14:17:32.102 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.100+0000 7f3bb02ef700 1 -- 172.21.15.110:0/4123012653 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3b8805a0b0 msgr2=0x7f3b8805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:32.102 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.100+0000 7f3bb02ef700 1 --2- 172.21.15.110:0/4123012653 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3b8805a0b0 0x7f3b8805c570 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f3ba4007fd0 tx=0x7f3ba4009040).stop 2021-03-25T14:17:32.102 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.100+0000 7f3bb02ef700 1 -- 172.21.15.110:0/4123012653 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ba814d9a0 msgr2=0x7f3ba81591a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:32.102 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.100+0000 7f3bb02ef700 1 --2- 172.21.15.110:0/4123012653 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ba814d9a0 0x7f3ba81591a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f3ba00090b0 tx=0x7f3ba0017000).stop 2021-03-25T14:17:32.102 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.100+0000 7f3bb02ef700 1 -- 172.21.15.110:0/4123012653 shutdown_connections 2021-03-25T14:17:32.102 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.100+0000 7f3bb02ef700 1 --2- 172.21.15.110:0/4123012653 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3b8805a0b0 0x7f3b8805c570 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:32.103 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.100+0000 7f3bb02ef700 1 --2- 172.21.15.110:0/4123012653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ba8066570 0x7f3ba80c0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:32.103 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.100+0000 7f3bb02ef700 1 --2- 172.21.15.110:0/4123012653 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ba814d9a0 0x7f3ba81591a0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:32.103 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.100+0000 7f3bb02ef700 1 --2- 172.21.15.110:0/4123012653 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ba80b65c0 0x7f3ba80be630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:32.103 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.100+0000 7f3bb02ef700 1 -- 172.21.15.110:0/4123012653 >> 172.21.15.110:0/4123012653 conn(0x7f3ba8063090 msgr2=0x7f3ba8069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:32.103 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.100+0000 7f3bb02ef700 1 -- 172.21.15.110:0/4123012653 shutdown_connections 2021-03-25T14:17:32.103 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.100+0000 7f3bb02ef700 1 -- 172.21.15.110:0/4123012653 wait complete. 2021-03-25T14:17:32.115 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2021-03-25T14:17:32.287 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.285+0000 7fb9f26ab700 1 Processor -- start 2021-03-25T14:17:32.287 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.286+0000 7fb9f26ab700 1 -- start start 2021-03-25T14:17:32.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.286+0000 7fb9f26ab700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb9ec0bfd50 0x7fb9ec0c0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:32.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.286+0000 7fb9f26ab700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9ec0bb060 con 0x7fb9ec0672a0 2021-03-25T14:17:32.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.286+0000 7fb9f26ab700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9ec14ae80 con 0x7fb9ec14aa20 2021-03-25T14:17:32.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.286+0000 7fb9f26ab700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9ec0bab20 con 0x7fb9ec0bfd50 2021-03-25T14:17:32.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.286+0000 7fb9f16a9700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb9ec0bfd50 0x7fb9ec0c0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:32.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.286+0000 7fb9f16a9700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb9ec0bfd50 0x7fb9ec0c0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50098/0 (socket says 172.21.15.110:50098) 2021-03-25T14:17:32.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.286+0000 7fb9f1eaa700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fb9ec0672a0 0x7fb9ec1431e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43038/0 (socket says 172.21.15.110:43038) 2021-03-25T14:17:32.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.287+0000 7fb9f16a9700 1 -- 172.21.15.110:0/2387444988 learned_addr learned my addr 172.21.15.110:0/2387444988 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:32.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.287+0000 7fb9f16a9700 1 -- 172.21.15.110:0/2387444988 >> v1:172.21.15.174:6789/0 conn(0x7fb9ec14aa20 legacy=0x7fb9ec149e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:32.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.287+0000 7fb9f16a9700 1 -- 172.21.15.110:0/2387444988 >> v1:172.21.15.110:6789/0 conn(0x7fb9ec0672a0 legacy=0x7fb9ec1431e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:32.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.287+0000 7fb9dbfff700 1 -- 172.21.15.110:0/2387444988 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1572805348 0 0) 0x7fb9ec0bb060 con 0x7fb9ec0672a0 2021-03-25T14:17:32.291 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.287+0000 7fb9f16a9700 1 -- 172.21.15.110:0/2387444988 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ec0badc0 con 0x7fb9ec0bfd50 2021-03-25T14:17:32.291 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.287+0000 7fb9f16a9700 1 --2- 172.21.15.110:0/2387444988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9ec0bfd50 0x7fb9ec0c0130 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7fb9e800ba20 tx=0x7fb9e8006ee0).ready entity=mon.0 client_cookie=bfc2789f71f34e7e server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:32.291 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.287+0000 7fb9dbfff700 1 -- 172.21.15.110:0/2387444988 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e80098d0 con 0x7fb9ec0bfd50 2021-03-25T14:17:32.291 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.287+0000 7fb9dbfff700 1 -- 172.21.15.110:0/2387444988 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e8009a30 con 0x7fb9ec0bfd50 2021-03-25T14:17:32.291 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.287+0000 7fb9dbfff700 1 -- 172.21.15.110:0/2387444988 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e8009db0 con 0x7fb9ec0bfd50 2021-03-25T14:17:32.291 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.288+0000 7fb9f26ab700 1 -- 172.21.15.110:0/2387444988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9ec0bfd50 msgr2=0x7fb9ec0c0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:32.291 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.288+0000 7fb9f26ab700 1 --2- 172.21.15.110:0/2387444988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9ec0bfd50 0x7fb9ec0c0130 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7fb9e800ba20 tx=0x7fb9e8006ee0).stop 2021-03-25T14:17:32.291 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.288+0000 7fb9f26ab700 1 -- 172.21.15.110:0/2387444988 shutdown_connections 2021-03-25T14:17:32.291 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.288+0000 7fb9f26ab700 1 --2- 172.21.15.110:0/2387444988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9ec0bfd50 0x7fb9ec0c0130 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:32.291 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.288+0000 7fb9f26ab700 1 -- 172.21.15.110:0/2387444988 >> 172.21.15.110:0/2387444988 conn(0x7fb9ec066370 msgr2=0x7fb9ec066780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:32.291 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.288+0000 7fb9f26ab700 1 -- 172.21.15.110:0/2387444988 shutdown_connections 2021-03-25T14:17:32.291 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.288+0000 7fb9f26ab700 1 -- 172.21.15.110:0/2387444988 wait complete. 2021-03-25T14:17:32.294 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.289+0000 7fb9f26ab700 1 Processor -- start 2021-03-25T14:17:32.294 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.289+0000 7fb9f26ab700 1 -- start start 2021-03-25T14:17:32.294 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.289+0000 7fb9f26ab700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9ec0672a0 0x7fb9ec159a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:32.294 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.289+0000 7fb9f26ab700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9ec0bfd50 0x7fb9ec14b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:32.294 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.289+0000 7fb9f26ab700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9ec14aa20 0x7fb9ec1447f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:32.295 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.289+0000 7fb9f26ab700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ec0b2f70 con 0x7fb9ec0672a0 2021-03-25T14:17:32.295 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.289+0000 7fb9f26ab700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ec159f40 con 0x7fb9ec0bfd50 2021-03-25T14:17:32.295 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.289+0000 7fb9f26ab700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ec0b24f0 con 0x7fb9ec14aa20 2021-03-25T14:17:32.295 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.290+0000 7fb9f16a9700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9ec0672a0 0x7fb9ec159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:32.295 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.290+0000 7fb9f16a9700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9ec0672a0 0x7fb9ec159a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50104/0 (socket says 172.21.15.110:50104) 2021-03-25T14:17:32.295 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.290+0000 7fb9f16a9700 1 -- 172.21.15.110:0/4014605993 learned_addr learned my addr 172.21.15.110:0/4014605993 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:32.295 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.290+0000 7fb9f1eaa700 1 --2- 172.21.15.110:0/4014605993 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9ec14aa20 0x7fb9ec1447f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:32.295 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.290+0000 7fb9f0ea8700 1 --2- 172.21.15.110:0/4014605993 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9ec0bfd50 0x7fb9ec14b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:32.295 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.290+0000 7fb9f16a9700 1 -- 172.21.15.110:0/4014605993 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9ec14aa20 msgr2=0x7fb9ec1447f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:32.295 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.290+0000 7fb9f16a9700 1 --2- 172.21.15.110:0/4014605993 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9ec14aa20 0x7fb9ec1447f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:32.295 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.290+0000 7fb9f16a9700 1 -- 172.21.15.110:0/4014605993 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9ec0bfd50 msgr2=0x7fb9ec14b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:32.295 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.290+0000 7fb9f16a9700 1 --2- 172.21.15.110:0/4014605993 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9ec0bfd50 0x7fb9ec14b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:32.296 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.290+0000 7fb9f16a9700 1 -- 172.21.15.110:0/4014605993 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ec0b2790 con 0x7fb9ec0672a0 2021-03-25T14:17:32.296 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.290+0000 7fb9f0ea8700 1 --2- 172.21.15.110:0/4014605993 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9ec0bfd50 0x7fb9ec14b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:17:32.296 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.290+0000 7fb9f16a9700 1 --2- 172.21.15.110:0/4014605993 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9ec0672a0 0x7fb9ec159a50 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7fb9e800b1d0 tx=0x7fb9e8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:32.296 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.290+0000 7fb9d97fa700 1 -- 172.21.15.110:0/4014605993 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e801c420 con 0x7fb9ec0672a0 2021-03-25T14:17:32.296 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.290+0000 7fb9d97fa700 1 -- 172.21.15.110:0/4014605993 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e801c580 con 0x7fb9ec0672a0 2021-03-25T14:17:32.296 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.290+0000 7fb9f26ab700 1 -- 172.21.15.110:0/4014605993 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9ec0b2a30 con 0x7fb9ec0672a0 2021-03-25T14:17:32.296 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.290+0000 7fb9d97fa700 1 -- 172.21.15.110:0/4014605993 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e801c920 con 0x7fb9ec0672a0 2021-03-25T14:17:32.296 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.290+0000 7fb9f26ab700 1 -- 172.21.15.110:0/4014605993 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9ec14b6f0 con 0x7fb9ec0672a0 2021-03-25T14:17:32.296 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.291+0000 7fb9f26ab700 1 -- 172.21.15.110:0/4014605993 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9ec045ae0 con 0x7fb9ec0672a0 2021-03-25T14:17:32.297 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.291+0000 7fb9d97fa700 1 -- 172.21.15.110:0/4014605993 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fb9e800f070 con 0x7fb9ec0672a0 2021-03-25T14:17:32.297 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.292+0000 7fb9d97fa700 1 --2- 172.21.15.110:0/4014605993 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb9cc05a0b0 0x7fb9cc05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:32.297 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.292+0000 7fb9d97fa700 1 -- 172.21.15.110:0/4014605993 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6602+0+0 (secure 0 0 0) 0x7fb9e80758f0 con 0x7fb9ec0672a0 2021-03-25T14:17:32.297 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.292+0000 7fb9f0ea8700 1 --2- 172.21.15.110:0/4014605993 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb9cc05a0b0 0x7fb9cc05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:32.297 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.292+0000 7fb9f0ea8700 1 --2- 172.21.15.110:0/4014605993 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb9cc05a0b0 0x7fb9cc05c570 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fb9ec0b65a0 tx=0x7fb9dc009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:32.297 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.295+0000 7fb9d97fa700 1 -- 172.21.15.110:0/4014605993 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fb9e8049060 con 0x7fb9ec0672a0 2021-03-25T14:17:32.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:32.443+0000 7fb9f26ab700 1 -- 172.21.15.110:0/4014605993 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb9ec0b80c0 con 0x7fb9ec0672a0 2021-03-25T14:17:33.102 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.100+0000 7fb9d97fa700 1 -- 172.21.15.110:0/4014605993 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v47) v1 ==== 184+0+0 (secure 0 0 0) 0x7fb9e804c680 con 0x7fb9ec0672a0 2021-03-25T14:17:33.104 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.102+0000 7fb9f26ab700 1 -- 172.21.15.110:0/4014605993 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb9cc05a0b0 msgr2=0x7fb9cc05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:33.105 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.102+0000 7fb9f26ab700 1 --2- 172.21.15.110:0/4014605993 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb9cc05a0b0 0x7fb9cc05c570 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fb9ec0b65a0 tx=0x7fb9dc009040).stop 2021-03-25T14:17:33.105 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.102+0000 7fb9f26ab700 1 -- 172.21.15.110:0/4014605993 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9ec0672a0 msgr2=0x7fb9ec159a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:33.105 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.102+0000 7fb9f26ab700 1 --2- 172.21.15.110:0/4014605993 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9ec0672a0 0x7fb9ec159a50 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7fb9e800b1d0 tx=0x7fb9e8016000).stop 2021-03-25T14:17:33.105 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.102+0000 7fb9f26ab700 1 -- 172.21.15.110:0/4014605993 shutdown_connections 2021-03-25T14:17:33.105 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.102+0000 7fb9f26ab700 1 --2- 172.21.15.110:0/4014605993 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb9cc05a0b0 0x7fb9cc05c570 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:33.105 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.102+0000 7fb9f26ab700 1 --2- 172.21.15.110:0/4014605993 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9ec14aa20 0x7fb9ec1447f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:33.105 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.102+0000 7fb9f26ab700 1 --2- 172.21.15.110:0/4014605993 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9ec0672a0 0x7fb9ec159a50 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:33.105 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.102+0000 7fb9f26ab700 1 --2- 172.21.15.110:0/4014605993 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9ec0bfd50 0x7fb9ec14b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:33.105 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.102+0000 7fb9f26ab700 1 -- 172.21.15.110:0/4014605993 >> 172.21.15.110:0/4014605993 conn(0x7fb9ec066370 msgr2=0x7fb9ec14c990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:33.105 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.102+0000 7fb9f26ab700 1 -- 172.21.15.110:0/4014605993 shutdown_connections 2021-03-25T14:17:33.105 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.102+0000 7fb9f26ab700 1 -- 172.21.15.110:0/4014605993 wait complete. 2021-03-25T14:17:33.106 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs2_metadata' removed 2021-03-25T14:17:33.118 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2021-03-25T14:17:33.234 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.232+0000 7fc1de8e6700 1 Processor -- start 2021-03-25T14:17:33.235 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.232+0000 7fc1de8e6700 1 -- start start 2021-03-25T14:17:33.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.233+0000 7fc1de8e6700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc1d80bc830 0x7fc1d814a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:33.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.233+0000 7fc1de8e6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1d80bcc10 0x7fc1d8148a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:33.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.233+0000 7fc1de8e6700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1d80b6af0 con 0x7fc1d80a1c70 2021-03-25T14:17:33.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.233+0000 7fc1de8e6700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1d80b2210 con 0x7fc1d80bc830 2021-03-25T14:17:33.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.233+0000 7fc1de8e6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d8149680 con 0x7fc1d80bcc10 2021-03-25T14:17:33.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.233+0000 7fc1d7fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc1d80bc830 0x7fc1d814a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:33.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.233+0000 7fc1d7fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc1d80bc830 0x7fc1d814a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50112/0 (socket says 172.21.15.110:50112) 2021-03-25T14:17:33.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.233+0000 7fc1d7fff700 1 -- 172.21.15.110:0/98276347 learned_addr learned my addr 172.21.15.110:0/98276347 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:33.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.233+0000 7fc1d77fe700 1 --2- 172.21.15.110:0/98276347 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1d80bcc10 0x7fc1d8148a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:33.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.233+0000 7fc1d7fff700 1 -- 172.21.15.110:0/98276347 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1d80bcc10 msgr2=0x7fc1d8148a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:33.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.233+0000 7fc1d7fff700 1 --2- 172.21.15.110:0/98276347 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1d80bcc10 0x7fc1d8148a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:33.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.233+0000 7fc1d7fff700 1 -- 172.21.15.110:0/98276347 >> v1:172.21.15.174:6789/0 conn(0x7fc1d80a1c70 legacy=0x7fc1d8148f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:33.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.233+0000 7fc1d7fff700 1 -- 172.21.15.110:0/98276347 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d80b6d90 con 0x7fc1d80bc830 2021-03-25T14:17:33.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.233+0000 7fc1d77fe700 1 --2- 172.21.15.110:0/98276347 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1d80bcc10 0x7fc1d8148a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:33.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.234+0000 7fc1d7fff700 1 --2- 172.21.15.110:0/98276347 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1d80bc830 0x7fc1d814a070 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7fc1c800ba50 tx=0x7fc1c8006ee0).ready entity=mon.0 client_cookie=affb64a4832e06c1 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:33.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.234+0000 7fc1d6ffd700 1 -- 172.21.15.110:0/98276347 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c8009800 con 0x7fc1d80bc830 2021-03-25T14:17:33.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.234+0000 7fc1d6ffd700 1 -- 172.21.15.110:0/98276347 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c8009960 con 0x7fc1d80bc830 2021-03-25T14:17:33.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.234+0000 7fc1d6ffd700 1 -- 172.21.15.110:0/98276347 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c8009ce0 con 0x7fc1d80bc830 2021-03-25T14:17:33.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.234+0000 7fc1de8e6700 1 -- 172.21.15.110:0/98276347 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1d80bc830 msgr2=0x7fc1d814a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:33.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.234+0000 7fc1de8e6700 1 --2- 172.21.15.110:0/98276347 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1d80bc830 0x7fc1d814a070 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7fc1c800ba50 tx=0x7fc1c8006ee0).stop 2021-03-25T14:17:33.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.234+0000 7fc1de8e6700 1 -- 172.21.15.110:0/98276347 shutdown_connections 2021-03-25T14:17:33.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.234+0000 7fc1de8e6700 1 --2- 172.21.15.110:0/98276347 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1d80bc830 0x7fc1d814a070 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:33.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.234+0000 7fc1de8e6700 1 --2- 172.21.15.110:0/98276347 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1d80bcc10 0x7fc1d8148a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:33.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.234+0000 7fc1de8e6700 1 -- 172.21.15.110:0/98276347 >> 172.21.15.110:0/98276347 conn(0x7fc1d80616d0 msgr2=0x7fc1d80bbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:33.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.234+0000 7fc1de8e6700 1 -- 172.21.15.110:0/98276347 shutdown_connections 2021-03-25T14:17:33.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.234+0000 7fc1de8e6700 1 -- 172.21.15.110:0/98276347 wait complete. 2021-03-25T14:17:33.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.235+0000 7fc1de8e6700 1 Processor -- start 2021-03-25T14:17:33.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.235+0000 7fc1de8e6700 1 -- start start 2021-03-25T14:17:33.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.236+0000 7fc1de8e6700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1d80a1c70 0x7fc1d80b5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:33.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.236+0000 7fc1de8e6700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1d80bc830 0x7fc1d814ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:33.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.236+0000 7fc1de8e6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1d8159a70 0x7fc1d809eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:33.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.236+0000 7fc1de8e6700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d80a0ef0 con 0x7fc1d80a1c70 2021-03-25T14:17:33.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.236+0000 7fc1de8e6700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d8158e60 con 0x7fc1d80bc830 2021-03-25T14:17:33.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.236+0000 7fc1de8e6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d8068030 con 0x7fc1d8159a70 2021-03-25T14:17:33.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.236+0000 7fc1d7fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1d80a1c70 0x7fc1d80b5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:33.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.236+0000 7fc1d7fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1d80a1c70 0x7fc1d80b5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50122/0 (socket says 172.21.15.110:50122) 2021-03-25T14:17:33.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.236+0000 7fc1d7fff700 1 -- 172.21.15.110:0/2707142324 learned_addr learned my addr 172.21.15.110:0/2707142324 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:33.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.236+0000 7fc1d77fe700 1 --2- 172.21.15.110:0/2707142324 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1d80bc830 0x7fc1d814ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:33.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.236+0000 7fc1dce83700 1 --2- 172.21.15.110:0/2707142324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1d8159a70 0x7fc1d809eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:33.245 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.237+0000 7fc1d7fff700 1 -- 172.21.15.110:0/2707142324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1d8159a70 msgr2=0x7fc1d809eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:33.245 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.237+0000 7fc1d7fff700 1 --2- 172.21.15.110:0/2707142324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1d8159a70 0x7fc1d809eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:33.245 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.237+0000 7fc1d7fff700 1 -- 172.21.15.110:0/2707142324 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1d80bc830 msgr2=0x7fc1d814ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:33.245 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.237+0000 7fc1d7fff700 1 --2- 172.21.15.110:0/2707142324 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1d80bc830 0x7fc1d814ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:33.245 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.237+0000 7fc1d7fff700 1 -- 172.21.15.110:0/2707142324 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d809e4c0 con 0x7fc1d80a1c70 2021-03-25T14:17:33.245 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.237+0000 7fc1d7fff700 1 --2- 172.21.15.110:0/2707142324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1d80a1c70 0x7fc1d80b5e80 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7fc1d805d6b0 tx=0x7fc1c8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:33.245 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.237+0000 7fc1cffff700 1 -- 172.21.15.110:0/2707142324 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c8011cd0 con 0x7fc1d80a1c70 2021-03-25T14:17:33.245 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.237+0000 7fc1cffff700 1 -- 172.21.15.110:0/2707142324 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c8011e30 con 0x7fc1d80a1c70 2021-03-25T14:17:33.245 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.237+0000 7fc1de8e6700 1 -- 172.21.15.110:0/2707142324 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d8159090 con 0x7fc1d80a1c70 2021-03-25T14:17:33.245 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.237+0000 7fc1cffff700 1 -- 172.21.15.110:0/2707142324 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c801c650 con 0x7fc1d80a1c70 2021-03-25T14:17:33.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.237+0000 7fc1de8e6700 1 -- 172.21.15.110:0/2707142324 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d8159380 con 0x7fc1d80a1c70 2021-03-25T14:17:33.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.238+0000 7fc1de8e6700 1 -- 172.21.15.110:0/2707142324 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1d805d7b0 con 0x7fc1d80a1c70 2021-03-25T14:17:33.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.238+0000 7fc1cffff700 1 -- 172.21.15.110:0/2707142324 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fc1c800f070 con 0x7fc1d80a1c70 2021-03-25T14:17:33.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.238+0000 7fc1cffff700 1 --2- 172.21.15.110:0/2707142324 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc1bc05a0b0 0x7fc1bc05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:33.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.238+0000 7fc1cffff700 1 -- 172.21.15.110:0/2707142324 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6162+0+0 (secure 0 0 0) 0x7fc1c8075300 con 0x7fc1d80a1c70 2021-03-25T14:17:33.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.239+0000 7fc1d77fe700 1 --2- 172.21.15.110:0/2707142324 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc1bc05a0b0 0x7fc1bc05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:33.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.239+0000 7fc1d77fe700 1 --2- 172.21.15.110:0/2707142324 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc1bc05a0b0 0x7fc1bc05c570 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7fc1d8064af0 tx=0x7fc1c0006f90).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:33.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.242+0000 7fc1cffff700 1 -- 172.21.15.110:0/2707142324 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fc1c8048c40 con 0x7fc1d80a1c70 2021-03-25T14:17:33.394 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:33.392+0000 7fc1de8e6700 1 -- 172.21.15.110:0/2707142324 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc1d8061c50 con 0x7fc1d80a1c70 2021-03-25T14:17:34.109 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.107+0000 7fc1cffff700 1 -- 172.21.15.110:0/2707142324 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v48) v1 ==== 172+0+0 (secure 0 0 0) 0x7fc1c804c260 con 0x7fc1d80a1c70 2021-03-25T14:17:34.111 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.109+0000 7fc1de8e6700 1 -- 172.21.15.110:0/2707142324 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc1bc05a0b0 msgr2=0x7fc1bc05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:34.112 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.109+0000 7fc1de8e6700 1 --2- 172.21.15.110:0/2707142324 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc1bc05a0b0 0x7fc1bc05c570 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7fc1d8064af0 tx=0x7fc1c0006f90).stop 2021-03-25T14:17:34.112 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.109+0000 7fc1de8e6700 1 -- 172.21.15.110:0/2707142324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1d80a1c70 msgr2=0x7fc1d80b5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:34.112 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.109+0000 7fc1de8e6700 1 --2- 172.21.15.110:0/2707142324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1d80a1c70 0x7fc1d80b5e80 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7fc1d805d6b0 tx=0x7fc1c8016000).stop 2021-03-25T14:17:34.112 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.109+0000 7fc1de8e6700 1 -- 172.21.15.110:0/2707142324 shutdown_connections 2021-03-25T14:17:34.112 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.109+0000 7fc1de8e6700 1 --2- 172.21.15.110:0/2707142324 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc1bc05a0b0 0x7fc1bc05c570 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:34.112 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.109+0000 7fc1de8e6700 1 --2- 172.21.15.110:0/2707142324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1d8159a70 0x7fc1d809eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:34.112 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.109+0000 7fc1de8e6700 1 --2- 172.21.15.110:0/2707142324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1d80a1c70 0x7fc1d80b5e80 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:34.112 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.109+0000 7fc1de8e6700 1 --2- 172.21.15.110:0/2707142324 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1d80bc830 0x7fc1d814ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:34.112 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.109+0000 7fc1de8e6700 1 -- 172.21.15.110:0/2707142324 >> 172.21.15.110:0/2707142324 conn(0x7fc1d80616d0 msgr2=0x7fc1d80686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:34.112 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.110+0000 7fc1de8e6700 1 -- 172.21.15.110:0/2707142324 shutdown_connections 2021-03-25T14:17:34.112 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.110+0000 7fc1de8e6700 1 -- 172.21.15.110:0/2707142324 wait complete. 2021-03-25T14:17:34.113 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs2_data' removed 2021-03-25T14:17:34.126 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-03-25T14:17:34.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.240+0000 7f4414a73700 1 Processor -- start 2021-03-25T14:17:34.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.240+0000 7f4414a73700 1 -- start start 2021-03-25T14:17:34.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.241+0000 7f4414a73700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f44100b4100 0x7f4410149340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:34.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.241+0000 7f4414a73700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44100b47a0 0x7f44100b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:34.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.241+0000 7f4414a73700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44100b4c30 con 0x7f44100be3a0 2021-03-25T14:17:34.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.241+0000 7f4414a73700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4410149960 con 0x7f44100b4100 2021-03-25T14:17:34.245 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.241+0000 7f4414a73700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4410149c00 con 0x7f44100b47a0 2021-03-25T14:17:34.245 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.241+0000 7f440dd9b700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f44100b4100 0x7f4410149340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:34.245 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.241+0000 7f440dd9b700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f44100b4100 0x7f4410149340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50130/0 (socket says 172.21.15.110:50130) 2021-03-25T14:17:34.245 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.241+0000 7f440dd9b700 1 -- 172.21.15.110:0/639675168 learned_addr learned my addr 172.21.15.110:0/639675168 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:34.245 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.241+0000 7f440ed9d700 1 --2- 172.21.15.110:0/639675168 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44100b47a0 0x7f44100b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:34.245 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.241+0000 7f440dd9b700 1 -- 172.21.15.110:0/639675168 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44100b47a0 msgr2=0x7f44100b8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:34.245 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.241+0000 7f440dd9b700 1 --2- 172.21.15.110:0/639675168 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44100b47a0 0x7f44100b8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:34.245 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.241+0000 7f440dd9b700 1 -- 172.21.15.110:0/639675168 >> v1:172.21.15.174:6789/0 conn(0x7f44100be3a0 legacy=0x7f4410148c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:34.245 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.241+0000 7f440dd9b700 1 -- 172.21.15.110:0/639675168 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4410149ea0 con 0x7f44100b4100 2021-03-25T14:17:34.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.241+0000 7f440ed9d700 1 --2- 172.21.15.110:0/639675168 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44100b47a0 0x7f44100b8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:17:34.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.241+0000 7f440dd9b700 1 --2- 172.21.15.110:0/639675168 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44100b4100 0x7f4410149340 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f440000ba20 tx=0x7f4400006ee0).ready entity=mon.0 client_cookie=2de5667ea7c30e71 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:34.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.241+0000 7f440d59a700 1 -- 172.21.15.110:0/639675168 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4400009800 con 0x7f44100b4100 2021-03-25T14:17:34.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.241+0000 7f440d59a700 1 -- 172.21.15.110:0/639675168 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4400009960 con 0x7f44100b4100 2021-03-25T14:17:34.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.241+0000 7f440d59a700 1 -- 172.21.15.110:0/639675168 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4400009ce0 con 0x7f44100b4100 2021-03-25T14:17:34.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.242+0000 7f4414a73700 1 -- 172.21.15.110:0/639675168 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44100b4100 msgr2=0x7f4410149340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:34.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.242+0000 7f4414a73700 1 --2- 172.21.15.110:0/639675168 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44100b4100 0x7f4410149340 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f440000ba20 tx=0x7f4400006ee0).stop 2021-03-25T14:17:34.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.242+0000 7f4414a73700 1 -- 172.21.15.110:0/639675168 shutdown_connections 2021-03-25T14:17:34.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.242+0000 7f4414a73700 1 --2- 172.21.15.110:0/639675168 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44100b47a0 0x7f44100b8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:34.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.242+0000 7f4414a73700 1 --2- 172.21.15.110:0/639675168 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44100b4100 0x7f4410149340 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:34.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.242+0000 7f4414a73700 1 -- 172.21.15.110:0/639675168 >> 172.21.15.110:0/639675168 conn(0x7f44100686f0 msgr2=0x7f4410068b00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:34.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.242+0000 7f4414a73700 1 -- 172.21.15.110:0/639675168 shutdown_connections 2021-03-25T14:17:34.247 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.242+0000 7f4414a73700 1 -- 172.21.15.110:0/639675168 wait complete. 2021-03-25T14:17:34.250 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.243+0000 7f4414a73700 1 Processor -- start 2021-03-25T14:17:34.250 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.243+0000 7f4414a73700 1 -- start start 2021-03-25T14:17:34.250 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.244+0000 7f4414a73700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44100b4100 0x7f441015ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:34.250 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.244+0000 7f4414a73700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44100b47a0 0x7f44100b7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:34.250 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.244+0000 7f4414a73700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44100be3a0 0x7f441014e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:34.250 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.244+0000 7f4414a73700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441014ebc0 con 0x7f44100b47a0 2021-03-25T14:17:34.250 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.244+0000 7f4414a73700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441014e920 con 0x7f44100be3a0 2021-03-25T14:17:34.250 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.244+0000 7f4414a73700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f441015c040 con 0x7f44100b4100 2021-03-25T14:17:34.251 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.244+0000 7f440dd9b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44100b47a0 0x7f44100b7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:34.251 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.244+0000 7f440dd9b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44100b47a0 0x7f44100b7510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50134/0 (socket says 172.21.15.110:50134) 2021-03-25T14:17:34.251 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.244+0000 7f440dd9b700 1 -- 172.21.15.110:0/1896593296 learned_addr learned my addr 172.21.15.110:0/1896593296 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:34.251 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.244+0000 7f440ed9d700 1 --2- 172.21.15.110:0/1896593296 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44100be3a0 0x7f441014e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:34.251 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.244+0000 7f440e59c700 1 --2- 172.21.15.110:0/1896593296 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44100b4100 0x7f441015ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:34.251 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.244+0000 7f440dd9b700 1 -- 172.21.15.110:0/1896593296 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44100b4100 msgr2=0x7f441015ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:34.251 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.244+0000 7f440dd9b700 1 --2- 172.21.15.110:0/1896593296 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44100b4100 0x7f441015ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:34.251 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.244+0000 7f440dd9b700 1 -- 172.21.15.110:0/1896593296 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44100be3a0 msgr2=0x7f441014e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:34.251 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.244+0000 7f440dd9b700 1 --2- 172.21.15.110:0/1896593296 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44100be3a0 0x7f441014e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:34.252 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.244+0000 7f440dd9b700 1 -- 172.21.15.110:0/1896593296 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f441015c2e0 con 0x7f44100b47a0 2021-03-25T14:17:34.252 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.244+0000 7f440dd9b700 1 --2- 172.21.15.110:0/1896593296 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44100b47a0 0x7f44100b7510 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f440000b1d0 tx=0x7f4400016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:34.252 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.244+0000 7f43fe7fc700 1 -- 172.21.15.110:0/1896593296 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4400011cf0 con 0x7f44100b47a0 2021-03-25T14:17:34.252 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.244+0000 7f43fe7fc700 1 -- 172.21.15.110:0/1896593296 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4400011e50 con 0x7f44100b47a0 2021-03-25T14:17:34.252 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.244+0000 7f4414a73700 1 -- 172.21.15.110:0/1896593296 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f441015c580 con 0x7f44100b47a0 2021-03-25T14:17:34.252 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.244+0000 7f43fe7fc700 1 -- 172.21.15.110:0/1896593296 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440001c630 con 0x7f44100b47a0 2021-03-25T14:17:34.252 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.244+0000 7f4414a73700 1 -- 172.21.15.110:0/1896593296 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f441014e540 con 0x7f44100b47a0 2021-03-25T14:17:34.252 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.245+0000 7f4414a73700 1 -- 172.21.15.110:0/1896593296 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f441015c710 con 0x7f44100b47a0 2021-03-25T14:17:34.252 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.246+0000 7f43fe7fc700 1 -- 172.21.15.110:0/1896593296 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f440000f070 con 0x7f44100b47a0 2021-03-25T14:17:34.252 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.246+0000 7f43fe7fc700 1 --2- 172.21.15.110:0/1896593296 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f43ec05a0b0 0x7f43ec05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:34.253 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.246+0000 7f43fe7fc700 1 -- 172.21.15.110:0/1896593296 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5778+0+0 (secure 0 0 0) 0x7f44000750c0 con 0x7f44100b47a0 2021-03-25T14:17:34.253 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.246+0000 7f440e59c700 1 --2- 172.21.15.110:0/1896593296 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f43ec05a0b0 0x7f43ec05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:34.253 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.246+0000 7f440e59c700 1 --2- 172.21.15.110:0/1896593296 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f43ec05a0b0 0x7f43ec05c570 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f4410064140 tx=0x7f4404008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:34.253 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.250+0000 7f43fe7fc700 1 -- 172.21.15.110:0/1896593296 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f440004c5b0 con 0x7f44100b47a0 2021-03-25T14:17:34.401 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.399+0000 7f4414a73700 1 -- 172.21.15.110:0/1896593296 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f441005d7b0 con 0x7f44100b47a0 2021-03-25T14:17:34.404 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.402+0000 7f43fe7fc700 1 -- 172.21.15.110:0/1896593296 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v3) v1 ==== 104+0+0 (secure 0 0 0) 0x7f440004c1a0 con 0x7f44100b47a0 2021-03-25T14:17:34.406 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.404+0000 7f4414a73700 1 -- 172.21.15.110:0/1896593296 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f43ec05a0b0 msgr2=0x7f43ec05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:34.406 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.404+0000 7f4414a73700 1 --2- 172.21.15.110:0/1896593296 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f43ec05a0b0 0x7f43ec05c570 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f4410064140 tx=0x7f4404008040).stop 2021-03-25T14:17:34.406 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.404+0000 7f4414a73700 1 -- 172.21.15.110:0/1896593296 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44100b47a0 msgr2=0x7f44100b7510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:34.406 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.404+0000 7f4414a73700 1 --2- 172.21.15.110:0/1896593296 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44100b47a0 0x7f44100b7510 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f440000b1d0 tx=0x7f4400016000).stop 2021-03-25T14:17:34.407 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.404+0000 7f4414a73700 1 -- 172.21.15.110:0/1896593296 shutdown_connections 2021-03-25T14:17:34.407 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.404+0000 7f4414a73700 1 --2- 172.21.15.110:0/1896593296 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f43ec05a0b0 0x7f43ec05c570 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:34.407 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.404+0000 7f4414a73700 1 --2- 172.21.15.110:0/1896593296 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44100be3a0 0x7f441014e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:34.407 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.404+0000 7f4414a73700 1 --2- 172.21.15.110:0/1896593296 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44100b4100 0x7f441015ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:34.407 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.404+0000 7f4414a73700 1 --2- 172.21.15.110:0/1896593296 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44100b47a0 0x7f44100b7510 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:34.407 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.404+0000 7f4414a73700 1 -- 172.21.15.110:0/1896593296 >> 172.21.15.110:0/1896593296 conn(0x7f44100686f0 msgr2=0x7f44100634c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:34.407 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.404+0000 7f4414a73700 1 -- 172.21.15.110:0/1896593296 shutdown_connections 2021-03-25T14:17:34.407 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.404+0000 7f4414a73700 1 -- 172.21.15.110:0/1896593296 wait complete. 2021-03-25T14:17:34.417 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2021-03-25T14:17:34.529 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.527+0000 7fe4abdf4700 1 Processor -- start 2021-03-25T14:17:34.530 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.528+0000 7fe4abdf4700 1 -- start start 2021-03-25T14:17:34.532 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.528+0000 7fe4abdf4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe4a40bbca0 0x7fe4a4067840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:34.533 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.528+0000 7fe4abdf4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe4a4068ac0 0x7fe4a40acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:34.533 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.528+0000 7fe4abdf4700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe4a40ad420 0x7fe4a4148fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:34.533 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.528+0000 7fe4abdf4700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a40ad890 con 0x7fe4a40ad420 2021-03-25T14:17:34.533 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.528+0000 7fe4abdf4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a40afee0 con 0x7fe4a40bbca0 2021-03-25T14:17:34.533 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.528+0000 7fe4abdf4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a4145b10 con 0x7fe4a4068ac0 2021-03-25T14:17:34.533 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.529+0000 7fe4aa391700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe4a40ad420 0x7fe4a4148fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:34.533 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.529+0000 7fe4aa391700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe4a40ad420 0x7fe4a4148fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50144/0 (socket says 172.21.15.110:50144) 2021-03-25T14:17:34.533 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.529+0000 7fe4aa391700 1 -- 172.21.15.110:0/3235073418 learned_addr learned my addr 172.21.15.110:0/3235073418 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:34.533 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.529+0000 7fe4a938f700 1 --2- 172.21.15.110:0/3235073418 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe4a4068ac0 0x7fe4a40acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:34.533 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.529+0000 7fe4a9b90700 1 --2- 172.21.15.110:0/3235073418 >> v2:172.21.15.174:3300/0 conn(0x7fe4a40bbca0 0x7fe4a4067840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:34.533 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.529+0000 7fe4aa391700 1 -- 172.21.15.110:0/3235073418 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe4a4068ac0 msgr2=0x7fe4a40acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:34.533 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.529+0000 7fe4aa391700 1 --2- 172.21.15.110:0/3235073418 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe4a4068ac0 0x7fe4a40acf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:34.533 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.529+0000 7fe4aa391700 1 -- 172.21.15.110:0/3235073418 >> v2:172.21.15.174:3300/0 conn(0x7fe4a40bbca0 msgr2=0x7fe4a4067840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:34.534 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.529+0000 7fe4aa391700 1 --2- 172.21.15.110:0/3235073418 >> v2:172.21.15.174:3300/0 conn(0x7fe4a40bbca0 0x7fe4a4067840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:34.534 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.529+0000 7fe4aa391700 1 -- 172.21.15.110:0/3235073418 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a4145d40 con 0x7fe4a40ad420 2021-03-25T14:17:34.534 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.529+0000 7fe4aa391700 1 --2- 172.21.15.110:0/3235073418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4a40ad420 0x7fe4a4148fd0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7fe4a4067140 tx=0x7fe49c0092d0).ready entity=mon.0 client_cookie=9e861223ee0c188e server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:34.534 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.529+0000 7fe4a8b8e700 1 -- 172.21.15.110:0/3235073418 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c00bc40 con 0x7fe4a40ad420 2021-03-25T14:17:34.534 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.529+0000 7fe4a8b8e700 1 -- 172.21.15.110:0/3235073418 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49c00bda0 con 0x7fe4a40ad420 2021-03-25T14:17:34.534 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.529+0000 7fe4a8b8e700 1 -- 172.21.15.110:0/3235073418 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c011610 con 0x7fe4a40ad420 2021-03-25T14:17:34.534 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.530+0000 7fe4abdf4700 1 -- 172.21.15.110:0/3235073418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4a40ad420 msgr2=0x7fe4a4148fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:34.534 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.530+0000 7fe4abdf4700 1 --2- 172.21.15.110:0/3235073418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4a40ad420 0x7fe4a4148fd0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7fe4a4067140 tx=0x7fe49c0092d0).stop 2021-03-25T14:17:34.534 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.530+0000 7fe4abdf4700 1 -- 172.21.15.110:0/3235073418 shutdown_connections 2021-03-25T14:17:34.534 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.530+0000 7fe4abdf4700 1 --2- 172.21.15.110:0/3235073418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4a40ad420 0x7fe4a4148fd0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:34.534 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.530+0000 7fe4abdf4700 1 --2- 172.21.15.110:0/3235073418 >> v2:172.21.15.174:3300/0 conn(0x7fe4a40bbca0 0x7fe4a4067840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:34.535 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.530+0000 7fe4abdf4700 1 --2- 172.21.15.110:0/3235073418 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe4a4068ac0 0x7fe4a40acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:34.535 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.530+0000 7fe4abdf4700 1 -- 172.21.15.110:0/3235073418 >> 172.21.15.110:0/3235073418 conn(0x7fe4a4063850 msgr2=0x7fe4a405c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:34.535 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.530+0000 7fe4abdf4700 1 -- 172.21.15.110:0/3235073418 shutdown_connections 2021-03-25T14:17:34.535 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.530+0000 7fe4abdf4700 1 -- 172.21.15.110:0/3235073418 wait complete. 2021-03-25T14:17:34.535 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.531+0000 7fe4abdf4700 1 Processor -- start 2021-03-25T14:17:34.535 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.531+0000 7fe4abdf4700 1 -- start start 2021-03-25T14:17:34.537 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.532+0000 7fe4abdf4700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4a4068ac0 0x7fe4a4133760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:34.537 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.532+0000 7fe4abdf4700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4a40ad420 0x7fe4a4130250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:34.538 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.532+0000 7fe4abdf4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe4a40bbca0 0x7fe4a4130740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:34.538 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.532+0000 7fe4abdf4700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a41343b0 con 0x7fe4a40ad420 2021-03-25T14:17:34.538 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.532+0000 7fe4abdf4700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a4159bd0 con 0x7fe4a4068ac0 2021-03-25T14:17:34.538 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.532+0000 7fe4abdf4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a4159e70 con 0x7fe4a40bbca0 2021-03-25T14:17:34.538 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.532+0000 7fe4a938f700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4a40ad420 0x7fe4a4130250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:34.538 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.532+0000 7fe4a938f700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4a40ad420 0x7fe4a4130250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50148/0 (socket says 172.21.15.110:50148) 2021-03-25T14:17:34.538 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.532+0000 7fe4a938f700 1 -- 172.21.15.110:0/141006867 learned_addr learned my addr 172.21.15.110:0/141006867 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:34.538 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.532+0000 7fe4a938f700 1 -- 172.21.15.110:0/141006867 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe4a40bbca0 msgr2=0x7fe4a4130740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:34.538 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.532+0000 7fe4a938f700 1 --2- 172.21.15.110:0/141006867 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe4a40bbca0 0x7fe4a4130740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:34.538 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.532+0000 7fe4a9b90700 1 --2- 172.21.15.110:0/141006867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4a4068ac0 0x7fe4a4133760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:34.539 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.532+0000 7fe4a938f700 1 -- 172.21.15.110:0/141006867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4a4068ac0 msgr2=0x7fe4a4133760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:34.539 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.532+0000 7fe4a938f700 1 --2- 172.21.15.110:0/141006867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4a4068ac0 0x7fe4a4133760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:34.539 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.532+0000 7fe4a938f700 1 -- 172.21.15.110:0/141006867 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a415a110 con 0x7fe4a40ad420 2021-03-25T14:17:34.539 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.532+0000 7fe4a938f700 1 --2- 172.21.15.110:0/141006867 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4a40ad420 0x7fe4a4130250 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7fe49400db60 tx=0x7fe494008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:34.539 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.532+0000 7fe491ffb700 1 -- 172.21.15.110:0/141006867 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe494009820 con 0x7fe4a40ad420 2021-03-25T14:17:34.539 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.532+0000 7fe491ffb700 1 -- 172.21.15.110:0/141006867 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe494009980 con 0x7fe4a40ad420 2021-03-25T14:17:34.539 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.532+0000 7fe4abdf4700 1 -- 172.21.15.110:0/141006867 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a415a3b0 con 0x7fe4a40ad420 2021-03-25T14:17:34.539 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.532+0000 7fe491ffb700 1 -- 172.21.15.110:0/141006867 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe494009d00 con 0x7fe4a40ad420 2021-03-25T14:17:34.539 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.533+0000 7fe4abdf4700 1 -- 172.21.15.110:0/141006867 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a414aad0 con 0x7fe4a40ad420 2021-03-25T14:17:34.539 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.533+0000 7fe4abdf4700 1 -- 172.21.15.110:0/141006867 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a405d7b0 con 0x7fe4a40ad420 2021-03-25T14:17:34.539 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.533+0000 7fe491ffb700 1 -- 172.21.15.110:0/141006867 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fe494013690 con 0x7fe4a40ad420 2021-03-25T14:17:34.539 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.534+0000 7fe491ffb700 1 --2- 172.21.15.110:0/141006867 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe48405a0b0 0x7fe48405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:34.539 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.534+0000 7fe491ffb700 1 -- 172.21.15.110:0/141006867 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5778+0+0 (secure 0 0 0) 0x7fe494074030 con 0x7fe4a40ad420 2021-03-25T14:17:34.540 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.534+0000 7fe4a9b90700 1 --2- 172.21.15.110:0/141006867 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe48405a0b0 0x7fe48405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:34.540 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.534+0000 7fe4a9b90700 1 --2- 172.21.15.110:0/141006867 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe48405a0b0 0x7fe48405c570 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fe4a0006fd0 tx=0x7fe4a0008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:34.540 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.537+0000 7fe491ffb700 1 -- 172.21.15.110:0/141006867 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fe494047af0 con 0x7fe4a40ad420 2021-03-25T14:17:34.746 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:34.745+0000 7fe4abdf4700 1 -- 172.21.15.110:0/141006867 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7fe4a40bc980 con 0x7fe4a40ad420 2021-03-25T14:17:35.110 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.108+0000 7fe491ffb700 1 -- 172.21.15.110:0/141006867 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v98) v1 ==== 159+0+0 (secure 0 0 0) 0x7fe494009e60 con 0x7fe4a40ad420 2021-03-25T14:17:35.113 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.110+0000 7fe4abdf4700 1 -- 172.21.15.110:0/141006867 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe48405a0b0 msgr2=0x7fe48405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:35.113 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.110+0000 7fe4abdf4700 1 --2- 172.21.15.110:0/141006867 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe48405a0b0 0x7fe48405c570 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fe4a0006fd0 tx=0x7fe4a0008040).stop 2021-03-25T14:17:35.113 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.110+0000 7fe4abdf4700 1 -- 172.21.15.110:0/141006867 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4a40ad420 msgr2=0x7fe4a4130250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:35.113 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.110+0000 7fe4abdf4700 1 --2- 172.21.15.110:0/141006867 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4a40ad420 0x7fe4a4130250 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7fe49400db60 tx=0x7fe494008040).stop 2021-03-25T14:17:35.114 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.111+0000 7fe4abdf4700 1 -- 172.21.15.110:0/141006867 shutdown_connections 2021-03-25T14:17:35.114 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.111+0000 7fe4abdf4700 1 --2- 172.21.15.110:0/141006867 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe48405a0b0 0x7fe48405c570 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:35.114 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.111+0000 7fe4abdf4700 1 --2- 172.21.15.110:0/141006867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4a4068ac0 0x7fe4a4133760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:35.114 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.111+0000 7fe4abdf4700 1 --2- 172.21.15.110:0/141006867 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe4a40bbca0 0x7fe4a4130740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:35.114 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.111+0000 7fe4abdf4700 1 --2- 172.21.15.110:0/141006867 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4a40ad420 0x7fe4a4130250 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:35.114 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.111+0000 7fe4abdf4700 1 -- 172.21.15.110:0/141006867 >> 172.21.15.110:0/141006867 conn(0x7fe4a4063850 msgr2=0x7fe4a40b9750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:35.114 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.111+0000 7fe4abdf4700 1 -- 172.21.15.110:0/141006867 shutdown_connections 2021-03-25T14:17:35.114 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.111+0000 7fe4abdf4700 1 -- 172.21.15.110:0/141006867 wait complete. 2021-03-25T14:17:35.124 INFO:tasks.cephfs_test_runner:test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) ... ok 2021-03-25T14:17:35.125 INFO:tasks.cephfs_test_runner:Starting test: test_mount_mon_and_osd_caps_present_mds_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2021-03-25T14:17:35.125 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent' 2021-03-25T14:17:35.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.234+0000 7f447ae4a700 1 Processor -- start 2021-03-25T14:17:35.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.234+0000 7f447ae4a700 1 -- start start 2021-03-25T14:17:35.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.235+0000 7f447ae4a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44740bcd90 0x7f447414d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:35.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.235+0000 7f447ae4a700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f44740b1340 0x7f4474060c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:35.246 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.235+0000 7f447ae4a700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44740b9140 con 0x7f44740b7620 2021-03-25T14:17:35.247 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.235+0000 7f447ae4a700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44740692a0 con 0x7f44740b1340 2021-03-25T14:17:35.247 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.235+0000 7f447ae4a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44740b93e0 con 0x7f44740bcd90 2021-03-25T14:17:35.247 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.235+0000 7f4473fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f44740b1340 0x7f4474060c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:35.247 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.235+0000 7f4473fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f44740b1340 0x7f4474060c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50154/0 (socket says 172.21.15.110:50154) 2021-03-25T14:17:35.247 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.235+0000 7f4473fff700 1 -- 172.21.15.110:0/2708909782 learned_addr learned my addr 172.21.15.110:0/2708909782 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:35.248 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.235+0000 7f4473fff700 1 -- 172.21.15.110:0/2708909782 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44740bcd90 msgr2=0x7f447414d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:35.248 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.235+0000 7f4473fff700 1 --2- 172.21.15.110:0/2708909782 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44740bcd90 0x7f447414d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:35.248 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.235+0000 7f4473fff700 1 -- 172.21.15.110:0/2708909782 >> v1:172.21.15.110:6789/0 conn(0x7f44740b7620 legacy=0x7f4474148ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:35.248 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.235+0000 7f4473fff700 1 -- 172.21.15.110:0/2708909782 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f447414cda0 con 0x7f44740b1340 2021-03-25T14:17:35.248 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.235+0000 7f44737fe700 1 -- 172.21.15.110:0/2708909782 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 639845179 0 0) 0x7f44740b9140 con 0x7f44740b7620 2021-03-25T14:17:35.248 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.235+0000 7f4473fff700 1 --2- 172.21.15.110:0/2708909782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44740b1340 0x7f4474060c40 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f446000ba20 tx=0x7f4460006ee0).ready entity=mon.0 client_cookie=ab97e652d4c7ca32 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:35.249 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.235+0000 7f44737fe700 1 -- 172.21.15.110:0/2708909782 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4460009840 con 0x7f44740b1340 2021-03-25T14:17:35.249 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.235+0000 7f44737fe700 1 -- 172.21.15.110:0/2708909782 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44600099a0 con 0x7f44740b1340 2021-03-25T14:17:35.249 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.235+0000 7f44737fe700 1 -- 172.21.15.110:0/2708909782 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4460009d20 con 0x7f44740b1340 2021-03-25T14:17:35.249 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.236+0000 7f447ae4a700 1 -- 172.21.15.110:0/2708909782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44740b1340 msgr2=0x7f4474060c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:35.249 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.236+0000 7f447ae4a700 1 --2- 172.21.15.110:0/2708909782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44740b1340 0x7f4474060c40 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f446000ba20 tx=0x7f4460006ee0).stop 2021-03-25T14:17:35.250 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.236+0000 7f447ae4a700 1 -- 172.21.15.110:0/2708909782 shutdown_connections 2021-03-25T14:17:35.250 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.236+0000 7f447ae4a700 1 --2- 172.21.15.110:0/2708909782 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44740bcd90 0x7f447414d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:35.250 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.236+0000 7f447ae4a700 1 --2- 172.21.15.110:0/2708909782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44740b1340 0x7f4474060c40 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:35.250 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.236+0000 7f447ae4a700 1 -- 172.21.15.110:0/2708909782 >> 172.21.15.110:0/2708909782 conn(0x7f4474063720 msgr2=0x7f4474063b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:35.250 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.236+0000 7f447ae4a700 1 -- 172.21.15.110:0/2708909782 shutdown_connections 2021-03-25T14:17:35.250 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.236+0000 7f447ae4a700 1 -- 172.21.15.110:0/2708909782 wait complete. 2021-03-25T14:17:35.251 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.237+0000 7f447ae4a700 1 Processor -- start 2021-03-25T14:17:35.251 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.237+0000 7f447ae4a700 1 -- start start 2021-03-25T14:17:35.251 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.238+0000 7f447ae4a700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44740b1340 0x7f44740b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:35.251 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.238+0000 7f447ae4a700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44740b7620 0x7f44740615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:35.252 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.238+0000 7f447ae4a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44740bcd90 0x7f44740b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:35.252 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.238+0000 7f447ae4a700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44740b6590 con 0x7f44740b1340 2021-03-25T14:17:35.252 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.238+0000 7f447ae4a700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44740b4130 con 0x7f44740b7620 2021-03-25T14:17:35.252 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.238+0000 7f447ae4a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44740b43d0 con 0x7f44740bcd90 2021-03-25T14:17:35.253 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.238+0000 7f4478be6700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44740b1340 0x7f44740b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:35.253 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.238+0000 7f4478be6700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44740b1340 0x7f44740b1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50160/0 (socket says 172.21.15.110:50160) 2021-03-25T14:17:35.253 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.238+0000 7f4478be6700 1 -- 172.21.15.110:0/1628518763 learned_addr learned my addr 172.21.15.110:0/1628518763 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:35.253 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.238+0000 7f44793e7700 1 --2- 172.21.15.110:0/1628518763 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44740bcd90 0x7f44740b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:35.253 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.238+0000 7f4473fff700 1 --2- 172.21.15.110:0/1628518763 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44740b7620 0x7f44740615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:35.253 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.238+0000 7f4478be6700 1 -- 172.21.15.110:0/1628518763 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44740bcd90 msgr2=0x7f44740b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:35.254 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.238+0000 7f4478be6700 1 --2- 172.21.15.110:0/1628518763 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44740bcd90 0x7f44740b2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:35.254 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.238+0000 7f4478be6700 1 -- 172.21.15.110:0/1628518763 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44740b7620 msgr2=0x7f44740615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:35.254 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.238+0000 7f4478be6700 1 --2- 172.21.15.110:0/1628518763 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44740b7620 0x7f44740615e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:35.254 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.238+0000 7f4478be6700 1 -- 172.21.15.110:0/1628518763 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44740b17e0 con 0x7f44740b1340 2021-03-25T14:17:35.255 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.238+0000 7f4473fff700 1 --2- 172.21.15.110:0/1628518763 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44740b7620 0x7f44740615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:17:35.255 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.238+0000 7f4478be6700 1 --2- 172.21.15.110:0/1628518763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44740b1340 0x7f44740b1f20 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f446800b8b0 tx=0x7f4468006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:35.255 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.238+0000 7f4470ff9700 1 -- 172.21.15.110:0/1628518763 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446800d680 con 0x7f44740b1340 2021-03-25T14:17:35.255 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.238+0000 7f4470ff9700 1 -- 172.21.15.110:0/1628518763 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f446800d800 con 0x7f44740b1340 2021-03-25T14:17:35.255 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.238+0000 7f4470ff9700 1 -- 172.21.15.110:0/1628518763 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446800dbc0 con 0x7f44740b1340 2021-03-25T14:17:35.255 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.238+0000 7f447ae4a700 1 -- 172.21.15.110:0/1628518763 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44740b1a80 con 0x7f44740b1340 2021-03-25T14:17:35.256 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.238+0000 7f447ae4a700 1 -- 172.21.15.110:0/1628518763 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4474061ad0 con 0x7f44740b1340 2021-03-25T14:17:35.256 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.239+0000 7f447ae4a700 1 -- 172.21.15.110:0/1628518763 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44740b1c10 con 0x7f44740b1340 2021-03-25T14:17:35.256 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.240+0000 7f4470ff9700 1 -- 172.21.15.110:0/1628518763 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f4468018460 con 0x7f44740b1340 2021-03-25T14:17:35.256 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.240+0000 7f4470ff9700 1 --2- 172.21.15.110:0/1628518763 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f445405a0b0 0x7f445405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:35.256 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.240+0000 7f4470ff9700 1 -- 172.21.15.110:0/1628518763 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5778+0+0 (secure 0 0 0) 0x7f44680739a0 con 0x7f44740b1340 2021-03-25T14:17:35.256 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.240+0000 7f4473fff700 1 --2- 172.21.15.110:0/1628518763 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f445405a0b0 0x7f445405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:35.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.240+0000 7f4473fff700 1 --2- 172.21.15.110:0/1628518763 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f445405a0b0 0x7f445405c570 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f446000ba20 tx=0x7f4460016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:35.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.244+0000 7f4470ff9700 1 -- 172.21.15.110:0/1628518763 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f4468047400 con 0x7f44740b1340 2021-03-25T14:17:35.452 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:35.450+0000 7f447ae4a700 1 -- 172.21.15.110:0/1628518763 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]} v 0) v1 -- 0x7f447405d7b0 con 0x7f44740b1340 2021-03-25T14:17:36.118 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.116+0000 7f4470ff9700 1 -- 172.21.15.110:0/1628518763 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]}]=0 v99) v1 ==== 187+0+0 (secure 0 0 0) 0x7f446804aa20 con 0x7f44740b1340 2021-03-25T14:17:36.120 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.118+0000 7f447ae4a700 1 -- 172.21.15.110:0/1628518763 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f445405a0b0 msgr2=0x7f445405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:36.120 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.118+0000 7f447ae4a700 1 --2- 172.21.15.110:0/1628518763 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f445405a0b0 0x7f445405c570 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f446000ba20 tx=0x7f4460016000).stop 2021-03-25T14:17:36.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.118+0000 7f447ae4a700 1 -- 172.21.15.110:0/1628518763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44740b1340 msgr2=0x7f44740b1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:36.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.118+0000 7f447ae4a700 1 --2- 172.21.15.110:0/1628518763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44740b1340 0x7f44740b1f20 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f446800b8b0 tx=0x7f4468006ef0).stop 2021-03-25T14:17:36.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.118+0000 7f447ae4a700 1 -- 172.21.15.110:0/1628518763 shutdown_connections 2021-03-25T14:17:36.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.118+0000 7f447ae4a700 1 --2- 172.21.15.110:0/1628518763 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f445405a0b0 0x7f445405c570 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:36.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.118+0000 7f447ae4a700 1 --2- 172.21.15.110:0/1628518763 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44740bcd90 0x7f44740b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:36.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.118+0000 7f447ae4a700 1 --2- 172.21.15.110:0/1628518763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44740b1340 0x7f44740b1f20 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:36.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.118+0000 7f447ae4a700 1 --2- 172.21.15.110:0/1628518763 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44740b7620 0x7f44740615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:36.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.118+0000 7f447ae4a700 1 -- 172.21.15.110:0/1628518763 >> 172.21.15.110:0/1628518763 conn(0x7f4474063720 msgr2=0x7f4474062610 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:36.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.118+0000 7f447ae4a700 1 -- 172.21.15.110:0/1628518763 shutdown_connections 2021-03-25T14:17:36.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.118+0000 7f447ae4a700 1 -- 172.21.15.110:0/1628518763 wait complete. 2021-03-25T14:17:36.134 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-03-25T14:17:36.253 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.251+0000 7f299338b700 1 Processor -- start 2021-03-25T14:17:36.253 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.251+0000 7f299338b700 1 -- start start 2021-03-25T14:17:36.255 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.252+0000 7f299338b700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f298c060e00 0x7f298c0a2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:36.255 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.252+0000 7f299338b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f298c068440 0x7f298c14da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:36.255 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.252+0000 7f299338b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f298c0b6c90 con 0x7f298c149970 2021-03-25T14:17:36.256 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.252+0000 7f299338b700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f298c068ca0 con 0x7f298c060e00 2021-03-25T14:17:36.256 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.252+0000 7f299338b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f298c0a2d40 con 0x7f298c068440 2021-03-25T14:17:36.256 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.252+0000 7f2991127700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f298c060e00 0x7f298c0a2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:36.256 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.252+0000 7f2991127700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f298c060e00 0x7f298c0a2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50170/0 (socket says 172.21.15.110:50170) 2021-03-25T14:17:36.256 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.252+0000 7f2991127700 1 -- 172.21.15.110:0/2044769722 learned_addr learned my addr 172.21.15.110:0/2044769722 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:36.256 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.252+0000 7f2990926700 1 --2- 172.21.15.110:0/2044769722 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f298c068440 0x7f298c14da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:36.256 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.252+0000 7f2991127700 1 -- 172.21.15.110:0/2044769722 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f298c068440 msgr2=0x7f298c14da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:36.256 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.252+0000 7f2991127700 1 --2- 172.21.15.110:0/2044769722 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f298c068440 0x7f298c14da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:36.256 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.252+0000 7f2991127700 1 -- 172.21.15.110:0/2044769722 >> v1:172.21.15.174:6789/0 conn(0x7f298c149970 legacy=0x7f298c1434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:36.256 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.252+0000 7f2991127700 1 -- 172.21.15.110:0/2044769722 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f298c0a2fe0 con 0x7f298c060e00 2021-03-25T14:17:36.256 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.252+0000 7f2991127700 1 --2- 172.21.15.110:0/2044769722 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f298c060e00 0x7f298c0a2710 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f298800ba20 tx=0x7f2988006ee0).ready entity=mon.0 client_cookie=7e322ea4a861b463 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:36.256 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.252+0000 7f297bfff700 1 -- 172.21.15.110:0/2044769722 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29880098d0 con 0x7f298c060e00 2021-03-25T14:17:36.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.252+0000 7f297bfff700 1 -- 172.21.15.110:0/2044769722 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2988009a30 con 0x7f298c060e00 2021-03-25T14:17:36.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.252+0000 7f297bfff700 1 -- 172.21.15.110:0/2044769722 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2988009db0 con 0x7f298c060e00 2021-03-25T14:17:36.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.253+0000 7f299338b700 1 -- 172.21.15.110:0/2044769722 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f298c060e00 msgr2=0x7f298c0a2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:36.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.253+0000 7f299338b700 1 --2- 172.21.15.110:0/2044769722 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f298c060e00 0x7f298c0a2710 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f298800ba20 tx=0x7f2988006ee0).stop 2021-03-25T14:17:36.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.253+0000 7f299338b700 1 -- 172.21.15.110:0/2044769722 shutdown_connections 2021-03-25T14:17:36.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.253+0000 7f299338b700 1 --2- 172.21.15.110:0/2044769722 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f298c060e00 0x7f298c0a2710 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:36.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.253+0000 7f299338b700 1 --2- 172.21.15.110:0/2044769722 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f298c068440 0x7f298c14da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:36.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.253+0000 7f299338b700 1 -- 172.21.15.110:0/2044769722 >> 172.21.15.110:0/2044769722 conn(0x7f298c061d50 msgr2=0x7f298c062160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:36.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.253+0000 7f299338b700 1 -- 172.21.15.110:0/2044769722 shutdown_connections 2021-03-25T14:17:36.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.253+0000 7f299338b700 1 -- 172.21.15.110:0/2044769722 wait complete. 2021-03-25T14:17:36.260 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.254+0000 7f299338b700 1 Processor -- start 2021-03-25T14:17:36.260 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.254+0000 7f299338b700 1 -- start start 2021-03-25T14:17:36.261 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.255+0000 7f299338b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f298c060e00 0x7f298c140ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:36.261 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.255+0000 7f299338b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f298c068440 0x7f298c141820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:36.261 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.255+0000 7f299338b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f298c149970 0x7f298c159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:36.261 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.255+0000 7f299338b700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298c1592c0 con 0x7f298c060e00 2021-03-25T14:17:36.261 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.255+0000 7f299338b700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298c141d10 con 0x7f298c068440 2021-03-25T14:17:36.261 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.255+0000 7f299338b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f298c140200 con 0x7f298c149970 2021-03-25T14:17:36.261 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.255+0000 7f2991127700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f298c060e00 0x7f298c140ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:36.261 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.255+0000 7f2991127700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f298c060e00 0x7f298c140ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50176/0 (socket says 172.21.15.110:50176) 2021-03-25T14:17:36.261 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.255+0000 7f2991127700 1 -- 172.21.15.110:0/2255728207 learned_addr learned my addr 172.21.15.110:0/2255728207 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:36.261 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.255+0000 7f2990926700 1 --2- 172.21.15.110:0/2255728207 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f298c068440 0x7f298c141820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:36.261 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.255+0000 7f2991928700 1 --2- 172.21.15.110:0/2255728207 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f298c149970 0x7f298c159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:36.262 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.255+0000 7f2991127700 1 -- 172.21.15.110:0/2255728207 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f298c149970 msgr2=0x7f298c159bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:36.262 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.255+0000 7f2991127700 1 --2- 172.21.15.110:0/2255728207 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f298c149970 0x7f298c159bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:36.262 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.255+0000 7f2991127700 1 -- 172.21.15.110:0/2255728207 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f298c068440 msgr2=0x7f298c141820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:36.262 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.255+0000 7f2991127700 1 --2- 172.21.15.110:0/2255728207 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f298c068440 0x7f298c141820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:36.262 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.255+0000 7f2991127700 1 -- 172.21.15.110:0/2255728207 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f298c1404a0 con 0x7f298c060e00 2021-03-25T14:17:36.262 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.255+0000 7f2991127700 1 --2- 172.21.15.110:0/2255728207 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f298c060e00 0x7f298c140ad0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f29880093a0 tx=0x7f2988016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:36.262 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.255+0000 7f29797fa700 1 -- 172.21.15.110:0/2255728207 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29880098d0 con 0x7f298c060e00 2021-03-25T14:17:36.262 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.256+0000 7f29797fa700 1 -- 172.21.15.110:0/2255728207 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298801c420 con 0x7f298c060e00 2021-03-25T14:17:36.262 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.256+0000 7f299338b700 1 -- 172.21.15.110:0/2255728207 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f298c1594b0 con 0x7f298c060e00 2021-03-25T14:17:36.262 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.256+0000 7f29797fa700 1 -- 172.21.15.110:0/2255728207 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298801c7a0 con 0x7f298c060e00 2021-03-25T14:17:36.262 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.256+0000 7f299338b700 1 -- 172.21.15.110:0/2255728207 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f298c15a0e0 con 0x7f298c060e00 2021-03-25T14:17:36.262 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.256+0000 7f299338b700 1 -- 172.21.15.110:0/2255728207 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f298c159910 con 0x7f298c060e00 2021-03-25T14:17:36.263 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.257+0000 7f29797fa700 1 -- 172.21.15.110:0/2255728207 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f298800f070 con 0x7f298c060e00 2021-03-25T14:17:36.263 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.257+0000 7f29797fa700 1 --2- 172.21.15.110:0/2255728207 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f296c05a0b0 0x7f296c05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:36.263 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.257+0000 7f29797fa700 1 -- 172.21.15.110:0/2255728207 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5778+0+0 (secure 0 0 0) 0x7f2988075360 con 0x7f298c060e00 2021-03-25T14:17:36.263 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.257+0000 7f2990926700 1 --2- 172.21.15.110:0/2255728207 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f296c05a0b0 0x7f296c05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:36.263 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.258+0000 7f2990926700 1 --2- 172.21.15.110:0/2255728207 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f296c05a0b0 0x7f296c05c570 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f297c006fd0 tx=0x7f297c008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:36.263 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.261+0000 7f29797fa700 1 -- 172.21.15.110:0/2255728207 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f2988048e20 con 0x7f298c060e00 2021-03-25T14:17:36.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.411+0000 7f299338b700 1 -- 172.21.15.110:0/2255728207 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f298c0a2950 con 0x7f298c060e00 2021-03-25T14:17:36.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.415+0000 7f29797fa700 1 -- 172.21.15.110:0/2255728207 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v4)=0 v4) v1 ==== 122+0+0 (secure 0 0 0) 0x7f298804c440 con 0x7f298c060e00 2021-03-25T14:17:36.420 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.416+0000 7f299338b700 1 -- 172.21.15.110:0/2255728207 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f296c05a0b0 msgr2=0x7f296c05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:36.420 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.416+0000 7f299338b700 1 --2- 172.21.15.110:0/2255728207 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f296c05a0b0 0x7f296c05c570 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f297c006fd0 tx=0x7f297c008040).stop 2021-03-25T14:17:36.420 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.416+0000 7f299338b700 1 -- 172.21.15.110:0/2255728207 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f298c060e00 msgr2=0x7f298c140ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:36.420 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.416+0000 7f299338b700 1 --2- 172.21.15.110:0/2255728207 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f298c060e00 0x7f298c140ad0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f29880093a0 tx=0x7f2988016000).stop 2021-03-25T14:17:36.420 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.416+0000 7f299338b700 1 -- 172.21.15.110:0/2255728207 shutdown_connections 2021-03-25T14:17:36.421 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.416+0000 7f299338b700 1 --2- 172.21.15.110:0/2255728207 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f296c05a0b0 0x7f296c05c570 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:36.421 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.417+0000 7f299338b700 1 --2- 172.21.15.110:0/2255728207 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f298c149970 0x7f298c159bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:36.421 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.417+0000 7f299338b700 1 --2- 172.21.15.110:0/2255728207 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f298c060e00 0x7f298c140ad0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:36.421 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.417+0000 7f299338b700 1 --2- 172.21.15.110:0/2255728207 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f298c068440 0x7f298c141820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:36.421 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.417+0000 7f299338b700 1 -- 172.21.15.110:0/2255728207 >> 172.21.15.110:0/2255728207 conn(0x7f298c061d50 msgr2=0x7f298c149e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:36.421 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.417+0000 7f299338b700 1 -- 172.21.15.110:0/2255728207 shutdown_connections 2021-03-25T14:17:36.421 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.417+0000 7f299338b700 1 -- 172.21.15.110:0/2255728207 wait complete. 2021-03-25T14:17:36.431 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-03-25T14:17:36.431 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-03-25T14:17:36.460 DEBUG:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-03-25T14:17:36.506 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-03-25T14:17:36.507 INFO:tasks.cephfs.cephfs_test_case:[, ] 2021-03-25T14:17:36.507 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-03-25T14:17:36.619 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.617+0000 7fc8fa4fc700 1 Processor -- start 2021-03-25T14:17:36.619 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.617+0000 7fc8fa4fc700 1 -- start start 2021-03-25T14:17:36.621 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.617+0000 7fc8fa4fc700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc8f40c09d0 0x7fc8f4068d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:36.621 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.617+0000 7fc8fa4fc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc8f414d580 0x7fc8f4149a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:36.621 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.618+0000 7fc8fa4fc700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8f40b75b0 con 0x7fc8f40672a0 2021-03-25T14:17:36.621 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.618+0000 7fc8fa4fc700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f4068820 con 0x7fc8f40c09d0 2021-03-25T14:17:36.621 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.618+0000 7fc8fa4fc700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f4069210 con 0x7fc8f414d580 2021-03-25T14:17:36.621 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.618+0000 7fc8f8cf9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc8f40c09d0 0x7fc8f4068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:36.622 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.618+0000 7fc8f8cf9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc8f40c09d0 0x7fc8f4068d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.110:48838/0 (socket says 172.21.15.110:48838) 2021-03-25T14:17:36.622 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.618+0000 7fc8f94fa700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fc8f40672a0 0x7fc8f414ce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.110:50786/0 (socket says 172.21.15.110:50786) 2021-03-25T14:17:36.622 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.618+0000 7fc8f8cf9700 1 -- 172.21.15.110:0/3433028678 learned_addr learned my addr 172.21.15.110:0/3433028678 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:36.622 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.618+0000 7fc8f9cfb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc8f414d580 0x7fc8f4149a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:36.622 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.618+0000 7fc8f8cf9700 1 -- 172.21.15.110:0/3433028678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc8f414d580 msgr2=0x7fc8f4149a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:36.622 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.618+0000 7fc8f8cf9700 1 --2- 172.21.15.110:0/3433028678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc8f414d580 0x7fc8f4149a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:36.622 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.618+0000 7fc8f8cf9700 1 -- 172.21.15.110:0/3433028678 >> v1:172.21.15.174:6789/0 conn(0x7fc8f40672a0 legacy=0x7fc8f414ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:36.622 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.618+0000 7fc8f8cf9700 1 -- 172.21.15.110:0/3433028678 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f4069430 con 0x7fc8f40c09d0 2021-03-25T14:17:36.622 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.618+0000 7fc8f9cfb700 1 --2- 172.21.15.110:0/3433028678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc8f414d580 0x7fc8f4149a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:17:36.622 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.618+0000 7fc8f8cf9700 1 --2- 172.21.15.110:0/3433028678 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8f40c09d0 0x7fc8f4068d20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fc8e400ba50 tx=0x7fc8e4006ee0).ready entity=mon.1 client_cookie=9a02995c593d13c2 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:36.623 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.619+0000 7fc8e3fff700 1 -- 172.21.15.110:0/3433028678 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e4009890 con 0x7fc8f40c09d0 2021-03-25T14:17:36.623 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.619+0000 7fc8e3fff700 1 -- 172.21.15.110:0/3433028678 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e40099f0 con 0x7fc8f40c09d0 2021-03-25T14:17:36.623 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.619+0000 7fc8e3fff700 1 -- 172.21.15.110:0/3433028678 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e4009d70 con 0x7fc8f40c09d0 2021-03-25T14:17:36.623 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.619+0000 7fc8fa4fc700 1 -- 172.21.15.110:0/3433028678 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8f40c09d0 msgr2=0x7fc8f4068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:36.623 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.619+0000 7fc8fa4fc700 1 --2- 172.21.15.110:0/3433028678 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8f40c09d0 0x7fc8f4068d20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fc8e400ba50 tx=0x7fc8e4006ee0).stop 2021-03-25T14:17:36.623 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.619+0000 7fc8fa4fc700 1 -- 172.21.15.110:0/3433028678 shutdown_connections 2021-03-25T14:17:36.623 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.619+0000 7fc8fa4fc700 1 --2- 172.21.15.110:0/3433028678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc8f414d580 0x7fc8f4149a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:36.623 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.619+0000 7fc8fa4fc700 1 --2- 172.21.15.110:0/3433028678 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8f40c09d0 0x7fc8f4068d20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:36.623 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.619+0000 7fc8fa4fc700 1 -- 172.21.15.110:0/3433028678 >> 172.21.15.110:0/3433028678 conn(0x7fc8f40633a0 msgr2=0x7fc8f40663e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:36.623 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.619+0000 7fc8fa4fc700 1 -- 172.21.15.110:0/3433028678 shutdown_connections 2021-03-25T14:17:36.624 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.619+0000 7fc8fa4fc700 1 -- 172.21.15.110:0/3433028678 wait complete. 2021-03-25T14:17:36.626 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.620+0000 7fc8fa4fc700 1 Processor -- start 2021-03-25T14:17:36.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.620+0000 7fc8fa4fc700 1 -- start start 2021-03-25T14:17:36.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.621+0000 7fc8fa4fc700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8f40672a0 0x7fc8f4147ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:36.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.621+0000 7fc8fa4fc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8f40c09d0 0x7fc8f4159500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:36.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.621+0000 7fc8fa4fc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc8f414d580 0x7fc8f41599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:36.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.621+0000 7fc8fa4fc700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f4158e70 con 0x7fc8f40c09d0 2021-03-25T14:17:36.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.621+0000 7fc8fa4fc700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f40b19b0 con 0x7fc8f40672a0 2021-03-25T14:17:36.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.621+0000 7fc8fa4fc700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f40b1c50 con 0x7fc8f414d580 2021-03-25T14:17:36.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.621+0000 7fc8f8cf9700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8f40c09d0 0x7fc8f4159500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:36.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.621+0000 7fc8f8cf9700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8f40c09d0 0x7fc8f4159500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50190/0 (socket says 172.21.15.110:50190) 2021-03-25T14:17:36.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.621+0000 7fc8f8cf9700 1 -- 172.21.15.110:0/167853799 learned_addr learned my addr 172.21.15.110:0/167853799 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:36.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.621+0000 7fc8f9cfb700 1 --2- 172.21.15.110:0/167853799 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc8f414d580 0x7fc8f41599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:36.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.621+0000 7fc8f94fa700 1 --2- 172.21.15.110:0/167853799 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8f40672a0 0x7fc8f4147ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:36.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.622+0000 7fc8f8cf9700 1 -- 172.21.15.110:0/167853799 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc8f414d580 msgr2=0x7fc8f41599f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:36.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.622+0000 7fc8f8cf9700 1 --2- 172.21.15.110:0/167853799 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc8f414d580 0x7fc8f41599f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:36.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.622+0000 7fc8f8cf9700 1 -- 172.21.15.110:0/167853799 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8f40672a0 msgr2=0x7fc8f4147ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:36.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.622+0000 7fc8f8cf9700 1 --2- 172.21.15.110:0/167853799 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8f40672a0 0x7fc8f4147ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:36.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.622+0000 7fc8f8cf9700 1 -- 172.21.15.110:0/167853799 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f40b1ef0 con 0x7fc8f40c09d0 2021-03-25T14:17:36.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.622+0000 7fc8f8cf9700 1 --2- 172.21.15.110:0/167853799 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8f40c09d0 0x7fc8f4159500 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7fc8f4066030 tx=0x7fc8e4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:36.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.622+0000 7fc8e17fa700 1 -- 172.21.15.110:0/167853799 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e4011d80 con 0x7fc8f40c09d0 2021-03-25T14:17:36.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.622+0000 7fc8e17fa700 1 -- 172.21.15.110:0/167853799 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e401c420 con 0x7fc8f40c09d0 2021-03-25T14:17:36.630 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.622+0000 7fc8fa4fc700 1 -- 172.21.15.110:0/167853799 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8f4159060 con 0x7fc8f40c09d0 2021-03-25T14:17:36.630 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.622+0000 7fc8e17fa700 1 -- 172.21.15.110:0/167853799 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e401c7a0 con 0x7fc8f40c09d0 2021-03-25T14:17:36.630 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.622+0000 7fc8fa4fc700 1 -- 172.21.15.110:0/167853799 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f40c01c0 con 0x7fc8f40c09d0 2021-03-25T14:17:36.630 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.623+0000 7fc8fa4fc700 1 -- 172.21.15.110:0/167853799 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8f41591f0 con 0x7fc8f40c09d0 2021-03-25T14:17:36.630 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.623+0000 7fc8e17fa700 1 -- 172.21.15.110:0/167853799 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fc8e400f070 con 0x7fc8f40c09d0 2021-03-25T14:17:36.630 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.623+0000 7fc8e17fa700 1 --2- 172.21.15.110:0/167853799 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc8d405a0b0 0x7fc8d405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:36.630 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.623+0000 7fc8e17fa700 1 -- 172.21.15.110:0/167853799 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5778+0+0 (secure 0 0 0) 0x7fc8e4074f70 con 0x7fc8f40c09d0 2021-03-25T14:17:36.630 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.624+0000 7fc8f94fa700 1 --2- 172.21.15.110:0/167853799 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc8d405a0b0 0x7fc8d405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:36.630 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.624+0000 7fc8f94fa700 1 --2- 172.21.15.110:0/167853799 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc8d405a0b0 0x7fc8d405c570 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fc8f0004610 tx=0x7fc8f0007bb0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:36.631 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.627+0000 7fc8e17fa700 1 -- 172.21.15.110:0/167853799 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fc8e4048a30 con 0x7fc8f40c09d0 2021-03-25T14:17:36.813 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.811+0000 7fc8fa4fc700 1 -- 172.21.15.110:0/167853799 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8f40b2080 con 0x7fc8f40c09d0 2021-03-25T14:17:36.813 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.811+0000 7fc8e17fa700 1 -- 172.21.15.110:0/167853799 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+1925 (secure 0 0 0) 0x7fc8e404c050 con 0x7fc8f40c09d0 2021-03-25T14:17:36.814 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:36.814 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4804,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6834/4176268149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4176268149},{"type":"v1","addr":"172.21.15.174:6834","nonce":4176268149}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":12},{"gid":4807,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/1554277551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6833","nonce":1554277551},{"type":"v1","addr":"172.21.15.174:6835","nonce":1554277551}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":13},{"gid":5451,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1204817763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1204817763},{"type":"v1","addr":"172.21.15.110:6837","nonce":1204817763}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":20},{"gid":5538,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.110:6836/3159424330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3159424330},{"type":"v1","addr":"172.21.15.110:6836","nonce":3159424330}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":23}],"filesystems":[]} 2021-03-25T14:17:36.815 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.813+0000 7fc8fa4fc700 1 -- 172.21.15.110:0/167853799 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc8d405a0b0 msgr2=0x7fc8d405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:36.815 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.813+0000 7fc8fa4fc700 1 --2- 172.21.15.110:0/167853799 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc8d405a0b0 0x7fc8d405c570 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fc8f0004610 tx=0x7fc8f0007bb0).stop 2021-03-25T14:17:36.816 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.813+0000 7fc8fa4fc700 1 -- 172.21.15.110:0/167853799 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8f40c09d0 msgr2=0x7fc8f4159500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:36.816 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.813+0000 7fc8fa4fc700 1 --2- 172.21.15.110:0/167853799 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8f40c09d0 0x7fc8f4159500 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7fc8f4066030 tx=0x7fc8e4016000).stop 2021-03-25T14:17:36.816 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.813+0000 7fc8fa4fc700 1 -- 172.21.15.110:0/167853799 shutdown_connections 2021-03-25T14:17:36.816 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.813+0000 7fc8fa4fc700 1 --2- 172.21.15.110:0/167853799 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc8d405a0b0 0x7fc8d405c570 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:36.816 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.813+0000 7fc8fa4fc700 1 --2- 172.21.15.110:0/167853799 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8f40672a0 0x7fc8f4147ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:36.816 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.813+0000 7fc8fa4fc700 1 --2- 172.21.15.110:0/167853799 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc8f414d580 0x7fc8f41599f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:36.816 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.813+0000 7fc8fa4fc700 1 --2- 172.21.15.110:0/167853799 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8f40c09d0 0x7fc8f4159500 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:36.816 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.813+0000 7fc8fa4fc700 1 -- 172.21.15.110:0/167853799 >> 172.21.15.110:0/167853799 conn(0x7fc8f40633a0 msgr2=0x7fc8f414abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:36.816 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.813+0000 7fc8fa4fc700 1 -- 172.21.15.110:0/167853799 shutdown_connections 2021-03-25T14:17:36.816 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:36.813+0000 7fc8fa4fc700 1 -- 172.21.15.110:0/167853799 wait complete. 2021-03-25T14:17:36.816 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 23 2021-03-25T14:17:36.827 INFO:tasks.ceph.mds.a:Restarting daemon 2021-03-25T14:17:36.827 INFO:tasks.ceph.mds.a:Stopping old one... 2021-03-25T14:17:36.827 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-03-25T14:17:36.827 INFO:teuthology.orchestra.run:waiting for 300 2021-03-25T14:17:36.827 INFO:tasks.ceph.mds.c:Restarting daemon 2021-03-25T14:17:36.828 INFO:tasks.ceph.mds.c:Stopping old one... 2021-03-25T14:17:36.828 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-03-25T14:17:36.828 INFO:teuthology.orchestra.run:waiting for 300 2021-03-25T14:17:36.828 INFO:tasks.ceph.mds.b:Restarting daemon 2021-03-25T14:17:36.828 INFO:tasks.ceph.mds.b:Stopping old one... 2021-03-25T14:17:36.828 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-03-25T14:17:36.829 INFO:teuthology.orchestra.run:waiting for 300 2021-03-25T14:17:36.829 INFO:tasks.ceph.mds.d:Restarting daemon 2021-03-25T14:17:36.829 INFO:tasks.ceph.mds.d:Stopping old one... 2021-03-25T14:17:36.829 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2021-03-25T14:17:36.829 INFO:teuthology.orchestra.run:waiting for 300 2021-03-25T14:17:36.836 INFO:tasks.ceph.mds.a:Stopped 2021-03-25T14:17:36.836 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-03-25T14:17:36.837 INFO:tasks.ceph.mds.c:Stopped 2021-03-25T14:17:36.837 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-03-25T14:17:36.839 INFO:tasks.ceph.mds.b:Stopped 2021-03-25T14:17:36.839 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-03-25T14:17:36.840 INFO:tasks.ceph.mds.d:Stopped 2021-03-25T14:17:36.840 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2021-03-25T14:17:36.878 INFO:tasks.ceph.mds.a:Started 2021-03-25T14:17:36.878 DEBUG:teuthology.parallel:result is None 2021-03-25T14:17:36.879 INFO:tasks.ceph.mds.c:Started 2021-03-25T14:17:36.879 DEBUG:teuthology.parallel:result is None 2021-03-25T14:17:36.882 INFO:tasks.ceph.mds.b:Started 2021-03-25T14:17:36.882 DEBUG:teuthology.parallel:result is None 2021-03-25T14:17:36.883 INFO:tasks.ceph.mds.d:Started 2021-03-25T14:17:36.883 DEBUG:teuthology.parallel:result is None 2021-03-25T14:17:36.883 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2021-03-25T14:17:36.949 INFO:tasks.ceph.mds.a.smithi110.stdout:starting mds.a at 2021-03-25T14:17:36.949 INFO:tasks.ceph.mds.c.smithi110.stdout:starting mds.c at 2021-03-25T14:17:36.950 INFO:tasks.ceph.mds.c.smithi110.stderr:2021-03-25T14:17:36.949+0000 7f26b3bf3700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2021-03-25T14:17:36.961 INFO:tasks.ceph.mds.b.smithi174.stdout:starting mds.b at 2021-03-25T14:17:36.962 INFO:tasks.ceph.mds.d.smithi174.stdout:starting mds.d at 2021-03-25T14:17:37.006 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.004+0000 7fbf45b4f700 1 Processor -- start 2021-03-25T14:17:37.006 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.004+0000 7fbf45b4f700 1 -- start start 2021-03-25T14:17:37.009 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.005+0000 7fbf45b4f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf400be5a0 0x7fbf4009d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:37.009 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.005+0000 7fbf45b4f700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbf400b9ba0 0x7fbf40143270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:37.009 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.005+0000 7fbf45b4f700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf4014d0e0 con 0x7fbf40143760 2021-03-25T14:17:37.009 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.005+0000 7fbf45b4f700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf4014d380 con 0x7fbf400b9ba0 2021-03-25T14:17:37.009 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.005+0000 7fbf45b4f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4014d620 con 0x7fbf400be5a0 2021-03-25T14:17:37.009 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.005+0000 7fbf3effd700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbf400b9ba0 0x7fbf40143270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:37.010 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.005+0000 7fbf3effd700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbf400b9ba0 0x7fbf40143270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50222/0 (socket says 172.21.15.110:50222) 2021-03-25T14:17:37.010 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.005+0000 7fbf3ffff700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fbf40143760 0x7fbf40149a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43162/0 (socket says 172.21.15.110:43162) 2021-03-25T14:17:37.010 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.005+0000 7fbf3effd700 1 -- 172.21.15.110:0/711501189 learned_addr learned my addr 172.21.15.110:0/711501189 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:37.010 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.005+0000 7fbf3f7fe700 1 --2- 172.21.15.110:0/711501189 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf400be5a0 0x7fbf4009d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:37.010 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.005+0000 7fbf3effd700 1 -- 172.21.15.110:0/711501189 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf400be5a0 msgr2=0x7fbf4009d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:37.010 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.005+0000 7fbf3effd700 1 --2- 172.21.15.110:0/711501189 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf400be5a0 0x7fbf4009d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:37.010 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.005+0000 7fbf3effd700 1 -- 172.21.15.110:0/711501189 >> v1:172.21.15.110:6789/0 conn(0x7fbf40143760 legacy=0x7fbf40149a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:37.010 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.005+0000 7fbf3e7fc700 1 -- 172.21.15.110:0/711501189 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3807658760 0 0) 0x7fbf4014d0e0 con 0x7fbf40143760 2021-03-25T14:17:37.010 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.005+0000 7fbf3effd700 1 -- 172.21.15.110:0/711501189 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf4014d8c0 con 0x7fbf400b9ba0 2021-03-25T14:17:37.010 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.005+0000 7fbf3f7fe700 1 --2- 172.21.15.110:0/711501189 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf400be5a0 0x7fbf4009d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:17:37.010 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.005+0000 7fbf3effd700 1 --2- 172.21.15.110:0/711501189 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf400b9ba0 0x7fbf40143270 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7fbf3400ba20 tx=0x7fbf34006ee0).ready entity=mon.0 client_cookie=c866ff7322810e4b server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:37.011 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.005+0000 7fbf3e7fc700 1 -- 172.21.15.110:0/711501189 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf340098d0 con 0x7fbf400b9ba0 2021-03-25T14:17:37.011 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.005+0000 7fbf3e7fc700 1 -- 172.21.15.110:0/711501189 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf34009a30 con 0x7fbf400b9ba0 2021-03-25T14:17:37.011 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.005+0000 7fbf3e7fc700 1 -- 172.21.15.110:0/711501189 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf34009db0 con 0x7fbf400b9ba0 2021-03-25T14:17:37.011 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.006+0000 7fbf45b4f700 1 -- 172.21.15.110:0/711501189 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf400b9ba0 msgr2=0x7fbf40143270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:37.011 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.006+0000 7fbf45b4f700 1 --2- 172.21.15.110:0/711501189 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf400b9ba0 0x7fbf40143270 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7fbf3400ba20 tx=0x7fbf34006ee0).stop 2021-03-25T14:17:37.011 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.006+0000 7fbf45b4f700 1 -- 172.21.15.110:0/711501189 shutdown_connections 2021-03-25T14:17:37.011 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.006+0000 7fbf45b4f700 1 --2- 172.21.15.110:0/711501189 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf400be5a0 0x7fbf4009d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:37.012 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.006+0000 7fbf45b4f700 1 --2- 172.21.15.110:0/711501189 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf400b9ba0 0x7fbf40143270 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:37.012 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.006+0000 7fbf45b4f700 1 -- 172.21.15.110:0/711501189 >> 172.21.15.110:0/711501189 conn(0x7fbf400616d0 msgr2=0x7fbf400bdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:37.012 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.006+0000 7fbf45b4f700 1 -- 172.21.15.110:0/711501189 shutdown_connections 2021-03-25T14:17:37.012 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.006+0000 7fbf45b4f700 1 -- 172.21.15.110:0/711501189 wait complete. 2021-03-25T14:17:37.012 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.007+0000 7fbf45b4f700 1 Processor -- start 2021-03-25T14:17:37.012 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.007+0000 7fbf45b4f700 1 -- start start 2021-03-25T14:17:37.015 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.008+0000 7fbf45b4f700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf400b9ba0 0x7fbf40066400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:37.015 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.008+0000 7fbf45b4f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf400be5a0 0x7fbf40063090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:37.015 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.008+0000 7fbf45b4f700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf40143760 0x7fbf400b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:37.015 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.008+0000 7fbf45b4f700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf400b5ce0 con 0x7fbf400b9ba0 2021-03-25T14:17:37.015 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.008+0000 7fbf45b4f700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf400b3a40 con 0x7fbf40143760 2021-03-25T14:17:37.015 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.008+0000 7fbf45b4f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf400b3ce0 con 0x7fbf400be5a0 2021-03-25T14:17:37.015 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.008+0000 7fbf3f7fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf400b9ba0 0x7fbf40066400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:37.016 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.008+0000 7fbf3f7fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf400b9ba0 0x7fbf40066400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50232/0 (socket says 172.21.15.110:50232) 2021-03-25T14:17:37.016 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.008+0000 7fbf3f7fe700 1 -- 172.21.15.110:0/3961754472 learned_addr learned my addr 172.21.15.110:0/3961754472 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:37.016 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.008+0000 7fbf3effd700 1 --2- 172.21.15.110:0/3961754472 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf400be5a0 0x7fbf40063090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:37.016 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.008+0000 7fbf3ffff700 1 --2- 172.21.15.110:0/3961754472 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf40143760 0x7fbf400b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:37.016 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.008+0000 7fbf3f7fe700 1 -- 172.21.15.110:0/3961754472 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf400be5a0 msgr2=0x7fbf40063090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:37.016 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.008+0000 7fbf3f7fe700 1 --2- 172.21.15.110:0/3961754472 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf400be5a0 0x7fbf40063090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:37.016 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.008+0000 7fbf3f7fe700 1 -- 172.21.15.110:0/3961754472 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf40143760 msgr2=0x7fbf400b2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:37.016 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.008+0000 7fbf3f7fe700 1 --2- 172.21.15.110:0/3961754472 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf40143760 0x7fbf400b2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:37.016 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.008+0000 7fbf3f7fe700 1 -- 172.21.15.110:0/3961754472 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf40065a20 con 0x7fbf400b9ba0 2021-03-25T14:17:37.016 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.008+0000 7fbf3ffff700 1 --2- 172.21.15.110:0/3961754472 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf40143760 0x7fbf400b2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:17:37.016 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.008+0000 7fbf3f7fe700 1 --2- 172.21.15.110:0/3961754472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf400b9ba0 0x7fbf40066400 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7fbf3000cb50 tx=0x7fbf30008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:37.016 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.008+0000 7fbf277fe700 1 -- 172.21.15.110:0/3961754472 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf30015070 con 0x7fbf400b9ba0 2021-03-25T14:17:37.017 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.009+0000 7fbf277fe700 1 -- 172.21.15.110:0/3961754472 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf30007740 con 0x7fbf400b9ba0 2021-03-25T14:17:37.017 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.009+0000 7fbf45b4f700 1 -- 172.21.15.110:0/3961754472 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf40065cc0 con 0x7fbf400b9ba0 2021-03-25T14:17:37.017 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.009+0000 7fbf277fe700 1 -- 172.21.15.110:0/3961754472 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf30007ac0 con 0x7fbf400b9ba0 2021-03-25T14:17:37.017 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.009+0000 7fbf45b4f700 1 -- 172.21.15.110:0/3961754472 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf400668f0 con 0x7fbf400b9ba0 2021-03-25T14:17:37.017 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.009+0000 7fbf45b4f700 1 -- 172.21.15.110:0/3961754472 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf40063640 con 0x7fbf400b9ba0 2021-03-25T14:17:37.017 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.010+0000 7fbf277fe700 1 -- 172.21.15.110:0/3961754472 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fbf3001a410 con 0x7fbf400b9ba0 2021-03-25T14:17:37.017 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.010+0000 7fbf277fe700 1 --2- 172.21.15.110:0/3961754472 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fbf2005a0b0 0x7fbf2005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:37.017 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.010+0000 7fbf277fe700 1 -- 172.21.15.110:0/3961754472 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5778+0+0 (secure 0 0 0) 0x7fbf30073a80 con 0x7fbf400b9ba0 2021-03-25T14:17:37.017 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.010+0000 7fbf3effd700 1 --2- 172.21.15.110:0/3961754472 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fbf2005a0b0 0x7fbf2005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:37.017 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.011+0000 7fbf3effd700 1 --2- 172.21.15.110:0/3961754472 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fbf2005a0b0 0x7fbf2005c570 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fbf40067370 tx=0x7fbf34016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:37.018 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.014+0000 7fbf277fe700 1 -- 172.21.15.110:0/3961754472 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fbf300474e0 con 0x7fbf400b9ba0 2021-03-25T14:17:37.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:37.178+0000 7fbf45b4f700 1 -- 172.21.15.110:0/3961754472 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fbf4005d7b0 con 0x7fbf400b9ba0 2021-03-25T14:17:38.124 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.122+0000 7fbf277fe700 1 -- 172.21.15.110:0/3961754472 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v52) v1 ==== 97+0+0 (secure 0 0 0) 0x7fbf3004ab00 con 0x7fbf400b9ba0 2021-03-25T14:17:38.126 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.124+0000 7fbf45b4f700 1 -- 172.21.15.110:0/3961754472 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fbf2005a0b0 msgr2=0x7fbf2005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:38.126 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.124+0000 7fbf45b4f700 1 --2- 172.21.15.110:0/3961754472 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fbf2005a0b0 0x7fbf2005c570 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fbf40067370 tx=0x7fbf34016000).stop 2021-03-25T14:17:38.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.124+0000 7fbf45b4f700 1 -- 172.21.15.110:0/3961754472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf400b9ba0 msgr2=0x7fbf40066400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:38.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.124+0000 7fbf45b4f700 1 --2- 172.21.15.110:0/3961754472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf400b9ba0 0x7fbf40066400 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7fbf3000cb50 tx=0x7fbf30008040).stop 2021-03-25T14:17:38.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.124+0000 7fbf45b4f700 1 -- 172.21.15.110:0/3961754472 shutdown_connections 2021-03-25T14:17:38.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.124+0000 7fbf45b4f700 1 --2- 172.21.15.110:0/3961754472 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fbf2005a0b0 0x7fbf2005c570 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:38.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.124+0000 7fbf45b4f700 1 --2- 172.21.15.110:0/3961754472 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf40143760 0x7fbf400b2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:38.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.124+0000 7fbf45b4f700 1 --2- 172.21.15.110:0/3961754472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf400b9ba0 0x7fbf40066400 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:38.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.124+0000 7fbf45b4f700 1 --2- 172.21.15.110:0/3961754472 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf400be5a0 0x7fbf40063090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:38.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.124+0000 7fbf45b4f700 1 -- 172.21.15.110:0/3961754472 >> 172.21.15.110:0/3961754472 conn(0x7fbf400616d0 msgr2=0x7fbf400bbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:38.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.124+0000 7fbf45b4f700 1 -- 172.21.15.110:0/3961754472 shutdown_connections 2021-03-25T14:17:38.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.124+0000 7fbf45b4f700 1 -- 172.21.15.110:0/3961754472 wait complete. 2021-03-25T14:17:38.128 INFO:teuthology.orchestra.run.smithi110.stderr: removed all blocklist entries 2021-03-25T14:17:38.141 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-03-25T14:17:38.256 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.255+0000 7fc3e052a700 1 Processor -- start 2021-03-25T14:17:38.257 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.255+0000 7fc3e052a700 1 -- start start 2021-03-25T14:17:38.260 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.255+0000 7fc3e052a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc3d80b1340 0x7fc3d814d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:38.260 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.255+0000 7fc3e052a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3d80b7620 0x7fc3d8148ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:38.260 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.255+0000 7fc3e052a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3d80b9140 con 0x7fc3d80bcd90 2021-03-25T14:17:38.260 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.255+0000 7fc3e052a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3d80692a0 con 0x7fc3d80b1340 2021-03-25T14:17:38.260 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.255+0000 7fc3e052a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d80b93e0 con 0x7fc3d80b7620 2021-03-25T14:17:38.260 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.256+0000 7fc3ddac5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc3d80b1340 0x7fc3d814d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:38.260 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.256+0000 7fc3deac7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3d80b7620 0x7fc3d8148ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:38.260 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.256+0000 7fc3deac7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3d80b7620 0x7fc3d8148ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.110:42642/0 (socket says 172.21.15.110:42642) 2021-03-25T14:17:38.260 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.256+0000 7fc3deac7700 1 -- 172.21.15.110:0/66616718 learned_addr learned my addr 172.21.15.110:0/66616718 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:38.261 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.256+0000 7fc3ddac5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc3d80b1340 0x7fc3d814d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.110:48888/0 (socket says 172.21.15.110:48888) 2021-03-25T14:17:38.261 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.256+0000 7fc3de2c6700 1 --1- 172.21.15.110:0/66616718 >> v1:172.21.15.174:6789/0 conn(0x7fc3d80bcd90 0x7fc3d8060c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.110:50840/0 (socket says 172.21.15.110:50840) 2021-03-25T14:17:38.261 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.256+0000 7fc3ddac5700 1 -- 172.21.15.110:0/66616718 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3d80b7620 msgr2=0x7fc3d8148ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:38.261 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.256+0000 7fc3ddac5700 1 --2- 172.21.15.110:0/66616718 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3d80b7620 0x7fc3d8148ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:38.261 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.256+0000 7fc3ddac5700 1 -- 172.21.15.110:0/66616718 >> v1:172.21.15.174:6789/0 conn(0x7fc3d80bcd90 legacy=0x7fc3d8060c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:38.261 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.256+0000 7fc3ddac5700 1 -- 172.21.15.110:0/66616718 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d814cda0 con 0x7fc3d80b1340 2021-03-25T14:17:38.261 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.256+0000 7fc3dd2c4700 1 -- 172.21.15.110:0/66616718 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 509374908 0 0) 0x7fc3d80b9140 con 0x7fc3d80bcd90 2021-03-25T14:17:38.261 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.256+0000 7fc3ddac5700 1 --2- 172.21.15.110:0/66616718 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3d80b1340 0x7fc3d814d780 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fc3c800b9c0 tx=0x7fc3c8006e20).ready entity=mon.1 client_cookie=bcd1ff520a5d9293 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:38.261 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.257+0000 7fc3dd2c4700 1 -- 172.21.15.110:0/66616718 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c80097e0 con 0x7fc3d80b1340 2021-03-25T14:17:38.261 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.257+0000 7fc3dd2c4700 1 -- 172.21.15.110:0/66616718 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c8009940 con 0x7fc3d80b1340 2021-03-25T14:17:38.261 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.257+0000 7fc3dd2c4700 1 -- 172.21.15.110:0/66616718 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c8009cc0 con 0x7fc3d80b1340 2021-03-25T14:17:38.261 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.257+0000 7fc3e052a700 1 -- 172.21.15.110:0/66616718 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3d80b1340 msgr2=0x7fc3d814d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:38.262 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.257+0000 7fc3e052a700 1 --2- 172.21.15.110:0/66616718 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3d80b1340 0x7fc3d814d780 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fc3c800b9c0 tx=0x7fc3c8006e20).stop 2021-03-25T14:17:38.262 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.257+0000 7fc3e052a700 1 -- 172.21.15.110:0/66616718 shutdown_connections 2021-03-25T14:17:38.262 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.257+0000 7fc3e052a700 1 --2- 172.21.15.110:0/66616718 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3d80b7620 0x7fc3d8148ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:38.262 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.257+0000 7fc3e052a700 1 --2- 172.21.15.110:0/66616718 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3d80b1340 0x7fc3d814d780 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:38.262 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.257+0000 7fc3e052a700 1 -- 172.21.15.110:0/66616718 >> 172.21.15.110:0/66616718 conn(0x7fc3d8063720 msgr2=0x7fc3d8063b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:38.262 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.257+0000 7fc3e052a700 1 -- 172.21.15.110:0/66616718 shutdown_connections 2021-03-25T14:17:38.262 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.257+0000 7fc3e052a700 1 -- 172.21.15.110:0/66616718 wait complete. 2021-03-25T14:17:38.262 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.258+0000 7fc3e052a700 1 Processor -- start 2021-03-25T14:17:38.262 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.258+0000 7fc3e052a700 1 -- start start 2021-03-25T14:17:38.266 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.259+0000 7fc3e052a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3d80b1340 0x7fc3d8145360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:38.266 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.259+0000 7fc3e052a700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3d80b7620 0x7fc3d81440d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:38.266 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.259+0000 7fc3e052a700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3d80bcd90 0x7fc3d81445c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:38.266 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.259+0000 7fc3e052a700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d8144ab0 con 0x7fc3d80b7620 2021-03-25T14:17:38.266 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.259+0000 7fc3e052a700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d814a150 con 0x7fc3d80bcd90 2021-03-25T14:17:38.266 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.259+0000 7fc3e052a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d80b20f0 con 0x7fc3d80b1340 2021-03-25T14:17:38.266 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.259+0000 7fc3ddac5700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3d80b7620 0x7fc3d81440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:38.266 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.259+0000 7fc3ddac5700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3d80b7620 0x7fc3d81440d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50244/0 (socket says 172.21.15.110:50244) 2021-03-25T14:17:38.266 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.259+0000 7fc3ddac5700 1 -- 172.21.15.110:0/1814830880 learned_addr learned my addr 172.21.15.110:0/1814830880 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:38.267 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.259+0000 7fc3de2c6700 1 --2- 172.21.15.110:0/1814830880 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3d80b1340 0x7fc3d8145360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:38.267 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.259+0000 7fc3deac7700 1 --2- 172.21.15.110:0/1814830880 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3d80bcd90 0x7fc3d81445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:38.267 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.259+0000 7fc3ddac5700 1 -- 172.21.15.110:0/1814830880 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3d80b1340 msgr2=0x7fc3d8145360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:38.267 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.259+0000 7fc3ddac5700 1 --2- 172.21.15.110:0/1814830880 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3d80b1340 0x7fc3d8145360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:38.267 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.259+0000 7fc3ddac5700 1 -- 172.21.15.110:0/1814830880 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3d80bcd90 msgr2=0x7fc3d81445c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:38.267 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.259+0000 7fc3ddac5700 1 --2- 172.21.15.110:0/1814830880 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3d80bcd90 0x7fc3d81445c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:38.267 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.259+0000 7fc3ddac5700 1 -- 172.21.15.110:0/1814830880 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d80b2360 con 0x7fc3d80b7620 2021-03-25T14:17:38.267 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.259+0000 7fc3ddac5700 1 --2- 172.21.15.110:0/1814830880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3d80b7620 0x7fc3d81440d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7fc3d80658c0 tx=0x7fc3c8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:38.267 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.260+0000 7fc3c67fc700 1 -- 172.21.15.110:0/1814830880 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c8011b30 con 0x7fc3d80b7620 2021-03-25T14:17:38.267 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.260+0000 7fc3c67fc700 1 -- 172.21.15.110:0/1814830880 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c8011c90 con 0x7fc3d80b7620 2021-03-25T14:17:38.267 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.260+0000 7fc3e052a700 1 -- 172.21.15.110:0/1814830880 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3d814a3b0 con 0x7fc3d80b7620 2021-03-25T14:17:38.267 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.260+0000 7fc3c67fc700 1 -- 172.21.15.110:0/1814830880 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c801c630 con 0x7fc3d80b7620 2021-03-25T14:17:38.268 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.260+0000 7fc3e052a700 1 -- 172.21.15.110:0/1814830880 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3d8145850 con 0x7fc3d80b7620 2021-03-25T14:17:38.268 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.261+0000 7fc3e052a700 1 -- 172.21.15.110:0/1814830880 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3d805d7b0 con 0x7fc3d80b7620 2021-03-25T14:17:38.268 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.261+0000 7fc3c67fc700 1 -- 172.21.15.110:0/1814830880 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fc3c800f070 con 0x7fc3d80b7620 2021-03-25T14:17:38.268 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.261+0000 7fc3c67fc700 1 --2- 172.21.15.110:0/1814830880 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc3b805a0b0 0x7fc3b805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:38.268 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.261+0000 7fc3c67fc700 1 -- 172.21.15.110:0/1814830880 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5606+0+0 (secure 0 0 0) 0x7fc3c8074fe0 con 0x7fc3d80b7620 2021-03-25T14:17:38.268 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.261+0000 7fc3de2c6700 1 --2- 172.21.15.110:0/1814830880 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc3b805a0b0 0x7fc3b805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:38.268 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.262+0000 7fc3de2c6700 1 --2- 172.21.15.110:0/1814830880 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc3b805a0b0 0x7fc3b805c570 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fc3d4007fd0 tx=0x7fc3d4007a50).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:38.268 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.265+0000 7fc3c67fc700 1 -- 172.21.15.110:0/1814830880 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fc3c8048b50 con 0x7fc3d80b7620 2021-03-25T14:17:38.470 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.467+0000 7fc3e052a700 1 -- 172.21.15.110:0/1814830880 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc3d80b3a20 con 0x7fc3d80b7620 2021-03-25T14:17:38.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.467+0000 7fc3c67fc700 1 -- 172.21.15.110:0/1814830880 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+4855 (secure 0 0 0) 0x7fc3c804c170 con 0x7fc3d80b7620 2021-03-25T14:17:38.471 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:38.471 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2021-03-25T14:17:38.471 INFO:teuthology.orchestra.run.smithi110.stdout: "auth_dump": [ 2021-03-25T14:17:38.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:17:38.471 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "mds.a", 2021-03-25T14:17:38.471 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDxmlxgu8aCEhAA9Q4e7SWq5aDsLFgylcYasw==", 2021-03-25T14:17:38.471 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:17:38.471 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": "allow", 2021-03-25T14:17:38.472 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2021-03-25T14:17:38.472 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2021-03-25T14:17:38.472 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:17:38.472 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:17:38.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:17:38.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:17:38.472 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "mds.b", 2021-03-25T14:17:38.472 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDxmlxgMKt4HRAA2Zg+dO3gKKuJXsTBqargjg==", 2021-03-25T14:17:38.472 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:17:38.472 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": "allow", 2021-03-25T14:17:38.472 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2021-03-25T14:17:38.472 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2021-03-25T14:17:38.473 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:17:38.473 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:17:38.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:17:38.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:17:38.473 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "mds.c", 2021-03-25T14:17:38.473 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDxmlxgEUUtGRAA88JXgGt3G5BUFrM3XSrcqA==", 2021-03-25T14:17:38.473 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:17:38.473 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": "allow", 2021-03-25T14:17:38.473 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2021-03-25T14:17:38.473 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2021-03-25T14:17:38.473 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:17:38.473 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:17:38.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:17:38.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:17:38.474 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "mds.d", 2021-03-25T14:17:38.474 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDxmlxgW9AxJBAA15D4zF2B1SapEee6SmRcvg==", 2021-03-25T14:17:38.474 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:17:38.474 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": "allow", 2021-03-25T14:17:38.474 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2021-03-25T14:17:38.474 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2021-03-25T14:17:38.474 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:17:38.474 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:17:38.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:17:38.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:17:38.474 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "osd.0", 2021-03-25T14:17:38.475 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDymlxgwZp8OBAAq9v4WdTkWcbGA+npuycbMg==", 2021-03-25T14:17:38.475 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:17:38.475 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2021-03-25T14:17:38.475 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2021-03-25T14:17:38.475 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:17:38.475 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:17:38.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:17:38.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:17:38.475 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "osd.1", 2021-03-25T14:17:38.475 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQD1mlxgGbipOBAA4pnOC/cuKte3/s/OynFO4Q==", 2021-03-25T14:17:38.475 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:17:38.475 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2021-03-25T14:17:38.475 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2021-03-25T14:17:38.476 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:17:38.476 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:17:38.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:17:38.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:17:38.476 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "osd.2", 2021-03-25T14:17:38.476 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQD4mlxgoMlQNhAAX+mGQaqbPBWJ6ML34o+2Ag==", 2021-03-25T14:17:38.476 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:17:38.476 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2021-03-25T14:17:38.476 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2021-03-25T14:17:38.476 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:17:38.476 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:17:38.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:17:38.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:17:38.477 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "osd.3", 2021-03-25T14:17:38.477 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQD7mlxgwMTDMxAASdzfZH/r/hxi4yntbTE44A==", 2021-03-25T14:17:38.477 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:17:38.477 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2021-03-25T14:17:38.477 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2021-03-25T14:17:38.477 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:17:38.477 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:17:38.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:17:38.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:17:38.478 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "osd.4", 2021-03-25T14:17:38.478 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQABm1xgveHKFxAAxxfuXs2iAaCtDS99y84xUA==", 2021-03-25T14:17:38.478 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:17:38.479 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2021-03-25T14:17:38.479 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2021-03-25T14:17:38.479 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:17:38.479 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:17:38.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:17:38.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:17:38.479 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "osd.5", 2021-03-25T14:17:38.479 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQAEm1xgfmgAFhAAS7sBExbnejoEm+RPDBfUbA==", 2021-03-25T14:17:38.479 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:17:38.479 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2021-03-25T14:17:38.480 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2021-03-25T14:17:38.480 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:17:38.480 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:17:38.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:17:38.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:17:38.480 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "osd.6", 2021-03-25T14:17:38.480 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQAHm1xg4ve5ExAA/lvAG/VBB5q20gHi8/t7qg==", 2021-03-25T14:17:38.480 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:17:38.480 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2021-03-25T14:17:38.480 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2021-03-25T14:17:38.480 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:17:38.480 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:17:38.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:17:38.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:17:38.481 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "osd.7", 2021-03-25T14:17:38.481 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQAKm1xgmgHpERAA5e/kkmZ5/bM9r1eLQn+47Q==", 2021-03-25T14:17:38.481 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:17:38.481 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2021-03-25T14:17:38.481 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2021-03-25T14:17:38.481 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:17:38.481 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:17:38.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:17:38.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:17:38.481 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "client.0", 2021-03-25T14:17:38.481 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDxmlxg8erbJxAAJisHYL2sfUoCtEM84zXmTQ==", 2021-03-25T14:17:38.482 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:17:38.482 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": "allow", 2021-03-25T14:17:38.482 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow r", 2021-03-25T14:17:38.482 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow rw pool=cephfs_data" 2021-03-25T14:17:38.482 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:17:38.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:17:38.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:17:38.483 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "client.1", 2021-03-25T14:17:38.483 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDxmlxg7uW1KhAAkf3kOWqyE6uoDsXybdU8CQ==", 2021-03-25T14:17:38.483 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:17:38.483 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": "allow", 2021-03-25T14:17:38.483 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow r", 2021-03-25T14:17:38.484 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow rw pool=cephfs2_data" 2021-03-25T14:17:38.484 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:17:38.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:17:38.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:17:38.484 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "client.admin", 2021-03-25T14:17:38.484 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDwmlxguzAoMxAA3QaeA8eVjVA329iGXhytNg==", 2021-03-25T14:17:38.485 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:17:38.485 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": "allow *", 2021-03-25T14:17:38.485 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2021-03-25T14:17:38.485 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2021-03-25T14:17:38.485 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:17:38.486 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:17:38.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:17:38.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:17:38.486 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "client.testuser", 2021-03-25T14:17:38.486 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQBtm1xg3jLMIxAARztP29wq9FGk2DzuV2j/qw==", 2021-03-25T14:17:38.486 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:17:38.487 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": "allow rw fsname=cephfs", 2021-03-25T14:17:38.487 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow r fsname=cephfs", 2021-03-25T14:17:38.487 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow rw tag cephfs data=cephfs" 2021-03-25T14:17:38.487 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:17:38.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:17:38.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:17:38.488 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "mgr.x", 2021-03-25T14:17:38.488 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDxmlxgW4eaDxAAeURkSVsbMqQMPgz6bES0zw==", 2021-03-25T14:17:38.488 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:17:38.489 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": "allow *", 2021-03-25T14:17:38.489 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow profile mgr", 2021-03-25T14:17:38.489 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:17:38.489 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:17:38.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:17:38.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:17:38.490 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "mgr.y", 2021-03-25T14:17:38.490 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDxmlxgil5jCxAAt3504C7TGciH7KF4EIkmhw==", 2021-03-25T14:17:38.490 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:17:38.490 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": "allow *", 2021-03-25T14:17:38.490 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow profile mgr", 2021-03-25T14:17:38.490 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:17:38.491 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:17:38.491 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:17:38.491 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2021-03-25T14:17:38.491 INFO:teuthology.orchestra.run.smithi110.stdout:} 2021-03-25T14:17:38.494 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.469+0000 7fc3e052a700 1 -- 172.21.15.110:0/1814830880 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc3b805a0b0 msgr2=0x7fc3b805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:38.494 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.469+0000 7fc3e052a700 1 --2- 172.21.15.110:0/1814830880 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc3b805a0b0 0x7fc3b805c570 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fc3d4007fd0 tx=0x7fc3d4007a50).stop 2021-03-25T14:17:38.494 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.469+0000 7fc3e052a700 1 -- 172.21.15.110:0/1814830880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3d80b7620 msgr2=0x7fc3d81440d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:38.494 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.469+0000 7fc3e052a700 1 --2- 172.21.15.110:0/1814830880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3d80b7620 0x7fc3d81440d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7fc3d80658c0 tx=0x7fc3c8016000).stop 2021-03-25T14:17:38.494 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.469+0000 7fc3e052a700 1 -- 172.21.15.110:0/1814830880 shutdown_connections 2021-03-25T14:17:38.494 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.469+0000 7fc3e052a700 1 --2- 172.21.15.110:0/1814830880 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc3b805a0b0 0x7fc3b805c570 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:38.494 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.469+0000 7fc3e052a700 1 --2- 172.21.15.110:0/1814830880 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3d80bcd90 0x7fc3d81445c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:38.494 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.469+0000 7fc3e052a700 1 --2- 172.21.15.110:0/1814830880 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3d80b1340 0x7fc3d8145360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:38.494 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.469+0000 7fc3e052a700 1 --2- 172.21.15.110:0/1814830880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3d80b7620 0x7fc3d81440d0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:38.495 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.469+0000 7fc3e052a700 1 -- 172.21.15.110:0/1814830880 >> 172.21.15.110:0/1814830880 conn(0x7fc3d8063720 msgr2=0x7fc3d80bab80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:38.495 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.469+0000 7fc3e052a700 1 -- 172.21.15.110:0/1814830880 shutdown_connections 2021-03-25T14:17:38.495 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.469+0000 7fc3e052a700 1 -- 172.21.15.110:0/1814830880 wait complete. 2021-03-25T14:17:38.495 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.testuser 2021-03-25T14:17:38.605 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.603+0000 7f0894939700 1 Processor -- start 2021-03-25T14:17:38.605 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.603+0000 7f0894939700 1 -- start start 2021-03-25T14:17:38.608 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.604+0000 7f0894939700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08900b9600 0x7f0890148bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:38.608 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.604+0000 7f0894939700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f08900684f0 0x7f08901499e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:38.608 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.604+0000 7f0894939700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f089014cfd0 con 0x7f08900690f0 2021-03-25T14:17:38.609 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.604+0000 7f0894939700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f089014d270 con 0x7f08900684f0 2021-03-25T14:17:38.609 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.604+0000 7f0894939700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f089014d510 con 0x7f08900b9600 2021-03-25T14:17:38.609 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.604+0000 7f088ffff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f08900684f0 0x7f08901499e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:38.609 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.604+0000 7f088ffff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f08900684f0 0x7f08901499e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50254/0 (socket says 172.21.15.110:50254) 2021-03-25T14:17:38.609 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.604+0000 7f088ffff700 1 -- 172.21.15.110:0/3800963791 learned_addr learned my addr 172.21.15.110:0/3800963791 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:38.609 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.605+0000 7f088ffff700 1 -- 172.21.15.110:0/3800963791 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08900b9600 msgr2=0x7f0890148bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:38.609 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.605+0000 7f088ffff700 1 --2- 172.21.15.110:0/3800963791 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08900b9600 0x7f0890148bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:38.609 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.605+0000 7f088ffff700 1 -- 172.21.15.110:0/3800963791 >> v1:172.21.15.174:6789/0 conn(0x7f08900690f0 legacy=0x7f08901490b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:38.609 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.605+0000 7f088ffff700 1 -- 172.21.15.110:0/3800963791 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f089014d7b0 con 0x7f08900684f0 2021-03-25T14:17:38.609 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.605+0000 7f088ffff700 1 --2- 172.21.15.110:0/3800963791 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08900684f0 0x7f08901499e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f0888009d70 tx=0x7f08880092b0).ready entity=mon.0 client_cookie=c6c3164748d02f2 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:38.610 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.605+0000 7f088e7fc700 1 -- 172.21.15.110:0/3800963791 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088800bbb0 con 0x7f08900684f0 2021-03-25T14:17:38.610 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.605+0000 7f088e7fc700 1 -- 172.21.15.110:0/3800963791 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088800bd10 con 0x7f08900684f0 2021-03-25T14:17:38.610 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.605+0000 7f088e7fc700 1 -- 172.21.15.110:0/3800963791 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0888005ce0 con 0x7f08900684f0 2021-03-25T14:17:38.610 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.605+0000 7f0894939700 1 -- 172.21.15.110:0/3800963791 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08900684f0 msgr2=0x7f08901499e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:38.610 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.605+0000 7f0894939700 1 --2- 172.21.15.110:0/3800963791 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08900684f0 0x7f08901499e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f0888009d70 tx=0x7f08880092b0).stop 2021-03-25T14:17:38.610 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.605+0000 7f0894939700 1 -- 172.21.15.110:0/3800963791 shutdown_connections 2021-03-25T14:17:38.610 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.605+0000 7f0894939700 1 --2- 172.21.15.110:0/3800963791 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08900684f0 0x7f08901499e0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:38.610 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.605+0000 7f0894939700 1 --2- 172.21.15.110:0/3800963791 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08900b9600 0x7f0890148bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:38.610 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.605+0000 7f0894939700 1 -- 172.21.15.110:0/3800963791 >> 172.21.15.110:0/3800963791 conn(0x7f0890061d50 msgr2=0x7f0890062160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:38.611 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.605+0000 7f0894939700 1 -- 172.21.15.110:0/3800963791 shutdown_connections 2021-03-25T14:17:38.611 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.605+0000 7f0894939700 1 -- 172.21.15.110:0/3800963791 wait complete. 2021-03-25T14:17:38.611 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.607+0000 7f0894939700 1 Processor -- start 2021-03-25T14:17:38.611 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.607+0000 7f0894939700 1 -- start start 2021-03-25T14:17:38.613 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.607+0000 7f0894939700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08900684f0 0x7f089015bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:38.614 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.607+0000 7f0894939700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08900690f0 0x7f08900bcc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:38.614 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.607+0000 7f0894939700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f08900b9600 0x7f089015c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:38.614 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.607+0000 7f0894939700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08900b4700 con 0x7f08900690f0 2021-03-25T14:17:38.614 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.607+0000 7f0894939700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f089009ed90 con 0x7f08900b9600 2021-03-25T14:17:38.614 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.607+0000 7f0894939700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f089009f030 con 0x7f08900684f0 2021-03-25T14:17:38.614 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.607+0000 7f088effd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08900690f0 0x7f08900bcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:38.614 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.607+0000 7f088effd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08900690f0 0x7f08900bcc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50258/0 (socket says 172.21.15.110:50258) 2021-03-25T14:17:38.614 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.607+0000 7f088effd700 1 -- 172.21.15.110:0/1896112257 learned_addr learned my addr 172.21.15.110:0/1896112257 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:38.614 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.607+0000 7f088f7fe700 1 --2- 172.21.15.110:0/1896112257 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08900684f0 0x7f089015bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:38.614 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.608+0000 7f088ffff700 1 --2- 172.21.15.110:0/1896112257 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f08900b9600 0x7f089015c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:38.614 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.608+0000 7f088effd700 1 -- 172.21.15.110:0/1896112257 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08900684f0 msgr2=0x7f089015bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:38.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.608+0000 7f088effd700 1 --2- 172.21.15.110:0/1896112257 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08900684f0 0x7f089015bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:38.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.608+0000 7f088effd700 1 -- 172.21.15.110:0/1896112257 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f08900b9600 msgr2=0x7f089015c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:38.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.608+0000 7f088effd700 1 --2- 172.21.15.110:0/1896112257 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f08900b9600 0x7f089015c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:38.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.608+0000 7f088effd700 1 -- 172.21.15.110:0/1896112257 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f089015b780 con 0x7f08900690f0 2021-03-25T14:17:38.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.608+0000 7f088effd700 1 --2- 172.21.15.110:0/1896112257 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08900690f0 0x7f08900bcc20 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f0884009760 tx=0x7f0884006e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:38.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.608+0000 7f08777fe700 1 -- 172.21.15.110:0/1896112257 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088400d4a0 con 0x7f08900690f0 2021-03-25T14:17:38.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.608+0000 7f08777fe700 1 -- 172.21.15.110:0/1896112257 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088400d620 con 0x7f08900690f0 2021-03-25T14:17:38.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.608+0000 7f0894939700 1 -- 172.21.15.110:0/1896112257 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f089015ba20 con 0x7f08900690f0 2021-03-25T14:17:38.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.608+0000 7f08777fe700 1 -- 172.21.15.110:0/1896112257 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088400d9e0 con 0x7f08900690f0 2021-03-25T14:17:38.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.608+0000 7f0894939700 1 -- 172.21.15.110:0/1896112257 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f089009ea10 con 0x7f08900690f0 2021-03-25T14:17:38.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.609+0000 7f0894939700 1 -- 172.21.15.110:0/1896112257 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08900ba060 con 0x7f08900690f0 2021-03-25T14:17:38.615 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.609+0000 7f08777fe700 1 -- 172.21.15.110:0/1896112257 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f088401b030 con 0x7f08900690f0 2021-03-25T14:17:38.616 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.609+0000 7f08777fe700 1 --2- 172.21.15.110:0/1896112257 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f087005a0b0 0x7f087005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:38.616 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.610+0000 7f08777fe700 1 -- 172.21.15.110:0/1896112257 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5606+0+0 (secure 0 0 0) 0x7f08840738d0 con 0x7f08900690f0 2021-03-25T14:17:38.616 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.610+0000 7f088f7fe700 1 --2- 172.21.15.110:0/1896112257 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f087005a0b0 0x7f087005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:38.616 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.610+0000 7f088f7fe700 1 --2- 172.21.15.110:0/1896112257 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f087005a0b0 0x7f087005c570 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f0880006fd0 tx=0x7f0880008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:38.616 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.613+0000 7f08777fe700 1 -- 172.21.15.110:0/1896112257 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f0884047440 con 0x7f08900690f0 2021-03-25T14:17:38.818 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.816+0000 7f0894939700 1 -- 172.21.15.110:0/1896112257 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.testuser"} v 0) v1 -- 0x7f0890045ae0 con 0x7f08900690f0 2021-03-25T14:17:38.821 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.819+0000 7f08777fe700 1 -- 172.21.15.110:0/1896112257 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.testuser"}]=0 updated v12) v1 ==== 92+0+0 (secure 0 0 0) 0x7f088404aa60 con 0x7f08900690f0 2021-03-25T14:17:38.823 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.821+0000 7f0894939700 1 -- 172.21.15.110:0/1896112257 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f087005a0b0 msgr2=0x7f087005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:38.824 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.821+0000 7f0894939700 1 --2- 172.21.15.110:0/1896112257 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f087005a0b0 0x7f087005c570 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f0880006fd0 tx=0x7f0880008040).stop 2021-03-25T14:17:38.824 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.821+0000 7f0894939700 1 -- 172.21.15.110:0/1896112257 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08900690f0 msgr2=0x7f08900bcc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:38.824 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.821+0000 7f0894939700 1 --2- 172.21.15.110:0/1896112257 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08900690f0 0x7f08900bcc20 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f0884009760 tx=0x7f0884006e20).stop 2021-03-25T14:17:38.824 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.821+0000 7f0894939700 1 -- 172.21.15.110:0/1896112257 shutdown_connections 2021-03-25T14:17:38.824 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.821+0000 7f0894939700 1 --2- 172.21.15.110:0/1896112257 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f087005a0b0 0x7f087005c570 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:38.824 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.821+0000 7f0894939700 1 --2- 172.21.15.110:0/1896112257 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f08900b9600 0x7f089015c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:38.824 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.821+0000 7f0894939700 1 --2- 172.21.15.110:0/1896112257 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08900684f0 0x7f089015bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:38.824 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.821+0000 7f0894939700 1 --2- 172.21.15.110:0/1896112257 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08900690f0 0x7f08900bcc20 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:38.824 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.821+0000 7f0894939700 1 -- 172.21.15.110:0/1896112257 >> 172.21.15.110:0/1896112257 conn(0x7f0890061d50 msgr2=0x7f08901481e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:38.824 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.821+0000 7f0894939700 1 -- 172.21.15.110:0/1896112257 shutdown_connections 2021-03-25T14:17:38.824 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.821+0000 7f0894939700 1 -- 172.21.15.110:0/1896112257 wait complete. 2021-03-25T14:17:38.825 INFO:teuthology.orchestra.run.smithi110.stderr:updated 2021-03-25T14:17:38.835 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:17:38.944 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.942+0000 7ff7864fc700 1 Processor -- start 2021-03-25T14:17:38.945 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.943+0000 7ff7864fc700 1 -- start start 2021-03-25T14:17:38.951 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.943+0000 7ff7864fc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7800b1720 0x7ff780149cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:38.951 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.943+0000 7ff7864fc700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff780067510 con 0x7ff7800b1340 2021-03-25T14:17:38.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.943+0000 7ff7864fc700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7800677b0 con 0x7ff78014a1e0 2021-03-25T14:17:38.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.943+0000 7ff7864fc700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff780067a50 con 0x7ff7800b1720 2021-03-25T14:17:38.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.943+0000 7ff77ffff700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7ff7800b1340 0x7ff780066420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43200/0 (socket says 172.21.15.110:43200) 2021-03-25T14:17:38.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.943+0000 7ff77ffff700 1 -- 172.21.15.110:0/4162844383 learned_addr learned my addr 172.21.15.110:0/4162844383 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:38.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.944+0000 7ff77f7fe700 1 --2- 172.21.15.110:0/4162844383 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7800b1720 0x7ff780149cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:38.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.944+0000 7ff77effd700 1 -- 172.21.15.110:0/4162844383 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1467616310 0 0) 0x7ff780067510 con 0x7ff7800b1340 2021-03-25T14:17:38.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.944+0000 7ff77effd700 1 -- 172.21.15.110:0/4162844383 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff76c003270 con 0x7ff7800b1340 2021-03-25T14:17:38.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.944+0000 7ff77effd700 1 -- 172.21.15.110:0/4162844383 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1379623578 0 0) 0x7ff7800677b0 con 0x7ff78014a1e0 2021-03-25T14:17:38.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.944+0000 7ff77effd700 1 -- 172.21.15.110:0/4162844383 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff780067510 con 0x7ff78014a1e0 2021-03-25T14:17:38.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.944+0000 7ff77effd700 1 -- 172.21.15.110:0/4162844383 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3743198327 0 0) 0x7ff76c003270 con 0x7ff7800b1340 2021-03-25T14:17:38.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.944+0000 7ff77effd700 1 -- 172.21.15.110:0/4162844383 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7800b1720 msgr2=0x7ff780149cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:38.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.944+0000 7ff77effd700 1 --2- 172.21.15.110:0/4162844383 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7800b1720 0x7ff780149cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:38.953 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.944+0000 7ff77effd700 1 -- 172.21.15.110:0/4162844383 >> v1:172.21.15.174:6789/0 conn(0x7ff78014a1e0 legacy=0x7ff78014cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:38.953 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.944+0000 7ff77effd700 1 -- 172.21.15.110:0/4162844383 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff780067cf0 con 0x7ff7800b1340 2021-03-25T14:17:38.953 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.944+0000 7ff77effd700 1 -- 172.21.15.110:0/4162844383 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7ff770001520 con 0x7ff7800b1340 2021-03-25T14:17:38.953 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.944+0000 7ff77effd700 1 -- 172.21.15.110:0/4162844383 >> v1:172.21.15.110:6789/0 conn(0x7ff7800b1340 legacy=0x7ff780066420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:38.953 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.944+0000 7ff77effd700 1 --2- 172.21.15.110:0/4162844383 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7800b1720 0x7ff76c003920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:38.953 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.944+0000 7ff77effd700 1 --2- 172.21.15.110:0/4162844383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff76c003e10 0x7ff76c004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:38.953 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.944+0000 7ff77effd700 1 --2- 172.21.15.110:0/4162844383 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff76c004a00 0x7ff76c004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:38.953 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.944+0000 7ff77effd700 1 -- 172.21.15.110:0/4162844383 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff780067a50 con 0x7ff76c003e10 2021-03-25T14:17:38.953 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.944+0000 7ff77effd700 1 -- 172.21.15.110:0/4162844383 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c0053a0 con 0x7ff76c004a00 2021-03-25T14:17:38.953 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.944+0000 7ff77effd700 1 -- 172.21.15.110:0/4162844383 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c00b7b0 con 0x7ff7800b1720 2021-03-25T14:17:38.953 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.944+0000 7ff77f7fe700 1 --2- 172.21.15.110:0/4162844383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff76c003e10 0x7ff76c004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:38.953 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.944+0000 7ff77ffff700 1 --2- 172.21.15.110:0/4162844383 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7800b1720 0x7ff76c003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:38.954 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.944+0000 7ff784a99700 1 --2- 172.21.15.110:0/4162844383 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff76c004a00 0x7ff76c004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:38.954 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.945+0000 7ff77f7fe700 1 -- 172.21.15.110:0/4162844383 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7800b1720 msgr2=0x7ff76c003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:38.954 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.945+0000 7ff77f7fe700 1 --2- 172.21.15.110:0/4162844383 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7800b1720 0x7ff76c003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:38.954 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.945+0000 7ff77f7fe700 1 -- 172.21.15.110:0/4162844383 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff76c004a00 msgr2=0x7ff76c004e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:38.954 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.945+0000 7ff77f7fe700 1 --2- 172.21.15.110:0/4162844383 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff76c004a00 0x7ff76c004e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:38.954 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.945+0000 7ff77f7fe700 1 -- 172.21.15.110:0/4162844383 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76c003270 con 0x7ff76c003e10 2021-03-25T14:17:38.954 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.945+0000 7ff77f7fe700 1 --2- 172.21.15.110:0/4162844383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff76c003e10 0x7ff76c004510 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7ff77400bc60 tx=0x7ff774006e20).ready entity=mon.0 client_cookie=f6dfd133e4c3e466 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:38.954 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.945+0000 7ff77effd700 1 -- 172.21.15.110:0/4162844383 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77400b310 con 0x7ff76c003e10 2021-03-25T14:17:38.954 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.945+0000 7ff77effd700 1 -- 172.21.15.110:0/4162844383 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff77400e9a0 con 0x7ff76c003e10 2021-03-25T14:17:38.955 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.945+0000 7ff77effd700 1 -- 172.21.15.110:0/4162844383 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77400ed20 con 0x7ff76c003e10 2021-03-25T14:17:38.955 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.945+0000 7ff7864fc700 1 -- 172.21.15.110:0/4162844383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff76c003e10 msgr2=0x7ff76c004510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:38.955 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.945+0000 7ff7864fc700 1 --2- 172.21.15.110:0/4162844383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff76c003e10 0x7ff76c004510 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7ff77400bc60 tx=0x7ff774006e20).stop 2021-03-25T14:17:38.955 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.945+0000 7ff784a99700 1 -- 172.21.15.110:0/4162844383 reap_dead start 2021-03-25T14:17:38.955 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.945+0000 7ff7864fc700 1 -- 172.21.15.110:0/4162844383 shutdown_connections 2021-03-25T14:17:38.955 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.945+0000 7ff7864fc700 1 -- 172.21.15.110:0/4162844383 >> 172.21.15.110:0/4162844383 conn(0x7ff7800649a0 msgr2=0x7ff78005c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:38.955 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.945+0000 7ff7864fc700 1 -- 172.21.15.110:0/4162844383 shutdown_connections 2021-03-25T14:17:38.955 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.945+0000 7ff7864fc700 1 -- 172.21.15.110:0/4162844383 wait complete. 2021-03-25T14:17:38.955 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.946+0000 7ff7864fc700 1 Processor -- start 2021-03-25T14:17:38.955 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.946+0000 7ff7864fc700 1 -- start start 2021-03-25T14:17:38.955 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.947+0000 7ff7864fc700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff76c003e10 0x7ff7800b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:38.955 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.947+0000 7ff7864fc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff780144ad0 0x7ff780140730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:38.956 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.947+0000 7ff7864fc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff780145670 0x7ff780140c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:38.956 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.947+0000 7ff7864fc700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7800b53c0 con 0x7ff780145670 2021-03-25T14:17:38.956 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.947+0000 7ff7864fc700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff780146530 con 0x7ff76c003e10 2021-03-25T14:17:38.956 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.947+0000 7ff7864fc700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff780145050 con 0x7ff780144ad0 2021-03-25T14:17:38.956 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.947+0000 7ff784a99700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff780145670 0x7ff780140c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:38.956 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.947+0000 7ff784a99700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff780145670 0x7ff780140c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50280/0 (socket says 172.21.15.110:50280) 2021-03-25T14:17:38.956 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.947+0000 7ff784a99700 1 -- 172.21.15.110:0/3449181793 learned_addr learned my addr 172.21.15.110:0/3449181793 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:38.956 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.947+0000 7ff77ffff700 1 --2- 172.21.15.110:0/3449181793 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff76c003e10 0x7ff7800b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:38.956 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.947+0000 7ff77f7fe700 1 --2- 172.21.15.110:0/3449181793 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff780144ad0 0x7ff780140730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:38.956 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.948+0000 7ff784a99700 1 -- 172.21.15.110:0/3449181793 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff780144ad0 msgr2=0x7ff780140730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:38.956 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.948+0000 7ff784a99700 1 --2- 172.21.15.110:0/3449181793 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff780144ad0 0x7ff780140730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:38.956 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.948+0000 7ff784a99700 1 -- 172.21.15.110:0/3449181793 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff76c003e10 msgr2=0x7ff7800b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:38.957 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.948+0000 7ff784a99700 1 --2- 172.21.15.110:0/3449181793 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff76c003e10 0x7ff7800b3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:38.957 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.948+0000 7ff784a99700 1 -- 172.21.15.110:0/3449181793 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff780146760 con 0x7ff780145670 2021-03-25T14:17:38.957 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.948+0000 7ff77f7fe700 1 --2- 172.21.15.110:0/3449181793 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff780144ad0 0x7ff780140730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:38.957 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.948+0000 7ff784a99700 1 --2- 172.21.15.110:0/3449181793 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff780145670 0x7ff780140c20 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7ff778007fd0 tx=0x7ff778007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:38.957 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.948+0000 7ff767fff700 1 -- 172.21.15.110:0/3449181793 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77800c960 con 0x7ff780145670 2021-03-25T14:17:38.957 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.948+0000 7ff767fff700 1 -- 172.21.15.110:0/3449181793 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff77800cae0 con 0x7ff780145670 2021-03-25T14:17:38.957 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.948+0000 7ff767fff700 1 -- 172.21.15.110:0/3449181793 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77800cea0 con 0x7ff780145670 2021-03-25T14:17:38.957 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.948+0000 7ff7864fc700 1 -- 172.21.15.110:0/3449181793 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff780146a00 con 0x7ff780145670 2021-03-25T14:17:38.957 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.948+0000 7ff7864fc700 1 -- 172.21.15.110:0/3449181793 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff780145de0 con 0x7ff780145670 2021-03-25T14:17:38.957 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.949+0000 7ff7864fc700 1 -- 172.21.15.110:0/3449181793 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff78005d7b0 con 0x7ff780145670 2021-03-25T14:17:38.957 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.949+0000 7ff767fff700 1 -- 172.21.15.110:0/3449181793 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7ff778001810 con 0x7ff780145670 2021-03-25T14:17:38.957 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.949+0000 7ff767fff700 1 --2- 172.21.15.110:0/3449181793 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff76005a0b0 0x7ff76005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:38.957 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.949+0000 7ff767fff700 1 -- 172.21.15.110:0/3449181793 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5606+0+0 (secure 0 0 0) 0x7ff778073540 con 0x7ff780145670 2021-03-25T14:17:38.958 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.949+0000 7ff77ffff700 1 --2- 172.21.15.110:0/3449181793 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff76005a0b0 0x7ff76005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:38.958 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.950+0000 7ff77ffff700 1 --2- 172.21.15.110:0/3449181793 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff76005a0b0 0x7ff76005c570 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7ff770000ff0 tx=0x7ff7800676a0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:38.958 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:38.953+0000 7ff767fff700 1 -- 172.21.15.110:0/3449181793 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7ff7780470b0 con 0x7ff780145670 2021-03-25T14:17:39.105 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.104+0000 7ff7864fc700 1 -- 172.21.15.110:0/3449181793 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7800bbd50 con 0x7ff780145670 2021-03-25T14:17:39.106 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.104+0000 7ff767fff700 1 -- 172.21.15.110:0/3449181793 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+13958 (secure 0 0 0) 0x7ff77804a6d0 con 0x7ff780145670 2021-03-25T14:17:39.106 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:39.107 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":52,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:17:38.117616+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:17:39.108 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.106+0000 7ff7864fc700 1 -- 172.21.15.110:0/3449181793 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff76005a0b0 msgr2=0x7ff76005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:39.108 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.106+0000 7ff7864fc700 1 --2- 172.21.15.110:0/3449181793 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff76005a0b0 0x7ff76005c570 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7ff770000ff0 tx=0x7ff7800676a0).stop 2021-03-25T14:17:39.109 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.106+0000 7ff7864fc700 1 -- 172.21.15.110:0/3449181793 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff780145670 msgr2=0x7ff780140c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:39.109 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.106+0000 7ff7864fc700 1 --2- 172.21.15.110:0/3449181793 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff780145670 0x7ff780140c20 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7ff778007fd0 tx=0x7ff778007f40).stop 2021-03-25T14:17:39.109 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.106+0000 7ff7864fc700 1 -- 172.21.15.110:0/3449181793 shutdown_connections 2021-03-25T14:17:39.109 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.106+0000 7ff7864fc700 1 --2- 172.21.15.110:0/3449181793 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff76005a0b0 0x7ff76005c570 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:39.109 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.106+0000 7ff7864fc700 1 --2- 172.21.15.110:0/3449181793 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff76c003e10 0x7ff7800b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:39.109 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.106+0000 7ff7864fc700 1 --2- 172.21.15.110:0/3449181793 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff780145670 0x7ff780140c20 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:39.109 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.106+0000 7ff7864fc700 1 --2- 172.21.15.110:0/3449181793 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff780144ad0 0x7ff780140730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:39.109 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.106+0000 7ff7864fc700 1 -- 172.21.15.110:0/3449181793 >> 172.21.15.110:0/3449181793 conn(0x7ff7800649a0 msgr2=0x7ff780141c60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:39.109 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.106+0000 7ff7864fc700 1 -- 172.21.15.110:0/3449181793 shutdown_connections 2021-03-25T14:17:39.109 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.106+0000 7ff7864fc700 1 -- 172.21.15.110:0/3449181793 wait complete. 2021-03-25T14:17:39.120 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-03-25T14:15:59.047299+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-03-25T14:16:00.537926+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-03-25T14:17:39.120 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-03-25T14:17:39.233 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.231+0000 7fa16958e700 1 Processor -- start 2021-03-25T14:17:39.233 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.231+0000 7fa16958e700 1 -- start start 2021-03-25T14:17:39.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.232+0000 7fa16958e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa1640b0cc0 0x7fa164145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:39.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.232+0000 7fa16958e700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa1640b5d00 0x7fa164067250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:39.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.232+0000 7fa16958e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa164149c50 con 0x7fa1640648a0 2021-03-25T14:17:39.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.232+0000 7fa16958e700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1641461b0 con 0x7fa1640b5d00 2021-03-25T14:17:39.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.232+0000 7fa16958e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa164149e80 con 0x7fa1640b0cc0 2021-03-25T14:17:39.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.232+0000 7fa1627fc700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa1640b5d00 0x7fa164067250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:39.236 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.232+0000 7fa1627fc700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa1640b5d00 0x7fa164067250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50288/0 (socket says 172.21.15.110:50288) 2021-03-25T14:17:39.237 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.232+0000 7fa1627fc700 1 -- 172.21.15.110:0/2050990377 learned_addr learned my addr 172.21.15.110:0/2050990377 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:39.237 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.232+0000 7fa162ffd700 1 --2- 172.21.15.110:0/2050990377 >> v2:172.21.15.174:3300/0 conn(0x7fa1640b0cc0 0x7fa164145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:39.237 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.232+0000 7fa1627fc700 1 -- 172.21.15.110:0/2050990377 >> v2:172.21.15.174:3300/0 conn(0x7fa1640b0cc0 msgr2=0x7fa164145cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:39.237 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.232+0000 7fa1627fc700 1 --2- 172.21.15.110:0/2050990377 >> v2:172.21.15.174:3300/0 conn(0x7fa1640b0cc0 0x7fa164145cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:39.237 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.232+0000 7fa1627fc700 1 -- 172.21.15.110:0/2050990377 >> v1:172.21.15.174:6789/0 conn(0x7fa1640648a0 legacy=0x7fa16409db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:39.237 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.232+0000 7fa1627fc700 1 -- 172.21.15.110:0/2050990377 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1640b6650 con 0x7fa1640b5d00 2021-03-25T14:17:39.237 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.232+0000 7fa1627fc700 1 --2- 172.21.15.110:0/2050990377 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1640b5d00 0x7fa164067250 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7fa164066100 tx=0x7fa158006ee0).ready entity=mon.0 client_cookie=c7f6aa9e069f8946 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:39.237 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.233+0000 7fa161ffb700 1 -- 172.21.15.110:0/2050990377 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa158009890 con 0x7fa1640b5d00 2021-03-25T14:17:39.237 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.233+0000 7fa161ffb700 1 -- 172.21.15.110:0/2050990377 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1580099f0 con 0x7fa1640b5d00 2021-03-25T14:17:39.237 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.233+0000 7fa161ffb700 1 -- 172.21.15.110:0/2050990377 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa158009d70 con 0x7fa1640b5d00 2021-03-25T14:17:39.237 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.233+0000 7fa16958e700 1 -- 172.21.15.110:0/2050990377 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1640b5d00 msgr2=0x7fa164067250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:39.237 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.233+0000 7fa16958e700 1 --2- 172.21.15.110:0/2050990377 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1640b5d00 0x7fa164067250 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7fa164066100 tx=0x7fa158006ee0).stop 2021-03-25T14:17:39.237 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.233+0000 7fa16958e700 1 -- 172.21.15.110:0/2050990377 shutdown_connections 2021-03-25T14:17:39.238 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.233+0000 7fa16958e700 1 --2- 172.21.15.110:0/2050990377 >> v2:172.21.15.174:3300/0 conn(0x7fa1640b0cc0 0x7fa164145cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:39.238 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.233+0000 7fa16958e700 1 --2- 172.21.15.110:0/2050990377 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1640b5d00 0x7fa164067250 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:39.238 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.233+0000 7fa16958e700 1 -- 172.21.15.110:0/2050990377 >> 172.21.15.110:0/2050990377 conn(0x7fa1640664e0 msgr2=0x7fa1640668f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:39.238 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.233+0000 7fa16958e700 1 -- 172.21.15.110:0/2050990377 shutdown_connections 2021-03-25T14:17:39.238 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.233+0000 7fa16958e700 1 -- 172.21.15.110:0/2050990377 wait complete. 2021-03-25T14:17:39.238 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.234+0000 7fa16958e700 1 Processor -- start 2021-03-25T14:17:39.238 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.234+0000 7fa16958e700 1 -- start start 2021-03-25T14:17:39.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.235+0000 7fa16958e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1640648a0 0x7fa1640b3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:39.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.235+0000 7fa16958e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa1640b0cc0 0x7fa164143440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:39.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.235+0000 7fa16958e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa1640b5d00 0x7fa164143930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:39.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.235+0000 7fa16958e700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16409d3b0 con 0x7fa1640648a0 2021-03-25T14:17:39.241 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.235+0000 7fa16958e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16409d650 con 0x7fa1640b5d00 2021-03-25T14:17:39.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.235+0000 7fa16958e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa16409d8f0 con 0x7fa1640b0cc0 2021-03-25T14:17:39.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.235+0000 7fa162ffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1640648a0 0x7fa1640b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:39.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.235+0000 7fa162ffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1640648a0 0x7fa1640b3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50290/0 (socket says 172.21.15.110:50290) 2021-03-25T14:17:39.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.235+0000 7fa162ffd700 1 -- 172.21.15.110:0/102432784 learned_addr learned my addr 172.21.15.110:0/102432784 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:39.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.235+0000 7fa162ffd700 1 -- 172.21.15.110:0/102432784 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa1640b0cc0 msgr2=0x7fa164143440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:39.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.235+0000 7fa162ffd700 1 --2- 172.21.15.110:0/102432784 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa1640b0cc0 0x7fa164143440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:39.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.235+0000 7fa162ffd700 1 -- 172.21.15.110:0/102432784 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa1640b5d00 msgr2=0x7fa164143930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:39.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.235+0000 7fa162ffd700 1 --2- 172.21.15.110:0/102432784 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa1640b5d00 0x7fa164143930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:39.242 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.235+0000 7fa162ffd700 1 -- 172.21.15.110:0/102432784 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1640b53f0 con 0x7fa1640648a0 2021-03-25T14:17:39.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.235+0000 7fa162ffd700 1 --2- 172.21.15.110:0/102432784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1640648a0 0x7fa1640b3830 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fa15400c920 tx=0x7fa154008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:39.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.236+0000 7fa14affd700 1 -- 172.21.15.110:0/102432784 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15400cec0 con 0x7fa1640648a0 2021-03-25T14:17:39.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.236+0000 7fa14affd700 1 -- 172.21.15.110:0/102432784 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa154007740 con 0x7fa1640648a0 2021-03-25T14:17:39.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.236+0000 7fa16958e700 1 -- 172.21.15.110:0/102432784 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1640b5690 con 0x7fa1640648a0 2021-03-25T14:17:39.243 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.236+0000 7fa14affd700 1 -- 172.21.15.110:0/102432784 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa154007ac0 con 0x7fa1640648a0 2021-03-25T14:17:39.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.236+0000 7fa16958e700 1 -- 172.21.15.110:0/102432784 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1640b3d20 con 0x7fa1640648a0 2021-03-25T14:17:39.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.236+0000 7fa16958e700 1 -- 172.21.15.110:0/102432784 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1640b5820 con 0x7fa1640648a0 2021-03-25T14:17:39.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.237+0000 7fa14affd700 1 -- 172.21.15.110:0/102432784 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fa15401b460 con 0x7fa1640648a0 2021-03-25T14:17:39.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.237+0000 7fa14affd700 1 --2- 172.21.15.110:0/102432784 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa14405a0b0 0x7fa14405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:39.244 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.237+0000 7fa14affd700 1 -- 172.21.15.110:0/102432784 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5606+0+0 (secure 0 0 0) 0x7fa154073bd0 con 0x7fa1640648a0 2021-03-25T14:17:39.245 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.237+0000 7fa1627fc700 1 --2- 172.21.15.110:0/102432784 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa14405a0b0 0x7fa14405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:39.245 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.237+0000 7fa1627fc700 1 --2- 172.21.15.110:0/102432784 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa14405a0b0 0x7fa14405c570 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fa16409d0d0 tx=0x7fa158016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:39.245 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.241+0000 7fa14affd700 1 -- 172.21.15.110:0/102432784 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fa1540476e0 con 0x7fa1640648a0 2021-03-25T14:17:39.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.391+0000 7fa16958e700 1 -- 172.21.15.110:0/102432784 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fa16405d7b0 con 0x7fa1640648a0 2021-03-25T14:17:39.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.391+0000 7fa14affd700 1 -- 172.21.15.110:0/102432784 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v52) v1 ==== 110+0+10 (secure 0 0 0) 0x7fa15404ad00 con 0x7fa1640648a0 2021-03-25T14:17:39.394 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 1 2021-03-25T14:17:39.395 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.393+0000 7fa16958e700 1 -- 172.21.15.110:0/102432784 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa14405a0b0 msgr2=0x7fa14405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:39.395 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.393+0000 7fa16958e700 1 --2- 172.21.15.110:0/102432784 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa14405a0b0 0x7fa14405c570 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fa16409d0d0 tx=0x7fa158016000).stop 2021-03-25T14:17:39.395 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.393+0000 7fa16958e700 1 -- 172.21.15.110:0/102432784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1640648a0 msgr2=0x7fa1640b3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:39.395 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.393+0000 7fa16958e700 1 --2- 172.21.15.110:0/102432784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1640648a0 0x7fa1640b3830 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fa15400c920 tx=0x7fa154008040).stop 2021-03-25T14:17:39.395 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.393+0000 7fa16958e700 1 -- 172.21.15.110:0/102432784 shutdown_connections 2021-03-25T14:17:39.395 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.393+0000 7fa16958e700 1 --2- 172.21.15.110:0/102432784 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa14405a0b0 0x7fa14405c570 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:39.395 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.393+0000 7fa16958e700 1 --2- 172.21.15.110:0/102432784 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa1640b5d00 0x7fa164143930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:39.396 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.393+0000 7fa16958e700 1 --2- 172.21.15.110:0/102432784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1640648a0 0x7fa1640b3830 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:39.396 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.393+0000 7fa16958e700 1 --2- 172.21.15.110:0/102432784 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa1640b0cc0 0x7fa164143440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:39.396 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.393+0000 7fa16958e700 1 -- 172.21.15.110:0/102432784 >> 172.21.15.110:0/102432784 conn(0x7fa1640664e0 msgr2=0x7fa16409e180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:39.396 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.393+0000 7fa16958e700 1 -- 172.21.15.110:0/102432784 shutdown_connections 2021-03-25T14:17:39.396 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.393+0000 7fa16958e700 1 -- 172.21.15.110:0/102432784 wait complete. 2021-03-25T14:17:39.407 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-03-25T14:17:39.518 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.516+0000 7fc3d7451700 1 Processor -- start 2021-03-25T14:17:39.518 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.517+0000 7fc3d7451700 1 -- start start 2021-03-25T14:17:39.522 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.517+0000 7fc3d7451700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3d0143bc0 0x7fc3d00a2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:39.522 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.517+0000 7fc3d7451700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3d00b6c90 con 0x7fc3d0060e00 2021-03-25T14:17:39.522 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.517+0000 7fc3d7451700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3d014a080 con 0x7fc3d0068440 2021-03-25T14:17:39.522 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.517+0000 7fc3d7451700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d0068ca0 con 0x7fc3d0143bc0 2021-03-25T14:17:39.522 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.517+0000 7fc3d51ed700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fc3d0060e00 0x7fc3d0149970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43234/0 (socket says 172.21.15.110:43234) 2021-03-25T14:17:39.522 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.518+0000 7fc3d51ed700 1 -- 172.21.15.110:0/1234898299 learned_addr learned my addr 172.21.15.110:0/1234898299 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:39.523 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.518+0000 7fc3d59ee700 1 --2- 172.21.15.110:0/1234898299 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3d0143bc0 0x7fc3d00a2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:39.523 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.518+0000 7fc3c3fff700 1 -- 172.21.15.110:0/1234898299 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1022356533 0 0) 0x7fc3cc001110 con 0x7fc3d0060e00 2021-03-25T14:17:39.523 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.518+0000 7fc3c3fff700 1 -- 172.21.15.110:0/1234898299 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3b8003270 con 0x7fc3d0060e00 2021-03-25T14:17:39.523 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.518+0000 7fc3c3fff700 1 -- 172.21.15.110:0/1234898299 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 416504907 0 0) 0x7fc3b8003270 con 0x7fc3d0060e00 2021-03-25T14:17:39.523 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.518+0000 7fc3c3fff700 1 -- 172.21.15.110:0/1234898299 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3d0143bc0 msgr2=0x7fc3d00a2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:39.523 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.518+0000 7fc3c3fff700 1 --2- 172.21.15.110:0/1234898299 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3d0143bc0 0x7fc3d00a2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:39.523 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.518+0000 7fc3c3fff700 1 -- 172.21.15.110:0/1234898299 >> v1:172.21.15.174:6789/0 conn(0x7fc3d0068440 legacy=0x7fc3d01434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:39.523 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.518+0000 7fc3c3fff700 1 -- 172.21.15.110:0/1234898299 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d00a2d40 con 0x7fc3d0060e00 2021-03-25T14:17:39.523 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.518+0000 7fc3c3fff700 1 -- 172.21.15.110:0/1234898299 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7fc3cc0016b0 con 0x7fc3d0060e00 2021-03-25T14:17:39.523 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.518+0000 7fc3c3fff700 1 -- 172.21.15.110:0/1234898299 >> v1:172.21.15.110:6789/0 conn(0x7fc3d0060e00 legacy=0x7fc3d0149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:39.523 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.518+0000 7fc3c3fff700 1 --2- 172.21.15.110:0/1234898299 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3d0143bc0 0x7fc3b8003790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:39.523 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.518+0000 7fc3c3fff700 1 --2- 172.21.15.110:0/1234898299 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3b8003c80 0x7fc3b8004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:39.523 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.518+0000 7fc3c3fff700 1 --2- 172.21.15.110:0/1234898299 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3b8004a00 0x7fc3b8004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:39.524 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.518+0000 7fc3c3fff700 1 -- 172.21.15.110:0/1234898299 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d0068ca0 con 0x7fc3b8003c80 2021-03-25T14:17:39.524 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.518+0000 7fc3c3fff700 1 -- 172.21.15.110:0/1234898299 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b80041a0 con 0x7fc3b8004a00 2021-03-25T14:17:39.524 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.518+0000 7fc3c3fff700 1 -- 172.21.15.110:0/1234898299 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b8004360 con 0x7fc3d0143bc0 2021-03-25T14:17:39.524 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.518+0000 7fc3d49ec700 1 --2- 172.21.15.110:0/1234898299 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3b8003c80 0x7fc3b8004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:39.524 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.518+0000 7fc3d51ed700 1 --2- 172.21.15.110:0/1234898299 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3d0143bc0 0x7fc3b8003790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:39.524 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.518+0000 7fc3d59ee700 1 --2- 172.21.15.110:0/1234898299 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3b8004a00 0x7fc3b8004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:39.524 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.518+0000 7fc3d49ec700 1 -- 172.21.15.110:0/1234898299 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3d0143bc0 msgr2=0x7fc3b8003790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:39.524 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.518+0000 7fc3d49ec700 1 --2- 172.21.15.110:0/1234898299 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3d0143bc0 0x7fc3b8003790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:39.524 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.518+0000 7fc3d49ec700 1 -- 172.21.15.110:0/1234898299 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3b8004a00 msgr2=0x7fc3b8004e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:39.524 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.518+0000 7fc3d49ec700 1 --2- 172.21.15.110:0/1234898299 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3b8004a00 0x7fc3b8004e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:39.524 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.518+0000 7fc3d49ec700 1 -- 172.21.15.110:0/1234898299 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b8003270 con 0x7fc3b8003c80 2021-03-25T14:17:39.524 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.519+0000 7fc3d49ec700 1 --2- 172.21.15.110:0/1234898299 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3b8003c80 0x7fc3b8004510 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7fc3c4001a40 tx=0x7fc3c4007ba0).ready entity=mon.0 client_cookie=5e5c88f6a0d763ca server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:39.525 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.519+0000 7fc3c3fff700 1 -- 172.21.15.110:0/1234898299 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c400c5f0 con 0x7fc3b8003c80 2021-03-25T14:17:39.525 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.519+0000 7fc3c3fff700 1 -- 172.21.15.110:0/1234898299 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c400c750 con 0x7fc3b8003c80 2021-03-25T14:17:39.525 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.519+0000 7fc3c3fff700 1 -- 172.21.15.110:0/1234898299 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c400cb10 con 0x7fc3b8003c80 2021-03-25T14:17:39.525 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.519+0000 7fc3d7451700 1 -- 172.21.15.110:0/1234898299 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3b8003c80 msgr2=0x7fc3b8004510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:39.525 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.519+0000 7fc3d7451700 1 --2- 172.21.15.110:0/1234898299 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3b8003c80 0x7fc3b8004510 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7fc3c4001a40 tx=0x7fc3c4007ba0).stop 2021-03-25T14:17:39.525 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.519+0000 7fc3d59ee700 1 -- 172.21.15.110:0/1234898299 reap_dead start 2021-03-25T14:17:39.525 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.519+0000 7fc3d7451700 1 -- 172.21.15.110:0/1234898299 shutdown_connections 2021-03-25T14:17:39.525 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.519+0000 7fc3d7451700 1 -- 172.21.15.110:0/1234898299 >> 172.21.15.110:0/1234898299 conn(0x7fc3d0061d50 msgr2=0x7fc3d0062160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:39.525 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.519+0000 7fc3d7451700 1 -- 172.21.15.110:0/1234898299 shutdown_connections 2021-03-25T14:17:39.525 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.519+0000 7fc3d7451700 1 -- 172.21.15.110:0/1234898299 wait complete. 2021-03-25T14:17:39.525 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.520+0000 7fc3d7451700 1 Processor -- start 2021-03-25T14:17:39.525 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.520+0000 7fc3d7451700 1 -- start start 2021-03-25T14:17:39.528 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.521+0000 7fc3d7451700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3d00a1f30 0x7fc3d009fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:39.528 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.521+0000 7fc3d7451700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3d00a0310 0x7fc3d01447e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:39.528 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.521+0000 7fc3d7451700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3d00a0790 0x7fc3d0144cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:39.528 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.521+0000 7fc3d7451700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d00a1560 con 0x7fc3d00a1f30 2021-03-25T14:17:39.529 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.521+0000 7fc3d7451700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d00a2870 con 0x7fc3d00a0310 2021-03-25T14:17:39.529 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.521+0000 7fc3d7451700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d0159bc0 con 0x7fc3d00a0790 2021-03-25T14:17:39.529 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.521+0000 7fc3d51ed700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3d00a1f30 0x7fc3d009fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:39.529 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.521+0000 7fc3d51ed700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3d00a1f30 0x7fc3d009fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50310/0 (socket says 172.21.15.110:50310) 2021-03-25T14:17:39.529 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.521+0000 7fc3d51ed700 1 -- 172.21.15.110:0/678533690 learned_addr learned my addr 172.21.15.110:0/678533690 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:39.529 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.521+0000 7fc3d59ee700 1 --2- 172.21.15.110:0/678533690 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3d00a0790 0x7fc3d0144cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:39.529 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.521+0000 7fc3d49ec700 1 --2- 172.21.15.110:0/678533690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3d00a0310 0x7fc3d01447e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:39.529 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.522+0000 7fc3d51ed700 1 -- 172.21.15.110:0/678533690 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3d00a0790 msgr2=0x7fc3d0144cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:39.529 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.522+0000 7fc3d51ed700 1 --2- 172.21.15.110:0/678533690 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3d00a0790 0x7fc3d0144cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:39.529 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.522+0000 7fc3d51ed700 1 -- 172.21.15.110:0/678533690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3d00a0310 msgr2=0x7fc3d01447e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:39.529 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.522+0000 7fc3d51ed700 1 --2- 172.21.15.110:0/678533690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3d00a0310 0x7fc3d01447e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:39.529 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.522+0000 7fc3d51ed700 1 -- 172.21.15.110:0/678533690 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d0159e60 con 0x7fc3d00a1f30 2021-03-25T14:17:39.529 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.522+0000 7fc3d51ed700 1 --2- 172.21.15.110:0/678533690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3d00a1f30 0x7fc3d009fe20 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7fc3cc004c20 tx=0x7fc3d00b7f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:39.530 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.522+0000 7fc3c17fa700 1 -- 172.21.15.110:0/678533690 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc00f8d0 con 0x7fc3d00a1f30 2021-03-25T14:17:39.530 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.522+0000 7fc3c17fa700 1 -- 172.21.15.110:0/678533690 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3cc00fa30 con 0x7fc3d00a1f30 2021-03-25T14:17:39.530 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.522+0000 7fc3d7451700 1 -- 172.21.15.110:0/678533690 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3d01440a0 con 0x7fc3d00a1f30 2021-03-25T14:17:39.530 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.522+0000 7fc3c17fa700 1 -- 172.21.15.110:0/678533690 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc00fdd0 con 0x7fc3d00a1f30 2021-03-25T14:17:39.530 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.522+0000 7fc3d7451700 1 -- 172.21.15.110:0/678533690 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3d0145ed0 con 0x7fc3d00a1f30 2021-03-25T14:17:39.530 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.523+0000 7fc3d7451700 1 -- 172.21.15.110:0/678533690 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3d0144500 con 0x7fc3d00a1f30 2021-03-25T14:17:39.530 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.523+0000 7fc3c17fa700 1 -- 172.21.15.110:0/678533690 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fc3cc01b030 con 0x7fc3d00a1f30 2021-03-25T14:17:39.530 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.523+0000 7fc3c17fa700 1 --2- 172.21.15.110:0/678533690 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc3b005a0b0 0x7fc3b005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:39.530 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.523+0000 7fc3c17fa700 1 -- 172.21.15.110:0/678533690 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5606+0+0 (secure 0 0 0) 0x7fc3cc073200 con 0x7fc3d00a1f30 2021-03-25T14:17:39.530 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.523+0000 7fc3d49ec700 1 --2- 172.21.15.110:0/678533690 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc3b005a0b0 0x7fc3b005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:39.530 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.524+0000 7fc3d49ec700 1 --2- 172.21.15.110:0/678533690 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc3b005a0b0 0x7fc3b005c570 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7fc3d005fdb0 tx=0x7fc3c4016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:39.531 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.527+0000 7fc3c17fa700 1 -- 172.21.15.110:0/678533690 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fc3cc046d70 con 0x7fc3d00a1f30 2021-03-25T14:17:39.677 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.676+0000 7fc3d7451700 1 -- 172.21.15.110:0/678533690 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc3d00b6c90 con 0x7fc3d00a1f30 2021-03-25T14:17:39.678 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.676+0000 7fc3c17fa700 1 -- 172.21.15.110:0/678533690 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v52) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc3d00b6c90 con 0x7fc3d00a1f30 2021-03-25T14:17:39.678 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:17:39.680 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.678+0000 7fc3d7451700 1 -- 172.21.15.110:0/678533690 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc3b005a0b0 msgr2=0x7fc3b005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:39.680 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.678+0000 7fc3d7451700 1 --2- 172.21.15.110:0/678533690 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc3b005a0b0 0x7fc3b005c570 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7fc3d005fdb0 tx=0x7fc3c4016000).stop 2021-03-25T14:17:39.680 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.678+0000 7fc3d7451700 1 -- 172.21.15.110:0/678533690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3d00a1f30 msgr2=0x7fc3d009fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:39.680 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.678+0000 7fc3d7451700 1 --2- 172.21.15.110:0/678533690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3d00a1f30 0x7fc3d009fe20 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7fc3cc004c20 tx=0x7fc3d00b7f40).stop 2021-03-25T14:17:39.680 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.678+0000 7fc3d7451700 1 -- 172.21.15.110:0/678533690 shutdown_connections 2021-03-25T14:17:39.680 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.678+0000 7fc3d7451700 1 --2- 172.21.15.110:0/678533690 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc3b005a0b0 0x7fc3b005c570 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:39.680 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.678+0000 7fc3d7451700 1 --2- 172.21.15.110:0/678533690 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3d00a0790 0x7fc3d0144cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:39.681 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.678+0000 7fc3d7451700 1 --2- 172.21.15.110:0/678533690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3d00a1f30 0x7fc3d009fe20 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:39.681 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.678+0000 7fc3d7451700 1 --2- 172.21.15.110:0/678533690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3d00a0310 0x7fc3d01447e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:39.681 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.678+0000 7fc3d7451700 1 -- 172.21.15.110:0/678533690 >> 172.21.15.110:0/678533690 conn(0x7fc3d0061d50 msgr2=0x7fc3d014c150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:39.681 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.678+0000 7fc3d7451700 1 -- 172.21.15.110:0/678533690 shutdown_connections 2021-03-25T14:17:39.681 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.678+0000 7fc3d7451700 1 -- 172.21.15.110:0/678533690 wait complete. 2021-03-25T14:17:39.691 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-03-25T14:17:39.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.798+0000 7f730c976700 1 Processor -- start 2021-03-25T14:17:39.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.798+0000 7f730c976700 1 -- start start 2021-03-25T14:17:39.803 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.799+0000 7f730c976700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f73080686f0 0x7f7308068ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:39.803 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.799+0000 7f730c976700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7308067930 0x7f73080b81a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:39.803 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.799+0000 7f730c976700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f730805ca90 0x7f73080b8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:39.803 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.799+0000 7f730c976700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f730814a760 con 0x7f730805ca90 2021-03-25T14:17:39.803 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.799+0000 7f730c976700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7308065620 con 0x7f7308067930 2021-03-25T14:17:39.803 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.799+0000 7f730c976700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73080b8b80 con 0x7f73080686f0 2021-03-25T14:17:39.803 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.799+0000 7f7307fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f730805ca90 0x7f73080b8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:39.804 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.799+0000 7f7307fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f730805ca90 0x7f73080b8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50318/0 (socket says 172.21.15.110:50318) 2021-03-25T14:17:39.804 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.799+0000 7f7307fff700 1 -- 172.21.15.110:0/2953202967 learned_addr learned my addr 172.21.15.110:0/2953202967 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:39.804 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.799+0000 7f7306ffd700 1 --2- 172.21.15.110:0/2953202967 >> v2:172.21.15.174:3300/0 conn(0x7f7308067930 0x7f73080b81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:39.804 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.799+0000 7f73077fe700 1 --2- 172.21.15.110:0/2953202967 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f73080686f0 0x7f7308068ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:39.804 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.800+0000 7f7307fff700 1 -- 172.21.15.110:0/2953202967 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f73080686f0 msgr2=0x7f7308068ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:39.804 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.800+0000 7f7307fff700 1 --2- 172.21.15.110:0/2953202967 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f73080686f0 0x7f7308068ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:39.804 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.800+0000 7f7307fff700 1 -- 172.21.15.110:0/2953202967 >> v2:172.21.15.174:3300/0 conn(0x7f7308067930 msgr2=0x7f73080b81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:39.804 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.800+0000 7f7307fff700 1 --2- 172.21.15.110:0/2953202967 >> v2:172.21.15.174:3300/0 conn(0x7f7308067930 0x7f73080b81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:39.804 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.800+0000 7f7307fff700 1 -- 172.21.15.110:0/2953202967 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7308064460 con 0x7f730805ca90 2021-03-25T14:17:39.804 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.800+0000 7f7306ffd700 1 --2- 172.21.15.110:0/2953202967 >> v2:172.21.15.174:3300/0 conn(0x7f7308067930 0x7f73080b81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:39.804 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.800+0000 7f7307fff700 1 --2- 172.21.15.110:0/2953202967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f730805ca90 0x7f73080b8690 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f7308062a50 tx=0x7f73000092d0).ready entity=mon.0 client_cookie=86193bf5acfc4a8f server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:39.804 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.800+0000 7f73067fc700 1 -- 172.21.15.110:0/2953202967 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730000bc00 con 0x7f730805ca90 2021-03-25T14:17:39.805 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.800+0000 7f73067fc700 1 -- 172.21.15.110:0/2953202967 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730000bd60 con 0x7f730805ca90 2021-03-25T14:17:39.805 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.800+0000 7f73067fc700 1 -- 172.21.15.110:0/2953202967 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7300011610 con 0x7f730805ca90 2021-03-25T14:17:39.805 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.800+0000 7f730c976700 1 -- 172.21.15.110:0/2953202967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f730805ca90 msgr2=0x7f73080b8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:39.805 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.800+0000 7f730c976700 1 --2- 172.21.15.110:0/2953202967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f730805ca90 0x7f73080b8690 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f7308062a50 tx=0x7f73000092d0).stop 2021-03-25T14:17:39.805 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.800+0000 7f730c976700 1 -- 172.21.15.110:0/2953202967 shutdown_connections 2021-03-25T14:17:39.805 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.800+0000 7f730c976700 1 --2- 172.21.15.110:0/2953202967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f730805ca90 0x7f73080b8690 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:39.805 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.800+0000 7f730c976700 1 --2- 172.21.15.110:0/2953202967 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f73080686f0 0x7f7308068ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:39.805 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.800+0000 7f730c976700 1 --2- 172.21.15.110:0/2953202967 >> v2:172.21.15.174:3300/0 conn(0x7f7308067930 0x7f73080b81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:39.805 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.800+0000 7f730c976700 1 -- 172.21.15.110:0/2953202967 >> 172.21.15.110:0/2953202967 conn(0x7f73080bc2e0 msgr2=0x7f73080bc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:39.806 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.800+0000 7f730c976700 1 -- 172.21.15.110:0/2953202967 shutdown_connections 2021-03-25T14:17:39.806 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.800+0000 7f730c976700 1 -- 172.21.15.110:0/2953202967 wait complete. 2021-03-25T14:17:39.809 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.802+0000 7f730c976700 1 Processor -- start 2021-03-25T14:17:39.809 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.802+0000 7f730c976700 1 -- start start 2021-03-25T14:17:39.809 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.802+0000 7f730c976700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f730805ca90 0x7f730814f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:39.809 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.802+0000 7f730c976700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7308067930 0x7f73081590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:39.809 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.802+0000 7f730c976700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73080686f0 0x7f73081595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:39.809 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.802+0000 7f730c976700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730814e810 con 0x7f73080686f0 2021-03-25T14:17:39.809 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.802+0000 7f730c976700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7308158a80 con 0x7f7308067930 2021-03-25T14:17:39.809 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.802+0000 7f730c976700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f730814ef40 con 0x7f730805ca90 2021-03-25T14:17:39.809 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.802+0000 7f7307fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73080686f0 0x7f73081595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:39.809 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.802+0000 7f7307fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73080686f0 0x7f73081595c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50328/0 (socket says 172.21.15.110:50328) 2021-03-25T14:17:39.809 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.802+0000 7f7307fff700 1 -- 172.21.15.110:0/3684116813 learned_addr learned my addr 172.21.15.110:0/3684116813 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:39.810 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.802+0000 7f73077fe700 1 --2- 172.21.15.110:0/3684116813 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f730805ca90 0x7f730814f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:39.810 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.802+0000 7f7306ffd700 1 --2- 172.21.15.110:0/3684116813 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7308067930 0x7f73081590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:39.810 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.803+0000 7f7307fff700 1 -- 172.21.15.110:0/3684116813 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f730805ca90 msgr2=0x7f730814f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:39.810 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.803+0000 7f7307fff700 1 --2- 172.21.15.110:0/3684116813 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f730805ca90 0x7f730814f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:39.810 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.803+0000 7f7307fff700 1 -- 172.21.15.110:0/3684116813 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7308067930 msgr2=0x7f73081590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:39.810 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.803+0000 7f7307fff700 1 --2- 172.21.15.110:0/3684116813 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7308067930 0x7f73081590d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:39.810 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.803+0000 7f7307fff700 1 -- 172.21.15.110:0/3684116813 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7308158c70 con 0x7f73080686f0 2021-03-25T14:17:39.810 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.803+0000 7f7307fff700 1 --2- 172.21.15.110:0/3684116813 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73080686f0 0x7f73081595c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f7308066870 tx=0x7f7300017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:39.810 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.803+0000 7f72ef7fe700 1 -- 172.21.15.110:0/3684116813 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730000bed0 con 0x7f73080686f0 2021-03-25T14:17:39.810 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.803+0000 7f72ef7fe700 1 -- 172.21.15.110:0/3684116813 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73000032d0 con 0x7f73080686f0 2021-03-25T14:17:39.810 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.803+0000 7f730c976700 1 -- 172.21.15.110:0/3684116813 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73081566e0 con 0x7f73080686f0 2021-03-25T14:17:39.811 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.803+0000 7f72ef7fe700 1 -- 172.21.15.110:0/3684116813 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7300010c90 con 0x7f73080686f0 2021-03-25T14:17:39.811 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.803+0000 7f730c976700 1 -- 172.21.15.110:0/3684116813 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f730814eca0 con 0x7f73080686f0 2021-03-25T14:17:39.811 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.804+0000 7f730c976700 1 -- 172.21.15.110:0/3684116813 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7308158e00 con 0x7f73080686f0 2021-03-25T14:17:39.811 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.804+0000 7f72ef7fe700 1 -- 172.21.15.110:0/3684116813 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f730000f070 con 0x7f73080686f0 2021-03-25T14:17:39.811 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.805+0000 7f72ef7fe700 1 --2- 172.21.15.110:0/3684116813 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f72e805a0b0 0x7f72e805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:39.811 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.805+0000 7f72ef7fe700 1 -- 172.21.15.110:0/3684116813 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5606+0+0 (secure 0 0 0) 0x7f7300075790 con 0x7f73080686f0 2021-03-25T14:17:39.811 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.805+0000 7f73077fe700 1 --2- 172.21.15.110:0/3684116813 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f72e805a0b0 0x7f72e805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:39.811 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.805+0000 7f73077fe700 1 --2- 172.21.15.110:0/3684116813 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f72e805a0b0 0x7f72e805c570 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f72f800d9b0 tx=0x7f72f8008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:39.811 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.808+0000 7f72ef7fe700 1 -- 172.21.15.110:0/3684116813 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f7300049300 con 0x7f73080686f0 2021-03-25T14:17:39.961 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.960+0000 7f730c976700 1 -- 172.21.15.110:0/3684116813 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7308045ae0 con 0x7f73080686f0 2021-03-25T14:17:39.962 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.960+0000 7f72ef7fe700 1 -- 172.21.15.110:0/3684116813 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v52) v1 ==== 84+0+143 (secure 0 0 0) 0x7f730004c920 con 0x7f73080686f0 2021-03-25T14:17:39.962 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:39.962 INFO:teuthology.orchestra.run.smithi110.stdout:[ 2021-03-25T14:17:39.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:17:39.962 INFO:teuthology.orchestra.run.smithi110.stdout: "poolnum": 1, 2021-03-25T14:17:39.962 INFO:teuthology.orchestra.run.smithi110.stdout: "poolname": "device_health_metrics" 2021-03-25T14:17:39.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:17:39.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:17:39.962 INFO:teuthology.orchestra.run.smithi110.stdout: "poolnum": 2, 2021-03-25T14:17:39.963 INFO:teuthology.orchestra.run.smithi110.stdout: "poolname": "rbd" 2021-03-25T14:17:39.963 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:17:39.963 INFO:teuthology.orchestra.run.smithi110.stdout:] 2021-03-25T14:17:39.964 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.961+0000 7f730c976700 1 -- 172.21.15.110:0/3684116813 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f72e805a0b0 msgr2=0x7f72e805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:39.964 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.961+0000 7f730c976700 1 --2- 172.21.15.110:0/3684116813 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f72e805a0b0 0x7f72e805c570 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f72f800d9b0 tx=0x7f72f8008040).stop 2021-03-25T14:17:39.964 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.961+0000 7f730c976700 1 -- 172.21.15.110:0/3684116813 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73080686f0 msgr2=0x7f73081595c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:39.964 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.961+0000 7f730c976700 1 --2- 172.21.15.110:0/3684116813 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73080686f0 0x7f73081595c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f7308066870 tx=0x7f7300017000).stop 2021-03-25T14:17:39.964 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.961+0000 7f730c976700 1 -- 172.21.15.110:0/3684116813 shutdown_connections 2021-03-25T14:17:39.964 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.961+0000 7f730c976700 1 --2- 172.21.15.110:0/3684116813 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f72e805a0b0 0x7f72e805c570 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:39.964 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.961+0000 7f730c976700 1 --2- 172.21.15.110:0/3684116813 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73080686f0 0x7f73081595c0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:39.964 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.961+0000 7f730c976700 1 --2- 172.21.15.110:0/3684116813 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f730805ca90 0x7f730814f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:39.964 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.961+0000 7f730c976700 1 --2- 172.21.15.110:0/3684116813 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7308067930 0x7f73081590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:39.965 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.961+0000 7f730c976700 1 -- 172.21.15.110:0/3684116813 >> 172.21.15.110:0/3684116813 conn(0x7f73080bc2e0 msgr2=0x7f73080b7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:39.965 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.962+0000 7f730c976700 1 -- 172.21.15.110:0/3684116813 shutdown_connections 2021-03-25T14:17:39.965 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:39.962+0000 7f730c976700 1 -- 172.21.15.110:0/3684116813 wait complete. 2021-03-25T14:17:39.975 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-03-25T14:17:39.975 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-03-25T14:17:40.087 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.085+0000 7f85a8f5a700 1 Processor -- start 2021-03-25T14:17:40.087 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.085+0000 7f85a8f5a700 1 -- start start 2021-03-25T14:17:40.090 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.086+0000 7f85a8f5a700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f85a40b0cc0 0x7f85a4145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:40.090 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.086+0000 7f85a8f5a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f85a40b5d00 0x7f85a4067250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:40.090 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.086+0000 7f85a8f5a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85a4149c50 con 0x7f85a40648a0 2021-03-25T14:17:40.090 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.086+0000 7f85a8f5a700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a41461b0 con 0x7f85a40b0cc0 2021-03-25T14:17:40.090 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.086+0000 7f85a8f5a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a4149e80 con 0x7f85a40b5d00 2021-03-25T14:17:40.090 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.086+0000 7f85a259c700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f85a40b0cc0 0x7f85a4145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:40.090 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.086+0000 7f85a259c700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f85a40b0cc0 0x7f85a4145cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50332/0 (socket says 172.21.15.110:50332) 2021-03-25T14:17:40.091 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.086+0000 7f85a259c700 1 -- 172.21.15.110:0/3462818740 learned_addr learned my addr 172.21.15.110:0/3462818740 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:40.091 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.086+0000 7f85a1d9b700 1 --2- 172.21.15.110:0/3462818740 >> v2:172.21.15.174:3300/0 conn(0x7f85a40b5d00 0x7f85a4067250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:40.091 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.086+0000 7f85a259c700 1 -- 172.21.15.110:0/3462818740 >> v2:172.21.15.174:3300/0 conn(0x7f85a40b5d00 msgr2=0x7f85a4067250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:40.091 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.086+0000 7f85a259c700 1 --2- 172.21.15.110:0/3462818740 >> v2:172.21.15.174:3300/0 conn(0x7f85a40b5d00 0x7f85a4067250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:40.091 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.086+0000 7f85a259c700 1 -- 172.21.15.110:0/3462818740 >> v1:172.21.15.174:6789/0 conn(0x7f85a40648a0 legacy=0x7f85a409db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:40.091 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.086+0000 7f85a259c700 1 -- 172.21.15.110:0/3462818740 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a40b6650 con 0x7f85a40b0cc0 2021-03-25T14:17:40.091 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.086+0000 7f85a1d9b700 1 --2- 172.21.15.110:0/3462818740 >> v2:172.21.15.174:3300/0 conn(0x7f85a40b5d00 0x7f85a4067250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:40.091 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.087+0000 7f85a259c700 1 --2- 172.21.15.110:0/3462818740 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85a40b0cc0 0x7f85a4145cc0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f85a40a1db0 tx=0x7f8594006ee0).ready entity=mon.0 client_cookie=846b6b0bbed62732 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:40.091 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.087+0000 7f85a159a700 1 -- 172.21.15.110:0/3462818740 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85940098d0 con 0x7f85a40b0cc0 2021-03-25T14:17:40.091 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.087+0000 7f85a159a700 1 -- 172.21.15.110:0/3462818740 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8594009a30 con 0x7f85a40b0cc0 2021-03-25T14:17:40.091 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.087+0000 7f85a159a700 1 -- 172.21.15.110:0/3462818740 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8594009db0 con 0x7f85a40b0cc0 2021-03-25T14:17:40.091 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.087+0000 7f85a8f5a700 1 -- 172.21.15.110:0/3462818740 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85a40b0cc0 msgr2=0x7f85a4145cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:40.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.087+0000 7f85a8f5a700 1 --2- 172.21.15.110:0/3462818740 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85a40b0cc0 0x7f85a4145cc0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f85a40a1db0 tx=0x7f8594006ee0).stop 2021-03-25T14:17:40.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.087+0000 7f85a8f5a700 1 -- 172.21.15.110:0/3462818740 shutdown_connections 2021-03-25T14:17:40.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.087+0000 7f85a8f5a700 1 --2- 172.21.15.110:0/3462818740 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85a40b0cc0 0x7f85a4145cc0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:40.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.087+0000 7f85a8f5a700 1 --2- 172.21.15.110:0/3462818740 >> v2:172.21.15.174:3300/0 conn(0x7f85a40b5d00 0x7f85a4067250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:40.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.087+0000 7f85a8f5a700 1 -- 172.21.15.110:0/3462818740 >> 172.21.15.110:0/3462818740 conn(0x7f85a40664e0 msgr2=0x7f85a40668f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:40.093 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.087+0000 7f85a8f5a700 1 -- 172.21.15.110:0/3462818740 shutdown_connections 2021-03-25T14:17:40.093 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.087+0000 7f85a8f5a700 1 -- 172.21.15.110:0/3462818740 wait complete. 2021-03-25T14:17:40.093 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.088+0000 7f85a8f5a700 1 Processor -- start 2021-03-25T14:17:40.093 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.088+0000 7f85a8f5a700 1 -- start start 2021-03-25T14:17:40.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.089+0000 7f85a8f5a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f85a40648a0 0x7f85a409d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:40.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.089+0000 7f85a8f5a700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85a40b0cc0 0x7f85a40b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:40.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.089+0000 7f85a8f5a700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85a40b5d00 0x7f85a4154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:40.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.089+0000 7f85a8f5a700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a40a0740 con 0x7f85a40b5d00 2021-03-25T14:17:40.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.089+0000 7f85a8f5a700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a409da80 con 0x7f85a40b0cc0 2021-03-25T14:17:40.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.089+0000 7f85a8f5a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a40b5260 con 0x7f85a40648a0 2021-03-25T14:17:40.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.089+0000 7f85a2d9d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85a40b5d00 0x7f85a4154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:40.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.089+0000 7f85a2d9d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85a40b5d00 0x7f85a4154d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50342/0 (socket says 172.21.15.110:50342) 2021-03-25T14:17:40.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.089+0000 7f85a2d9d700 1 -- 172.21.15.110:0/2592156781 learned_addr learned my addr 172.21.15.110:0/2592156781 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:40.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.089+0000 7f85a1d9b700 1 --2- 172.21.15.110:0/2592156781 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85a40b0cc0 0x7f85a40b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:40.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.089+0000 7f85a259c700 1 --2- 172.21.15.110:0/2592156781 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f85a40648a0 0x7f85a409d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:40.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.089+0000 7f85a2d9d700 1 -- 172.21.15.110:0/2592156781 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f85a40648a0 msgr2=0x7f85a409d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:40.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.089+0000 7f85a2d9d700 1 --2- 172.21.15.110:0/2592156781 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f85a40648a0 0x7f85a409d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:40.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.089+0000 7f85a2d9d700 1 -- 172.21.15.110:0/2592156781 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85a40b0cc0 msgr2=0x7f85a40b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:40.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.089+0000 7f85a2d9d700 1 --2- 172.21.15.110:0/2592156781 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85a40b0cc0 0x7f85a40b36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:40.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.089+0000 7f85a2d9d700 1 -- 172.21.15.110:0/2592156781 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a40b32a0 con 0x7f85a40b5d00 2021-03-25T14:17:40.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.090+0000 7f85a2d9d700 1 --2- 172.21.15.110:0/2592156781 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85a40b5d00 0x7f85a4154d20 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f859c00cac0 tx=0x7f859c007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:40.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.090+0000 7f85927fc700 1 -- 172.21.15.110:0/2592156781 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859c00cea0 con 0x7f85a40b5d00 2021-03-25T14:17:40.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.090+0000 7f85927fc700 1 -- 172.21.15.110:0/2592156781 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f859c00a760 con 0x7f85a40b5d00 2021-03-25T14:17:40.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.090+0000 7f85927fc700 1 -- 172.21.15.110:0/2592156781 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859c00aae0 con 0x7f85a40b5d00 2021-03-25T14:17:40.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.090+0000 7f85a8f5a700 1 -- 172.21.15.110:0/2592156781 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85a40a0970 con 0x7f85a40b5d00 2021-03-25T14:17:40.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.090+0000 7f85a8f5a700 1 -- 172.21.15.110:0/2592156781 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85a40b5760 con 0x7f85a40b5d00 2021-03-25T14:17:40.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.091+0000 7f85a8f5a700 1 -- 172.21.15.110:0/2592156781 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85a405d7b0 con 0x7f85a40b5d00 2021-03-25T14:17:40.099 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.091+0000 7f85927fc700 1 -- 172.21.15.110:0/2592156781 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f859c019030 con 0x7f85a40b5d00 2021-03-25T14:17:40.099 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.091+0000 7f85927fc700 1 --2- 172.21.15.110:0/2592156781 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f858005a0b0 0x7f858005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:40.099 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.091+0000 7f85927fc700 1 -- 172.21.15.110:0/2592156781 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5606+0+0 (secure 0 0 0) 0x7f859c0731c0 con 0x7f85a40b5d00 2021-03-25T14:17:40.099 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.091+0000 7f85a259c700 1 --2- 172.21.15.110:0/2592156781 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f858005a0b0 0x7f858005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:40.099 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.092+0000 7f85a259c700 1 --2- 172.21.15.110:0/2592156781 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f858005a0b0 0x7f858005c570 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f8594006f20 tx=0x7f8594016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:40.099 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.095+0000 7f85927fc700 1 -- 172.21.15.110:0/2592156781 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f859c045620 con 0x7f85a40b5d00 2021-03-25T14:17:40.249 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.247+0000 7f85a8f5a700 1 -- 172.21.15.110:0/2592156781 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f85a4149030 con 0x7f85a40b5d00 2021-03-25T14:17:40.959 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.957+0000 7f85927fc700 1 -- 172.21.15.110:0/2592156781 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v53) v1 ==== 133+0+0 (secure 0 0 0) 0x7f859c046de0 con 0x7f85a40b5d00 2021-03-25T14:17:40.961 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.959+0000 7f85a8f5a700 1 -- 172.21.15.110:0/2592156781 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f858005a0b0 msgr2=0x7f858005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:40.961 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.959+0000 7f85a8f5a700 1 --2- 172.21.15.110:0/2592156781 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f858005a0b0 0x7f858005c570 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f8594006f20 tx=0x7f8594016000).stop 2021-03-25T14:17:40.961 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.959+0000 7f85a8f5a700 1 -- 172.21.15.110:0/2592156781 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85a40b5d00 msgr2=0x7f85a4154d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:40.961 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.959+0000 7f85a8f5a700 1 --2- 172.21.15.110:0/2592156781 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85a40b5d00 0x7f85a4154d20 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f859c00cac0 tx=0x7f859c007f10).stop 2021-03-25T14:17:40.962 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.959+0000 7f85a8f5a700 1 -- 172.21.15.110:0/2592156781 shutdown_connections 2021-03-25T14:17:40.962 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.959+0000 7f85a8f5a700 1 --2- 172.21.15.110:0/2592156781 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f858005a0b0 0x7f858005c570 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:40.962 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.959+0000 7f85a8f5a700 1 --2- 172.21.15.110:0/2592156781 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85a40b5d00 0x7f85a4154d20 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:40.962 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.959+0000 7f85a8f5a700 1 --2- 172.21.15.110:0/2592156781 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f85a40648a0 0x7f85a409d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:40.962 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.959+0000 7f85a8f5a700 1 --2- 172.21.15.110:0/2592156781 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85a40b0cc0 0x7f85a40b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:40.962 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.959+0000 7f85a8f5a700 1 -- 172.21.15.110:0/2592156781 >> 172.21.15.110:0/2592156781 conn(0x7f85a40664e0 msgr2=0x7f85a40b8680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:40.962 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.960+0000 7f85a8f5a700 1 -- 172.21.15.110:0/2592156781 shutdown_connections 2021-03-25T14:17:40.962 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:40.960+0000 7f85a8f5a700 1 -- 172.21.15.110:0/2592156781 wait complete. 2021-03-25T14:17:40.963 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs_metadata' created 2021-03-25T14:17:40.975 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-03-25T14:17:41.089 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.087+0000 7f9bfc05a700 1 Processor -- start 2021-03-25T14:17:41.089 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.087+0000 7f9bfc05a700 1 -- start start 2021-03-25T14:17:41.091 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.088+0000 7f9bfc05a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bf4148ab0 0x7f9bf4148f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:41.091 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.088+0000 7f9bfc05a700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9bf4149400 0x7f9bf4154110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:41.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.088+0000 7f9bfc05a700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bf40a1f40 con 0x7f9bf40b8060 2021-03-25T14:17:41.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.088+0000 7f9bfc05a700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bf4149920 con 0x7f9bf4149400 2021-03-25T14:17:41.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.088+0000 7f9bfc05a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf4149bc0 con 0x7f9bf4148ab0 2021-03-25T14:17:41.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.088+0000 7f9bfa5f7700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9bf4149400 0x7f9bf4154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:41.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.088+0000 7f9bf9df6700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f9bf40b8060 0x7f9bf4063180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43282/0 (socket says 172.21.15.110:43282) 2021-03-25T14:17:41.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.088+0000 7f9bf9df6700 1 -- 172.21.15.110:0/849059446 learned_addr learned my addr 172.21.15.110:0/849059446 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:41.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.088+0000 7f9bf95f5700 1 --2- 172.21.15.110:0/849059446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bf4148ab0 0x7f9bf4148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:41.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.088+0000 7f9bfa5f7700 1 -- 172.21.15.110:0/849059446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bf4148ab0 msgr2=0x7f9bf4148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:41.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.088+0000 7f9bf8df4700 1 -- 172.21.15.110:0/849059446 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 988218777 0 0) 0x7f9bf40a1f40 con 0x7f9bf40b8060 2021-03-25T14:17:41.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.088+0000 7f9bfa5f7700 1 --2- 172.21.15.110:0/849059446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bf4148ab0 0x7f9bf4148f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:41.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.088+0000 7f9bfa5f7700 1 -- 172.21.15.110:0/849059446 >> v1:172.21.15.110:6789/0 conn(0x7f9bf40b8060 legacy=0x7f9bf4063180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:41.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.088+0000 7f9bfa5f7700 1 -- 172.21.15.110:0/849059446 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf4149e60 con 0x7f9bf4149400 2021-03-25T14:17:41.092 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.088+0000 7f9bfa5f7700 1 --2- 172.21.15.110:0/849059446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bf4149400 0x7f9bf4154110 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f9bec009cc0 tx=0x7f9bec009220).ready entity=mon.0 client_cookie=af781c272f22d973 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:41.093 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.088+0000 7f9bf8df4700 1 -- 172.21.15.110:0/849059446 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bec00bc80 con 0x7f9bf4149400 2021-03-25T14:17:41.093 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.088+0000 7f9bf8df4700 1 -- 172.21.15.110:0/849059446 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bec00bde0 con 0x7f9bf4149400 2021-03-25T14:17:41.093 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.089+0000 7f9bf8df4700 1 -- 172.21.15.110:0/849059446 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bec011630 con 0x7f9bf4149400 2021-03-25T14:17:41.093 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.089+0000 7f9bfc05a700 1 -- 172.21.15.110:0/849059446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bf4149400 msgr2=0x7f9bf4154110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:41.093 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.089+0000 7f9bfc05a700 1 --2- 172.21.15.110:0/849059446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bf4149400 0x7f9bf4154110 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f9bec009cc0 tx=0x7f9bec009220).stop 2021-03-25T14:17:41.093 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.089+0000 7f9bfc05a700 1 -- 172.21.15.110:0/849059446 shutdown_connections 2021-03-25T14:17:41.093 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.089+0000 7f9bfc05a700 1 --2- 172.21.15.110:0/849059446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bf4149400 0x7f9bf4154110 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:41.093 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.089+0000 7f9bfc05a700 1 --2- 172.21.15.110:0/849059446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bf4148ab0 0x7f9bf4148f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:41.093 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.089+0000 7f9bfc05a700 1 -- 172.21.15.110:0/849059446 >> 172.21.15.110:0/849059446 conn(0x7f9bf4060c40 msgr2=0x7f9bf4061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:41.093 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.089+0000 7f9bfc05a700 1 -- 172.21.15.110:0/849059446 shutdown_connections 2021-03-25T14:17:41.093 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.089+0000 7f9bfc05a700 1 -- 172.21.15.110:0/849059446 wait complete. 2021-03-25T14:17:41.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.090+0000 7f9bfc05a700 1 Processor -- start 2021-03-25T14:17:41.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.090+0000 7f9bfc05a700 1 -- start start 2021-03-25T14:17:41.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.091+0000 7f9bfc05a700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bf40b8060 0x7f9bf40a0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:41.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.091+0000 7f9bfc05a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bf4148ab0 0x7f9bf414b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:41.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.091+0000 7f9bfc05a700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9bf4149400 0x7f9bf415c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:41.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.091+0000 7f9bfc05a700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf409fb20 con 0x7f9bf40b8060 2021-03-25T14:17:41.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.091+0000 7f9bfc05a700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf409fdc0 con 0x7f9bf4149400 2021-03-25T14:17:41.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.091+0000 7f9bfc05a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf40a0060 con 0x7f9bf4148ab0 2021-03-25T14:17:41.097 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.091+0000 7f9bf9df6700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bf40b8060 0x7f9bf40a0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:41.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.091+0000 7f9bf9df6700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bf40b8060 0x7f9bf40a0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50352/0 (socket says 172.21.15.110:50352) 2021-03-25T14:17:41.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.091+0000 7f9bf9df6700 1 -- 172.21.15.110:0/1675661501 learned_addr learned my addr 172.21.15.110:0/1675661501 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:41.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.091+0000 7f9bfa5f7700 1 --2- 172.21.15.110:0/1675661501 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9bf4149400 0x7f9bf415c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:41.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.091+0000 7f9bf95f5700 1 --2- 172.21.15.110:0/1675661501 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bf4148ab0 0x7f9bf414b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:41.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.091+0000 7f9bf9df6700 1 -- 172.21.15.110:0/1675661501 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bf4148ab0 msgr2=0x7f9bf414b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:41.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.091+0000 7f9bf9df6700 1 --2- 172.21.15.110:0/1675661501 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bf4148ab0 0x7f9bf414b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:41.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.091+0000 7f9bf9df6700 1 -- 172.21.15.110:0/1675661501 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9bf4149400 msgr2=0x7f9bf415c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:41.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.091+0000 7f9bf9df6700 1 --2- 172.21.15.110:0/1675661501 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9bf4149400 0x7f9bf415c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:41.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.091+0000 7f9bf9df6700 1 -- 172.21.15.110:0/1675661501 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf415c070 con 0x7f9bf40b8060 2021-03-25T14:17:41.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.091+0000 7f9bf95f5700 1 --2- 172.21.15.110:0/1675661501 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bf4148ab0 0x7f9bf414b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:41.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.091+0000 7f9bfa5f7700 1 --2- 172.21.15.110:0/1675661501 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9bf4149400 0x7f9bf415c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:41.098 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.091+0000 7f9bf9df6700 1 --2- 172.21.15.110:0/1675661501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bf40b8060 0x7f9bf40a0360 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7f9be400c7c0 tx=0x7f9be4007af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:41.099 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.091+0000 7f9be1ffb700 1 -- 172.21.15.110:0/1675661501 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be4007320 con 0x7f9bf40b8060 2021-03-25T14:17:41.099 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.092+0000 7f9be1ffb700 1 -- 172.21.15.110:0/1675661501 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be4007480 con 0x7f9bf40b8060 2021-03-25T14:17:41.099 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.092+0000 7f9bfc05a700 1 -- 172.21.15.110:0/1675661501 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bf415c310 con 0x7f9bf40b8060 2021-03-25T14:17:41.099 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.092+0000 7f9be1ffb700 1 -- 172.21.15.110:0/1675661501 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be4005830 con 0x7f9bf40b8060 2021-03-25T14:17:41.099 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.092+0000 7f9bfc05a700 1 -- 172.21.15.110:0/1675661501 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bf414f320 con 0x7f9bf40b8060 2021-03-25T14:17:41.099 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.093+0000 7f9bfc05a700 1 -- 172.21.15.110:0/1675661501 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bf405d7b0 con 0x7f9bf40b8060 2021-03-25T14:17:41.099 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.093+0000 7f9be1ffb700 1 -- 172.21.15.110:0/1675661501 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f9be4010030 con 0x7f9bf40b8060 2021-03-25T14:17:41.099 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.093+0000 7f9be1ffb700 1 --2- 172.21.15.110:0/1675661501 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f9bd405a0b0 0x7f9bd405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:41.099 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.093+0000 7f9be1ffb700 1 -- 172.21.15.110:0/1675661501 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5960+0+0 (secure 0 0 0) 0x7f9be4073af0 con 0x7f9bf40b8060 2021-03-25T14:17:41.099 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.093+0000 7f9bf95f5700 1 --2- 172.21.15.110:0/1675661501 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f9bd405a0b0 0x7f9bd405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:41.099 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.094+0000 7f9bf95f5700 1 --2- 172.21.15.110:0/1675661501 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f9bd405a0b0 0x7f9bd405c570 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f9bf0006fd0 tx=0x7f9bf0008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:41.100 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.097+0000 7f9be1ffb700 1 -- 172.21.15.110:0/1675661501 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f9be4047500 con 0x7f9bf40b8060 2021-03-25T14:17:41.250 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.248+0000 7f9bfc05a700 1 -- 172.21.15.110:0/1675661501 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f9bf4061fe0 con 0x7f9bf40b8060 2021-03-25T14:17:41.939 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-03-25T14:17:41.942 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-03-25T14:17:41.961 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.959+0000 7f9be1ffb700 1 -- 172.21.15.110:0/1675661501 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v54) v1 ==== 125+0+0 (secure 0 0 0) 0x7f9be404ab20 con 0x7f9bf40b8060 2021-03-25T14:17:41.966 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.964+0000 7f9bfc05a700 1 -- 172.21.15.110:0/1675661501 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f9bd405a0b0 msgr2=0x7f9bd405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:41.966 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.964+0000 7f9bfc05a700 1 --2- 172.21.15.110:0/1675661501 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f9bd405a0b0 0x7f9bd405c570 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f9bf0006fd0 tx=0x7f9bf0008040).stop 2021-03-25T14:17:41.967 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.964+0000 7f9bfc05a700 1 -- 172.21.15.110:0/1675661501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bf40b8060 msgr2=0x7f9bf40a0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:41.967 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.964+0000 7f9bfc05a700 1 --2- 172.21.15.110:0/1675661501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bf40b8060 0x7f9bf40a0360 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7f9be400c7c0 tx=0x7f9be4007af0).stop 2021-03-25T14:17:41.967 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.964+0000 7f9bfc05a700 1 -- 172.21.15.110:0/1675661501 shutdown_connections 2021-03-25T14:17:41.967 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.964+0000 7f9bfc05a700 1 --2- 172.21.15.110:0/1675661501 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f9bd405a0b0 0x7f9bd405c570 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:41.967 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.964+0000 7f9bfc05a700 1 --2- 172.21.15.110:0/1675661501 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9bf4149400 0x7f9bf415c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:41.967 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.964+0000 7f9bfc05a700 1 --2- 172.21.15.110:0/1675661501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bf40b8060 0x7f9bf40a0360 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:41.967 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.964+0000 7f9bfc05a700 1 --2- 172.21.15.110:0/1675661501 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bf4148ab0 0x7f9bf414b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:41.967 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.964+0000 7f9bfc05a700 1 -- 172.21.15.110:0/1675661501 >> 172.21.15.110:0/1675661501 conn(0x7f9bf4060c40 msgr2=0x7f9bf4069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:41.968 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.966+0000 7f9bfc05a700 1 -- 172.21.15.110:0/1675661501 shutdown_connections 2021-03-25T14:17:41.968 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:41.966+0000 7f9bfc05a700 1 -- 172.21.15.110:0/1675661501 wait complete. 2021-03-25T14:17:41.970 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs_data' created 2021-03-25T14:17:41.983 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2021-03-25T14:17:42.148 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.146+0000 7f4fcd163700 1 Processor -- start 2021-03-25T14:17:42.148 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.146+0000 7f4fcd163700 1 -- start start 2021-03-25T14:17:42.151 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.147+0000 7f4fcd163700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4fc80b5d00 0x7f4fc8145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:42.151 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.147+0000 7f4fcd163700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4fc80648a0 0x7f4fc809db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:42.151 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.147+0000 7f4fcd163700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc8149c50 con 0x7f4fc80b0cc0 2021-03-25T14:17:42.151 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.147+0000 7f4fcd163700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc8067960 con 0x7f4fc80648a0 2021-03-25T14:17:42.151 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.147+0000 7f4fcd163700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc81461b0 con 0x7f4fc80b5d00 2021-03-25T14:17:42.151 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.147+0000 7f4fc759e700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4fc80648a0 0x7f4fc809db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:42.151 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.147+0000 7f4fc759e700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4fc80648a0 0x7f4fc809db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50366/0 (socket says 172.21.15.110:50366) 2021-03-25T14:17:42.152 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.147+0000 7f4fc759e700 1 -- 172.21.15.110:0/4158037405 learned_addr learned my addr 172.21.15.110:0/4158037405 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:42.152 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.147+0000 7f4fc659c700 1 --2- 172.21.15.110:0/4158037405 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4fc80b5d00 0x7f4fc8145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:42.152 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.147+0000 7f4fc759e700 1 -- 172.21.15.110:0/4158037405 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4fc80b5d00 msgr2=0x7f4fc8145cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:42.152 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.147+0000 7f4fc759e700 1 --2- 172.21.15.110:0/4158037405 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4fc80b5d00 0x7f4fc8145cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:42.152 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.147+0000 7f4fc759e700 1 -- 172.21.15.110:0/4158037405 >> v1:172.21.15.174:6789/0 conn(0x7f4fc80b0cc0 legacy=0x7f4fc8067250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:42.152 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.147+0000 7f4fc759e700 1 -- 172.21.15.110:0/4158037405 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc8149e80 con 0x7f4fc80648a0 2021-03-25T14:17:42.152 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.147+0000 7f4fc759e700 1 --2- 172.21.15.110:0/4158037405 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fc80648a0 0x7f4fc809db40 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f4fc0009d90 tx=0x7f4fc00092d0).ready entity=mon.0 client_cookie=1e7f86d212db1149 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:42.152 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.147+0000 7f4fc5d9b700 1 -- 172.21.15.110:0/4158037405 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc000bc80 con 0x7f4fc80648a0 2021-03-25T14:17:42.152 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.148+0000 7f4fc5d9b700 1 -- 172.21.15.110:0/4158037405 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc000bde0 con 0x7f4fc80648a0 2021-03-25T14:17:42.152 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.148+0000 7f4fc5d9b700 1 -- 172.21.15.110:0/4158037405 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0011610 con 0x7f4fc80648a0 2021-03-25T14:17:42.152 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.148+0000 7f4fcd163700 1 -- 172.21.15.110:0/4158037405 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fc80648a0 msgr2=0x7f4fc809db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:42.152 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.148+0000 7f4fcd163700 1 --2- 172.21.15.110:0/4158037405 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fc80648a0 0x7f4fc809db40 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f4fc0009d90 tx=0x7f4fc00092d0).stop 2021-03-25T14:17:42.152 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.148+0000 7f4fcd163700 1 -- 172.21.15.110:0/4158037405 shutdown_connections 2021-03-25T14:17:42.152 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.148+0000 7f4fcd163700 1 --2- 172.21.15.110:0/4158037405 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fc80648a0 0x7f4fc809db40 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:42.153 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.148+0000 7f4fcd163700 1 --2- 172.21.15.110:0/4158037405 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4fc80b5d00 0x7f4fc8145cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:42.153 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.148+0000 7f4fcd163700 1 -- 172.21.15.110:0/4158037405 >> 172.21.15.110:0/4158037405 conn(0x7f4fc80664e0 msgr2=0x7f4fc80668f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:42.153 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.148+0000 7f4fcd163700 1 -- 172.21.15.110:0/4158037405 shutdown_connections 2021-03-25T14:17:42.153 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.148+0000 7f4fcd163700 1 -- 172.21.15.110:0/4158037405 wait complete. 2021-03-25T14:17:42.153 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.149+0000 7f4fcd163700 1 Processor -- start 2021-03-25T14:17:42.153 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.149+0000 7f4fcd163700 1 -- start start 2021-03-25T14:17:42.156 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.150+0000 7f4fcd163700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4fc80648a0 0x7f4fc809f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:42.156 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.150+0000 7f4fcd163700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4fc80b0cc0 0x7f4fc80a1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:42.156 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.150+0000 7f4fcd163700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fc80b5d00 0x7f4fc815c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:42.156 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.150+0000 7f4fcd163700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc8158f40 con 0x7f4fc80b5d00 2021-03-25T14:17:42.156 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.150+0000 7f4fcd163700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc8159170 con 0x7f4fc80b0cc0 2021-03-25T14:17:42.156 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.150+0000 7f4fcd163700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc8159410 con 0x7f4fc80648a0 2021-03-25T14:17:42.156 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.150+0000 7f4fc759e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fc80b5d00 0x7f4fc815c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:42.156 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.150+0000 7f4fc759e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fc80b5d00 0x7f4fc815c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50372/0 (socket says 172.21.15.110:50372) 2021-03-25T14:17:42.156 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.150+0000 7f4fc759e700 1 -- 172.21.15.110:0/3852669896 learned_addr learned my addr 172.21.15.110:0/3852669896 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:42.157 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.150+0000 7f4fc659c700 1 --2- 172.21.15.110:0/3852669896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4fc80b0cc0 0x7f4fc80a1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:42.157 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.150+0000 7f4fc6d9d700 1 --2- 172.21.15.110:0/3852669896 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4fc80648a0 0x7f4fc809f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:42.157 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.150+0000 7f4fc759e700 1 -- 172.21.15.110:0/3852669896 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4fc80648a0 msgr2=0x7f4fc809f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:42.157 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.150+0000 7f4fc759e700 1 --2- 172.21.15.110:0/3852669896 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4fc80648a0 0x7f4fc809f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:42.157 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.150+0000 7f4fc759e700 1 -- 172.21.15.110:0/3852669896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4fc80b0cc0 msgr2=0x7f4fc80a1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:42.157 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.150+0000 7f4fc759e700 1 --2- 172.21.15.110:0/3852669896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4fc80b0cc0 0x7f4fc80a1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:42.157 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.150+0000 7f4fc759e700 1 -- 172.21.15.110:0/3852669896 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc81596b0 con 0x7f4fc80b5d00 2021-03-25T14:17:42.157 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.150+0000 7f4fc759e700 1 --2- 172.21.15.110:0/3852669896 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fc80b5d00 0x7f4fc815c3c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f4fc0009310 tx=0x7f4fc0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:42.157 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.150+0000 7f4fbeffd700 1 -- 172.21.15.110:0/3852669896 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc000bc80 con 0x7f4fc80b5d00 2021-03-25T14:17:42.157 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.150+0000 7f4fbeffd700 1 -- 172.21.15.110:0/3852669896 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc0011e70 con 0x7f4fc80b5d00 2021-03-25T14:17:42.157 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.150+0000 7f4fcd163700 1 -- 172.21.15.110:0/3852669896 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc809efd0 con 0x7f4fc80b5d00 2021-03-25T14:17:42.157 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.151+0000 7f4fbeffd700 1 -- 172.21.15.110:0/3852669896 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0010c70 con 0x7f4fc80b5d00 2021-03-25T14:17:42.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.151+0000 7f4fcd163700 1 -- 172.21.15.110:0/3852669896 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc80b41b0 con 0x7f4fc80b5d00 2021-03-25T14:17:42.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.151+0000 7f4fcd163700 1 -- 172.21.15.110:0/3852669896 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc8146cd0 con 0x7f4fc80b5d00 2021-03-25T14:17:42.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.152+0000 7f4fbeffd700 1 -- 172.21.15.110:0/3852669896 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f4fc000f070 con 0x7f4fc80b5d00 2021-03-25T14:17:42.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.152+0000 7f4fbeffd700 1 --2- 172.21.15.110:0/3852669896 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4fac05a0b0 0x7f4fac05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:42.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.152+0000 7f4fbeffd700 1 -- 172.21.15.110:0/3852669896 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6310+0+0 (secure 0 0 0) 0x7f4fc0075b40 con 0x7f4fc80b5d00 2021-03-25T14:17:42.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.152+0000 7f4fc6d9d700 1 --2- 172.21.15.110:0/3852669896 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4fac05a0b0 0x7f4fac05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:42.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.153+0000 7f4fc6d9d700 1 --2- 172.21.15.110:0/3852669896 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4fac05a0b0 0x7f4fac05c570 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f4fb80037b0 tx=0x7f4fb8000bc0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:42.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.156+0000 7f4fbeffd700 1 -- 172.21.15.110:0/3852669896 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f4fc00493f0 con 0x7f4fc80b5d00 2021-03-25T14:17:42.344 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.342+0000 7f4fcd163700 1 -- 172.21.15.110:0/3852669896 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4fc8159840 con 0x7f4fc80b5d00 2021-03-25T14:17:42.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.347+0000 7f4fbeffd700 1 -- 172.21.15.110:0/3852669896 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v26) v1 ==== 174+0+0 (secure 0 0 0) 0x7f4fc004ca10 con 0x7f4fc80b5d00 2021-03-25T14:17:42.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.351+0000 7f4fcd163700 1 -- 172.21.15.110:0/3852669896 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4fac05a0b0 msgr2=0x7f4fac05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:42.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.351+0000 7f4fcd163700 1 --2- 172.21.15.110:0/3852669896 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4fac05a0b0 0x7f4fac05c570 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f4fb80037b0 tx=0x7f4fb8000bc0).stop 2021-03-25T14:17:42.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.351+0000 7f4fcd163700 1 -- 172.21.15.110:0/3852669896 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fc80b5d00 msgr2=0x7f4fc815c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:42.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.351+0000 7f4fcd163700 1 --2- 172.21.15.110:0/3852669896 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fc80b5d00 0x7f4fc815c3c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f4fc0009310 tx=0x7f4fc0017000).stop 2021-03-25T14:17:42.354 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.352+0000 7f4fcd163700 1 -- 172.21.15.110:0/3852669896 shutdown_connections 2021-03-25T14:17:42.354 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.352+0000 7f4fcd163700 1 --2- 172.21.15.110:0/3852669896 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4fac05a0b0 0x7f4fac05c570 secure :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0x7f4fb80037b0 tx=0x7f4fb8000bc0).stop 2021-03-25T14:17:42.355 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.352+0000 7f4fcd163700 1 --2- 172.21.15.110:0/3852669896 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fc80b5d00 0x7f4fc815c3c0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:42.355 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.352+0000 7f4fcd163700 1 --2- 172.21.15.110:0/3852669896 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4fc80648a0 0x7f4fc809f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:42.355 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.353+0000 7f4fcd163700 1 --2- 172.21.15.110:0/3852669896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4fc80b0cc0 0x7f4fc80a1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:42.355 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.353+0000 7f4fcd163700 1 -- 172.21.15.110:0/3852669896 >> 172.21.15.110:0/3852669896 conn(0x7f4fc80664e0 msgr2=0x7f4fc8145000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:42.355 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.353+0000 7f4fcd163700 1 -- 172.21.15.110:0/3852669896 shutdown_connections 2021-03-25T14:17:42.356 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.354+0000 7f4fcd163700 1 -- 172.21.15.110:0/3852669896 wait complete. 2021-03-25T14:17:42.360 INFO:teuthology.orchestra.run.smithi110.stderr:new fs with metadata pool 10 and data pool 11 2021-03-25T14:17:42.373 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:17:42.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.480+0000 7f0e3b275700 1 Processor -- start 2021-03-25T14:17:42.483 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.481+0000 7f0e3b275700 1 -- start start 2021-03-25T14:17:42.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.481+0000 7f0e3b275700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0e340b99b0 0x7f0e340ba4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:42.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.481+0000 7f0e3b275700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e34148fc0 0x7f0e340a3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:42.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.481+0000 7f0e3b275700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e34149450 con 0x7f0e3414a050 2021-03-25T14:17:42.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.481+0000 7f0e3b275700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e340ba9e0 con 0x7f0e340b99b0 2021-03-25T14:17:42.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.481+0000 7f0e3b275700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e340babc0 con 0x7f0e34148fc0 2021-03-25T14:17:42.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.482+0000 7f0e39011700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0e340b99b0 0x7f0e340ba4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:42.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.482+0000 7f0e39011700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0e340b99b0 0x7f0e340ba4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50386/0 (socket says 172.21.15.110:50386) 2021-03-25T14:17:42.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.482+0000 7f0e39011700 1 -- 172.21.15.110:0/2218335381 learned_addr learned my addr 172.21.15.110:0/2218335381 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:42.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.482+0000 7f0e39011700 1 -- 172.21.15.110:0/2218335381 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e34148fc0 msgr2=0x7f0e340a3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:42.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.482+0000 7f0e39011700 1 --2- 172.21.15.110:0/2218335381 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e34148fc0 0x7f0e340a3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:42.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.482+0000 7f0e39011700 1 -- 172.21.15.110:0/2218335381 >> v1:172.21.15.174:6789/0 conn(0x7f0e3414a050 legacy=0x7f0e341488b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:42.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.482+0000 7f0e39011700 1 -- 172.21.15.110:0/2218335381 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e340bae60 con 0x7f0e340b99b0 2021-03-25T14:17:42.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.482+0000 7f0e39011700 1 --2- 172.21.15.110:0/2218335381 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e340b99b0 0x7f0e340ba4f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f0e2400ba70 tx=0x7f0e24006e80).ready entity=mon.0 client_cookie=2836aca89a28cec1 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:42.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.482+0000 7f0e23fff700 1 -- 172.21.15.110:0/2218335381 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e24009900 con 0x7f0e340b99b0 2021-03-25T14:17:42.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.482+0000 7f0e23fff700 1 -- 172.21.15.110:0/2218335381 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e24009a60 con 0x7f0e340b99b0 2021-03-25T14:17:42.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.482+0000 7f0e23fff700 1 -- 172.21.15.110:0/2218335381 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e24009de0 con 0x7f0e340b99b0 2021-03-25T14:17:42.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.483+0000 7f0e3b275700 1 -- 172.21.15.110:0/2218335381 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e340b99b0 msgr2=0x7f0e340ba4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:42.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.483+0000 7f0e3b275700 1 --2- 172.21.15.110:0/2218335381 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e340b99b0 0x7f0e340ba4f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f0e2400ba70 tx=0x7f0e24006e80).stop 2021-03-25T14:17:42.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.483+0000 7f0e3b275700 1 -- 172.21.15.110:0/2218335381 shutdown_connections 2021-03-25T14:17:42.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.483+0000 7f0e3b275700 1 --2- 172.21.15.110:0/2218335381 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e34148fc0 0x7f0e340a3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:42.487 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.483+0000 7f0e3b275700 1 --2- 172.21.15.110:0/2218335381 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e340b99b0 0x7f0e340ba4f0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:42.488 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.483+0000 7f0e3b275700 1 -- 172.21.15.110:0/2218335381 >> 172.21.15.110:0/2218335381 conn(0x7f0e34060c40 msgr2=0x7f0e34061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:42.488 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.483+0000 7f0e3b275700 1 -- 172.21.15.110:0/2218335381 shutdown_connections 2021-03-25T14:17:42.488 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.483+0000 7f0e3b275700 1 -- 172.21.15.110:0/2218335381 wait complete. 2021-03-25T14:17:42.488 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.484+0000 7f0e3b275700 1 Processor -- start 2021-03-25T14:17:42.488 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.484+0000 7f0e3b275700 1 -- start start 2021-03-25T14:17:42.491 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.484+0000 7f0e3b275700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0e340b99b0 0x7f0e340b4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:42.491 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.484+0000 7f0e3b275700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e34148fc0 0x7f0e34147860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:42.491 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.484+0000 7f0e3b275700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e3414a050 0x7f0e34147d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:42.491 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.484+0000 7f0e3b275700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e34159830 con 0x7f0e34148fc0 2021-03-25T14:17:42.491 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.484+0000 7f0e3b275700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e34159ad0 con 0x7f0e340b99b0 2021-03-25T14:17:42.491 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.485+0000 7f0e3b275700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e340b6460 con 0x7f0e3414a050 2021-03-25T14:17:42.491 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.485+0000 7f0e38810700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e34148fc0 0x7f0e34147860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:42.492 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.485+0000 7f0e38810700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e34148fc0 0x7f0e34147860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50394/0 (socket says 172.21.15.110:50394) 2021-03-25T14:17:42.492 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.485+0000 7f0e38810700 1 -- 172.21.15.110:0/3738969973 learned_addr learned my addr 172.21.15.110:0/3738969973 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:42.492 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.485+0000 7f0e39011700 1 --2- 172.21.15.110:0/3738969973 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0e340b99b0 0x7f0e340b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:42.492 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.485+0000 7f0e39812700 1 --2- 172.21.15.110:0/3738969973 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e3414a050 0x7f0e34147d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:42.492 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.485+0000 7f0e38810700 1 -- 172.21.15.110:0/3738969973 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e3414a050 msgr2=0x7f0e34147d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:42.492 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.485+0000 7f0e38810700 1 --2- 172.21.15.110:0/3738969973 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e3414a050 0x7f0e34147d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:42.492 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.485+0000 7f0e38810700 1 -- 172.21.15.110:0/3738969973 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0e340b99b0 msgr2=0x7f0e340b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:42.492 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.485+0000 7f0e38810700 1 --2- 172.21.15.110:0/3738969973 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0e340b99b0 0x7f0e340b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:42.492 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.485+0000 7f0e38810700 1 -- 172.21.15.110:0/3738969973 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e340b6700 con 0x7f0e34148fc0 2021-03-25T14:17:42.492 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.485+0000 7f0e38810700 1 --2- 172.21.15.110:0/3738969973 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e34148fc0 0x7f0e34147860 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f0e300096e0 tx=0x7f0e30006d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:42.492 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.485+0000 7f0e217fa700 1 -- 172.21.15.110:0/3738969973 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3000d4a0 con 0x7f0e34148fc0 2021-03-25T14:17:42.492 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.485+0000 7f0e217fa700 1 -- 172.21.15.110:0/3738969973 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3000d620 con 0x7f0e34148fc0 2021-03-25T14:17:42.492 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.485+0000 7f0e3b275700 1 -- 172.21.15.110:0/3738969973 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e340b6150 con 0x7f0e34148fc0 2021-03-25T14:17:42.493 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.485+0000 7f0e217fa700 1 -- 172.21.15.110:0/3738969973 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3000d9e0 con 0x7f0e34148fc0 2021-03-25T14:17:42.493 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.485+0000 7f0e3b275700 1 -- 172.21.15.110:0/3738969973 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e340b4c50 con 0x7f0e34148fc0 2021-03-25T14:17:42.493 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.486+0000 7f0e3b275700 1 -- 172.21.15.110:0/3738969973 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e340b6890 con 0x7f0e34148fc0 2021-03-25T14:17:42.493 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.486+0000 7f0e217fa700 1 -- 172.21.15.110:0/3738969973 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f0e3000f030 con 0x7f0e34148fc0 2021-03-25T14:17:42.493 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.487+0000 7f0e217fa700 1 --2- 172.21.15.110:0/3738969973 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f0e1405a0b0 0x7f0e1405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:42.493 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.487+0000 7f0e217fa700 1 -- 172.21.15.110:0/3738969973 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6426+0+0 (secure 0 0 0) 0x7f0e30073cc0 con 0x7f0e34148fc0 2021-03-25T14:17:42.493 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.487+0000 7f0e39011700 1 --2- 172.21.15.110:0/3738969973 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f0e1405a0b0 0x7f0e1405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:42.494 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.487+0000 7f0e39011700 1 --2- 172.21.15.110:0/3738969973 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f0e1405a0b0 0x7f0e1405c570 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f0e340bc950 tx=0x7f0e24015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:42.494 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.490+0000 7f0e217fa700 1 -- 172.21.15.110:0/3738969973 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f0e30047500 con 0x7f0e34148fc0 2021-03-25T14:17:42.641 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.640+0000 7f0e3b275700 1 -- 172.21.15.110:0/3738969973 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e3405d7b0 con 0x7f0e34148fc0 2021-03-25T14:17:42.642 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.641+0000 7f0e217fa700 1 -- 172.21.15.110:0/3738969973 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+17125 (secure 0 0 0) 0x7f0e3004ab20 con 0x7f0e34148fc0 2021-03-25T14:17:42.643 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:42.643 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":55,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:17:42.344562+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2021-03-25T14:17:40.271092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2021-03-25T14:17:41.271977+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:17:42.644 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.642+0000 7f0e3b275700 1 -- 172.21.15.110:0/3738969973 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f0e1405a0b0 msgr2=0x7f0e1405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:42.645 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.642+0000 7f0e3b275700 1 --2- 172.21.15.110:0/3738969973 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f0e1405a0b0 0x7f0e1405c570 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f0e340bc950 tx=0x7f0e24015000).stop 2021-03-25T14:17:42.645 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.642+0000 7f0e3b275700 1 -- 172.21.15.110:0/3738969973 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e34148fc0 msgr2=0x7f0e34147860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:42.645 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.642+0000 7f0e3b275700 1 --2- 172.21.15.110:0/3738969973 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e34148fc0 0x7f0e34147860 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f0e300096e0 tx=0x7f0e30006d80).stop 2021-03-25T14:17:42.645 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.642+0000 7f0e3b275700 1 -- 172.21.15.110:0/3738969973 shutdown_connections 2021-03-25T14:17:42.645 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.642+0000 7f0e3b275700 1 --2- 172.21.15.110:0/3738969973 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f0e1405a0b0 0x7f0e1405c570 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:42.645 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.642+0000 7f0e3b275700 1 --2- 172.21.15.110:0/3738969973 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0e340b99b0 0x7f0e340b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:42.645 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.642+0000 7f0e3b275700 1 --2- 172.21.15.110:0/3738969973 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e3414a050 0x7f0e34147d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:42.645 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.642+0000 7f0e3b275700 1 --2- 172.21.15.110:0/3738969973 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e34148fc0 0x7f0e34147860 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:42.645 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.642+0000 7f0e3b275700 1 -- 172.21.15.110:0/3738969973 >> 172.21.15.110:0/3738969973 conn(0x7f0e34060c40 msgr2=0x7f0e340b7010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:42.645 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.642+0000 7f0e3b275700 1 -- 172.21.15.110:0/3738969973 shutdown_connections 2021-03-25T14:17:42.645 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.642+0000 7f0e3b275700 1 -- 172.21.15.110:0/3738969973 wait complete. 2021-03-25T14:17:42.656 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:17:42.766 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.764+0000 7fa22d689700 1 Processor -- start 2021-03-25T14:17:42.766 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.764+0000 7fa22d689700 1 -- start start 2021-03-25T14:17:42.769 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.765+0000 7fa22d689700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2280675d0 0x7fa2280b1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:42.769 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.765+0000 7fa22d689700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa2280bc220 0x7fa22814cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:42.769 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.765+0000 7fa22d689700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2280bafc0 con 0x7fa22814d0a0 2021-03-25T14:17:42.769 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.765+0000 7fa22d689700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2280b1830 con 0x7fa2280bc220 2021-03-25T14:17:42.769 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.765+0000 7fa22d689700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2280baa80 con 0x7fa2280675d0 2021-03-25T14:17:42.769 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.765+0000 7fa2267fc700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa2280bc220 0x7fa22814cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:42.770 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.765+0000 7fa2267fc700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa2280bc220 0x7fa22814cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50400/0 (socket says 172.21.15.110:50400) 2021-03-25T14:17:42.770 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.765+0000 7fa2277fe700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fa22814d0a0 0x7fa228148970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43340/0 (socket says 172.21.15.110:43340) 2021-03-25T14:17:42.770 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.765+0000 7fa2267fc700 1 -- 172.21.15.110:0/2069360302 learned_addr learned my addr 172.21.15.110:0/2069360302 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:42.770 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.765+0000 7fa226ffd700 1 --2- 172.21.15.110:0/2069360302 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2280675d0 0x7fa2280b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:42.770 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.765+0000 7fa2267fc700 1 -- 172.21.15.110:0/2069360302 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2280675d0 msgr2=0x7fa2280b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:42.770 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.765+0000 7fa2267fc700 1 --2- 172.21.15.110:0/2069360302 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2280675d0 0x7fa2280b1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:42.770 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.765+0000 7fa2267fc700 1 -- 172.21.15.110:0/2069360302 >> v1:172.21.15.110:6789/0 conn(0x7fa22814d0a0 legacy=0x7fa228148970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:42.770 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.765+0000 7fa225ffb700 1 -- 172.21.15.110:0/2069360302 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2531753910 0 0) 0x7fa2280bafc0 con 0x7fa22814d0a0 2021-03-25T14:17:42.770 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.765+0000 7fa2267fc700 1 -- 172.21.15.110:0/2069360302 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2280bad20 con 0x7fa2280bc220 2021-03-25T14:17:42.770 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.766+0000 7fa226ffd700 1 --2- 172.21.15.110:0/2069360302 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2280675d0 0x7fa2280b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:42.770 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.766+0000 7fa2267fc700 1 --2- 172.21.15.110:0/2069360302 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2280bc220 0x7fa22814cbb0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7fa21c00ba20 tx=0x7fa21c006ee0).ready entity=mon.0 client_cookie=b6cc9ed10c6da41c server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:42.770 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.766+0000 7fa225ffb700 1 -- 172.21.15.110:0/2069360302 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21c0098d0 con 0x7fa2280bc220 2021-03-25T14:17:42.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.766+0000 7fa225ffb700 1 -- 172.21.15.110:0/2069360302 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa21c009a30 con 0x7fa2280bc220 2021-03-25T14:17:42.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.766+0000 7fa225ffb700 1 -- 172.21.15.110:0/2069360302 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21c009db0 con 0x7fa2280bc220 2021-03-25T14:17:42.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.766+0000 7fa22d689700 1 -- 172.21.15.110:0/2069360302 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2280bc220 msgr2=0x7fa22814cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:42.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.766+0000 7fa22d689700 1 --2- 172.21.15.110:0/2069360302 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2280bc220 0x7fa22814cbb0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7fa21c00ba20 tx=0x7fa21c006ee0).stop 2021-03-25T14:17:42.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.766+0000 7fa22d689700 1 -- 172.21.15.110:0/2069360302 shutdown_connections 2021-03-25T14:17:42.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.766+0000 7fa22d689700 1 --2- 172.21.15.110:0/2069360302 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2280675d0 0x7fa2280b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:42.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.766+0000 7fa22d689700 1 --2- 172.21.15.110:0/2069360302 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2280bc220 0x7fa22814cbb0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:42.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.766+0000 7fa22d689700 1 -- 172.21.15.110:0/2069360302 >> 172.21.15.110:0/2069360302 conn(0x7fa228064a10 msgr2=0x7fa22805c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:42.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.766+0000 7fa22d689700 1 -- 172.21.15.110:0/2069360302 shutdown_connections 2021-03-25T14:17:42.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.766+0000 7fa22d689700 1 -- 172.21.15.110:0/2069360302 wait complete. 2021-03-25T14:17:42.771 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.767+0000 7fa22d689700 1 Processor -- start 2021-03-25T14:17:42.772 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.768+0000 7fa22d689700 1 -- start start 2021-03-25T14:17:42.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.768+0000 7fa22d689700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2280675d0 0x7fa22814c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:42.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.768+0000 7fa22d689700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2280bc220 0x7fa228144930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:42.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.768+0000 7fa22d689700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa22814d0a0 0x7fa22814ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:42.775 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.768+0000 7fa22d689700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa228158d40 con 0x7fa22814d0a0 2021-03-25T14:17:42.775 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.768+0000 7fa22d689700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22814cf40 con 0x7fa2280675d0 2021-03-25T14:17:42.775 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.768+0000 7fa22d689700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa228158f30 con 0x7fa2280bc220 2021-03-25T14:17:42.775 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.768+0000 7fa2277fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa22814d0a0 0x7fa22814ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:42.775 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.768+0000 7fa2277fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa22814d0a0 0x7fa22814ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50410/0 (socket says 172.21.15.110:50410) 2021-03-25T14:17:42.775 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.768+0000 7fa2277fe700 1 -- 172.21.15.110:0/2521721416 learned_addr learned my addr 172.21.15.110:0/2521721416 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:42.775 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.768+0000 7fa226ffd700 1 --2- 172.21.15.110:0/2521721416 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2280675d0 0x7fa22814c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:42.775 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.768+0000 7fa2267fc700 1 --2- 172.21.15.110:0/2521721416 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2280bc220 0x7fa228144930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:42.775 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.769+0000 7fa2277fe700 1 -- 172.21.15.110:0/2521721416 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2280bc220 msgr2=0x7fa228144930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:42.775 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.769+0000 7fa2277fe700 1 --2- 172.21.15.110:0/2521721416 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2280bc220 0x7fa228144930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:42.775 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.769+0000 7fa2277fe700 1 -- 172.21.15.110:0/2521721416 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2280675d0 msgr2=0x7fa22814c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:42.775 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.769+0000 7fa2277fe700 1 --2- 172.21.15.110:0/2521721416 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2280675d0 0x7fa22814c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:42.775 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.769+0000 7fa2277fe700 1 -- 172.21.15.110:0/2521721416 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22814ca00 con 0x7fa22814d0a0 2021-03-25T14:17:42.776 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.769+0000 7fa2267fc700 1 --2- 172.21.15.110:0/2521721416 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2280bc220 0x7fa228144930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:42.776 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.769+0000 7fa226ffd700 1 --2- 172.21.15.110:0/2521721416 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2280675d0 0x7fa22814c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:42.776 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.769+0000 7fa2277fe700 1 --2- 172.21.15.110:0/2521721416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa22814d0a0 0x7fa22814ef20 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7fa22000cae0 tx=0x7fa2200013f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:42.776 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.769+0000 7fa20effd700 1 -- 172.21.15.110:0/2521721416 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa220005af0 con 0x7fa22814d0a0 2021-03-25T14:17:42.776 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.769+0000 7fa20effd700 1 -- 172.21.15.110:0/2521721416 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa220005c50 con 0x7fa22814d0a0 2021-03-25T14:17:42.776 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.769+0000 7fa22d689700 1 -- 172.21.15.110:0/2521721416 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa22814cca0 con 0x7fa22814d0a0 2021-03-25T14:17:42.776 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.769+0000 7fa20effd700 1 -- 172.21.15.110:0/2521721416 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa220007110 con 0x7fa22814d0a0 2021-03-25T14:17:42.776 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.769+0000 7fa22d689700 1 -- 172.21.15.110:0/2521721416 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2281437e0 con 0x7fa22814d0a0 2021-03-25T14:17:42.776 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.770+0000 7fa22d689700 1 -- 172.21.15.110:0/2521721416 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa228159350 con 0x7fa22814d0a0 2021-03-25T14:17:42.776 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.770+0000 7fa20effd700 1 -- 172.21.15.110:0/2521721416 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fa220010030 con 0x7fa22814d0a0 2021-03-25T14:17:42.776 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.770+0000 7fa20effd700 1 --2- 172.21.15.110:0/2521721416 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa20805a0b0 0x7fa20805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:42.776 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.770+0000 7fa20effd700 1 -- 172.21.15.110:0/2521721416 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6426+0+0 (secure 0 0 0) 0x7fa220073e50 con 0x7fa22814d0a0 2021-03-25T14:17:42.777 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.770+0000 7fa226ffd700 1 --2- 172.21.15.110:0/2521721416 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa20805a0b0 0x7fa20805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:42.777 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.771+0000 7fa226ffd700 1 --2- 172.21.15.110:0/2521721416 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa20805a0b0 0x7fa20805c570 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7fa218006fd0 tx=0x7fa218008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:42.777 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.774+0000 7fa20effd700 1 -- 172.21.15.110:0/2521721416 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fa220047690 con 0x7fa22814d0a0 2021-03-25T14:17:42.926 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.924+0000 7fa22d689700 1 -- 172.21.15.110:0/2521721416 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa228068850 con 0x7fa22814d0a0 2021-03-25T14:17:42.927 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.925+0000 7fa20effd700 1 -- 172.21.15.110:0/2521721416 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+17125 (secure 0 0 0) 0x7fa22004acb0 con 0x7fa22814d0a0 2021-03-25T14:17:42.927 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:42.927 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":55,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:17:42.344562+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2021-03-25T14:17:40.271092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2021-03-25T14:17:41.271977+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:17:42.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.927+0000 7fa22d689700 1 -- 172.21.15.110:0/2521721416 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa20805a0b0 msgr2=0x7fa20805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:42.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.927+0000 7fa22d689700 1 --2- 172.21.15.110:0/2521721416 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa20805a0b0 0x7fa20805c570 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7fa218006fd0 tx=0x7fa218008040).stop 2021-03-25T14:17:42.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.927+0000 7fa22d689700 1 -- 172.21.15.110:0/2521721416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa22814d0a0 msgr2=0x7fa22814ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:42.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.927+0000 7fa22d689700 1 --2- 172.21.15.110:0/2521721416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa22814d0a0 0x7fa22814ef20 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7fa22000cae0 tx=0x7fa2200013f0).stop 2021-03-25T14:17:42.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.927+0000 7fa22d689700 1 -- 172.21.15.110:0/2521721416 shutdown_connections 2021-03-25T14:17:42.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.927+0000 7fa22d689700 1 --2- 172.21.15.110:0/2521721416 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fa20805a0b0 0x7fa20805c570 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:42.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.927+0000 7fa22d689700 1 --2- 172.21.15.110:0/2521721416 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2280675d0 0x7fa22814c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:42.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.927+0000 7fa22d689700 1 --2- 172.21.15.110:0/2521721416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa22814d0a0 0x7fa22814ef20 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:42.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.927+0000 7fa22d689700 1 --2- 172.21.15.110:0/2521721416 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2280bc220 0x7fa228144930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:42.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.927+0000 7fa22d689700 1 -- 172.21.15.110:0/2521721416 >> 172.21.15.110:0/2521721416 conn(0x7fa228064a10 msgr2=0x7fa228147e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:42.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.927+0000 7fa22d689700 1 -- 172.21.15.110:0/2521721416 shutdown_connections 2021-03-25T14:17:42.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:42.927+0000 7fa22d689700 1 -- 172.21.15.110:0/2521721416 wait complete. 2021-03-25T14:17:42.940 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-03-25T14:17:43.053 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.051+0000 7f02e3913700 1 Processor -- start 2021-03-25T14:17:43.053 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.051+0000 7f02e3913700 1 -- start start 2021-03-25T14:17:43.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.052+0000 7f02e3913700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f02dc0be3a0 0x7f02dc0b4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:43.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.052+0000 7f02e3913700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f02dc0b47a0 0x7f02dc148c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:43.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.052+0000 7f02e3913700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f02dc149120 0x7f02dc0b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:43.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.052+0000 7f02e3913700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02dc0b4c20 con 0x7f02dc0be3a0 2021-03-25T14:17:43.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.052+0000 7f02e3913700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02dc149960 con 0x7f02dc149120 2021-03-25T14:17:43.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.052+0000 7f02e3913700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc149c00 con 0x7f02dc0b47a0 2021-03-25T14:17:43.056 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.052+0000 7f02e16af700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f02dc0be3a0 0x7f02dc0b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:43.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.052+0000 7f02e16af700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f02dc0be3a0 0x7f02dc0b4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50414/0 (socket says 172.21.15.110:50414) 2021-03-25T14:17:43.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.052+0000 7f02e16af700 1 -- 172.21.15.110:0/2541750188 learned_addr learned my addr 172.21.15.110:0/2541750188 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:43.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.052+0000 7f02e0eae700 1 --2- 172.21.15.110:0/2541750188 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f02dc0b47a0 0x7f02dc148c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:43.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.052+0000 7f02e1eb0700 1 --2- 172.21.15.110:0/2541750188 >> v2:172.21.15.174:3300/0 conn(0x7f02dc149120 0x7f02dc0b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:43.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.052+0000 7f02e16af700 1 -- 172.21.15.110:0/2541750188 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f02dc0b47a0 msgr2=0x7f02dc148c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:43.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.052+0000 7f02e16af700 1 --2- 172.21.15.110:0/2541750188 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f02dc0b47a0 0x7f02dc148c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:43.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.052+0000 7f02e16af700 1 -- 172.21.15.110:0/2541750188 >> v2:172.21.15.174:3300/0 conn(0x7f02dc149120 msgr2=0x7f02dc0b8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:43.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.052+0000 7f02e16af700 1 --2- 172.21.15.110:0/2541750188 >> v2:172.21.15.174:3300/0 conn(0x7f02dc149120 0x7f02dc0b8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:43.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.052+0000 7f02e16af700 1 -- 172.21.15.110:0/2541750188 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02dc149ea0 con 0x7f02dc0be3a0 2021-03-25T14:17:43.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.053+0000 7f02e16af700 1 --2- 172.21.15.110:0/2541750188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02dc0be3a0 0x7f02dc0b4100 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f02dc0a0ae0 tx=0x7f02d8006ee0).ready entity=mon.0 client_cookie=2cfeea9df3bf5d20 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:43.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.053+0000 7f02cbfff700 1 -- 172.21.15.110:0/2541750188 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d8009690 con 0x7f02dc0be3a0 2021-03-25T14:17:43.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.053+0000 7f02cbfff700 1 -- 172.21.15.110:0/2541750188 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d80097f0 con 0x7f02dc0be3a0 2021-03-25T14:17:43.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.053+0000 7f02cbfff700 1 -- 172.21.15.110:0/2541750188 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d8009b70 con 0x7f02dc0be3a0 2021-03-25T14:17:43.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.053+0000 7f02e3913700 1 -- 172.21.15.110:0/2541750188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02dc0be3a0 msgr2=0x7f02dc0b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:43.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.053+0000 7f02e3913700 1 --2- 172.21.15.110:0/2541750188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02dc0be3a0 0x7f02dc0b4100 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f02dc0a0ae0 tx=0x7f02d8006ee0).stop 2021-03-25T14:17:43.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.053+0000 7f02e3913700 1 -- 172.21.15.110:0/2541750188 shutdown_connections 2021-03-25T14:17:43.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.053+0000 7f02e3913700 1 --2- 172.21.15.110:0/2541750188 >> v2:172.21.15.174:3300/0 conn(0x7f02dc149120 0x7f02dc0b8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:43.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.053+0000 7f02e3913700 1 --2- 172.21.15.110:0/2541750188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02dc0be3a0 0x7f02dc0b4100 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:43.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.053+0000 7f02e3913700 1 --2- 172.21.15.110:0/2541750188 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f02dc0b47a0 0x7f02dc148c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:43.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.053+0000 7f02e3913700 1 -- 172.21.15.110:0/2541750188 >> 172.21.15.110:0/2541750188 conn(0x7f02dc0686f0 msgr2=0x7f02dc068b00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:43.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.053+0000 7f02e3913700 1 -- 172.21.15.110:0/2541750188 shutdown_connections 2021-03-25T14:17:43.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.053+0000 7f02e3913700 1 -- 172.21.15.110:0/2541750188 wait complete. 2021-03-25T14:17:43.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.054+0000 7f02e3913700 1 Processor -- start 2021-03-25T14:17:43.059 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.054+0000 7f02e3913700 1 -- start start 2021-03-25T14:17:43.062 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.055+0000 7f02e3913700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f02dc0b47a0 0x7f02dc147210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:43.062 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.055+0000 7f02e3913700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02dc0be3a0 0x7f02dc0a3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:43.062 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.055+0000 7f02e3913700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02dc149120 0x7f02dc0a3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:43.062 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.055+0000 7f02e3913700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc0b76e0 con 0x7f02dc0be3a0 2021-03-25T14:17:43.062 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.055+0000 7f02e3913700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc0b6050 con 0x7f02dc149120 2021-03-25T14:17:43.062 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.055+0000 7f02e3913700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc0b5200 con 0x7f02dc0b47a0 2021-03-25T14:17:43.062 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.055+0000 7f02e0eae700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02dc0be3a0 0x7f02dc0a3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:43.062 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.055+0000 7f02e0eae700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02dc0be3a0 0x7f02dc0a3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50422/0 (socket says 172.21.15.110:50422) 2021-03-25T14:17:43.062 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.055+0000 7f02e0eae700 1 -- 172.21.15.110:0/974504508 learned_addr learned my addr 172.21.15.110:0/974504508 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:43.062 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.055+0000 7f02e16af700 1 --2- 172.21.15.110:0/974504508 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f02dc0b47a0 0x7f02dc147210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:43.063 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.055+0000 7f02e1eb0700 1 --2- 172.21.15.110:0/974504508 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02dc149120 0x7f02dc0a3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:43.063 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.056+0000 7f02e0eae700 1 -- 172.21.15.110:0/974504508 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f02dc0b47a0 msgr2=0x7f02dc147210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:43.063 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.056+0000 7f02e0eae700 1 --2- 172.21.15.110:0/974504508 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f02dc0b47a0 0x7f02dc147210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:43.063 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.056+0000 7f02e0eae700 1 -- 172.21.15.110:0/974504508 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02dc149120 msgr2=0x7f02dc0a3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:43.063 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.056+0000 7f02e0eae700 1 --2- 172.21.15.110:0/974504508 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02dc149120 0x7f02dc0a3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:43.063 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.056+0000 7f02e0eae700 1 -- 172.21.15.110:0/974504508 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02dc0b6280 con 0x7f02dc0be3a0 2021-03-25T14:17:43.063 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.056+0000 7f02e1eb0700 1 --2- 172.21.15.110:0/974504508 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02dc149120 0x7f02dc0a3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:43.063 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.056+0000 7f02e0eae700 1 --2- 172.21.15.110:0/974504508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02dc0be3a0 0x7f02dc0a3030 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7f02cc00ebd0 tx=0x7f02cc006e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:43.063 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.056+0000 7f02c97fa700 1 -- 172.21.15.110:0/974504508 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc00c8c0 con 0x7f02dc0be3a0 2021-03-25T14:17:43.063 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.056+0000 7f02c97fa700 1 -- 172.21.15.110:0/974504508 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02cc00ca20 con 0x7f02dc0be3a0 2021-03-25T14:17:43.063 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.056+0000 7f02e3913700 1 -- 172.21.15.110:0/974504508 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02dc0b6520 con 0x7f02dc0be3a0 2021-03-25T14:17:43.063 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.056+0000 7f02c97fa700 1 -- 172.21.15.110:0/974504508 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc00cda0 con 0x7f02dc0be3a0 2021-03-25T14:17:43.063 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.056+0000 7f02e3913700 1 -- 172.21.15.110:0/974504508 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02dc147700 con 0x7f02dc0be3a0 2021-03-25T14:17:43.064 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.057+0000 7f02e3913700 1 -- 172.21.15.110:0/974504508 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02dc05d7b0 con 0x7f02dc0be3a0 2021-03-25T14:17:43.064 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.057+0000 7f02c97fa700 1 -- 172.21.15.110:0/974504508 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f02cc012600 con 0x7f02dc0be3a0 2021-03-25T14:17:43.064 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.057+0000 7f02c97fa700 1 --2- 172.21.15.110:0/974504508 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f02bc05a0b0 0x7f02bc05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:43.064 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.057+0000 7f02c97fa700 1 -- 172.21.15.110:0/974504508 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6426+0+0 (secure 0 0 0) 0x7f02cc074230 con 0x7f02dc0be3a0 2021-03-25T14:17:43.064 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.057+0000 7f02e16af700 1 --2- 172.21.15.110:0/974504508 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f02bc05a0b0 0x7f02bc05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:43.064 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.058+0000 7f02e16af700 1 --2- 172.21.15.110:0/974504508 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f02bc05a0b0 0x7f02bc05c570 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f02d8006f20 tx=0x7f02d8016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:43.064 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.061+0000 7f02c97fa700 1 -- 172.21.15.110:0/974504508 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f02cc047a70 con 0x7f02dc0be3a0 2021-03-25T14:17:43.250 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.248+0000 7f02e3913700 1 -- 172.21.15.110:0/974504508 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f02dc061c50 con 0x7f02dc0be3a0 2021-03-25T14:17:43.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.347+0000 7f02c97fa700 1 -- 172.21.15.110:0/974504508 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v27) v1 ==== 118+0+0 (secure 0 0 0) 0x7f02cc04b090 con 0x7f02dc0be3a0 2021-03-25T14:17:43.351 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.349+0000 7f02e3913700 1 -- 172.21.15.110:0/974504508 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f02bc05a0b0 msgr2=0x7f02bc05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:43.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.349+0000 7f02e3913700 1 --2- 172.21.15.110:0/974504508 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f02bc05a0b0 0x7f02bc05c570 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f02d8006f20 tx=0x7f02d8016000).stop 2021-03-25T14:17:43.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.349+0000 7f02e3913700 1 -- 172.21.15.110:0/974504508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02dc0be3a0 msgr2=0x7f02dc0a3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:43.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.349+0000 7f02e3913700 1 --2- 172.21.15.110:0/974504508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02dc0be3a0 0x7f02dc0a3030 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7f02cc00ebd0 tx=0x7f02cc006e20).stop 2021-03-25T14:17:43.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.349+0000 7f02e3913700 1 -- 172.21.15.110:0/974504508 shutdown_connections 2021-03-25T14:17:43.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.349+0000 7f02e3913700 1 --2- 172.21.15.110:0/974504508 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f02bc05a0b0 0x7f02bc05c570 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:43.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.349+0000 7f02e3913700 1 --2- 172.21.15.110:0/974504508 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02dc149120 0x7f02dc0a3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:43.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.349+0000 7f02e3913700 1 --2- 172.21.15.110:0/974504508 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f02dc0b47a0 0x7f02dc147210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:43.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.349+0000 7f02e3913700 1 --2- 172.21.15.110:0/974504508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02dc0be3a0 0x7f02dc0a3030 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:43.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.349+0000 7f02e3913700 1 -- 172.21.15.110:0/974504508 >> 172.21.15.110:0/974504508 conn(0x7f02dc0686f0 msgr2=0x7f02dc0bc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:43.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.349+0000 7f02e3913700 1 -- 172.21.15.110:0/974504508 shutdown_connections 2021-03-25T14:17:43.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.349+0000 7f02e3913700 1 -- 172.21.15.110:0/974504508 wait complete. 2021-03-25T14:17:43.363 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-03-25T14:17:43.472 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.470+0000 7ff0e0675700 1 Processor -- start 2021-03-25T14:17:43.472 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.470+0000 7ff0e0675700 1 -- start start 2021-03-25T14:17:43.479 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.471+0000 7ff0e0675700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0d80b99b0 0x7ff0d80ba4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:43.479 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.471+0000 7ff0e0675700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff0d814a050 0x7ff0d81488b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:43.479 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.471+0000 7ff0e0675700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0d80babc0 con 0x7ff0d8148da0 2021-03-25T14:17:43.479 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.471+0000 7ff0e0675700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d80ba9e0 con 0x7ff0d814a050 2021-03-25T14:17:43.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.471+0000 7ff0e0675700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d80bae60 con 0x7ff0d80b99b0 2021-03-25T14:17:43.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.471+0000 7ff0dec12700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7ff0d8148da0 0x7ff0d80a3190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43368/0 (socket says 172.21.15.110:43368) 2021-03-25T14:17:43.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.471+0000 7ff0dec12700 1 -- 172.21.15.110:0/788102030 learned_addr learned my addr 172.21.15.110:0/788102030 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:43.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.471+0000 7ff0ddc10700 1 --2- 172.21.15.110:0/788102030 >> v2:172.21.15.174:3300/0 conn(0x7ff0d814a050 0x7ff0d81488b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:43.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.471+0000 7ff0de411700 1 --2- 172.21.15.110:0/788102030 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0d80b99b0 0x7ff0d80ba4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:43.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.472+0000 7ff0dd40f700 1 -- 172.21.15.110:0/788102030 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3348380223 0 0) 0x7ff0d80babc0 con 0x7ff0d8148da0 2021-03-25T14:17:43.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.472+0000 7ff0dd40f700 1 -- 172.21.15.110:0/788102030 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0c0003270 con 0x7ff0d8148da0 2021-03-25T14:17:43.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.472+0000 7ff0dd40f700 1 -- 172.21.15.110:0/788102030 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3225029041 0 0) 0x7ff0c0003270 con 0x7ff0d8148da0 2021-03-25T14:17:43.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.472+0000 7ff0dd40f700 1 -- 172.21.15.110:0/788102030 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0d80b99b0 msgr2=0x7ff0d80ba4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:43.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.472+0000 7ff0dd40f700 1 --2- 172.21.15.110:0/788102030 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0d80b99b0 0x7ff0d80ba4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:43.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.472+0000 7ff0dd40f700 1 -- 172.21.15.110:0/788102030 >> v2:172.21.15.174:3300/0 conn(0x7ff0d814a050 msgr2=0x7ff0d81488b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:43.480 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.472+0000 7ff0dd40f700 1 --2- 172.21.15.110:0/788102030 >> v2:172.21.15.174:3300/0 conn(0x7ff0d814a050 0x7ff0d81488b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:43.481 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.472+0000 7ff0dd40f700 1 -- 172.21.15.110:0/788102030 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d80a2a50 con 0x7ff0d8148da0 2021-03-25T14:17:43.481 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.472+0000 7ff0dd40f700 1 -- 172.21.15.110:0/788102030 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7ff0d00018a0 con 0x7ff0d8148da0 2021-03-25T14:17:43.481 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.472+0000 7ff0dd40f700 1 -- 172.21.15.110:0/788102030 >> v1:172.21.15.110:6789/0 conn(0x7ff0d8148da0 legacy=0x7ff0d80a3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:43.481 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.472+0000 7ff0dd40f700 1 --2- 172.21.15.110:0/788102030 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0c0003760 0x7ff0c0003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:43.481 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.472+0000 7ff0dd40f700 1 --2- 172.21.15.110:0/788102030 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0c0004510 0x7ff0c0004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:43.481 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.472+0000 7ff0dd40f700 1 --2- 172.21.15.110:0/788102030 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0d80b99b0 0x7ff0c0004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:43.481 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.472+0000 7ff0dd40f700 1 -- 172.21.15.110:0/788102030 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d80ba9e0 con 0x7ff0c0004510 2021-03-25T14:17:43.481 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.472+0000 7ff0dd40f700 1 -- 172.21.15.110:0/788102030 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d80bae60 con 0x7ff0c0003760 2021-03-25T14:17:43.481 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.472+0000 7ff0dd40f700 1 -- 172.21.15.110:0/788102030 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c00042a0 con 0x7ff0d80b99b0 2021-03-25T14:17:43.481 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.472+0000 7ff0ddc10700 1 --2- 172.21.15.110:0/788102030 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0c0004510 0x7ff0c0004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:43.481 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.472+0000 7ff0de411700 1 --2- 172.21.15.110:0/788102030 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0c0003760 0x7ff0c0003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:43.481 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.472+0000 7ff0dec12700 1 --2- 172.21.15.110:0/788102030 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0d80b99b0 0x7ff0c0004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:43.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.472+0000 7ff0ddc10700 1 -- 172.21.15.110:0/788102030 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0d80b99b0 msgr2=0x7ff0c0004e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:43.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.472+0000 7ff0ddc10700 1 --2- 172.21.15.110:0/788102030 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0d80b99b0 0x7ff0c0004e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:43.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.472+0000 7ff0ddc10700 1 -- 172.21.15.110:0/788102030 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0c0003760 msgr2=0x7ff0c0003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:43.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.472+0000 7ff0ddc10700 1 --2- 172.21.15.110:0/788102030 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0c0003760 0x7ff0c0003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:43.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.472+0000 7ff0ddc10700 1 -- 172.21.15.110:0/788102030 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c0003270 con 0x7ff0c0004510 2021-03-25T14:17:43.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.472+0000 7ff0ddc10700 1 --2- 172.21.15.110:0/788102030 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0c0004510 0x7ff0c0004990 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7ff0c800bc00 tx=0x7ff0c8006e20).ready entity=mon.0 client_cookie=bda44bece45b0939 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:43.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.473+0000 7ff0dd40f700 1 -- 172.21.15.110:0/788102030 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c800b330 con 0x7ff0c0004510 2021-03-25T14:17:43.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.473+0000 7ff0dd40f700 1 -- 172.21.15.110:0/788102030 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c800ea00 con 0x7ff0c0004510 2021-03-25T14:17:43.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.473+0000 7ff0dd40f700 1 -- 172.21.15.110:0/788102030 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c800ed80 con 0x7ff0c0004510 2021-03-25T14:17:43.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.473+0000 7ff0e0675700 1 -- 172.21.15.110:0/788102030 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0c0004510 msgr2=0x7ff0c0004990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:43.482 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.473+0000 7ff0e0675700 1 --2- 172.21.15.110:0/788102030 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0c0004510 0x7ff0c0004990 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7ff0c800bc00 tx=0x7ff0c8006e20).stop 2021-03-25T14:17:43.483 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.473+0000 7ff0dec12700 1 -- 172.21.15.110:0/788102030 reap_dead start 2021-03-25T14:17:43.483 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.473+0000 7ff0e0675700 1 -- 172.21.15.110:0/788102030 shutdown_connections 2021-03-25T14:17:43.483 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.473+0000 7ff0e0675700 1 -- 172.21.15.110:0/788102030 >> 172.21.15.110:0/788102030 conn(0x7ff0d8060c40 msgr2=0x7ff0d8061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:43.483 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.473+0000 7ff0e0675700 1 -- 172.21.15.110:0/788102030 shutdown_connections 2021-03-25T14:17:43.483 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.473+0000 7ff0e0675700 1 -- 172.21.15.110:0/788102030 wait complete. 2021-03-25T14:17:43.483 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.474+0000 7ff0e0675700 1 Processor -- start 2021-03-25T14:17:43.483 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.474+0000 7ff0e0675700 1 -- start start 2021-03-25T14:17:43.483 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.475+0000 7ff0e0675700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0c0004510 0x7ff0d80bb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:43.483 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.475+0000 7ff0e0675700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0d8065d80 0x7ff0d8145d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:43.483 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.475+0000 7ff0e0675700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0d8064210 0x7ff0d8064670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:43.483 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.475+0000 7ff0e0675700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d80bbe80 con 0x7ff0d8065d80 2021-03-25T14:17:43.483 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.475+0000 7ff0e0675700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d80bc060 con 0x7ff0c0004510 2021-03-25T14:17:43.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.475+0000 7ff0e0675700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d80bc300 con 0x7ff0d8064210 2021-03-25T14:17:43.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.475+0000 7ff0ddc10700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0d8065d80 0x7ff0d8145d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:43.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.475+0000 7ff0ddc10700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0d8065d80 0x7ff0d8145d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50442/0 (socket says 172.21.15.110:50442) 2021-03-25T14:17:43.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.475+0000 7ff0ddc10700 1 -- 172.21.15.110:0/1074304132 learned_addr learned my addr 172.21.15.110:0/1074304132 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:43.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.475+0000 7ff0dec12700 1 --2- 172.21.15.110:0/1074304132 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0d8064210 0x7ff0d8064670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:43.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.475+0000 7ff0de411700 1 --2- 172.21.15.110:0/1074304132 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0c0004510 0x7ff0d80bb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:43.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.475+0000 7ff0ddc10700 1 -- 172.21.15.110:0/1074304132 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0d8064210 msgr2=0x7ff0d8064670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:43.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.475+0000 7ff0ddc10700 1 --2- 172.21.15.110:0/1074304132 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0d8064210 0x7ff0d8064670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:43.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.475+0000 7ff0ddc10700 1 -- 172.21.15.110:0/1074304132 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0c0004510 msgr2=0x7ff0d80bb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:43.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.475+0000 7ff0ddc10700 1 --2- 172.21.15.110:0/1074304132 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0c0004510 0x7ff0d80bb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:43.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.475+0000 7ff0ddc10700 1 -- 172.21.15.110:0/1074304132 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d80653a0 con 0x7ff0d8065d80 2021-03-25T14:17:43.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.475+0000 7ff0de411700 1 --2- 172.21.15.110:0/1074304132 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0c0004510 0x7ff0d80bb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:43.484 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.475+0000 7ff0dec12700 1 --2- 172.21.15.110:0/1074304132 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0d8064210 0x7ff0d8064670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:43.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.475+0000 7ff0ddc10700 1 --2- 172.21.15.110:0/1074304132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0d8065d80 0x7ff0d8145d80 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7ff0c8006e60 tx=0x7ff0c8018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:43.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.475+0000 7ff0c67fc700 1 -- 172.21.15.110:0/1074304132 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c801e420 con 0x7ff0d8065d80 2021-03-25T14:17:43.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.475+0000 7ff0c67fc700 1 -- 172.21.15.110:0/1074304132 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c801e580 con 0x7ff0d8065d80 2021-03-25T14:17:43.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.475+0000 7ff0e0675700 1 -- 172.21.15.110:0/1074304132 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d8065640 con 0x7ff0d8065d80 2021-03-25T14:17:43.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.475+0000 7ff0c67fc700 1 -- 172.21.15.110:0/1074304132 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c801e920 con 0x7ff0d8065d80 2021-03-25T14:17:43.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.475+0000 7ff0e0675700 1 -- 172.21.15.110:0/1074304132 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d8144700 con 0x7ff0d8065d80 2021-03-25T14:17:43.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.476+0000 7ff0e0675700 1 -- 172.21.15.110:0/1074304132 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d8065aa0 con 0x7ff0d8065d80 2021-03-25T14:17:43.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.477+0000 7ff0c67fc700 1 -- 172.21.15.110:0/1074304132 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7ff0c801ed10 con 0x7ff0d8065d80 2021-03-25T14:17:43.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.477+0000 7ff0c67fc700 1 --2- 172.21.15.110:0/1074304132 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff0b805a0b0 0x7ff0b805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:43.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.477+0000 7ff0c67fc700 1 -- 172.21.15.110:0/1074304132 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6426+0+0 (secure 0 0 0) 0x7ff0c8075d30 con 0x7ff0d8065d80 2021-03-25T14:17:43.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.477+0000 7ff0de411700 1 --2- 172.21.15.110:0/1074304132 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff0b805a0b0 0x7ff0b805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:43.485 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.477+0000 7ff0de411700 1 --2- 172.21.15.110:0/1074304132 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff0b805a0b0 0x7ff0b805c570 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7ff0d4006fd0 tx=0x7ff0d4008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:43.486 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.481+0000 7ff0c67fc700 1 -- 172.21.15.110:0/1074304132 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7ff0c8049570 con 0x7ff0d8065d80 2021-03-25T14:17:43.665 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.664+0000 7ff0e0675700 1 -- 172.21.15.110:0/1074304132 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0d805d7b0 con 0x7ff0d8065d80 2021-03-25T14:17:43.666 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.664+0000 7ff0c67fc700 1 -- 172.21.15.110:0/1074304132 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+2849 (secure 0 0 0) 0x7ff0c804cb90 con 0x7ff0d8065d80 2021-03-25T14:17:43.666 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:43.667 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":27,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4997,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/3015251726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3015251726},{"type":"v1","addr":"172.21.15.174:6835","nonce":3015251726}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":24},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/1698368640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1698368640},{"type":"v1","addr":"172.21.15.174:6833","nonce":1698368640}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":24},{"gid":5601,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.110:6837/2143874763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":2143874763},{"type":"v1","addr":"172.21.15.110:6837","nonce":2143874763}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":25}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-03-25T14:17:42.344725+0000","modified":"2021-03-25T14:17:43.345825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5604":{"gid":5604,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6836/426511293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":426511293},{"type":"v1","addr":"172.21.15.110:6836","nonce":426511293}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-03-25T14:17:43.668 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.666+0000 7ff0e0675700 1 -- 172.21.15.110:0/1074304132 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff0b805a0b0 msgr2=0x7ff0b805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:43.668 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.666+0000 7ff0e0675700 1 --2- 172.21.15.110:0/1074304132 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff0b805a0b0 0x7ff0b805c570 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7ff0d4006fd0 tx=0x7ff0d4008040).stop 2021-03-25T14:17:43.668 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.666+0000 7ff0e0675700 1 -- 172.21.15.110:0/1074304132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0d8065d80 msgr2=0x7ff0d8145d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:43.668 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.666+0000 7ff0e0675700 1 --2- 172.21.15.110:0/1074304132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0d8065d80 0x7ff0d8145d80 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7ff0c8006e60 tx=0x7ff0c8018000).stop 2021-03-25T14:17:43.668 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.666+0000 7ff0e0675700 1 -- 172.21.15.110:0/1074304132 shutdown_connections 2021-03-25T14:17:43.668 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.666+0000 7ff0e0675700 1 --2- 172.21.15.110:0/1074304132 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff0b805a0b0 0x7ff0b805c570 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:43.668 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.666+0000 7ff0e0675700 1 --2- 172.21.15.110:0/1074304132 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0c0004510 0x7ff0d80bb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:43.668 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.666+0000 7ff0e0675700 1 --2- 172.21.15.110:0/1074304132 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0d8064210 0x7ff0d8064670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:43.669 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.666+0000 7ff0e0675700 1 --2- 172.21.15.110:0/1074304132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0d8065d80 0x7ff0d8145d80 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:43.669 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.666+0000 7ff0e0675700 1 -- 172.21.15.110:0/1074304132 >> 172.21.15.110:0/1074304132 conn(0x7ff0d8060c40 msgr2=0x7ff0d80b9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:43.669 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.666+0000 7ff0e0675700 1 -- 172.21.15.110:0/1074304132 shutdown_connections 2021-03-25T14:17:43.669 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.666+0000 7ff0e0675700 1 -- 172.21.15.110:0/1074304132 wait complete. 2021-03-25T14:17:43.669 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 27 2021-03-25T14:17:43.679 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:17:43.791 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.789+0000 7fefaebfb700 1 Processor -- start 2021-03-25T14:17:43.791 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.789+0000 7fefaebfb700 1 -- start start 2021-03-25T14:17:43.798 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.790+0000 7fefaebfb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fefa80ba680 0x7fefa80baa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:43.798 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.790+0000 7fefaebfb700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefa80bbcd0 con 0x7fefa80b86d0 2021-03-25T14:17:43.798 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.790+0000 7fefaebfb700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefa80bbf70 con 0x7fefa8148d00 2021-03-25T14:17:43.798 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.790+0000 7fefaebfb700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefa80bc210 con 0x7fefa80ba680 2021-03-25T14:17:43.798 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.790+0000 7fefad3f8700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fefa80b86d0 0x7fefa80bcc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43384/0 (socket says 172.21.15.110:43384) 2021-03-25T14:17:43.798 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.790+0000 7fefad3f8700 1 -- 172.21.15.110:0/1302644272 learned_addr learned my addr 172.21.15.110:0/1302644272 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:43.798 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.790+0000 7fefacbf7700 1 -- 172.21.15.110:0/1302644272 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2151746704 0 0) 0x7fefa80bbcd0 con 0x7fefa80b86d0 2021-03-25T14:17:43.798 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.790+0000 7fefacbf7700 1 -- 172.21.15.110:0/1302644272 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef90003270 con 0x7fefa80b86d0 2021-03-25T14:17:43.798 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.790+0000 7fefadbf9700 1 --2- 172.21.15.110:0/1302644272 >> v2:172.21.15.174:3300/0 conn(0x7fefa80ba680 0x7fefa80baa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:43.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.790+0000 7fefacbf7700 1 -- 172.21.15.110:0/1302644272 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 357330480 0 0) 0x7fef90003270 con 0x7fefa80b86d0 2021-03-25T14:17:43.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.790+0000 7fefacbf7700 1 -- 172.21.15.110:0/1302644272 >> v2:172.21.15.174:3300/0 conn(0x7fefa80ba680 msgr2=0x7fefa80baa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:43.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.790+0000 7fefacbf7700 1 --2- 172.21.15.110:0/1302644272 >> v2:172.21.15.174:3300/0 conn(0x7fefa80ba680 0x7fefa80baa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:43.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.790+0000 7fefacbf7700 1 -- 172.21.15.110:0/1302644272 >> v1:172.21.15.174:6789/0 conn(0x7fefa8148d00 legacy=0x7fefa8149150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:43.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.790+0000 7fefacbf7700 1 -- 172.21.15.110:0/1302644272 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa80bc4b0 con 0x7fefa80b86d0 2021-03-25T14:17:43.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.790+0000 7fefacbf7700 1 -- 172.21.15.110:0/1302644272 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7fef98001520 con 0x7fefa80b86d0 2021-03-25T14:17:43.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.790+0000 7fefacbf7700 1 -- 172.21.15.110:0/1302644272 >> v1:172.21.15.110:6789/0 conn(0x7fefa80b86d0 legacy=0x7fefa80bcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:43.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.790+0000 7fefacbf7700 1 --2- 172.21.15.110:0/1302644272 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef90003760 0x7fef90003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:43.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.790+0000 7fefacbf7700 1 --2- 172.21.15.110:0/1302644272 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef90004510 0x7fef90004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:43.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.790+0000 7fefacbf7700 1 --2- 172.21.15.110:0/1302644272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef90004e80 0x7fef9000b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:43.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.790+0000 7fefacbf7700 1 -- 172.21.15.110:0/1302644272 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa80bc210 con 0x7fef90004e80 2021-03-25T14:17:43.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.790+0000 7fefacbf7700 1 -- 172.21.15.110:0/1302644272 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef90004290 con 0x7fef90003760 2021-03-25T14:17:43.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.790+0000 7fefacbf7700 1 -- 172.21.15.110:0/1302644272 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9000bc50 con 0x7fef90004510 2021-03-25T14:17:43.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.791+0000 7fefae3fa700 1 --2- 172.21.15.110:0/1302644272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef90004e80 0x7fef9000b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:43.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.791+0000 7fefadbf9700 1 --2- 172.21.15.110:0/1302644272 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef90003760 0x7fef90003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:43.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.791+0000 7fefad3f8700 1 --2- 172.21.15.110:0/1302644272 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef90004510 0x7fef90004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:43.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.791+0000 7fefae3fa700 1 -- 172.21.15.110:0/1302644272 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef90004510 msgr2=0x7fef90004990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:43.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.791+0000 7fefae3fa700 1 --2- 172.21.15.110:0/1302644272 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef90004510 0x7fef90004990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:43.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.791+0000 7fefae3fa700 1 -- 172.21.15.110:0/1302644272 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef90003760 msgr2=0x7fef90003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:43.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.791+0000 7fefae3fa700 1 --2- 172.21.15.110:0/1302644272 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef90003760 0x7fef90003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:43.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.791+0000 7fefae3fa700 1 -- 172.21.15.110:0/1302644272 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef90003270 con 0x7fef90004e80 2021-03-25T14:17:43.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.791+0000 7fefad3f8700 1 --2- 172.21.15.110:0/1302644272 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef90004510 0x7fef90004990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:43.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.791+0000 7fefae3fa700 1 -- 172.21.15.110:0/1302644272 reap_dead start 2021-03-25T14:17:43.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.791+0000 7fefae3fa700 1 --2- 172.21.15.110:0/1302644272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef90004e80 0x7fef9000b760 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7fefa0001f20 tx=0x7fefa0007f90).ready entity=mon.0 client_cookie=1503bb217bd69364 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:43.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.791+0000 7fefacbf7700 1 -- 172.21.15.110:0/1302644272 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa000c9c0 con 0x7fef90004e80 2021-03-25T14:17:43.801 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.791+0000 7fefacbf7700 1 -- 172.21.15.110:0/1302644272 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa000cb20 con 0x7fef90004e80 2021-03-25T14:17:43.801 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.791+0000 7fefacbf7700 1 -- 172.21.15.110:0/1302644272 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa000cea0 con 0x7fef90004e80 2021-03-25T14:17:43.801 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.792+0000 7fefaebfb700 1 -- 172.21.15.110:0/1302644272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef90004e80 msgr2=0x7fef9000b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:43.801 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.792+0000 7fefaebfb700 1 --2- 172.21.15.110:0/1302644272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef90004e80 0x7fef9000b760 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7fefa0001f20 tx=0x7fefa0007f90).stop 2021-03-25T14:17:43.801 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.792+0000 7fefaebfb700 1 -- 172.21.15.110:0/1302644272 shutdown_connections 2021-03-25T14:17:43.801 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.792+0000 7fefaebfb700 1 --2- 172.21.15.110:0/1302644272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef90004e80 0x7fef9000b760 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:43.801 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.792+0000 7fefaebfb700 1 -- 172.21.15.110:0/1302644272 >> 172.21.15.110:0/1302644272 conn(0x7fefa8060c40 msgr2=0x7fefa8061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:43.801 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.792+0000 7fefaebfb700 1 -- 172.21.15.110:0/1302644272 shutdown_connections 2021-03-25T14:17:43.801 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.792+0000 7fefaebfb700 1 -- 172.21.15.110:0/1302644272 wait complete. 2021-03-25T14:17:43.801 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.793+0000 7fefaebfb700 1 Processor -- start 2021-03-25T14:17:43.801 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.793+0000 7fefaebfb700 1 -- start start 2021-03-25T14:17:43.801 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.793+0000 7fefaebfb700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef90004e80 0x7fefa814d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:43.801 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.793+0000 7fefaebfb700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefa8063090 0x7fefa80655c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:43.802 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.793+0000 7fefaebfb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fefa80b60d0 0x7fefa8065ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:43.802 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.793+0000 7fefaebfb700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa8063e70 con 0x7fef90004e80 2021-03-25T14:17:43.802 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.793+0000 7fefaebfb700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa80b6650 con 0x7fefa8063090 2021-03-25T14:17:43.802 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.793+0000 7fefaebfb700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa8063690 con 0x7fefa80b60d0 2021-03-25T14:17:43.802 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.793+0000 7fefadbf9700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef90004e80 0x7fefa814d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:43.802 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.793+0000 7fefadbf9700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef90004e80 0x7fefa814d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50460/0 (socket says 172.21.15.110:50460) 2021-03-25T14:17:43.802 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.793+0000 7fefadbf9700 1 -- 172.21.15.110:0/631405888 learned_addr learned my addr 172.21.15.110:0/631405888 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:43.802 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.794+0000 7fefad3f8700 1 --2- 172.21.15.110:0/631405888 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefa8063090 0x7fefa80655c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:43.802 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.794+0000 7fefae3fa700 1 --2- 172.21.15.110:0/631405888 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fefa80b60d0 0x7fefa8065ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:43.802 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.794+0000 7fefadbf9700 1 -- 172.21.15.110:0/631405888 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fefa80b60d0 msgr2=0x7fefa8065ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:43.802 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.794+0000 7fefadbf9700 1 --2- 172.21.15.110:0/631405888 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fefa80b60d0 0x7fefa8065ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:43.802 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.794+0000 7fefadbf9700 1 -- 172.21.15.110:0/631405888 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefa8063090 msgr2=0x7fefa80655c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:43.803 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.794+0000 7fefadbf9700 1 --2- 172.21.15.110:0/631405888 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefa8063090 0x7fefa80655c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:43.803 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.794+0000 7fefadbf9700 1 -- 172.21.15.110:0/631405888 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa8063930 con 0x7fef90004e80 2021-03-25T14:17:43.803 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.794+0000 7fefadbf9700 1 --2- 172.21.15.110:0/631405888 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef90004e80 0x7fefa814d2e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7fefa4006890 tx=0x7fefa4006e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:43.803 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.794+0000 7fef95ffb700 1 -- 172.21.15.110:0/631405888 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa400b3e0 con 0x7fef90004e80 2021-03-25T14:17:43.803 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.794+0000 7fef95ffb700 1 -- 172.21.15.110:0/631405888 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa400fb50 con 0x7fef90004e80 2021-03-25T14:17:43.803 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.794+0000 7fefaebfb700 1 -- 172.21.15.110:0/631405888 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefa8063bd0 con 0x7fef90004e80 2021-03-25T14:17:43.803 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.794+0000 7fef95ffb700 1 -- 172.21.15.110:0/631405888 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa400fed0 con 0x7fef90004e80 2021-03-25T14:17:43.803 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.794+0000 7fefaebfb700 1 -- 172.21.15.110:0/631405888 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefa814d7d0 con 0x7fef90004e80 2021-03-25T14:17:43.803 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.795+0000 7fefaebfb700 1 -- 172.21.15.110:0/631405888 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefa8045ae0 con 0x7fef90004e80 2021-03-25T14:17:43.803 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.795+0000 7fef95ffb700 1 -- 172.21.15.110:0/631405888 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fefa4024070 con 0x7fef90004e80 2021-03-25T14:17:43.803 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.796+0000 7fef95ffb700 1 --2- 172.21.15.110:0/631405888 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fef8805a0b0 0x7fef8805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:43.803 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.796+0000 7fef95ffb700 1 -- 172.21.15.110:0/631405888 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6426+0+0 (secure 0 0 0) 0x7fefa4074930 con 0x7fef90004e80 2021-03-25T14:17:43.804 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.796+0000 7fefad3f8700 1 --2- 172.21.15.110:0/631405888 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fef8805a0b0 0x7fef8805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:43.804 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.796+0000 7fefad3f8700 1 --2- 172.21.15.110:0/631405888 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fef8805a0b0 0x7fef8805c570 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fefa8063490 tx=0x7fef98009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:43.804 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.799+0000 7fef95ffb700 1 -- 172.21.15.110:0/631405888 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fefa4048170 con 0x7fef90004e80 2021-03-25T14:17:43.951 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.949+0000 7fefaebfb700 1 -- 172.21.15.110:0/631405888 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fefa80bda30 con 0x7fef90004e80 2021-03-25T14:17:43.951 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.950+0000 7fef95ffb700 1 -- 172.21.15.110:0/631405888 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+17112 (secure 0 0 0) 0x7fefa404b790 con 0x7fef90004e80 2021-03-25T14:17:43.952 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:43.952 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":56,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:17:43.346063+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2021-03-25T14:17:40.271092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2021-03-25T14:17:41.271977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:17:43.953 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.951+0000 7fefaebfb700 1 -- 172.21.15.110:0/631405888 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fef8805a0b0 msgr2=0x7fef8805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:43.953 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.951+0000 7fefaebfb700 1 --2- 172.21.15.110:0/631405888 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fef8805a0b0 0x7fef8805c570 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fefa8063490 tx=0x7fef98009040).stop 2021-03-25T14:17:43.954 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.951+0000 7fefaebfb700 1 -- 172.21.15.110:0/631405888 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef90004e80 msgr2=0x7fefa814d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:43.954 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.951+0000 7fefaebfb700 1 --2- 172.21.15.110:0/631405888 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef90004e80 0x7fefa814d2e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7fefa4006890 tx=0x7fefa4006e20).stop 2021-03-25T14:17:43.954 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.951+0000 7fefaebfb700 1 -- 172.21.15.110:0/631405888 shutdown_connections 2021-03-25T14:17:43.954 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.951+0000 7fefaebfb700 1 --2- 172.21.15.110:0/631405888 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fef8805a0b0 0x7fef8805c570 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:43.954 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.951+0000 7fefaebfb700 1 --2- 172.21.15.110:0/631405888 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fefa80b60d0 0x7fefa8065ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:43.954 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.951+0000 7fefaebfb700 1 --2- 172.21.15.110:0/631405888 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef90004e80 0x7fefa814d2e0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:43.954 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.951+0000 7fefaebfb700 1 --2- 172.21.15.110:0/631405888 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefa8063090 0x7fefa80655c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:43.954 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.951+0000 7fefaebfb700 1 -- 172.21.15.110:0/631405888 >> 172.21.15.110:0/631405888 conn(0x7fefa8060c40 msgr2=0x7fefa8145cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:43.954 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.951+0000 7fefaebfb700 1 -- 172.21.15.110:0/631405888 shutdown_connections 2021-03-25T14:17:43.954 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:43.951+0000 7fefaebfb700 1 -- 172.21.15.110:0/631405888 wait complete. 2021-03-25T14:17:43.965 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw pool=cephfs_data' mds allow 2021-03-25T14:17:44.080 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.078+0000 7f34b0af2700 1 Processor -- start 2021-03-25T14:17:44.080 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.078+0000 7f34b0af2700 1 -- start start 2021-03-25T14:17:44.083 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.079+0000 7f34b0af2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f34ac0b4100 0x7f34ac149340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:44.083 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.079+0000 7f34b0af2700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34ac0b4c10 con 0x7f34ac0b47a0 2021-03-25T14:17:44.083 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.079+0000 7f34b0af2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34ac149960 con 0x7f34ac0be3a0 2021-03-25T14:17:44.083 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.079+0000 7f34b0af2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34ac149c00 con 0x7f34ac0b4100 2021-03-25T14:17:44.083 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.079+0000 7f34aad9d700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f34ac0b47a0 0x7f34ac0b8cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43406/0 (socket says 172.21.15.110:43406) 2021-03-25T14:17:44.083 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.079+0000 7f34aad9d700 1 -- 172.21.15.110:0/2429039341 learned_addr learned my addr 172.21.15.110:0/2429039341 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:44.083 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.079+0000 7f34a9d9b700 1 --2- 172.21.15.110:0/2429039341 >> v2:172.21.15.174:3300/0 conn(0x7f34ac0b4100 0x7f34ac149340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:44.083 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.080+0000 7f34a959a700 1 -- 172.21.15.110:0/2429039341 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 569292557 0 0) 0x7f34ac0b4c10 con 0x7f34ac0b47a0 2021-03-25T14:17:44.083 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.080+0000 7f34a959a700 1 -- 172.21.15.110:0/2429039341 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3490003270 con 0x7f34ac0b47a0 2021-03-25T14:17:44.084 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.080+0000 7f34a959a700 1 -- 172.21.15.110:0/2429039341 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2034643487 0 0) 0x7f3490003270 con 0x7f34ac0b47a0 2021-03-25T14:17:44.084 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.080+0000 7f34a9d9b700 1 -- 172.21.15.110:0/2429039341 >> v1:172.21.15.174:6789/0 conn(0x7f34ac0be3a0 legacy=0x7f34ac148c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:44.084 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.080+0000 7f34a9d9b700 1 -- 172.21.15.110:0/2429039341 >> v1:172.21.15.110:6789/0 conn(0x7f34ac0b47a0 legacy=0x7f34ac0b8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:44.084 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.080+0000 7f34a9d9b700 1 -- 172.21.15.110:0/2429039341 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ac149ea0 con 0x7f34ac0b4100 2021-03-25T14:17:44.084 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.080+0000 7f34a9d9b700 1 --2- 172.21.15.110:0/2429039341 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34ac0b4100 0x7f34ac149340 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f34a000b9c0 tx=0x7f34a0006e20).ready entity=mon.1 client_cookie=e859be1e963e50c9 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:44.084 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.080+0000 7f34a959a700 1 -- 172.21.15.110:0/2429039341 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a40018a0 con 0x7f34ac0b4100 2021-03-25T14:17:44.084 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.080+0000 7f34a959a700 1 -- 172.21.15.110:0/2429039341 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a000beb0 con 0x7f34ac0b4100 2021-03-25T14:17:44.084 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.080+0000 7f34a959a700 1 -- 172.21.15.110:0/2429039341 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a00096e0 con 0x7f34ac0b4100 2021-03-25T14:17:44.084 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.081+0000 7f34b0af2700 1 -- 172.21.15.110:0/2429039341 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34ac0b4100 msgr2=0x7f34ac149340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:44.084 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.081+0000 7f34b0af2700 1 --2- 172.21.15.110:0/2429039341 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34ac0b4100 0x7f34ac149340 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f34a000b9c0 tx=0x7f34a0006e20).stop 2021-03-25T14:17:44.084 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.081+0000 7f34b0af2700 1 -- 172.21.15.110:0/2429039341 shutdown_connections 2021-03-25T14:17:44.084 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.081+0000 7f34b0af2700 1 --2- 172.21.15.110:0/2429039341 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34ac0b4100 0x7f34ac149340 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:44.084 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.081+0000 7f34b0af2700 1 -- 172.21.15.110:0/2429039341 >> 172.21.15.110:0/2429039341 conn(0x7f34ac0686f0 msgr2=0x7f34ac068b00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:44.085 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.081+0000 7f34b0af2700 1 -- 172.21.15.110:0/2429039341 shutdown_connections 2021-03-25T14:17:44.085 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.081+0000 7f34b0af2700 1 -- 172.21.15.110:0/2429039341 wait complete. 2021-03-25T14:17:44.087 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.082+0000 7f34b0af2700 1 Processor -- start 2021-03-25T14:17:44.087 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.082+0000 7f34b0af2700 1 -- start start 2021-03-25T14:17:44.088 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.082+0000 7f34b0af2700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34ac0b4100 0x7f34ac0b6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:44.088 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.082+0000 7f34b0af2700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34ac0b47a0 0x7f34ac0a0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:44.088 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.082+0000 7f34b0af2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34ac0be3a0 0x7f34ac1460c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:44.088 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.082+0000 7f34b0af2700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac14acb0 con 0x7f34ac0b47a0 2021-03-25T14:17:44.088 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.082+0000 7f34b0af2700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac158a80 con 0x7f34ac0b4100 2021-03-25T14:17:44.088 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.082+0000 7f34b0af2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac14aea0 con 0x7f34ac0be3a0 2021-03-25T14:17:44.088 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.083+0000 7f34a9d9b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34ac0b47a0 0x7f34ac0a0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:44.088 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.083+0000 7f34a9d9b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34ac0b47a0 0x7f34ac0a0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50476/0 (socket says 172.21.15.110:50476) 2021-03-25T14:17:44.088 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.083+0000 7f34a9d9b700 1 -- 172.21.15.110:0/1173892626 learned_addr learned my addr 172.21.15.110:0/1173892626 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:44.088 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.083+0000 7f34aa59c700 1 --2- 172.21.15.110:0/1173892626 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34ac0b4100 0x7f34ac0b6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:44.088 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.083+0000 7f34aad9d700 1 --2- 172.21.15.110:0/1173892626 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34ac0be3a0 0x7f34ac1460c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:44.089 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.083+0000 7f34a9d9b700 1 -- 172.21.15.110:0/1173892626 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34ac0be3a0 msgr2=0x7f34ac1460c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:44.089 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.083+0000 7f34a9d9b700 1 --2- 172.21.15.110:0/1173892626 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34ac0be3a0 0x7f34ac1460c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:44.089 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.083+0000 7f34a9d9b700 1 -- 172.21.15.110:0/1173892626 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34ac0b4100 msgr2=0x7f34ac0b6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:44.089 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.083+0000 7f34a9d9b700 1 --2- 172.21.15.110:0/1173892626 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34ac0b4100 0x7f34ac0b6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:44.089 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.083+0000 7f34a9d9b700 1 -- 172.21.15.110:0/1173892626 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ac14b140 con 0x7f34ac0b47a0 2021-03-25T14:17:44.089 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.083+0000 7f34a9d9b700 1 --2- 172.21.15.110:0/1173892626 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34ac0b47a0 0x7f34ac0a0140 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f34ac0683f0 tx=0x7f34a0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:44.089 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.083+0000 7f349a7fc700 1 -- 172.21.15.110:0/1173892626 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a00118e0 con 0x7f34ac0b47a0 2021-03-25T14:17:44.089 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.083+0000 7f349a7fc700 1 -- 172.21.15.110:0/1173892626 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a0011a40 con 0x7f34ac0b47a0 2021-03-25T14:17:44.089 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.083+0000 7f34b0af2700 1 -- 172.21.15.110:0/1173892626 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34ac14b3e0 con 0x7f34ac0b47a0 2021-03-25T14:17:44.089 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.083+0000 7f349a7fc700 1 -- 172.21.15.110:0/1173892626 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a0011dc0 con 0x7f34ac0b47a0 2021-03-25T14:17:44.089 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.083+0000 7f34b0af2700 1 -- 172.21.15.110:0/1173892626 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34ac0b6b70 con 0x7f34ac0b47a0 2021-03-25T14:17:44.089 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.084+0000 7f3487fff700 1 -- 172.21.15.110:0/1173892626 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3480004fa0 con 0x7f34ac0b47a0 2021-03-25T14:17:44.089 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.085+0000 7f349a7fc700 1 -- 172.21.15.110:0/1173892626 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f34a0023020 con 0x7f34ac0b47a0 2021-03-25T14:17:44.090 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.085+0000 7f349a7fc700 1 --2- 172.21.15.110:0/1173892626 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f348805a0b0 0x7f348805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:44.090 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.085+0000 7f349a7fc700 1 -- 172.21.15.110:0/1173892626 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6426+0+0 (secure 0 0 0) 0x7f34a00756f0 con 0x7f34ac0b47a0 2021-03-25T14:17:44.090 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.085+0000 7f34aa59c700 1 --2- 172.21.15.110:0/1173892626 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f348805a0b0 0x7f348805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:44.090 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.085+0000 7f34aa59c700 1 --2- 172.21.15.110:0/1173892626 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f348805a0b0 0x7f348805c570 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f349c0036e0 tx=0x7f349c007bc0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:44.090 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.089+0000 7f349a7fc700 1 -- 172.21.15.110:0/1173892626 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f34a0048f30 con 0x7f34ac0b47a0 2021-03-25T14:17:44.293 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.291+0000 7f3487fff700 1 -- 172.21.15.110:0/1173892626 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]} v 0) v1 -- 0x7f3480005250 con 0x7f34ac0b47a0 2021-03-25T14:17:44.296 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.294+0000 7f349a7fc700 1 -- 172.21.15.110:0/1173892626 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 184+0+0 (secure 0 0 0) 0x7f34a004c550 con 0x7f34ac0b47a0 2021-03-25T14:17:44.298 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.296+0000 7f3487fff700 1 -- 172.21.15.110:0/1173892626 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f348805a0b0 msgr2=0x7f348805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:44.298 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.296+0000 7f3487fff700 1 --2- 172.21.15.110:0/1173892626 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f348805a0b0 0x7f348805c570 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f349c0036e0 tx=0x7f349c007bc0).stop 2021-03-25T14:17:44.299 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.296+0000 7f3487fff700 1 -- 172.21.15.110:0/1173892626 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34ac0b47a0 msgr2=0x7f34ac0a0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:44.299 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.296+0000 7f3487fff700 1 --2- 172.21.15.110:0/1173892626 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34ac0b47a0 0x7f34ac0a0140 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f34ac0683f0 tx=0x7f34a0016000).stop 2021-03-25T14:17:44.299 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.296+0000 7f3487fff700 1 -- 172.21.15.110:0/1173892626 shutdown_connections 2021-03-25T14:17:44.299 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.296+0000 7f3487fff700 1 --2- 172.21.15.110:0/1173892626 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f348805a0b0 0x7f348805c570 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:44.299 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.296+0000 7f3487fff700 1 --2- 172.21.15.110:0/1173892626 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34ac0b4100 0x7f34ac0b6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:44.299 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.296+0000 7f3487fff700 1 --2- 172.21.15.110:0/1173892626 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34ac0be3a0 0x7f34ac1460c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:44.299 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.296+0000 7f3487fff700 1 --2- 172.21.15.110:0/1173892626 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34ac0b47a0 0x7f34ac0a0140 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:44.299 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.296+0000 7f3487fff700 1 -- 172.21.15.110:0/1173892626 >> 172.21.15.110:0/1173892626 conn(0x7f34ac0686f0 msgr2=0x7f34ac0b9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:44.299 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.296+0000 7f3487fff700 1 -- 172.21.15.110:0/1173892626 shutdown_connections 2021-03-25T14:17:44.299 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.296+0000 7f3487fff700 1 -- 172.21.15.110:0/1173892626 wait complete. 2021-03-25T14:17:44.299 INFO:teuthology.orchestra.run.smithi110.stderr:updated caps for client.0 2021-03-25T14:17:44.309 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-03-25T14:17:44.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.417+0000 7f46ccf58700 1 Processor -- start 2021-03-25T14:17:44.420 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.417+0000 7f46ccf58700 1 -- start start 2021-03-25T14:17:44.427 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.418+0000 7f46ccf58700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f46c80b9730 0x7f46c814cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:44.427 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.418+0000 7f46ccf58700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f46c80667d0 0x7f46c814d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:44.427 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.418+0000 7f46ccf58700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f46c80a1f20 0x7f46c814d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:44.427 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.418+0000 7f46ccf58700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c814db10 con 0x7f46c80a1f20 2021-03-25T14:17:44.427 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.418+0000 7f46ccf58700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c80a1b90 con 0x7f46c80b9730 2021-03-25T14:17:44.428 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.418+0000 7f46ccf58700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c8064680 con 0x7f46c80667d0 2021-03-25T14:17:44.428 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.418+0000 7f46c6d9d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f46c80a1f20 0x7f46c814d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:44.428 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.419+0000 7f46c6d9d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f46c80a1f20 0x7f46c814d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50484/0 (socket says 172.21.15.110:50484) 2021-03-25T14:17:44.428 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.419+0000 7f46c6d9d700 1 -- 172.21.15.110:0/1234882536 learned_addr learned my addr 172.21.15.110:0/1234882536 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:44.428 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.419+0000 7f46c659c700 1 --2- 172.21.15.110:0/1234882536 >> v2:172.21.15.174:3300/0 conn(0x7f46c80b9730 0x7f46c814cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:44.428 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.419+0000 7f46c6d9d700 1 -- 172.21.15.110:0/1234882536 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f46c80667d0 msgr2=0x7f46c814d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:44.428 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.419+0000 7f46c6d9d700 1 --2- 172.21.15.110:0/1234882536 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f46c80667d0 0x7f46c814d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:44.428 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.419+0000 7f46c6d9d700 1 -- 172.21.15.110:0/1234882536 >> v2:172.21.15.174:3300/0 conn(0x7f46c80b9730 msgr2=0x7f46c814cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:44.428 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.419+0000 7f46c6d9d700 1 --2- 172.21.15.110:0/1234882536 >> v2:172.21.15.174:3300/0 conn(0x7f46c80b9730 0x7f46c814cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:44.428 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.419+0000 7f46c6d9d700 1 -- 172.21.15.110:0/1234882536 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c8064840 con 0x7f46c80a1f20 2021-03-25T14:17:44.428 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.419+0000 7f46c6d9d700 1 --2- 172.21.15.110:0/1234882536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46c80a1f20 0x7f46c814d620 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f46c0009df0 tx=0x7f46c00092d0).ready entity=mon.0 client_cookie=146d59f9dcaa191 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:44.428 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.419+0000 7f46c559a700 1 -- 172.21.15.110:0/1234882536 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c000bc00 con 0x7f46c80a1f20 2021-03-25T14:17:44.428 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.419+0000 7f46c559a700 1 -- 172.21.15.110:0/1234882536 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46c000bd60 con 0x7f46c80a1f20 2021-03-25T14:17:44.429 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.419+0000 7f46c559a700 1 -- 172.21.15.110:0/1234882536 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c0011610 con 0x7f46c80a1f20 2021-03-25T14:17:44.429 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.420+0000 7f46ccf58700 1 -- 172.21.15.110:0/1234882536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46c80a1f20 msgr2=0x7f46c814d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:44.429 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.420+0000 7f46ccf58700 1 --2- 172.21.15.110:0/1234882536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46c80a1f20 0x7f46c814d620 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f46c0009df0 tx=0x7f46c00092d0).stop 2021-03-25T14:17:44.429 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.420+0000 7f46ccf58700 1 -- 172.21.15.110:0/1234882536 shutdown_connections 2021-03-25T14:17:44.429 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.420+0000 7f46ccf58700 1 --2- 172.21.15.110:0/1234882536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46c80a1f20 0x7f46c814d620 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:44.429 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.420+0000 7f46ccf58700 1 --2- 172.21.15.110:0/1234882536 >> v2:172.21.15.174:3300/0 conn(0x7f46c80b9730 0x7f46c814cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:44.429 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.420+0000 7f46ccf58700 1 --2- 172.21.15.110:0/1234882536 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f46c80667d0 0x7f46c814d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:44.429 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.420+0000 7f46ccf58700 1 -- 172.21.15.110:0/1234882536 >> 172.21.15.110:0/1234882536 conn(0x7f46c80bce50 msgr2=0x7f46c80b8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:44.429 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.420+0000 7f46ccf58700 1 -- 172.21.15.110:0/1234882536 shutdown_connections 2021-03-25T14:17:44.429 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.420+0000 7f46ccf58700 1 -- 172.21.15.110:0/1234882536 wait complete. 2021-03-25T14:17:44.429 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.421+0000 7f46ccf58700 1 Processor -- start 2021-03-25T14:17:44.429 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.421+0000 7f46ccf58700 1 -- start start 2021-03-25T14:17:44.430 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.421+0000 7f46ccf58700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46c80667d0 0x7f46c815c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:44.430 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.421+0000 7f46ccf58700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46c80a1f20 0x7f46c8146340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:44.430 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.421+0000 7f46ccf58700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f46c80b9730 0x7f46c814bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:44.430 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.421+0000 7f46ccf58700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c8146830 con 0x7f46c80667d0 2021-03-25T14:17:44.430 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.421+0000 7f46ccf58700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c8146a50 con 0x7f46c80a1f20 2021-03-25T14:17:44.430 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.421+0000 7f46ccf58700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c8146cf0 con 0x7f46c80b9730 2021-03-25T14:17:44.430 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.421+0000 7f46c659c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46c80667d0 0x7f46c815c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:44.430 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.421+0000 7f46c659c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46c80667d0 0x7f46c815c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50488/0 (socket says 172.21.15.110:50488) 2021-03-25T14:17:44.431 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.421+0000 7f46c659c700 1 -- 172.21.15.110:0/4243618974 learned_addr learned my addr 172.21.15.110:0/4243618974 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:44.431 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.422+0000 7f46c6d9d700 1 --2- 172.21.15.110:0/4243618974 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f46c80b9730 0x7f46c814bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:44.431 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.422+0000 7f46c5d9b700 1 --2- 172.21.15.110:0/4243618974 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46c80a1f20 0x7f46c8146340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:44.431 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.422+0000 7f46c659c700 1 -- 172.21.15.110:0/4243618974 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f46c80b9730 msgr2=0x7f46c814bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:44.431 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.422+0000 7f46c659c700 1 --2- 172.21.15.110:0/4243618974 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f46c80b9730 0x7f46c814bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:44.432 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.422+0000 7f46c659c700 1 -- 172.21.15.110:0/4243618974 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46c80a1f20 msgr2=0x7f46c8146340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:44.432 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.422+0000 7f46c659c700 1 --2- 172.21.15.110:0/4243618974 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46c80a1f20 0x7f46c8146340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:44.432 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.422+0000 7f46c659c700 1 -- 172.21.15.110:0/4243618974 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c815bf60 con 0x7f46c80667d0 2021-03-25T14:17:44.432 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.422+0000 7f46c659c700 1 --2- 172.21.15.110:0/4243618974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46c80667d0 0x7f46c815c940 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f46b800c920 tx=0x7f46b8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:44.432 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.422+0000 7f46b67fc700 1 -- 172.21.15.110:0/4243618974 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b8010580 con 0x7f46c80667d0 2021-03-25T14:17:44.432 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.422+0000 7f46b67fc700 1 -- 172.21.15.110:0/4243618974 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b80106e0 con 0x7f46c80667d0 2021-03-25T14:17:44.432 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.422+0000 7f46ccf58700 1 -- 172.21.15.110:0/4243618974 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c815c200 con 0x7f46c80667d0 2021-03-25T14:17:44.432 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.422+0000 7f46b67fc700 1 -- 172.21.15.110:0/4243618974 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b8010a80 con 0x7f46c80667d0 2021-03-25T14:17:44.432 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.422+0000 7f46ccf58700 1 -- 172.21.15.110:0/4243618974 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c81454d0 con 0x7f46c80667d0 2021-03-25T14:17:44.432 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.423+0000 7f46ccf58700 1 -- 172.21.15.110:0/4243618974 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c815c660 con 0x7f46c80667d0 2021-03-25T14:17:44.432 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.423+0000 7f46b67fc700 1 -- 172.21.15.110:0/4243618974 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f46b801b460 con 0x7f46c80667d0 2021-03-25T14:17:44.432 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.423+0000 7f46b67fc700 1 --2- 172.21.15.110:0/4243618974 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f46a405a0b0 0x7f46a405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:44.433 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.424+0000 7f46b67fc700 1 -- 172.21.15.110:0/4243618974 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6426+0+0 (secure 0 0 0) 0x7f46b8073e60 con 0x7f46c80667d0 2021-03-25T14:17:44.433 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.424+0000 7f46c5d9b700 1 --2- 172.21.15.110:0/4243618974 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f46a405a0b0 0x7f46a405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:44.433 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.424+0000 7f46c5d9b700 1 --2- 172.21.15.110:0/4243618974 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f46a405a0b0 0x7f46a405c570 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f46c805dc50 tx=0x7f46bc008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:44.433 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.427+0000 7f46b67fc700 1 -- 172.21.15.110:0/4243618974 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f46b8047640 con 0x7f46c80667d0 2021-03-25T14:17:44.617 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.615+0000 7f46ccf58700 1 -- 172.21.15.110:0/4243618974 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46c805d7b0 con 0x7f46c80667d0 2021-03-25T14:17:44.617 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.616+0000 7f46b67fc700 1 -- 172.21.15.110:0/4243618974 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+2849 (secure 0 0 0) 0x7f46b804ac60 con 0x7f46c80667d0 2021-03-25T14:17:44.618 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:44.618 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":27,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4997,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/3015251726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3015251726},{"type":"v1","addr":"172.21.15.174:6835","nonce":3015251726}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":24},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/1698368640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1698368640},{"type":"v1","addr":"172.21.15.174:6833","nonce":1698368640}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":24},{"gid":5601,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.110:6837/2143874763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":2143874763},{"type":"v1","addr":"172.21.15.110:6837","nonce":2143874763}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":25}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-03-25T14:17:42.344725+0000","modified":"2021-03-25T14:17:43.345825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5604":{"gid":5604,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6836/426511293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":426511293},{"type":"v1","addr":"172.21.15.110:6836","nonce":426511293}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-03-25T14:17:44.619 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.617+0000 7f46ccf58700 1 -- 172.21.15.110:0/4243618974 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f46a405a0b0 msgr2=0x7f46a405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:44.619 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.617+0000 7f46ccf58700 1 --2- 172.21.15.110:0/4243618974 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f46a405a0b0 0x7f46a405c570 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f46c805dc50 tx=0x7f46bc008040).stop 2021-03-25T14:17:44.619 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.617+0000 7f46ccf58700 1 -- 172.21.15.110:0/4243618974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46c80667d0 msgr2=0x7f46c815c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:44.620 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.617+0000 7f46ccf58700 1 --2- 172.21.15.110:0/4243618974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46c80667d0 0x7f46c815c940 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f46b800c920 tx=0x7f46b8008040).stop 2021-03-25T14:17:44.620 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.617+0000 7f46ccf58700 1 -- 172.21.15.110:0/4243618974 shutdown_connections 2021-03-25T14:17:44.620 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.617+0000 7f46ccf58700 1 --2- 172.21.15.110:0/4243618974 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f46a405a0b0 0x7f46a405c570 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:44.620 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.617+0000 7f46ccf58700 1 --2- 172.21.15.110:0/4243618974 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f46c80b9730 0x7f46c814bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:44.620 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.617+0000 7f46ccf58700 1 --2- 172.21.15.110:0/4243618974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46c80667d0 0x7f46c815c940 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:44.620 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.617+0000 7f46ccf58700 1 --2- 172.21.15.110:0/4243618974 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46c80a1f20 0x7f46c8146340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:44.620 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.617+0000 7f46ccf58700 1 -- 172.21.15.110:0/4243618974 >> 172.21.15.110:0/4243618974 conn(0x7f46c80bce50 msgr2=0x7f46c80ba5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:44.620 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.617+0000 7f46ccf58700 1 -- 172.21.15.110:0/4243618974 shutdown_connections 2021-03-25T14:17:44.620 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:44.617+0000 7f46ccf58700 1 -- 172.21.15.110:0/4243618974 wait complete. 2021-03-25T14:17:44.621 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 27 2021-03-25T14:17:45.035 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-03-25T14:17:42.344725+0000', 'modified': '2021-03-25T14:17:43.345825+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5604}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5604': {'gid': 5604, 'name': 'a', 'rank': 0, 'incarnation': 26, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.110:6836/426511293', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6834', 'nonce': 426511293}, {'type': 'v1', 'addr': '172.21.15.110:6836', 'nonce': 426511293}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138303579357183, 'flags': 0}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-03-25T14:17:45.035 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-03-25T14:17:45.036 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-03-25T14:17:45.167 INFO:teuthology.orchestra.run.smithi110.stdout:{"cluster_fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","whoami":0,"id":5604,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":2.8109271520000001,"mdsmap_epoch":27,"osdmap_epoch":56,"osdmap_epoch_barrier":55,"uptime":8.2047511770000003} 2021-03-25T14:17:45.167 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5524cbad-8383-4081-a708-5d9e9f7cc15c", "fs_name": "cephfs", "id": 5604, "mdsmap_epoch": 27, "osdmap_epoch": 56, "osdmap_epoch_barrier": 55, "rank_uptime": 2.810927152, "state": "up:active", "uptime": 8.204751177, "want_state": "up:active", "whoami": 0 } 2021-03-25T14:17:45.168 DEBUG:teuthology.orchestra.run.smithi110:> ceph fs ls 2021-03-25T14:17:45.266 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.264+0000 7f855d484700 1 Processor -- start 2021-03-25T14:17:45.267 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.265+0000 7f855d484700 1 -- start start 2021-03-25T14:17:45.269 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.265+0000 7f855d484700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f85580b7700 0x7f8558146df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:45.269 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.265+0000 7f855d484700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f85580b09f0 0x7f85580b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:45.269 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.265+0000 7f855d484700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85581472e0 con 0x7f855809acd0 2021-03-25T14:17:45.269 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.265+0000 7f855d484700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85580b8bb0 con 0x7f85580b09f0 2021-03-25T14:17:45.269 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.265+0000 7f855d484700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85580bba40 con 0x7f85580b7700 2021-03-25T14:17:45.270 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.266+0000 7f8557fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f85580b7700 0x7f8558146df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:45.270 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.266+0000 7f855cc83700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f85580b09f0 0x7f85580b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:45.270 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.266+0000 7f855cc83700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f85580b09f0 0x7f85580b0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.110:49148/0 (socket says 172.21.15.110:49148) 2021-03-25T14:17:45.270 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.266+0000 7f85577fe700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f855809acd0 0x7f85581400a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.110:51098/0 (socket says 172.21.15.110:51098) 2021-03-25T14:17:45.270 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.266+0000 7f8557fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f85580b7700 0x7f8558146df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.110:42896/0 (socket says 172.21.15.110:42896) 2021-03-25T14:17:45.270 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.266+0000 7f855cc83700 1 -- 172.21.15.110:0/2199702234 learned_addr learned my addr 172.21.15.110:0/2199702234 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:45.270 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.266+0000 7f8557fff700 1 -- 172.21.15.110:0/2199702234 >> v2:172.21.15.174:3300/0 conn(0x7f85580b09f0 msgr2=0x7f85580b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:45.270 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.266+0000 7f8557fff700 1 --2- 172.21.15.110:0/2199702234 >> v2:172.21.15.174:3300/0 conn(0x7f85580b09f0 0x7f85580b0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:45.270 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.266+0000 7f8557fff700 1 -- 172.21.15.110:0/2199702234 >> v1:172.21.15.174:6789/0 conn(0x7f855809acd0 legacy=0x7f85581400a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:45.270 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.266+0000 7f8557fff700 1 -- 172.21.15.110:0/2199702234 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85580bbce0 con 0x7f85580b7700 2021-03-25T14:17:45.270 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.266+0000 7f8556ffd700 1 -- 172.21.15.110:0/2199702234 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1956187184 0 0) 0x7f85581472e0 con 0x7f855809acd0 2021-03-25T14:17:45.270 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.266+0000 7f855cc83700 1 --2- 172.21.15.110:0/2199702234 >> v2:172.21.15.174:3300/0 conn(0x7f85580b09f0 0x7f85580b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:17:45.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.266+0000 7f8557fff700 1 --2- 172.21.15.110:0/2199702234 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f85580b7700 0x7f8558146df0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f8548006fd0 tx=0x7f8548006eb0).ready entity=mon.2 client_cookie=9c6f33e61fb66023 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:45.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.266+0000 7f8556ffd700 1 -- 172.21.15.110:0/2199702234 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854800bbd0 con 0x7f85580b7700 2021-03-25T14:17:45.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.266+0000 7f8556ffd700 1 -- 172.21.15.110:0/2199702234 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854800bd30 con 0x7f85580b7700 2021-03-25T14:17:45.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.266+0000 7f8556ffd700 1 -- 172.21.15.110:0/2199702234 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854800bea0 con 0x7f85580b7700 2021-03-25T14:17:45.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.267+0000 7f855d484700 1 -- 172.21.15.110:0/2199702234 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f85580b7700 msgr2=0x7f8558146df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:45.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.267+0000 7f855d484700 1 --2- 172.21.15.110:0/2199702234 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f85580b7700 0x7f8558146df0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f8548006fd0 tx=0x7f8548006eb0).stop 2021-03-25T14:17:45.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.267+0000 7f855d484700 1 -- 172.21.15.110:0/2199702234 shutdown_connections 2021-03-25T14:17:45.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.267+0000 7f855d484700 1 --2- 172.21.15.110:0/2199702234 >> v2:172.21.15.174:3300/0 conn(0x7f85580b09f0 0x7f85580b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:45.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.267+0000 7f855d484700 1 --2- 172.21.15.110:0/2199702234 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f85580b7700 0x7f8558146df0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:45.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.267+0000 7f855d484700 1 -- 172.21.15.110:0/2199702234 >> 172.21.15.110:0/2199702234 conn(0x7f8558062640 msgr2=0x7f8558060de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:45.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.267+0000 7f855d484700 1 -- 172.21.15.110:0/2199702234 shutdown_connections 2021-03-25T14:17:45.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.267+0000 7f855d484700 1 -- 172.21.15.110:0/2199702234 wait complete. 2021-03-25T14:17:45.274 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.268+0000 7f855d484700 1 Processor -- start 2021-03-25T14:17:45.274 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.268+0000 7f855d484700 1 -- start start 2021-03-25T14:17:45.274 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.269+0000 7f855d484700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f855809acd0 0x7f85580b6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:45.275 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.269+0000 7f855d484700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85580b09f0 0x7f855813a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:45.275 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.269+0000 7f855d484700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85580b7700 0x7f855813ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:45.275 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.269+0000 7f855d484700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8558159190 con 0x7f85580b7700 2021-03-25T14:17:45.275 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.269+0000 7f855d484700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8558158710 con 0x7f85580b09f0 2021-03-25T14:17:45.275 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.269+0000 7f855d484700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85581589b0 con 0x7f855809acd0 2021-03-25T14:17:45.275 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.269+0000 7f855cc83700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85580b7700 0x7f855813ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:45.275 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.269+0000 7f855cc83700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85580b7700 0x7f855813ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50504/0 (socket says 172.21.15.110:50504) 2021-03-25T14:17:45.275 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.269+0000 7f855cc83700 1 -- 172.21.15.110:0/2121474209 learned_addr learned my addr 172.21.15.110:0/2121474209 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:45.275 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.269+0000 7f85577fe700 1 --2- 172.21.15.110:0/2121474209 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85580b09f0 0x7f855813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:45.275 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.269+0000 7f8557fff700 1 --2- 172.21.15.110:0/2121474209 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f855809acd0 0x7f85580b6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:45.275 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.269+0000 7f855cc83700 1 -- 172.21.15.110:0/2121474209 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f855809acd0 msgr2=0x7f85580b6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:45.276 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.269+0000 7f855cc83700 1 --2- 172.21.15.110:0/2121474209 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f855809acd0 0x7f85580b6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:45.276 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.269+0000 7f855cc83700 1 -- 172.21.15.110:0/2121474209 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85580b09f0 msgr2=0x7f855813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:45.276 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.269+0000 7f855cc83700 1 --2- 172.21.15.110:0/2121474209 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85580b09f0 0x7f855813a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:45.276 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.269+0000 7f855cc83700 1 -- 172.21.15.110:0/2121474209 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8558158c50 con 0x7f85580b7700 2021-03-25T14:17:45.276 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.269+0000 7f8557fff700 1 --2- 172.21.15.110:0/2121474209 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f855809acd0 0x7f85580b6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:17:45.276 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.269+0000 7f855cc83700 1 --2- 172.21.15.110:0/2121474209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85580b7700 0x7f855813ae70 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f855000ef80 tx=0x7f85500092d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:45.276 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.269+0000 7f853ffff700 1 -- 172.21.15.110:0/2121474209 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855000cdf0 con 0x7f85580b7700 2021-03-25T14:17:45.276 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.270+0000 7f853ffff700 1 -- 172.21.15.110:0/2121474209 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85500123f0 con 0x7f85580b7700 2021-03-25T14:17:45.276 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.270+0000 7f855d484700 1 -- 172.21.15.110:0/2121474209 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8558158ef0 con 0x7f85580b7700 2021-03-25T14:17:45.276 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.270+0000 7f853ffff700 1 -- 172.21.15.110:0/2121474209 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8550012790 con 0x7f85580b7700 2021-03-25T14:17:45.276 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.270+0000 7f855d484700 1 -- 172.21.15.110:0/2121474209 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f855813ee10 con 0x7f85580b7700 2021-03-25T14:17:45.276 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.270+0000 7f855d484700 1 -- 172.21.15.110:0/2121474209 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f855806aaa0 con 0x7f85580b7700 2021-03-25T14:17:45.276 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.271+0000 7f853ffff700 1 -- 172.21.15.110:0/2121474209 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f8550022070 con 0x7f85580b7700 2021-03-25T14:17:45.276 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.271+0000 7f853ffff700 1 --2- 172.21.15.110:0/2121474209 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f853805a0b0 0x7f853805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:45.277 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.271+0000 7f853ffff700 1 -- 172.21.15.110:0/2121474209 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6426+0+0 (secure 0 0 0) 0x7f8550074910 con 0x7f85580b7700 2021-03-25T14:17:45.277 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.271+0000 7f8557fff700 1 --2- 172.21.15.110:0/2121474209 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f853805a0b0 0x7f853805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:45.277 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.271+0000 7f8557fff700 1 --2- 172.21.15.110:0/2121474209 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f853805a0b0 0x7f853805c570 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f8548006fd0 tx=0x7f8548006eb0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:45.277 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.275+0000 7f853ffff700 1 -- 172.21.15.110:0/2121474209 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f8550048150 con 0x7f85580b7700 2021-03-25T14:17:45.462 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.460+0000 7f855d484700 1 -- 172.21.15.110:0/2121474209 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f855809b370 con 0x7f85580b7700 2021-03-25T14:17:45.462 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.460+0000 7f853ffff700 1 -- 172.21.15.110:0/2121474209 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8550016060 con 0x7f85580b7700 2021-03-25T14:17:45.462 INFO:teuthology.orchestra.run.smithi110.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2021-03-25T14:17:45.463 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.461+0000 7f855d484700 1 -- 172.21.15.110:0/2121474209 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f853805a0b0 msgr2=0x7f853805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:45.464 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.461+0000 7f855d484700 1 --2- 172.21.15.110:0/2121474209 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f853805a0b0 0x7f853805c570 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f8548006fd0 tx=0x7f8548006eb0).stop 2021-03-25T14:17:45.464 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.461+0000 7f855d484700 1 -- 172.21.15.110:0/2121474209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85580b7700 msgr2=0x7f855813ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:45.464 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.461+0000 7f855d484700 1 --2- 172.21.15.110:0/2121474209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85580b7700 0x7f855813ae70 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f855000ef80 tx=0x7f85500092d0).stop 2021-03-25T14:17:45.464 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.462+0000 7f855d484700 1 -- 172.21.15.110:0/2121474209 shutdown_connections 2021-03-25T14:17:45.464 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.462+0000 7f855d484700 1 --2- 172.21.15.110:0/2121474209 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f853805a0b0 0x7f853805c570 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:45.464 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.462+0000 7f855d484700 1 --2- 172.21.15.110:0/2121474209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85580b7700 0x7f855813ae70 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:45.464 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.462+0000 7f855d484700 1 --2- 172.21.15.110:0/2121474209 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f855809acd0 0x7f85580b6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:45.464 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.462+0000 7f855d484700 1 --2- 172.21.15.110:0/2121474209 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85580b09f0 0x7f855813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:45.464 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.462+0000 7f855d484700 1 -- 172.21.15.110:0/2121474209 >> 172.21.15.110:0/2121474209 conn(0x7f8558062640 msgr2=0x7f85580ba5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:45.464 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.462+0000 7f855d484700 1 -- 172.21.15.110:0/2121474209 shutdown_connections 2021-03-25T14:17:45.464 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:45.462+0000 7f855d484700 1 -- 172.21.15.110:0/2121474209 wait complete. 2021-03-25T14:17:45.473 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2021-03-25T14:17:45.473 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2021-03-25T14:17:45.473 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi110.front.sepia.ceph.com 2021-03-25T14:17:45.474 INFO:tasks.cephfs.mount:self.client.name = client.0 2021-03-25T14:17:45.474 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2021-03-25T14:17:45.474 INFO:tasks.cephfs.mount:self.cephfs_name = None 2021-03-25T14:17:45.474 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2021-03-25T14:17:45.474 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2021-03-25T14:17:45.474 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2021-03-25T14:17:45.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:45.474 DEBUG:teuthology.orchestra.run.smithi110:> ip addr 2021-03-25T14:17:45.489 INFO:teuthology.orchestra.run.smithi110.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2021-03-25T14:17:45.489 INFO:teuthology.orchestra.run.smithi110.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2021-03-25T14:17:45.489 INFO:teuthology.orchestra.run.smithi110.stdout: inet 127.0.0.1/8 scope host lo 2021-03-25T14:17:45.489 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:45.490 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 ::1/128 scope host 2021-03-25T14:17:45.490 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:45.490 INFO:teuthology.orchestra.run.smithi110.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-03-25T14:17:45.490 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:14 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:17:45.490 INFO:teuthology.orchestra.run.smithi110.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-03-25T14:17:45.490 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:15 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:17:45.490 INFO:teuthology.orchestra.run.smithi110.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-03-25T14:17:45.490 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:34 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:17:45.490 INFO:teuthology.orchestra.run.smithi110.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2021-03-25T14:17:45.490 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:35 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:17:45.490 INFO:teuthology.orchestra.run.smithi110.stdout: inet 172.21.15.110/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2021-03-25T14:17:45.490 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft 42536sec preferred_lft 42536sec 2021-03-25T14:17:45.491 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::ec4:7aff:fe8f:cc35/64 scope link 2021-03-25T14:17:45.491 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:45.491 INFO:teuthology.orchestra.run.smithi110.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2021-03-25T14:17:45.491 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 1a:d9:4b:2f:6c:02 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:17:45.491 INFO:teuthology.orchestra.run.smithi110.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2021-03-25T14:17:45.491 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:45.491 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::1835:66ff:feca:f994/64 scope link 2021-03-25T14:17:45.491 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:45.491 INFO:teuthology.orchestra.run.smithi110.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2021-03-25T14:17:45.491 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 1a:d9:4b:2f:6c:02 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2021-03-25T14:17:45.491 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::18d9:4bff:fe2f:6c02/64 scope link 2021-03-25T14:17:45.491 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:45.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:45.492 DEBUG:teuthology.orchestra.run.smithi110:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2021-03-25T14:17:45.552 INFO:teuthology.orchestra.run.smithi110.stdout:1 2021-03-25T14:17:45.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:45.554 DEBUG:teuthology.orchestra.run.smithi110:> route 2021-03-25T14:17:45.609 INFO:teuthology.orchestra.run.smithi110.stdout:Kernel IP routing table 2021-03-25T14:17:45.609 INFO:teuthology.orchestra.run.smithi110.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2021-03-25T14:17:45.610 INFO:teuthology.orchestra.run.smithi110.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2021-03-25T14:17:45.610 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2021-03-25T14:17:45.610 INFO:teuthology.orchestra.run.smithi110.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2021-03-25T14:17:45.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:45.610 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec sudo bash -c ' 2021-03-25T14:17:45.610 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2021-03-25T14:17:45.610 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2021-03-25T14:17:45.610 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2021-03-25T14:17:45.611 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2021-03-25T14:17:45.611 DEBUG:teuthology.orchestra.run.smithi110:> ') 2021-03-25T14:17:45.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:45.743 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2021-03-25T14:17:45.757 INFO:teuthology.orchestra.run.smithi110.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2021-03-25T14:17:45.758 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2021-03-25T14:17:45.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:45.758 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set brx.0 up 2021-03-25T14:17:45.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:45.822 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p /home/ubuntu/cephtest/mnt.0 2021-03-25T14:17:45.875 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-03-25T14:17:45.876 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2021-03-25T14:17:45.953 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2021-03-25T14:17:45.953 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2021-03-25T14:17:45.997 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2021-03-25T14:17:45.997 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2021-03-25T14:17:46.000 INFO:tasks.cephfs.kernel_mount:mount command passed 2021-03-25T14:17:46.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:46.000 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2021-03-25T14:17:46.064 DEBUG:teuthology.orchestra.run.smithi174:> ceph fs ls 2021-03-25T14:17:46.175 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.173+0000 7ff0fc686700 1 Processor -- start 2021-03-25T14:17:46.175 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.173+0000 7ff0fc686700 1 -- start start 2021-03-25T14:17:46.181 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.174+0000 7ff0fc686700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff0f4068e90 0x7ff0f4149710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:46.182 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.174+0000 7ff0fc686700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff0f40c0300 0x7ff0f40c0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:46.182 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.174+0000 7ff0fc686700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0f40bfed0 con 0x7ff0f40674c0 2021-03-25T14:17:46.182 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.174+0000 7ff0fc686700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0f40b6ee0 con 0x7ff0f40c0300 2021-03-25T14:17:46.182 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.174+0000 7ff0fc686700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0f4149d50 con 0x7ff0f4068e90 2021-03-25T14:17:46.182 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.174+0000 7ff0f9c21700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff0f4068e90 0x7ff0f4149710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:46.182 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.174+0000 7ff0f9c21700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff0f4068e90 0x7ff0f4149710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:47200/0 (socket says 172.21.15.174:47200) 2021-03-25T14:17:46.182 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.174+0000 7ff0f9c21700 1 -- 172.21.15.174:0/2153382966 learned_addr learned my addr 172.21.15.174:0/2153382966 (peer_addr_for_me v2:172.21.15.174:0/0) 2021-03-25T14:17:46.182 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.174+0000 7ff0fa422700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7ff0f40674c0 0x7ff0f4143450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:49444/0 (socket says 172.21.15.174:49444) 2021-03-25T14:17:46.182 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.174+0000 7ff0fac23700 1 --2- 172.21.15.174:0/2153382966 >> v2:172.21.15.110:3300/0 conn(0x7ff0f40c0300 0x7ff0f40c0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:46.182 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.174+0000 7ff0f9c21700 1 -- 172.21.15.174:0/2153382966 >> v2:172.21.15.110:3300/0 conn(0x7ff0f40c0300 msgr2=0x7ff0f40c0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:46.183 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.174+0000 7ff0f9c21700 1 --2- 172.21.15.174:0/2153382966 >> v2:172.21.15.110:3300/0 conn(0x7ff0f40c0300 0x7ff0f40c0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:46.183 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.174+0000 7ff0f9c21700 1 -- 172.21.15.174:0/2153382966 >> v1:172.21.15.174:6789/0 conn(0x7ff0f40674c0 legacy=0x7ff0f4143450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:46.183 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.174+0000 7ff0f9c21700 1 -- 172.21.15.174:0/2153382966 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f4149ff0 con 0x7ff0f4068e90 2021-03-25T14:17:46.183 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.174+0000 7ff0f9420700 1 -- 172.21.15.174:0/2153382966 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2006688388 0 0) 0x7ff0f40bfed0 con 0x7ff0f40674c0 2021-03-25T14:17:46.183 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.175+0000 7ff0f9c21700 1 --2- 172.21.15.174:0/2153382966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0f4068e90 0x7ff0f4149710 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7ff0f405daa0 tx=0x7ff0e8006ee0).ready entity=mon.1 client_cookie=1d8a67c75d1d761f server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:46.183 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.175+0000 7ff0f9420700 1 -- 172.21.15.174:0/2153382966 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8009840 con 0x7ff0f4068e90 2021-03-25T14:17:46.183 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.175+0000 7ff0f9420700 1 -- 172.21.15.174:0/2153382966 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e80099a0 con 0x7ff0f4068e90 2021-03-25T14:17:46.183 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.175+0000 7ff0f9420700 1 -- 172.21.15.174:0/2153382966 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8009d20 con 0x7ff0f4068e90 2021-03-25T14:17:46.183 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.175+0000 7ff0fc686700 1 -- 172.21.15.174:0/2153382966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0f4068e90 msgr2=0x7ff0f4149710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:46.183 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.175+0000 7ff0fc686700 1 --2- 172.21.15.174:0/2153382966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0f4068e90 0x7ff0f4149710 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7ff0f405daa0 tx=0x7ff0e8006ee0).stop 2021-03-25T14:17:46.183 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.175+0000 7ff0fc686700 1 -- 172.21.15.174:0/2153382966 shutdown_connections 2021-03-25T14:17:46.183 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.175+0000 7ff0fc686700 1 --2- 172.21.15.174:0/2153382966 >> v2:172.21.15.110:3300/0 conn(0x7ff0f40c0300 0x7ff0f40c0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:46.183 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.175+0000 7ff0fc686700 1 --2- 172.21.15.174:0/2153382966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0f4068e90 0x7ff0f4149710 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:46.184 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.175+0000 7ff0fc686700 1 -- 172.21.15.174:0/2153382966 >> 172.21.15.174:0/2153382966 conn(0x7ff0f4062480 msgr2=0x7ff0f4062890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:46.184 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.175+0000 7ff0fc686700 1 -- 172.21.15.174:0/2153382966 shutdown_connections 2021-03-25T14:17:46.184 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.175+0000 7ff0fc686700 1 -- 172.21.15.174:0/2153382966 wait complete. 2021-03-25T14:17:46.184 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.176+0000 7ff0fc686700 1 Processor -- start 2021-03-25T14:17:46.184 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.177+0000 7ff0fc686700 1 -- start start 2021-03-25T14:17:46.184 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.177+0000 7ff0fc686700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0f40674c0 0x7ff0f40beaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:46.184 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.177+0000 7ff0fc686700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0f4068e90 0x7ff0f40ba760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:46.184 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.177+0000 7ff0fc686700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0f40c0300 0x7ff0f415c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:46.184 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.177+0000 7ff0fc686700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f40bf2e0 con 0x7ff0f40674c0 2021-03-25T14:17:46.184 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.177+0000 7ff0fc686700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f4158db0 con 0x7ff0f4068e90 2021-03-25T14:17:46.184 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.177+0000 7ff0fc686700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f4159050 con 0x7ff0f40c0300 2021-03-25T14:17:46.184 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.177+0000 7ff0fac23700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0f40c0300 0x7ff0f415c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:46.185 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.177+0000 7ff0fac23700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0f40c0300 0x7ff0f415c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:34862/0 (socket says 172.21.15.174:34862) 2021-03-25T14:17:46.185 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.177+0000 7ff0fac23700 1 -- 172.21.15.174:0/1217430644 learned_addr learned my addr 172.21.15.174:0/1217430644 (peer_addr_for_me v2:172.21.15.174:0/0) 2021-03-25T14:17:46.185 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.177+0000 7ff0f9c21700 1 --2- 172.21.15.174:0/1217430644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0f4068e90 0x7ff0f40ba760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:46.185 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.178+0000 7ff0fa422700 1 --2- 172.21.15.174:0/1217430644 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0f40674c0 0x7ff0f40beaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:46.185 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.178+0000 7ff0fac23700 1 -- 172.21.15.174:0/1217430644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0f4068e90 msgr2=0x7ff0f40ba760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:46.185 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.178+0000 7ff0fac23700 1 --2- 172.21.15.174:0/1217430644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0f4068e90 0x7ff0f40ba760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:46.185 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.178+0000 7ff0fac23700 1 -- 172.21.15.174:0/1217430644 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0f40674c0 msgr2=0x7ff0f40beaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:46.185 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.178+0000 7ff0fac23700 1 --2- 172.21.15.174:0/1217430644 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0f40674c0 0x7ff0f40beaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:46.185 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.178+0000 7ff0fac23700 1 -- 172.21.15.174:0/1217430644 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f41592f0 con 0x7ff0f40c0300 2021-03-25T14:17:46.185 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.178+0000 7ff0fa422700 1 --2- 172.21.15.174:0/1217430644 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0f40674c0 0x7ff0f40beaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:46.185 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.178+0000 7ff0fac23700 1 --2- 172.21.15.174:0/1217430644 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0f40c0300 0x7ff0f415c210 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7ff0ec00ed20 tx=0x7ff0ec009220).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:46.185 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.178+0000 7ff0e67fc700 1 -- 172.21.15.174:0/1217430644 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec00ee80 con 0x7ff0f40c0300 2021-03-25T14:17:46.185 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.178+0000 7ff0e67fc700 1 -- 172.21.15.174:0/1217430644 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ec00cb80 con 0x7ff0f40c0300 2021-03-25T14:17:46.186 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.178+0000 7ff0fc686700 1 -- 172.21.15.174:0/1217430644 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0f4159590 con 0x7ff0f40c0300 2021-03-25T14:17:46.186 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.178+0000 7ff0e67fc700 1 -- 172.21.15.174:0/1217430644 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec0123f0 con 0x7ff0f40c0300 2021-03-25T14:17:46.186 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.178+0000 7ff0fc686700 1 -- 172.21.15.174:0/1217430644 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0f40befe0 con 0x7ff0f40c0300 2021-03-25T14:17:46.186 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.179+0000 7ff0fc686700 1 -- 172.21.15.174:0/1217430644 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0f406aaa0 con 0x7ff0f40c0300 2021-03-25T14:17:46.186 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.179+0000 7ff0e67fc700 1 -- 172.21.15.174:0/1217430644 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7ff0ec022070 con 0x7ff0f40c0300 2021-03-25T14:17:46.186 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.180+0000 7ff0e67fc700 1 --2- 172.21.15.174:0/1217430644 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff0d405a0b0 0x7ff0d405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:46.186 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.180+0000 7ff0e67fc700 1 -- 172.21.15.174:0/1217430644 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6426+0+0 (secure 0 0 0) 0x7ff0ec074570 con 0x7ff0f40c0300 2021-03-25T14:17:46.187 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.180+0000 7ff0fa422700 1 --2- 172.21.15.174:0/1217430644 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff0d405a0b0 0x7ff0d405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:46.187 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.180+0000 7ff0fa422700 1 --2- 172.21.15.174:0/1217430644 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff0d405a0b0 0x7ff0d405c570 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7ff0f00011e0 tx=0x7ff0f0007120).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:46.187 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.184+0000 7ff0e67fc700 1 -- 172.21.15.174:0/1217430644 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7ff0ec047db0 con 0x7ff0f40c0300 2021-03-25T14:17:46.371 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.369+0000 7ff0fc686700 1 -- 172.21.15.174:0/1217430644 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff0f4159720 con 0x7ff0f40c0300 2021-03-25T14:17:46.371 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.370+0000 7ff0e67fc700 1 -- 172.21.15.174:0/1217430644 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff0ec016070 con 0x7ff0f40c0300 2021-03-25T14:17:46.372 INFO:teuthology.orchestra.run.smithi174.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2021-03-25T14:17:46.373 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.371+0000 7ff0fc686700 1 -- 172.21.15.174:0/1217430644 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff0d405a0b0 msgr2=0x7ff0d405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:46.373 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.371+0000 7ff0fc686700 1 --2- 172.21.15.174:0/1217430644 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff0d405a0b0 0x7ff0d405c570 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7ff0f00011e0 tx=0x7ff0f0007120).stop 2021-03-25T14:17:46.373 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.371+0000 7ff0fc686700 1 -- 172.21.15.174:0/1217430644 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0f40c0300 msgr2=0x7ff0f415c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:46.373 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.371+0000 7ff0fc686700 1 --2- 172.21.15.174:0/1217430644 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0f40c0300 0x7ff0f415c210 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7ff0ec00ed20 tx=0x7ff0ec009220).stop 2021-03-25T14:17:46.374 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.371+0000 7ff0fc686700 1 -- 172.21.15.174:0/1217430644 shutdown_connections 2021-03-25T14:17:46.374 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.371+0000 7ff0fc686700 1 --2- 172.21.15.174:0/1217430644 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff0d405a0b0 0x7ff0d405c570 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:46.374 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.371+0000 7ff0fc686700 1 --2- 172.21.15.174:0/1217430644 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0f40c0300 0x7ff0f415c210 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:46.374 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.371+0000 7ff0fc686700 1 --2- 172.21.15.174:0/1217430644 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0f40674c0 0x7ff0f40beaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:46.374 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.371+0000 7ff0fc686700 1 --2- 172.21.15.174:0/1217430644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0f4068e90 0x7ff0f40ba760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:46.374 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.371+0000 7ff0fc686700 1 -- 172.21.15.174:0/1217430644 >> 172.21.15.174:0/1217430644 conn(0x7ff0f4062480 msgr2=0x7ff0f4143300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:46.374 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.371+0000 7ff0fc686700 1 -- 172.21.15.174:0/1217430644 shutdown_connections 2021-03-25T14:17:46.374 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:46.371+0000 7ff0fc686700 1 -- 172.21.15.174:0/1217430644 wait complete. 2021-03-25T14:17:46.383 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2021-03-25T14:17:46.383 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2021-03-25T14:17:46.383 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi174.front.sepia.ceph.com 2021-03-25T14:17:46.383 INFO:tasks.cephfs.mount:self.client.name = client.1 2021-03-25T14:17:46.383 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2021-03-25T14:17:46.383 INFO:tasks.cephfs.mount:self.cephfs_name = None 2021-03-25T14:17:46.383 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2021-03-25T14:17:46.383 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2021-03-25T14:17:46.383 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2021-03-25T14:17:46.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:46.384 DEBUG:teuthology.orchestra.run.smithi174:> ip addr 2021-03-25T14:17:46.399 INFO:teuthology.orchestra.run.smithi174.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2021-03-25T14:17:46.399 INFO:teuthology.orchestra.run.smithi174.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2021-03-25T14:17:46.399 INFO:teuthology.orchestra.run.smithi174.stdout: inet 127.0.0.1/8 scope host lo 2021-03-25T14:17:46.399 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:46.399 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 ::1/128 scope host 2021-03-25T14:17:46.399 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:46.399 INFO:teuthology.orchestra.run.smithi174.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-03-25T14:17:46.399 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:d9:36:e0 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:17:46.399 INFO:teuthology.orchestra.run.smithi174.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-03-25T14:17:46.399 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:d9:36:e1 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:17:46.399 INFO:teuthology.orchestra.run.smithi174.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-03-25T14:17:46.400 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:88:77:1a brd ff:ff:ff:ff:ff:ff 2021-03-25T14:17:46.400 INFO:teuthology.orchestra.run.smithi174.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2021-03-25T14:17:46.400 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:88:77:1b brd ff:ff:ff:ff:ff:ff 2021-03-25T14:17:46.400 INFO:teuthology.orchestra.run.smithi174.stdout: inet 172.21.15.174/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2021-03-25T14:17:46.400 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft 42536sec preferred_lft 42536sec 2021-03-25T14:17:46.400 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::ec4:7aff:fe88:771b/64 scope link 2021-03-25T14:17:46.400 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:46.400 INFO:teuthology.orchestra.run.smithi174.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2021-03-25T14:17:46.400 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 32:28:39:9e:9c:fe brd ff:ff:ff:ff:ff:ff 2021-03-25T14:17:46.400 INFO:teuthology.orchestra.run.smithi174.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2021-03-25T14:17:46.400 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:46.400 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::2843:d3ff:fe04:eed1/64 scope link 2021-03-25T14:17:46.401 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:46.401 INFO:teuthology.orchestra.run.smithi174.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2021-03-25T14:17:46.401 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 32:28:39:9e:9c:fe brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2021-03-25T14:17:46.401 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::3028:39ff:fe9e:9cfe/64 scope link 2021-03-25T14:17:46.401 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:46.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:46.401 DEBUG:teuthology.orchestra.run.smithi174:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2021-03-25T14:17:46.462 INFO:teuthology.orchestra.run.smithi174.stdout:1 2021-03-25T14:17:46.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:46.464 DEBUG:teuthology.orchestra.run.smithi174:> route 2021-03-25T14:17:46.520 INFO:teuthology.orchestra.run.smithi174.stdout:Kernel IP routing table 2021-03-25T14:17:46.520 INFO:teuthology.orchestra.run.smithi174.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2021-03-25T14:17:46.520 INFO:teuthology.orchestra.run.smithi174.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2021-03-25T14:17:46.520 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2021-03-25T14:17:46.520 INFO:teuthology.orchestra.run.smithi174.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2021-03-25T14:17:46.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:46.521 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec sudo bash -c ' 2021-03-25T14:17:46.521 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2021-03-25T14:17:46.521 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2021-03-25T14:17:46.521 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2021-03-25T14:17:46.521 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2021-03-25T14:17:46.521 DEBUG:teuthology.orchestra.run.smithi174:> ') 2021-03-25T14:17:46.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:46.616 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list 2021-03-25T14:17:46.631 INFO:teuthology.orchestra.run.smithi174.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2021-03-25T14:17:46.631 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2021-03-25T14:17:46.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:46.632 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set brx.0 up 2021-03-25T14:17:46.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:46.705 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p /home/ubuntu/cephtest/mnt.1 2021-03-25T14:17:46.761 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-03-25T14:17:46.762 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,norbytes 2021-03-25T14:17:46.842 INFO:teuthology.orchestra.run.smithi174.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,norbytes 2021-03-25T14:17:46.842 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,name=1,norbytes" will pass to kernel. 2021-03-25T14:17:46.865 INFO:teuthology.orchestra.run.smithi174.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,norbytes 2021-03-25T14:17:46.865 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,name=1,norbytes" will pass to kernel. 2021-03-25T14:17:46.868 INFO:tasks.cephfs.kernel_mount:mount command passed 2021-03-25T14:17:46.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:46.868 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2021-03-25T14:17:46.932 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2021-03-25T14:17:47.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.052+0000 7f6494d13700 1 Processor -- start 2021-03-25T14:17:47.054 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.052+0000 7f6494d13700 1 -- start start 2021-03-25T14:17:47.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.053+0000 7f6494d13700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6490064280 0x7f6490064660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:47.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.053+0000 7f6494d13700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64900b8740 0x7f6490147060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:47.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.053+0000 7f6494d13700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64900b0b30 con 0x7f64900b7800 2021-03-25T14:17:47.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.053+0000 7f6494d13700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6490147550 con 0x7f6490064280 2021-03-25T14:17:47.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.053+0000 7f6494d13700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64900b0dd0 con 0x7f64900b8740 2021-03-25T14:17:47.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.053+0000 7f648e59c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6490064280 0x7f6490064660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:47.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.053+0000 7f648ed9d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64900b8740 0x7f6490147060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:47.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.053+0000 7f648dd9b700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f64900b7800 0x7f64900b8030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.110:51118/0 (socket says 172.21.15.110:51118) 2021-03-25T14:17:47.057 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.053+0000 7f648dd9b700 1 -- 172.21.15.110:0/908220715 learned_addr learned my addr 172.21.15.110:0/908220715 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:47.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.054+0000 7f648d59a700 1 -- 172.21.15.110:0/908220715 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1922696161 0 0) 0x7f64900b0b30 con 0x7f64900b7800 2021-03-25T14:17:47.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.054+0000 7f648d59a700 1 -- 172.21.15.110:0/908220715 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6474003270 con 0x7f64900b7800 2021-03-25T14:17:47.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.054+0000 7f648e59c700 1 -- 172.21.15.110:0/908220715 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64900b8740 msgr2=0x7f6490147060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:47.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.054+0000 7f648e59c700 1 --2- 172.21.15.110:0/908220715 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64900b8740 0x7f6490147060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:47.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.054+0000 7f648e59c700 1 -- 172.21.15.110:0/908220715 >> v1:172.21.15.174:6789/0 conn(0x7f64900b7800 legacy=0x7f64900b8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:47.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.054+0000 7f648e59c700 1 -- 172.21.15.110:0/908220715 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64900b1070 con 0x7f6490064280 2021-03-25T14:17:47.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.054+0000 7f648ed9d700 1 --2- 172.21.15.110:0/908220715 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64900b8740 0x7f6490147060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:17:47.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.054+0000 7f648e59c700 1 --2- 172.21.15.110:0/908220715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6490064280 0x7f6490064660 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f648000b9c0 tx=0x7f6480006e20).ready entity=mon.1 client_cookie=cf06e69460000946 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:47.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.054+0000 7f648d59a700 1 -- 172.21.15.110:0/908220715 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6480009690 con 0x7f6490064280 2021-03-25T14:17:47.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.054+0000 7f648d59a700 1 -- 172.21.15.110:0/908220715 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64800097f0 con 0x7f6490064280 2021-03-25T14:17:47.058 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.054+0000 7f648d59a700 1 -- 172.21.15.110:0/908220715 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6480009b70 con 0x7f6490064280 2021-03-25T14:17:47.059 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.054+0000 7f6494d13700 1 -- 172.21.15.110:0/908220715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6490064280 msgr2=0x7f6490064660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:47.059 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.054+0000 7f6494d13700 1 --2- 172.21.15.110:0/908220715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6490064280 0x7f6490064660 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f648000b9c0 tx=0x7f6480006e20).stop 2021-03-25T14:17:47.059 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.055+0000 7f6494d13700 1 -- 172.21.15.110:0/908220715 shutdown_connections 2021-03-25T14:17:47.059 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.055+0000 7f6494d13700 1 --2- 172.21.15.110:0/908220715 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64900b8740 0x7f6490147060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:47.059 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.055+0000 7f6494d13700 1 --2- 172.21.15.110:0/908220715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6490064280 0x7f6490064660 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:47.059 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.055+0000 7f6494d13700 1 -- 172.21.15.110:0/908220715 >> 172.21.15.110:0/908220715 conn(0x7f64900663f0 msgr2=0x7f6490066800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:47.059 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.055+0000 7f6494d13700 1 -- 172.21.15.110:0/908220715 shutdown_connections 2021-03-25T14:17:47.059 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.055+0000 7f6494d13700 1 -- 172.21.15.110:0/908220715 wait complete. 2021-03-25T14:17:47.062 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.056+0000 7f6494d13700 1 Processor -- start 2021-03-25T14:17:47.062 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.056+0000 7f6494d13700 1 -- start start 2021-03-25T14:17:47.062 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.056+0000 7f6494d13700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6490064280 0x7f6490139110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:47.062 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.056+0000 7f6494d13700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64900b7800 0x7f649014a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:47.063 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.056+0000 7f6494d13700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64900b8740 0x7f6490135830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:47.063 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.056+0000 7f6494d13700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64901491d0 con 0x7f64900b7800 2021-03-25T14:17:47.063 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.056+0000 7f6494d13700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6490149470 con 0x7f6490064280 2021-03-25T14:17:47.063 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.056+0000 7f6494d13700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6490149710 con 0x7f64900b8740 2021-03-25T14:17:47.063 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.056+0000 7f648e59c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6490064280 0x7f6490139110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:47.063 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.056+0000 7f648dd9b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64900b7800 0x7f649014a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:47.063 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.057+0000 7f648e59c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6490064280 0x7f6490139110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.110:49168/0 (socket says 172.21.15.110:49168) 2021-03-25T14:17:47.063 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.057+0000 7f648e59c700 1 -- 172.21.15.110:0/2536888036 learned_addr learned my addr 172.21.15.110:0/2536888036 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:47.063 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.057+0000 7f648ed9d700 1 --2- 172.21.15.110:0/2536888036 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64900b8740 0x7f6490135830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:47.063 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.057+0000 7f648e59c700 1 -- 172.21.15.110:0/2536888036 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64900b8740 msgr2=0x7f6490135830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:47.063 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.057+0000 7f648e59c700 1 --2- 172.21.15.110:0/2536888036 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64900b8740 0x7f6490135830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:47.063 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.057+0000 7f648e59c700 1 -- 172.21.15.110:0/2536888036 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64900b7800 msgr2=0x7f649014a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:47.063 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.057+0000 7f648e59c700 1 --2- 172.21.15.110:0/2536888036 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64900b7800 0x7f649014a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:47.064 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.057+0000 7f648e59c700 1 -- 172.21.15.110:0/2536888036 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64901499b0 con 0x7f6490064280 2021-03-25T14:17:47.064 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.057+0000 7f648ed9d700 1 --2- 172.21.15.110:0/2536888036 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64900b8740 0x7f6490135830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:17:47.064 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.057+0000 7f648e59c700 1 --2- 172.21.15.110:0/2536888036 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6490064280 0x7f6490139110 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f6480007fd0 tx=0x7f6480016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:47.064 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.057+0000 7f647e7fc700 1 -- 172.21.15.110:0/2536888036 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6480020070 con 0x7f6490064280 2021-03-25T14:17:47.064 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.057+0000 7f647e7fc700 1 -- 172.21.15.110:0/2536888036 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6480011d30 con 0x7f6490064280 2021-03-25T14:17:47.064 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.057+0000 7f6494d13700 1 -- 172.21.15.110:0/2536888036 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6490149c50 con 0x7f6490064280 2021-03-25T14:17:47.064 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.057+0000 7f647e7fc700 1 -- 172.21.15.110:0/2536888036 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6480011ea0 con 0x7f6490064280 2021-03-25T14:17:47.064 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.057+0000 7f6494d13700 1 -- 172.21.15.110:0/2536888036 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6490068e90 con 0x7f6490064280 2021-03-25T14:17:47.064 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.058+0000 7f6494d13700 1 -- 172.21.15.110:0/2536888036 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f649005d7b0 con 0x7f6490064280 2021-03-25T14:17:47.064 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.058+0000 7f647e7fc700 1 -- 172.21.15.110:0/2536888036 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f648000f070 con 0x7f6490064280 2021-03-25T14:17:47.064 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.059+0000 7f647e7fc700 1 --2- 172.21.15.110:0/2536888036 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f646c05a0b0 0x7f646c05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:47.064 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.059+0000 7f647e7fc700 1 -- 172.21.15.110:0/2536888036 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6426+0+0 (secure 0 0 0) 0x7f6480074da0 con 0x7f6490064280 2021-03-25T14:17:47.064 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.059+0000 7f648dd9b700 1 --2- 172.21.15.110:0/2536888036 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f646c05a0b0 0x7f646c05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:47.065 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.059+0000 7f648dd9b700 1 --2- 172.21.15.110:0/2536888036 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f646c05a0b0 0x7f646c05c570 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f6490137f80 tx=0x7f6484009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:47.065 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.063+0000 7f647e7fc700 1 -- 172.21.15.110:0/2536888036 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f64800485e0 con 0x7f6490064280 2021-03-25T14:17:47.270 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.268+0000 7f6494d13700 1 -- 172.21.15.110:0/2536888036 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7f6490061c50 con 0x7f6490064280 2021-03-25T14:17:47.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.269+0000 7f647e7fc700 1 -- 172.21.15.110:0/2536888036 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 entity client.testuser does not exist v13) v1 ==== 121+0+0 (secure 0 0 0) 0x7f648004bc00 con 0x7f6490064280 2021-03-25T14:17:47.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.271+0000 7f6494d13700 1 -- 172.21.15.110:0/2536888036 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f646c05a0b0 msgr2=0x7f646c05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:47.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.271+0000 7f6494d13700 1 --2- 172.21.15.110:0/2536888036 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f646c05a0b0 0x7f646c05c570 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f6490137f80 tx=0x7f6484009040).stop 2021-03-25T14:17:47.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.271+0000 7f6494d13700 1 -- 172.21.15.110:0/2536888036 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6490064280 msgr2=0x7f6490139110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:47.274 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.271+0000 7f6494d13700 1 --2- 172.21.15.110:0/2536888036 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6490064280 0x7f6490139110 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f6480007fd0 tx=0x7f6480016000).stop 2021-03-25T14:17:47.274 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.271+0000 7f6494d13700 1 -- 172.21.15.110:0/2536888036 shutdown_connections 2021-03-25T14:17:47.274 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.271+0000 7f6494d13700 1 --2- 172.21.15.110:0/2536888036 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f646c05a0b0 0x7f646c05c570 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:47.274 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.271+0000 7f6494d13700 1 --2- 172.21.15.110:0/2536888036 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6490064280 0x7f6490139110 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:47.274 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.271+0000 7f6494d13700 1 --2- 172.21.15.110:0/2536888036 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64900b8740 0x7f6490135830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:47.274 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.271+0000 7f6494d13700 1 --2- 172.21.15.110:0/2536888036 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64900b7800 0x7f649014a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:47.274 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.271+0000 7f6494d13700 1 -- 172.21.15.110:0/2536888036 >> 172.21.15.110:0/2536888036 conn(0x7f64900663f0 msgr2=0x7f649013d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:47.274 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.271+0000 7f6494d13700 1 -- 172.21.15.110:0/2536888036 shutdown_connections 2021-03-25T14:17:47.274 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.271+0000 7f6494d13700 1 -- 172.21.15.110:0/2536888036 wait complete. 2021-03-25T14:17:47.274 INFO:teuthology.orchestra.run.smithi110.stderr:entity client.testuser does not exist 2021-03-25T14:17:47.284 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true 2021-03-25T14:17:47.398 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.396+0000 7fc122460700 1 Processor -- start 2021-03-25T14:17:47.398 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.396+0000 7fc122460700 1 -- start start 2021-03-25T14:17:47.406 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.396+0000 7fc122460700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc11c0b6780 0x7fc11c146120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:47.406 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.396+0000 7fc122460700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc11c14a790 con 0x7fc11c147130 2021-03-25T14:17:47.406 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.396+0000 7fc122460700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc11c146750 con 0x7fc11c0bbfd0 2021-03-25T14:17:47.406 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.396+0000 7fc122460700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c1469f0 con 0x7fc11c0b6780 2021-03-25T14:17:47.406 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.397+0000 7fc11b7fe700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fc11c147130 0x7fc11c145a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43462/0 (socket says 172.21.15.110:43462) 2021-03-25T14:17:47.407 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.397+0000 7fc11b7fe700 1 -- 172.21.15.110:0/2178266239 learned_addr learned my addr 172.21.15.110:0/2178266239 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:47.407 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.397+0000 7fc1209fd700 1 --2- 172.21.15.110:0/2178266239 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc11c0b6780 0x7fc11c146120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:47.407 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.397+0000 7fc11affd700 1 -- 172.21.15.110:0/2178266239 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 932329838 0 0) 0x7fc11c14a790 con 0x7fc11c147130 2021-03-25T14:17:47.407 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.397+0000 7fc11affd700 1 -- 172.21.15.110:0/2178266239 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc108003270 con 0x7fc11c147130 2021-03-25T14:17:47.407 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.397+0000 7fc11affd700 1 -- 172.21.15.110:0/2178266239 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2171845874 0 0) 0x7fc108003270 con 0x7fc11c147130 2021-03-25T14:17:47.407 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.397+0000 7fc11affd700 1 -- 172.21.15.110:0/2178266239 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc11c0b6780 msgr2=0x7fc11c146120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:47.407 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.397+0000 7fc11affd700 1 --2- 172.21.15.110:0/2178266239 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc11c0b6780 0x7fc11c146120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:47.407 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.397+0000 7fc11affd700 1 -- 172.21.15.110:0/2178266239 >> v1:172.21.15.174:6789/0 conn(0x7fc11c0bbfd0 legacy=0x7fc11c0b0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:47.407 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.397+0000 7fc11affd700 1 -- 172.21.15.110:0/2178266239 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11c146c90 con 0x7fc11c147130 2021-03-25T14:17:47.407 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.397+0000 7fc11affd700 1 -- 172.21.15.110:0/2178266239 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7fc110001520 con 0x7fc11c147130 2021-03-25T14:17:47.407 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.397+0000 7fc11affd700 1 -- 172.21.15.110:0/2178266239 >> v1:172.21.15.110:6789/0 conn(0x7fc11c147130 legacy=0x7fc11c145a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:47.407 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.397+0000 7fc11affd700 1 --2- 172.21.15.110:0/2178266239 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc11c0b6780 0x7fc108003790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:47.408 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.397+0000 7fc11affd700 1 --2- 172.21.15.110:0/2178266239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc108003ca0 0x7fc108004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:47.408 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.397+0000 7fc11affd700 1 --2- 172.21.15.110:0/2178266239 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc108004a00 0x7fc108004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:47.408 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.397+0000 7fc11affd700 1 -- 172.21.15.110:0/2178266239 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c1469f0 con 0x7fc108004a00 2021-03-25T14:17:47.408 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.397+0000 7fc11affd700 1 -- 172.21.15.110:0/2178266239 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc108004230 con 0x7fc108003ca0 2021-03-25T14:17:47.408 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.397+0000 7fc11affd700 1 -- 172.21.15.110:0/2178266239 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc10800b760 con 0x7fc11c0b6780 2021-03-25T14:17:47.408 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.397+0000 7fc1209fd700 1 --2- 172.21.15.110:0/2178266239 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc108004a00 0x7fc108004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:47.408 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.397+0000 7fc11b7fe700 1 --2- 172.21.15.110:0/2178266239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc108003ca0 0x7fc108004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:47.408 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.397+0000 7fc11bfff700 1 --2- 172.21.15.110:0/2178266239 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc11c0b6780 0x7fc108003790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:47.408 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.398+0000 7fc1209fd700 1 -- 172.21.15.110:0/2178266239 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc11c0b6780 msgr2=0x7fc108003790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:47.408 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.398+0000 7fc1209fd700 1 --2- 172.21.15.110:0/2178266239 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc11c0b6780 0x7fc108003790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:47.408 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.398+0000 7fc1209fd700 1 -- 172.21.15.110:0/2178266239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc108003ca0 msgr2=0x7fc108004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:47.408 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.398+0000 7fc1209fd700 1 --2- 172.21.15.110:0/2178266239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc108003ca0 0x7fc108004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:47.408 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.398+0000 7fc1209fd700 1 -- 172.21.15.110:0/2178266239 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc108003270 con 0x7fc108004a00 2021-03-25T14:17:47.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.398+0000 7fc1209fd700 1 --2- 172.21.15.110:0/2178266239 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc108004a00 0x7fc108004e80 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7fc114009ed0 tx=0x7fc114009220).ready entity=mon.0 client_cookie=831dbebf1f37323f server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:47.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.398+0000 7fc11affd700 1 -- 172.21.15.110:0/2178266239 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1140095f0 con 0x7fc108004a00 2021-03-25T14:17:47.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.398+0000 7fc11affd700 1 -- 172.21.15.110:0/2178266239 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc11400ec20 con 0x7fc108004a00 2021-03-25T14:17:47.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.398+0000 7fc11affd700 1 -- 172.21.15.110:0/2178266239 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1140123f0 con 0x7fc108004a00 2021-03-25T14:17:47.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.398+0000 7fc122460700 1 -- 172.21.15.110:0/2178266239 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc108004a00 msgr2=0x7fc108004e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:47.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.398+0000 7fc122460700 1 --2- 172.21.15.110:0/2178266239 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc108004a00 0x7fc108004e80 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7fc114009ed0 tx=0x7fc114009220).stop 2021-03-25T14:17:47.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.398+0000 7fc1209fd700 1 -- 172.21.15.110:0/2178266239 reap_dead start 2021-03-25T14:17:47.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.398+0000 7fc122460700 1 -- 172.21.15.110:0/2178266239 shutdown_connections 2021-03-25T14:17:47.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.398+0000 7fc122460700 1 -- 172.21.15.110:0/2178266239 >> 172.21.15.110:0/2178266239 conn(0x7fc11c0664e0 msgr2=0x7fc11c0668f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:47.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.398+0000 7fc122460700 1 -- 172.21.15.110:0/2178266239 shutdown_connections 2021-03-25T14:17:47.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.398+0000 7fc122460700 1 -- 172.21.15.110:0/2178266239 wait complete. 2021-03-25T14:17:47.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.399+0000 7fc122460700 1 Processor -- start 2021-03-25T14:17:47.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.400+0000 7fc122460700 1 -- start start 2021-03-25T14:17:47.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.400+0000 7fc122460700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc11c09da20 0x7fc11c0b4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:47.410 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.400+0000 7fc122460700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc11c0b3b70 0x7fc11c156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:47.410 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.400+0000 7fc122460700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc11c1573e0 0x7fc11c15a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:47.410 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.400+0000 7fc122460700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c09eb30 con 0x7fc11c09da20 2021-03-25T14:17:47.410 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.400+0000 7fc122460700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c156960 con 0x7fc11c1573e0 2021-03-25T14:17:47.410 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.400+0000 7fc122460700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c09f540 con 0x7fc11c0b3b70 2021-03-25T14:17:47.410 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.400+0000 7fc11bfff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc11c09da20 0x7fc11c0b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:47.410 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.400+0000 7fc11bfff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc11c09da20 0x7fc11c0b4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50540/0 (socket says 172.21.15.110:50540) 2021-03-25T14:17:47.410 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.400+0000 7fc11bfff700 1 -- 172.21.15.110:0/1655399120 learned_addr learned my addr 172.21.15.110:0/1655399120 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:47.410 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.400+0000 7fc11b7fe700 1 --2- 172.21.15.110:0/1655399120 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc11c0b3b70 0x7fc11c156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:47.410 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.400+0000 7fc1209fd700 1 --2- 172.21.15.110:0/1655399120 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc11c1573e0 0x7fc11c15a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:47.410 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.401+0000 7fc11bfff700 1 -- 172.21.15.110:0/1655399120 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc11c0b3b70 msgr2=0x7fc11c156ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:47.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.401+0000 7fc11bfff700 1 --2- 172.21.15.110:0/1655399120 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc11c0b3b70 0x7fc11c156ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:47.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.401+0000 7fc11bfff700 1 -- 172.21.15.110:0/1655399120 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc11c1573e0 msgr2=0x7fc11c15a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:47.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.401+0000 7fc11bfff700 1 --2- 172.21.15.110:0/1655399120 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc11c1573e0 0x7fc11c15a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:47.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.401+0000 7fc11bfff700 1 -- 172.21.15.110:0/1655399120 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11c09ed60 con 0x7fc11c09da20 2021-03-25T14:17:47.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.401+0000 7fc11bfff700 1 --2- 172.21.15.110:0/1655399120 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc11c09da20 0x7fc11c0b4520 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fc10c0028e0 tx=0x7fc10c007bc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:47.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.401+0000 7fc103fff700 1 -- 172.21.15.110:0/1655399120 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c00f5f0 con 0x7fc11c09da20 2021-03-25T14:17:47.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.401+0000 7fc103fff700 1 -- 172.21.15.110:0/1655399120 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10c00f750 con 0x7fc11c09da20 2021-03-25T14:17:47.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.401+0000 7fc122460700 1 -- 172.21.15.110:0/1655399120 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc11c09f000 con 0x7fc11c09da20 2021-03-25T14:17:47.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.401+0000 7fc103fff700 1 -- 172.21.15.110:0/1655399120 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c00fad0 con 0x7fc11c09da20 2021-03-25T14:17:47.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.401+0000 7fc122460700 1 -- 172.21.15.110:0/1655399120 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc11c157860 con 0x7fc11c09da20 2021-03-25T14:17:47.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.402+0000 7fc122460700 1 -- 172.21.15.110:0/1655399120 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc11c05d070 con 0x7fc11c09da20 2021-03-25T14:17:47.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.402+0000 7fc103fff700 1 -- 172.21.15.110:0/1655399120 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fc10c01b030 con 0x7fc11c09da20 2021-03-25T14:17:47.412 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.402+0000 7fc103fff700 1 --2- 172.21.15.110:0/1655399120 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc0fc05a0b0 0x7fc0fc05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:47.412 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.402+0000 7fc103fff700 1 -- 172.21.15.110:0/1655399120 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6426+0+0 (secure 0 0 0) 0x7fc10c073990 con 0x7fc11c09da20 2021-03-25T14:17:47.412 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.402+0000 7fc11b7fe700 1 --2- 172.21.15.110:0/1655399120 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc0fc05a0b0 0x7fc0fc05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:47.412 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.403+0000 7fc11b7fe700 1 --2- 172.21.15.110:0/1655399120 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc0fc05a0b0 0x7fc0fc05c570 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fc110007880 tx=0x7fc11c14a920).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:47.412 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.406+0000 7fc103fff700 1 -- 172.21.15.110:0/1655399120 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fc10c047280 con 0x7fc11c09da20 2021-03-25T14:17:47.421 INFO:tasks.ceph.mds.a.smithi110.stderr:2021-03-25T14:17:47.419+0000 7f39586a2700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2021-03-25T14:17:47.592 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:47.590+0000 7fc122460700 1 -- 172.21.15.110:0/1655399120 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true"} v 0) v1 -- 0x7fc11c05d7b0 con 0x7fc11c09da20 2021-03-25T14:17:48.149 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.148+0000 7fc103fff700 1 -- 172.21.15.110:0/1655399120 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true"}]=0 v28) v1 ==== 106+0+0 (secure 0 0 0) 0x7fc10c04a8a0 con 0x7fc11c09da20 2021-03-25T14:17:48.152 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.150+0000 7fc122460700 1 -- 172.21.15.110:0/1655399120 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc0fc05a0b0 msgr2=0x7fc0fc05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:48.152 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.150+0000 7fc122460700 1 --2- 172.21.15.110:0/1655399120 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc0fc05a0b0 0x7fc0fc05c570 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fc110007880 tx=0x7fc11c14a920).stop 2021-03-25T14:17:48.152 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.150+0000 7fc122460700 1 -- 172.21.15.110:0/1655399120 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc11c09da20 msgr2=0x7fc11c0b4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:48.152 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.150+0000 7fc122460700 1 --2- 172.21.15.110:0/1655399120 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc11c09da20 0x7fc11c0b4520 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fc10c0028e0 tx=0x7fc10c007bc0).stop 2021-03-25T14:17:48.152 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.150+0000 7fc122460700 1 -- 172.21.15.110:0/1655399120 shutdown_connections 2021-03-25T14:17:48.152 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.150+0000 7fc122460700 1 --2- 172.21.15.110:0/1655399120 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc0fc05a0b0 0x7fc0fc05c570 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:48.152 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.150+0000 7fc122460700 1 --2- 172.21.15.110:0/1655399120 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc11c1573e0 0x7fc11c15a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:48.153 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.150+0000 7fc122460700 1 --2- 172.21.15.110:0/1655399120 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc11c09da20 0x7fc11c0b4520 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:48.153 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.150+0000 7fc122460700 1 --2- 172.21.15.110:0/1655399120 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc11c0b3b70 0x7fc11c156ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:48.153 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.150+0000 7fc122460700 1 -- 172.21.15.110:0/1655399120 >> 172.21.15.110:0/1655399120 conn(0x7fc11c0664e0 msgr2=0x7fc11c149840 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:48.153 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.150+0000 7fc122460700 1 -- 172.21.15.110:0/1655399120 shutdown_connections 2021-03-25T14:17:48.153 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.150+0000 7fc122460700 1 -- 172.21.15.110:0/1655399120 wait complete. 2021-03-25T14:17:48.165 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:17:48.278 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.276+0000 7f19c6370700 1 Processor -- start 2021-03-25T14:17:48.279 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.276+0000 7f19c6370700 1 -- start start 2021-03-25T14:17:48.285 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.277+0000 7f19c6370700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19c00bbca0 0x7f19c0067840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:48.285 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.277+0000 7f19c6370700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f19c0144960 0x7f19c0144df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:48.285 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.277+0000 7f19c6370700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c00afee0 con 0x7f19c0068ac0 2021-03-25T14:17:48.285 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.277+0000 7f19c6370700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19c0145d40 con 0x7f19c0144960 2021-03-25T14:17:48.285 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.277+0000 7f19c6370700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c0145fe0 con 0x7f19c00bbca0 2021-03-25T14:17:48.285 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.277+0000 7f19c490d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f19c0144960 0x7f19c0144df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:48.286 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.277+0000 7f19bf7fe700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f19c0068ac0 0x7f19c00acf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43482/0 (socket says 172.21.15.110:43482) 2021-03-25T14:17:48.286 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.277+0000 7f19c490d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f19c0144960 0x7f19c0144df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50550/0 (socket says 172.21.15.110:50550) 2021-03-25T14:17:48.286 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.277+0000 7f19bf7fe700 1 -- 172.21.15.110:0/3171467230 learned_addr learned my addr 172.21.15.110:0/3171467230 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:48.286 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.277+0000 7f19bffff700 1 --2- 172.21.15.110:0/3171467230 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19c00bbca0 0x7f19c0067840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:48.287 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.277+0000 7f19c490d700 1 -- 172.21.15.110:0/3171467230 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19c00bbca0 msgr2=0x7f19c0067840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:48.287 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.277+0000 7f19c490d700 1 --2- 172.21.15.110:0/3171467230 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19c00bbca0 0x7f19c0067840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:48.287 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.277+0000 7f19c490d700 1 -- 172.21.15.110:0/3171467230 >> v1:172.21.15.110:6789/0 conn(0x7f19c0068ac0 legacy=0x7f19c00acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:48.287 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.277+0000 7f19c490d700 1 -- 172.21.15.110:0/3171467230 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c0145b10 con 0x7f19c0144960 2021-03-25T14:17:48.287 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.277+0000 7f19beffd700 1 -- 172.21.15.110:0/3171467230 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2352680382 0 0) 0x7f19c00afee0 con 0x7f19c0068ac0 2021-03-25T14:17:48.288 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.277+0000 7f19bffff700 1 --2- 172.21.15.110:0/3171467230 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19c00bbca0 0x7f19c0067840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:17:48.288 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.278+0000 7f19c490d700 1 --2- 172.21.15.110:0/3171467230 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19c0144960 0x7f19c0144df0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f19b8009cc0 tx=0x7f19b8009220).ready entity=mon.0 client_cookie=38718b58eb218fec server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:48.288 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.278+0000 7f19beffd700 1 -- 172.21.15.110:0/3171467230 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b800bc80 con 0x7f19c0144960 2021-03-25T14:17:48.288 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.278+0000 7f19beffd700 1 -- 172.21.15.110:0/3171467230 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b800bde0 con 0x7f19c0144960 2021-03-25T14:17:48.288 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.278+0000 7f19beffd700 1 -- 172.21.15.110:0/3171467230 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b8011630 con 0x7f19c0144960 2021-03-25T14:17:48.289 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.278+0000 7f19c6370700 1 -- 172.21.15.110:0/3171467230 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19c0144960 msgr2=0x7f19c0144df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:48.289 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.278+0000 7f19c6370700 1 --2- 172.21.15.110:0/3171467230 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19c0144960 0x7f19c0144df0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f19b8009cc0 tx=0x7f19b8009220).stop 2021-03-25T14:17:48.289 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.278+0000 7f19c6370700 1 -- 172.21.15.110:0/3171467230 shutdown_connections 2021-03-25T14:17:48.289 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.278+0000 7f19c6370700 1 --2- 172.21.15.110:0/3171467230 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19c0144960 0x7f19c0144df0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:48.289 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.278+0000 7f19c6370700 1 --2- 172.21.15.110:0/3171467230 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19c00bbca0 0x7f19c0067840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:48.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.278+0000 7f19c6370700 1 -- 172.21.15.110:0/3171467230 >> 172.21.15.110:0/3171467230 conn(0x7f19c0063850 msgr2=0x7f19c005c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:48.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.278+0000 7f19c6370700 1 -- 172.21.15.110:0/3171467230 shutdown_connections 2021-03-25T14:17:48.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.278+0000 7f19c6370700 1 -- 172.21.15.110:0/3171467230 wait complete. 2021-03-25T14:17:48.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.279+0000 7f19c6370700 1 Processor -- start 2021-03-25T14:17:48.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.279+0000 7f19c6370700 1 -- start start 2021-03-25T14:17:48.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.280+0000 7f19c6370700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f19c0068ac0 0x7f19c013b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:48.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.280+0000 7f19c6370700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19c00bbca0 0x7f19c00b9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:48.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.280+0000 7f19c6370700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19c0144960 0x7f19c01591c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:48.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.280+0000 7f19c6370700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c013bb80 con 0x7f19c0144960 2021-03-25T14:17:48.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.280+0000 7f19c6370700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c0158d60 con 0x7f19c0068ac0 2021-03-25T14:17:48.291 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.280+0000 7f19c6370700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c0150ee0 con 0x7f19c00bbca0 2021-03-25T14:17:48.291 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.280+0000 7f19c490d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19c0144960 0x7f19c01591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:48.291 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.280+0000 7f19c490d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19c0144960 0x7f19c01591c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50554/0 (socket says 172.21.15.110:50554) 2021-03-25T14:17:48.291 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.280+0000 7f19c490d700 1 -- 172.21.15.110:0/1811361666 learned_addr learned my addr 172.21.15.110:0/1811361666 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:48.291 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.280+0000 7f19c490d700 1 -- 172.21.15.110:0/1811361666 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19c00bbca0 msgr2=0x7f19c00b9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:48.291 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.280+0000 7f19c490d700 1 --2- 172.21.15.110:0/1811361666 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19c00bbca0 0x7f19c00b9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:48.291 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.280+0000 7f19c490d700 1 -- 172.21.15.110:0/1811361666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f19c0068ac0 msgr2=0x7f19c013b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:48.291 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.280+0000 7f19c490d700 1 --2- 172.21.15.110:0/1811361666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f19c0068ac0 0x7f19c013b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:48.291 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.280+0000 7f19c490d700 1 -- 172.21.15.110:0/1811361666 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c013bdb0 con 0x7f19c0144960 2021-03-25T14:17:48.291 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.280+0000 7f19c490d700 1 --2- 172.21.15.110:0/1811361666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19c0144960 0x7f19c01591c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f19c0065e30 tx=0x7f19b8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:48.291 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.281+0000 7f19a7fff700 1 -- 172.21.15.110:0/1811361666 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b8009e00 con 0x7f19c0144960 2021-03-25T14:17:48.292 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.281+0000 7f19a7fff700 1 -- 172.21.15.110:0/1811361666 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b801f070 con 0x7f19c0144960 2021-03-25T14:17:48.292 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.281+0000 7f19a7fff700 1 -- 172.21.15.110:0/1811361666 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b801ac20 con 0x7f19c0144960 2021-03-25T14:17:48.292 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.281+0000 7f19c6370700 1 -- 172.21.15.110:0/1811361666 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c013c050 con 0x7f19c0144960 2021-03-25T14:17:48.292 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.281+0000 7f19c6370700 1 -- 172.21.15.110:0/1811361666 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c0150b60 con 0x7f19c0144960 2021-03-25T14:17:48.292 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.281+0000 7f19c6370700 1 -- 172.21.15.110:0/1811361666 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19c00688d0 con 0x7f19c0144960 2021-03-25T14:17:48.292 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.282+0000 7f19a7fff700 1 -- 172.21.15.110:0/1811361666 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f19b802c070 con 0x7f19c0144960 2021-03-25T14:17:48.292 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.282+0000 7f19a7fff700 1 --2- 172.21.15.110:0/1811361666 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f19a005a0b0 0x7f19a005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:48.292 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.282+0000 7f19a7fff700 1 -- 172.21.15.110:0/1811361666 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6426+0+0 (secure 0 0 0) 0x7f19b8075930 con 0x7f19c0144960 2021-03-25T14:17:48.292 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.282+0000 7f19bffff700 1 --2- 172.21.15.110:0/1811361666 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f19a005a0b0 0x7f19a005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:48.292 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.283+0000 7f19bffff700 1 --2- 172.21.15.110:0/1811361666 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f19a005a0b0 0x7f19a005c570 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f19b4006fd0 tx=0x7f19b4008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:48.293 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.286+0000 7f19a7fff700 1 -- 172.21.15.110:0/1811361666 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f19b8049170 con 0x7f19c0144960 2021-03-25T14:17:48.437 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.435+0000 7f19c6370700 1 -- 172.21.15.110:0/1811361666 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19c0158ed0 con 0x7f19c0144960 2021-03-25T14:17:48.437 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.436+0000 7f19a7fff700 1 -- 172.21.15.110:0/1811361666 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+17112 (secure 0 0 0) 0x7f19b804c790 con 0x7f19c0144960 2021-03-25T14:17:48.438 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:48.438 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":56,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:17:43.346063+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2021-03-25T14:17:40.271092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2021-03-25T14:17:41.271977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:17:48.439 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.437+0000 7f19c6370700 1 -- 172.21.15.110:0/1811361666 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f19a005a0b0 msgr2=0x7f19a005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:48.440 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.437+0000 7f19c6370700 1 --2- 172.21.15.110:0/1811361666 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f19a005a0b0 0x7f19a005c570 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f19b4006fd0 tx=0x7f19b4008040).stop 2021-03-25T14:17:48.440 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.437+0000 7f19c6370700 1 -- 172.21.15.110:0/1811361666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19c0144960 msgr2=0x7f19c01591c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:48.440 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.437+0000 7f19c6370700 1 --2- 172.21.15.110:0/1811361666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19c0144960 0x7f19c01591c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f19c0065e30 tx=0x7f19b8017000).stop 2021-03-25T14:17:48.440 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.437+0000 7f19c6370700 1 -- 172.21.15.110:0/1811361666 shutdown_connections 2021-03-25T14:17:48.440 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.437+0000 7f19c6370700 1 --2- 172.21.15.110:0/1811361666 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f19a005a0b0 0x7f19a005c570 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:48.440 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.437+0000 7f19c6370700 1 --2- 172.21.15.110:0/1811361666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f19c0068ac0 0x7f19c013b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:48.440 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.437+0000 7f19c6370700 1 --2- 172.21.15.110:0/1811361666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19c0144960 0x7f19c01591c0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:48.440 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.437+0000 7f19c6370700 1 --2- 172.21.15.110:0/1811361666 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19c00bbca0 0x7f19c00b9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:48.440 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.437+0000 7f19c6370700 1 -- 172.21.15.110:0/1811361666 >> 172.21.15.110:0/1811361666 conn(0x7f19c0063850 msgr2=0x7f19c005c890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:48.440 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.437+0000 7f19c6370700 1 -- 172.21.15.110:0/1811361666 shutdown_connections 2021-03-25T14:17:48.440 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.437+0000 7f19c6370700 1 -- 172.21.15.110:0/1811361666 wait complete. 2021-03-25T14:17:48.451 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-03-25T14:15:59.047299+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-03-25T14:16:00.537926+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2021-03-25T14:17:40.271092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2021-03-25T14:17:41.271977+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-03-25T14:17:48.452 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-03-25T14:17:48.565 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.563+0000 7fd199e6e700 1 Processor -- start 2021-03-25T14:17:48.565 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.563+0000 7fd199e6e700 1 -- start start 2021-03-25T14:17:48.568 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.563+0000 7fd199e6e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd1940be3a0 0x7fd1940b4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:48.568 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.563+0000 7fd199e6e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1940b47a0 0x7fd194148c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:48.569 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.563+0000 7fd199e6e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1940b4c20 con 0x7fd194149120 2021-03-25T14:17:48.569 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.563+0000 7fd199e6e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd194149960 con 0x7fd1940be3a0 2021-03-25T14:17:48.569 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.563+0000 7fd199e6e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd194149c00 con 0x7fd1940b47a0 2021-03-25T14:17:48.569 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.564+0000 7fd192ffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1940b47a0 0x7fd194148c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:48.569 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.564+0000 7fd1937fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd1940be3a0 0x7fd1940b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:48.569 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.564+0000 7fd192ffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1940b47a0 0x7fd194148c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.110:42964/0 (socket says 172.21.15.110:42964) 2021-03-25T14:17:48.570 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.564+0000 7fd193fff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fd194149120 0x7fd1940b8cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.110:51162/0 (socket says 172.21.15.110:51162) 2021-03-25T14:17:48.570 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.564+0000 7fd192ffd700 1 -- 172.21.15.110:0/2893802706 learned_addr learned my addr 172.21.15.110:0/2893802706 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:48.570 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.564+0000 7fd192ffd700 1 -- 172.21.15.110:0/2893802706 >> v2:172.21.15.174:3300/0 conn(0x7fd1940be3a0 msgr2=0x7fd1940b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:48.570 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.564+0000 7fd192ffd700 1 --2- 172.21.15.110:0/2893802706 >> v2:172.21.15.174:3300/0 conn(0x7fd1940be3a0 0x7fd1940b4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:48.570 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.564+0000 7fd192ffd700 1 -- 172.21.15.110:0/2893802706 >> v1:172.21.15.174:6789/0 conn(0x7fd194149120 legacy=0x7fd1940b8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:48.570 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.564+0000 7fd192ffd700 1 -- 172.21.15.110:0/2893802706 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd194149ea0 con 0x7fd1940b47a0 2021-03-25T14:17:48.570 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.564+0000 7fd192ffd700 1 --2- 172.21.15.110:0/2893802706 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1940b47a0 0x7fd194148c30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fd180009d90 tx=0x7fd1800092d0).ready entity=mon.2 client_cookie=e0f5d7d9d4886a42 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:48.570 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.565+0000 7fd1927fc700 1 -- 172.21.15.110:0/2893802706 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18000bbf0 con 0x7fd1940b47a0 2021-03-25T14:17:48.571 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.565+0000 7fd1927fc700 1 -- 172.21.15.110:0/2893802706 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18000bd50 con 0x7fd1940b47a0 2021-03-25T14:17:48.571 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.565+0000 7fd1927fc700 1 -- 172.21.15.110:0/2893802706 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd180011610 con 0x7fd1940b47a0 2021-03-25T14:17:48.571 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.565+0000 7fd199e6e700 1 -- 172.21.15.110:0/2893802706 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1940b47a0 msgr2=0x7fd194148c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:48.571 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.565+0000 7fd199e6e700 1 --2- 172.21.15.110:0/2893802706 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1940b47a0 0x7fd194148c30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fd180009d90 tx=0x7fd1800092d0).stop 2021-03-25T14:17:48.571 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.565+0000 7fd199e6e700 1 -- 172.21.15.110:0/2893802706 shutdown_connections 2021-03-25T14:17:48.571 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.565+0000 7fd199e6e700 1 --2- 172.21.15.110:0/2893802706 >> v2:172.21.15.174:3300/0 conn(0x7fd1940be3a0 0x7fd1940b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:48.571 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.565+0000 7fd199e6e700 1 --2- 172.21.15.110:0/2893802706 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1940b47a0 0x7fd194148c30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:48.571 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.565+0000 7fd199e6e700 1 -- 172.21.15.110:0/2893802706 >> 172.21.15.110:0/2893802706 conn(0x7fd1940686f0 msgr2=0x7fd194068b00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:48.571 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.565+0000 7fd199e6e700 1 -- 172.21.15.110:0/2893802706 shutdown_connections 2021-03-25T14:17:48.571 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.565+0000 7fd199e6e700 1 -- 172.21.15.110:0/2893802706 wait complete. 2021-03-25T14:17:48.571 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.566+0000 7fd199e6e700 1 Processor -- start 2021-03-25T14:17:48.571 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.566+0000 7fd199e6e700 1 -- start start 2021-03-25T14:17:48.575 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.567+0000 7fd199e6e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1940b47a0 0x7fd1940bbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:48.575 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.567+0000 7fd199e6e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1940be3a0 0x7fd1940a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:48.575 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.567+0000 7fd199e6e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd194149120 0x7fd1940a23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:48.575 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.567+0000 7fd199e6e700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19414af30 con 0x7fd1940be3a0 2021-03-25T14:17:48.575 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.567+0000 7fd199e6e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1940a31d0 con 0x7fd194149120 2021-03-25T14:17:48.575 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.567+0000 7fd199e6e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd194158a80 con 0x7fd1940b47a0 2021-03-25T14:17:48.576 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.567+0000 7fd192ffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1940be3a0 0x7fd1940a1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:48.576 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.567+0000 7fd192ffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1940be3a0 0x7fd1940a1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50568/0 (socket says 172.21.15.110:50568) 2021-03-25T14:17:48.576 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.567+0000 7fd192ffd700 1 -- 172.21.15.110:0/3178137911 learned_addr learned my addr 172.21.15.110:0/3178137911 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:48.576 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.567+0000 7fd193fff700 1 --2- 172.21.15.110:0/3178137911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd194149120 0x7fd1940a23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:48.576 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.567+0000 7fd1937fe700 1 --2- 172.21.15.110:0/3178137911 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1940b47a0 0x7fd1940bbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:48.577 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.567+0000 7fd192ffd700 1 -- 172.21.15.110:0/3178137911 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1940b47a0 msgr2=0x7fd1940bbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:48.577 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.567+0000 7fd192ffd700 1 --2- 172.21.15.110:0/3178137911 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1940b47a0 0x7fd1940bbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:48.577 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.567+0000 7fd192ffd700 1 -- 172.21.15.110:0/3178137911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd194149120 msgr2=0x7fd1940a23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:48.577 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.567+0000 7fd192ffd700 1 --2- 172.21.15.110:0/3178137911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd194149120 0x7fd1940a23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:48.577 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.567+0000 7fd192ffd700 1 -- 172.21.15.110:0/3178137911 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1940b54d0 con 0x7fd1940be3a0 2021-03-25T14:17:48.578 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.568+0000 7fd192ffd700 1 --2- 172.21.15.110:0/3178137911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1940be3a0 0x7fd1940a1ec0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7fd194149d40 tx=0x7fd180017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:48.578 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.568+0000 7fd18b7fe700 1 -- 172.21.15.110:0/3178137911 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd180011e70 con 0x7fd1940be3a0 2021-03-25T14:17:48.578 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.568+0000 7fd18b7fe700 1 -- 172.21.15.110:0/3178137911 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd180009e20 con 0x7fd1940be3a0 2021-03-25T14:17:48.578 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.568+0000 7fd199e6e700 1 -- 172.21.15.110:0/3178137911 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd194158cb0 con 0x7fd1940be3a0 2021-03-25T14:17:48.578 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.568+0000 7fd18b7fe700 1 -- 172.21.15.110:0/3178137911 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18001b830 con 0x7fd1940be3a0 2021-03-25T14:17:48.579 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.568+0000 7fd199e6e700 1 -- 172.21.15.110:0/3178137911 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1940b5770 con 0x7fd1940be3a0 2021-03-25T14:17:48.579 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.569+0000 7fd199e6e700 1 -- 172.21.15.110:0/3178137911 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd194159020 con 0x7fd1940be3a0 2021-03-25T14:17:48.579 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.569+0000 7fd18b7fe700 1 -- 172.21.15.110:0/3178137911 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fd18000f070 con 0x7fd1940be3a0 2021-03-25T14:17:48.579 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.569+0000 7fd18b7fe700 1 --2- 172.21.15.110:0/3178137911 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd17005a0e0 0x7fd17005c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:48.579 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.569+0000 7fd18b7fe700 1 -- 172.21.15.110:0/3178137911 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6426+0+0 (secure 0 0 0) 0x7fd180075b50 con 0x7fd1940be3a0 2021-03-25T14:17:48.580 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.569+0000 7fd1937fe700 1 --2- 172.21.15.110:0/3178137911 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd17005a0e0 0x7fd17005c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:48.580 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.570+0000 7fd1937fe700 1 --2- 172.21.15.110:0/3178137911 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd17005a0e0 0x7fd17005c5a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fd18c00bb90 tx=0x7fd18c006e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:48.580 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.573+0000 7fd18b7fe700 1 -- 172.21.15.110:0/3178137911 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fd180049390 con 0x7fd1940be3a0 2021-03-25T14:17:48.728 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.726+0000 7fd199e6e700 1 -- 172.21.15.110:0/3178137911 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd19405d7b0 con 0x7fd1940be3a0 2021-03-25T14:17:48.728 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.726+0000 7fd18b7fe700 1 -- 172.21.15.110:0/3178137911 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v56) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd18004c9b0 con 0x7fd1940be3a0 2021-03-25T14:17:48.728 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 1 2021-03-25T14:17:48.730 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.728+0000 7fd199e6e700 1 -- 172.21.15.110:0/3178137911 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd17005a0e0 msgr2=0x7fd17005c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:48.730 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.728+0000 7fd199e6e700 1 --2- 172.21.15.110:0/3178137911 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd17005a0e0 0x7fd17005c5a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fd18c00bb90 tx=0x7fd18c006e20).stop 2021-03-25T14:17:48.730 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.728+0000 7fd199e6e700 1 -- 172.21.15.110:0/3178137911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1940be3a0 msgr2=0x7fd1940a1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:48.731 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.728+0000 7fd199e6e700 1 --2- 172.21.15.110:0/3178137911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1940be3a0 0x7fd1940a1ec0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7fd194149d40 tx=0x7fd180017000).stop 2021-03-25T14:17:48.731 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.728+0000 7fd199e6e700 1 -- 172.21.15.110:0/3178137911 shutdown_connections 2021-03-25T14:17:48.731 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.728+0000 7fd199e6e700 1 --2- 172.21.15.110:0/3178137911 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd17005a0e0 0x7fd17005c5a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:48.731 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.728+0000 7fd199e6e700 1 --2- 172.21.15.110:0/3178137911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd194149120 0x7fd1940a23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:48.731 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.728+0000 7fd199e6e700 1 --2- 172.21.15.110:0/3178137911 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1940b47a0 0x7fd1940bbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:48.731 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.728+0000 7fd199e6e700 1 --2- 172.21.15.110:0/3178137911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1940be3a0 0x7fd1940a1ec0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:48.731 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.728+0000 7fd199e6e700 1 -- 172.21.15.110:0/3178137911 >> 172.21.15.110:0/3178137911 conn(0x7fd1940686f0 msgr2=0x7fd194147180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:48.731 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.728+0000 7fd199e6e700 1 -- 172.21.15.110:0/3178137911 shutdown_connections 2021-03-25T14:17:48.731 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.728+0000 7fd199e6e700 1 -- 172.21.15.110:0/3178137911 wait complete. 2021-03-25T14:17:48.742 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-03-25T14:17:48.855 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.853+0000 7fda9560f700 1 Processor -- start 2021-03-25T14:17:48.855 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.853+0000 7fda9560f700 1 -- start start 2021-03-25T14:17:48.861 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.853+0000 7fda9560f700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fda9014cc90 0x7fda9014d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:48.861 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.853+0000 7fda9560f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fda900685d0 0x7fda90068a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:48.861 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.853+0000 7fda9560f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda900691b0 con 0x7fda9014d470 2021-03-25T14:17:48.862 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.853+0000 7fda9560f700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda900bc2b0 con 0x7fda9014cc90 2021-03-25T14:17:48.862 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.853+0000 7fda9560f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda90149dd0 con 0x7fda900685d0 2021-03-25T14:17:48.862 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.853+0000 7fda87fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fda9014cc90 0x7fda9014d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:48.862 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.854+0000 7fda87fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fda9014cc90 0x7fda9014d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50574/0 (socket says 172.21.15.110:50574) 2021-03-25T14:17:48.862 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.854+0000 7fda87fff700 1 -- 172.21.15.110:0/2136356220 learned_addr learned my addr 172.21.15.110:0/2136356220 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:48.862 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.854+0000 7fda8f7fe700 1 --2- 172.21.15.110:0/2136356220 >> v2:172.21.15.174:3300/0 conn(0x7fda900685d0 0x7fda90068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:48.862 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.854+0000 7fda87fff700 1 -- 172.21.15.110:0/2136356220 >> v2:172.21.15.174:3300/0 conn(0x7fda900685d0 msgr2=0x7fda90068a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:48.862 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.854+0000 7fda87fff700 1 --2- 172.21.15.110:0/2136356220 >> v2:172.21.15.174:3300/0 conn(0x7fda900685d0 0x7fda90068a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:48.863 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.854+0000 7fda87fff700 1 -- 172.21.15.110:0/2136356220 >> v1:172.21.15.174:6789/0 conn(0x7fda9014d470 legacy=0x7fda901493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:48.863 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.854+0000 7fda87fff700 1 -- 172.21.15.110:0/2136356220 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9014a070 con 0x7fda9014cc90 2021-03-25T14:17:48.863 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.854+0000 7fda87fff700 1 --2- 172.21.15.110:0/2136356220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda9014cc90 0x7fda9014d850 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7fda900bc110 tx=0x7fda78006ee0).ready entity=mon.0 client_cookie=e624c8abd9558247 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:48.863 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.854+0000 7fda8e7fc700 1 -- 172.21.15.110:0/2136356220 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda780098d0 con 0x7fda9014cc90 2021-03-25T14:17:48.863 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.854+0000 7fda8e7fc700 1 -- 172.21.15.110:0/2136356220 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda78009a30 con 0x7fda9014cc90 2021-03-25T14:17:48.863 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.854+0000 7fda8e7fc700 1 -- 172.21.15.110:0/2136356220 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda78009db0 con 0x7fda9014cc90 2021-03-25T14:17:48.863 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.855+0000 7fda9560f700 1 -- 172.21.15.110:0/2136356220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda9014cc90 msgr2=0x7fda9014d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:48.863 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.855+0000 7fda9560f700 1 --2- 172.21.15.110:0/2136356220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda9014cc90 0x7fda9014d850 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7fda900bc110 tx=0x7fda78006ee0).stop 2021-03-25T14:17:48.863 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.855+0000 7fda9560f700 1 -- 172.21.15.110:0/2136356220 shutdown_connections 2021-03-25T14:17:48.863 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.855+0000 7fda9560f700 1 --2- 172.21.15.110:0/2136356220 >> v2:172.21.15.174:3300/0 conn(0x7fda900685d0 0x7fda90068a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:48.863 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.855+0000 7fda9560f700 1 --2- 172.21.15.110:0/2136356220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda9014cc90 0x7fda9014d850 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:48.864 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.855+0000 7fda9560f700 1 -- 172.21.15.110:0/2136356220 >> 172.21.15.110:0/2136356220 conn(0x7fda90060c40 msgr2=0x7fda90061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:48.864 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.855+0000 7fda9560f700 1 -- 172.21.15.110:0/2136356220 shutdown_connections 2021-03-25T14:17:48.864 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.855+0000 7fda9560f700 1 -- 172.21.15.110:0/2136356220 wait complete. 2021-03-25T14:17:48.864 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.856+0000 7fda9560f700 1 Processor -- start 2021-03-25T14:17:48.864 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.856+0000 7fda9560f700 1 -- start start 2021-03-25T14:17:48.864 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.856+0000 7fda9560f700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda900685d0 0x7fda900a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:48.864 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.856+0000 7fda9560f700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda9014cc90 0x7fda90145de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:48.864 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.856+0000 7fda9560f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda9014d470 0x7fda900a2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:48.864 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.856+0000 7fda9560f700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9014bbd0 con 0x7fda9014cc90 2021-03-25T14:17:48.864 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.856+0000 7fda9560f700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9014be70 con 0x7fda900685d0 2021-03-25T14:17:48.864 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.856+0000 7fda9560f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9014c110 con 0x7fda9014d470 2021-03-25T14:17:48.865 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.857+0000 7fda87fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda9014cc90 0x7fda90145de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:48.865 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.857+0000 7fda87fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda9014cc90 0x7fda90145de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50580/0 (socket says 172.21.15.110:50580) 2021-03-25T14:17:48.865 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.857+0000 7fda87fff700 1 -- 172.21.15.110:0/2916258707 learned_addr learned my addr 172.21.15.110:0/2916258707 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:48.865 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.857+0000 7fda8effd700 1 --2- 172.21.15.110:0/2916258707 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda900685d0 0x7fda900a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:48.865 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.857+0000 7fda8f7fe700 1 --2- 172.21.15.110:0/2916258707 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda9014d470 0x7fda900a2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:48.865 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.857+0000 7fda87fff700 1 -- 172.21.15.110:0/2916258707 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda9014d470 msgr2=0x7fda900a2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:48.865 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.857+0000 7fda87fff700 1 --2- 172.21.15.110:0/2916258707 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda9014d470 0x7fda900a2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:48.865 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.857+0000 7fda87fff700 1 -- 172.21.15.110:0/2916258707 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda900685d0 msgr2=0x7fda900a3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:48.865 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.857+0000 7fda87fff700 1 --2- 172.21.15.110:0/2916258707 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda900685d0 0x7fda900a3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:48.865 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.857+0000 7fda87fff700 1 -- 172.21.15.110:0/2916258707 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9014ad30 con 0x7fda9014cc90 2021-03-25T14:17:48.865 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.857+0000 7fda8f7fe700 1 --2- 172.21.15.110:0/2916258707 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda9014d470 0x7fda900a2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:48.865 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.857+0000 7fda87fff700 1 --2- 172.21.15.110:0/2916258707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda9014cc90 0x7fda90145de0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7fda9005d650 tx=0x7fda78016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:48.866 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.857+0000 7fda86ffd700 1 -- 172.21.15.110:0/2916258707 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda78012e10 con 0x7fda9014cc90 2021-03-25T14:17:48.866 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.857+0000 7fda86ffd700 1 -- 172.21.15.110:0/2916258707 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7801c420 con 0x7fda9014cc90 2021-03-25T14:17:48.866 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.857+0000 7fda86ffd700 1 -- 172.21.15.110:0/2916258707 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7801c7c0 con 0x7fda9014cc90 2021-03-25T14:17:48.866 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.857+0000 7fda9560f700 1 -- 172.21.15.110:0/2916258707 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda900a5b90 con 0x7fda9014cc90 2021-03-25T14:17:48.866 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.857+0000 7fda9560f700 1 -- 172.21.15.110:0/2916258707 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda9014b1d0 con 0x7fda9014cc90 2021-03-25T14:17:48.867 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.858+0000 7fda9560f700 1 -- 172.21.15.110:0/2916258707 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda9014b3f0 con 0x7fda9014cc90 2021-03-25T14:17:48.867 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.858+0000 7fda86ffd700 1 -- 172.21.15.110:0/2916258707 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fda7800f070 con 0x7fda9014cc90 2021-03-25T14:17:48.867 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.859+0000 7fda86ffd700 1 --2- 172.21.15.110:0/2916258707 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fda7405a0b0 0x7fda7405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:48.867 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.859+0000 7fda86ffd700 1 -- 172.21.15.110:0/2916258707 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6426+0+0 (secure 0 0 0) 0x7fda78075530 con 0x7fda9014cc90 2021-03-25T14:17:48.867 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.859+0000 7fda8effd700 1 --2- 172.21.15.110:0/2916258707 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fda7405a0b0 0x7fda7405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:48.867 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.859+0000 7fda8effd700 1 --2- 172.21.15.110:0/2916258707 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fda7405a0b0 0x7fda7405c570 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7fda800036e0 tx=0x7fda80007bc0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:48.868 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:48.862+0000 7fda86ffd700 1 -- 172.21.15.110:0/2916258707 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fda78048d70 con 0x7fda9014cc90 2021-03-25T14:17:49.016 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.014+0000 7fda9560f700 1 -- 172.21.15.110:0/2916258707 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fda9014a250 con 0x7fda9014cc90 2021-03-25T14:17:49.016 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.014+0000 7fda86ffd700 1 -- 172.21.15.110:0/2916258707 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v56) v1 ==== 92+0+10 (secure 0 0 0) 0x7fda7804c390 con 0x7fda9014cc90 2021-03-25T14:17:49.016 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:17:49.018 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.015+0000 7fda9560f700 1 -- 172.21.15.110:0/2916258707 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fda7405a0b0 msgr2=0x7fda7405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:49.018 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.015+0000 7fda9560f700 1 --2- 172.21.15.110:0/2916258707 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fda7405a0b0 0x7fda7405c570 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7fda800036e0 tx=0x7fda80007bc0).stop 2021-03-25T14:17:49.018 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.015+0000 7fda9560f700 1 -- 172.21.15.110:0/2916258707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda9014cc90 msgr2=0x7fda90145de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:49.018 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.015+0000 7fda9560f700 1 --2- 172.21.15.110:0/2916258707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda9014cc90 0x7fda90145de0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7fda9005d650 tx=0x7fda78016000).stop 2021-03-25T14:17:49.018 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.015+0000 7fda9560f700 1 -- 172.21.15.110:0/2916258707 shutdown_connections 2021-03-25T14:17:49.018 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.015+0000 7fda9560f700 1 --2- 172.21.15.110:0/2916258707 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fda7405a0b0 0x7fda7405c570 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:49.019 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.015+0000 7fda9560f700 1 --2- 172.21.15.110:0/2916258707 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda900685d0 0x7fda900a3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:49.019 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.015+0000 7fda9560f700 1 --2- 172.21.15.110:0/2916258707 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda9014d470 0x7fda900a2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:49.019 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.015+0000 7fda9560f700 1 --2- 172.21.15.110:0/2916258707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda9014cc90 0x7fda90145de0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:49.019 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.015+0000 7fda9560f700 1 -- 172.21.15.110:0/2916258707 >> 172.21.15.110:0/2916258707 conn(0x7fda90060c40 msgr2=0x7fda900bf220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:49.019 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.016+0000 7fda9560f700 1 -- 172.21.15.110:0/2916258707 shutdown_connections 2021-03-25T14:17:49.019 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.016+0000 7fda9560f700 1 -- 172.21.15.110:0/2916258707 wait complete. 2021-03-25T14:17:49.029 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-03-25T14:17:49.142 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.140+0000 7f32a2419700 1 Processor -- start 2021-03-25T14:17:49.142 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.140+0000 7f32a2419700 1 -- start start 2021-03-25T14:17:49.145 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.141+0000 7f32a2419700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f329c0b0cc0 0x7f329c145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:49.145 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.141+0000 7f32a2419700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f329c0648a0 0x7f329c09db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:49.145 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.141+0000 7f32a2419700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f329c149c50 con 0x7f329c0b5d00 2021-03-25T14:17:49.145 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.141+0000 7f32a2419700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f329c067960 con 0x7f329c0648a0 2021-03-25T14:17:49.146 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.141+0000 7f32a2419700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f329c1461b0 con 0x7f329c0b0cc0 2021-03-25T14:17:49.146 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.141+0000 7f32a09b6700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f329c0648a0 0x7f329c09db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:49.146 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.141+0000 7f32a09b6700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f329c0648a0 0x7f329c09db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50592/0 (socket says 172.21.15.110:50592) 2021-03-25T14:17:49.146 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.141+0000 7f32a09b6700 1 -- 172.21.15.110:0/4145087468 learned_addr learned my addr 172.21.15.110:0/4145087468 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:49.146 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.141+0000 7f329bfff700 1 --2- 172.21.15.110:0/4145087468 >> v2:172.21.15.174:3300/0 conn(0x7f329c0b0cc0 0x7f329c145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:49.146 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.141+0000 7f32a09b6700 1 -- 172.21.15.110:0/4145087468 >> v2:172.21.15.174:3300/0 conn(0x7f329c0b0cc0 msgr2=0x7f329c145cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:49.146 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.141+0000 7f32a09b6700 1 --2- 172.21.15.110:0/4145087468 >> v2:172.21.15.174:3300/0 conn(0x7f329c0b0cc0 0x7f329c145cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:49.146 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.141+0000 7f32a09b6700 1 -- 172.21.15.110:0/4145087468 >> v1:172.21.15.174:6789/0 conn(0x7f329c0b5d00 legacy=0x7f329c067250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:49.146 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.141+0000 7f32a09b6700 1 -- 172.21.15.110:0/4145087468 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f329c149e80 con 0x7f329c0648a0 2021-03-25T14:17:49.146 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.141+0000 7f32a09b6700 1 --2- 172.21.15.110:0/4145087468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f329c0648a0 0x7f329c09db40 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f329c066100 tx=0x7f32940092d0).ready entity=mon.0 client_cookie=3e47dd54c7093cc1 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:49.147 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.142+0000 7f329affd700 1 -- 172.21.15.110:0/4145087468 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329400bc40 con 0x7f329c0648a0 2021-03-25T14:17:49.147 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.142+0000 7f329affd700 1 -- 172.21.15.110:0/4145087468 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f329400bda0 con 0x7f329c0648a0 2021-03-25T14:17:49.147 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.142+0000 7f329affd700 1 -- 172.21.15.110:0/4145087468 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3294011610 con 0x7f329c0648a0 2021-03-25T14:17:49.147 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.142+0000 7f32a2419700 1 -- 172.21.15.110:0/4145087468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f329c0648a0 msgr2=0x7f329c09db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:49.147 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.142+0000 7f32a2419700 1 --2- 172.21.15.110:0/4145087468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f329c0648a0 0x7f329c09db40 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f329c066100 tx=0x7f32940092d0).stop 2021-03-25T14:17:49.147 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.142+0000 7f32a2419700 1 -- 172.21.15.110:0/4145087468 shutdown_connections 2021-03-25T14:17:49.147 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.142+0000 7f32a2419700 1 --2- 172.21.15.110:0/4145087468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f329c0648a0 0x7f329c09db40 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:49.147 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.142+0000 7f32a2419700 1 --2- 172.21.15.110:0/4145087468 >> v2:172.21.15.174:3300/0 conn(0x7f329c0b0cc0 0x7f329c145cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:49.147 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.142+0000 7f32a2419700 1 -- 172.21.15.110:0/4145087468 >> 172.21.15.110:0/4145087468 conn(0x7f329c0664e0 msgr2=0x7f329c0668f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:49.147 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.142+0000 7f32a2419700 1 -- 172.21.15.110:0/4145087468 shutdown_connections 2021-03-25T14:17:49.147 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.142+0000 7f32a2419700 1 -- 172.21.15.110:0/4145087468 wait complete. 2021-03-25T14:17:49.147 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.143+0000 7f32a2419700 1 Processor -- start 2021-03-25T14:17:49.148 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.143+0000 7f32a2419700 1 -- start start 2021-03-25T14:17:49.151 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.144+0000 7f32a2419700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f329c0648a0 0x7f329c0ba930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:49.151 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.144+0000 7f32a2419700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f329c0b0cc0 0x7f329c157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:49.151 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.144+0000 7f32a2419700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f329c0b5d00 0x7f329c157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:49.151 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.144+0000 7f32a2419700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329c0b5ba0 con 0x7f329c0b0cc0 2021-03-25T14:17:49.151 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.144+0000 7f32a2419700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329c156ac0 con 0x7f329c0b5d00 2021-03-25T14:17:49.151 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.144+0000 7f32a2419700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f329c156cf0 con 0x7f329c0648a0 2021-03-25T14:17:49.151 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.144+0000 7f329b7fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f329c0b0cc0 0x7f329c157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:49.151 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.144+0000 7f329b7fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f329c0b0cc0 0x7f329c157150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50598/0 (socket says 172.21.15.110:50598) 2021-03-25T14:17:49.151 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.144+0000 7f329b7fe700 1 -- 172.21.15.110:0/3688240076 learned_addr learned my addr 172.21.15.110:0/3688240076 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:49.151 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.144+0000 7f32a09b6700 1 --2- 172.21.15.110:0/3688240076 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f329c0b5d00 0x7f329c157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:49.152 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.144+0000 7f329bfff700 1 --2- 172.21.15.110:0/3688240076 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f329c0648a0 0x7f329c0ba930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:49.152 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.144+0000 7f329b7fe700 1 -- 172.21.15.110:0/3688240076 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f329c0648a0 msgr2=0x7f329c0ba930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:49.152 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.144+0000 7f329b7fe700 1 --2- 172.21.15.110:0/3688240076 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f329c0648a0 0x7f329c0ba930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:49.152 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.144+0000 7f329b7fe700 1 -- 172.21.15.110:0/3688240076 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f329c0b5d00 msgr2=0x7f329c157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:49.152 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.144+0000 7f329b7fe700 1 --2- 172.21.15.110:0/3688240076 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f329c0b5d00 0x7f329c157640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:49.152 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.145+0000 7f329b7fe700 1 -- 172.21.15.110:0/3688240076 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f329c14ee80 con 0x7f329c0b0cc0 2021-03-25T14:17:49.152 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.145+0000 7f329bfff700 1 --2- 172.21.15.110:0/3688240076 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f329c0648a0 0x7f329c0ba930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:17:49.152 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.145+0000 7f329b7fe700 1 --2- 172.21.15.110:0/3688240076 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f329c0b0cc0 0x7f329c157150 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f3290009760 tx=0x7f3290006e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:49.152 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.145+0000 7f3283fff700 1 -- 172.21.15.110:0/3688240076 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329000d520 con 0x7f329c0b0cc0 2021-03-25T14:17:49.152 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.145+0000 7f3283fff700 1 -- 172.21.15.110:0/3688240076 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f329000d6a0 con 0x7f329c0b0cc0 2021-03-25T14:17:49.152 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.145+0000 7f32a2419700 1 -- 172.21.15.110:0/3688240076 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f329c0b5660 con 0x7f329c0b0cc0 2021-03-25T14:17:49.152 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.145+0000 7f3283fff700 1 -- 172.21.15.110:0/3688240076 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329000da60 con 0x7f329c0b0cc0 2021-03-25T14:17:49.153 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.145+0000 7f32a2419700 1 -- 172.21.15.110:0/3688240076 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f329c0bb600 con 0x7f329c0b0cc0 2021-03-25T14:17:49.153 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.146+0000 7f32a2419700 1 -- 172.21.15.110:0/3688240076 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f329c05d7b0 con 0x7f329c0b0cc0 2021-03-25T14:17:49.153 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.146+0000 7f3283fff700 1 -- 172.21.15.110:0/3688240076 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f3290012440 con 0x7f329c0b0cc0 2021-03-25T14:17:49.153 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.146+0000 7f3283fff700 1 --2- 172.21.15.110:0/3688240076 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f327c05a0b0 0x7f327c05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:49.153 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.147+0000 7f3283fff700 1 -- 172.21.15.110:0/3688240076 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6426+0+0 (secure 0 0 0) 0x7f3290073e90 con 0x7f329c0b0cc0 2021-03-25T14:17:49.153 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.147+0000 7f329bfff700 1 --2- 172.21.15.110:0/3688240076 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f327c05a0b0 0x7f327c05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:49.153 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.147+0000 7f329bfff700 1 --2- 172.21.15.110:0/3688240076 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f327c05a0b0 0x7f327c05c570 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f329c0b8640 tx=0x7f328c008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:49.153 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.150+0000 7f3283fff700 1 -- 172.21.15.110:0/3688240076 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f329004b0a0 con 0x7f329c0b0cc0 2021-03-25T14:17:49.303 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.301+0000 7f32a2419700 1 -- 172.21.15.110:0/3688240076 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f329c066de0 con 0x7f329c0b0cc0 2021-03-25T14:17:49.303 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.301+0000 7f3283fff700 1 -- 172.21.15.110:0/3688240076 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v56) v1 ==== 104+0+10 (secure 0 0 0) 0x7f329004ac90 con 0x7f329c0b0cc0 2021-03-25T14:17:49.303 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:17:49.305 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.303+0000 7f32a2419700 1 -- 172.21.15.110:0/3688240076 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f327c05a0b0 msgr2=0x7f327c05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:49.305 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.303+0000 7f32a2419700 1 --2- 172.21.15.110:0/3688240076 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f327c05a0b0 0x7f327c05c570 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f329c0b8640 tx=0x7f328c008040).stop 2021-03-25T14:17:49.305 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.303+0000 7f32a2419700 1 -- 172.21.15.110:0/3688240076 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f329c0b0cc0 msgr2=0x7f329c157150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:49.305 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.303+0000 7f32a2419700 1 --2- 172.21.15.110:0/3688240076 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f329c0b0cc0 0x7f329c157150 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f3290009760 tx=0x7f3290006e20).stop 2021-03-25T14:17:49.305 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.303+0000 7f32a2419700 1 -- 172.21.15.110:0/3688240076 shutdown_connections 2021-03-25T14:17:49.305 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.303+0000 7f32a2419700 1 --2- 172.21.15.110:0/3688240076 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f327c05a0b0 0x7f327c05c570 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:49.305 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.303+0000 7f32a2419700 1 --2- 172.21.15.110:0/3688240076 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f329c0b5d00 0x7f329c157640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:49.305 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.303+0000 7f32a2419700 1 --2- 172.21.15.110:0/3688240076 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f329c0648a0 0x7f329c0ba930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:49.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.303+0000 7f32a2419700 1 --2- 172.21.15.110:0/3688240076 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f329c0b0cc0 0x7f329c157150 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:49.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.303+0000 7f32a2419700 1 -- 172.21.15.110:0/3688240076 >> 172.21.15.110:0/3688240076 conn(0x7f329c0664e0 msgr2=0x7f329c0bc040 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:49.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.303+0000 7f32a2419700 1 -- 172.21.15.110:0/3688240076 shutdown_connections 2021-03-25T14:17:49.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.303+0000 7f32a2419700 1 -- 172.21.15.110:0/3688240076 wait complete. 2021-03-25T14:17:49.316 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-03-25T14:17:49.434 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.426+0000 7ff5d759e700 1 Processor -- start 2021-03-25T14:17:49.434 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.426+0000 7ff5d759e700 1 -- start start 2021-03-25T14:17:49.434 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.427+0000 7ff5d759e700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff5d80bb660 0x7ff5d80ba9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:49.434 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.427+0000 7ff5d759e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff5d814cdc0 0x7ff5d8148c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:49.434 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.427+0000 7ff5d759e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d80b1920 con 0x7ff5d80bc110 2021-03-25T14:17:49.434 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.427+0000 7ff5d759e700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d8068850 con 0x7ff5d80bb660 2021-03-25T14:17:49.434 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.427+0000 7ff5d759e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d8067d30 con 0x7ff5d814cdc0 2021-03-25T14:17:49.434 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.427+0000 7ff5d659c700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff5d80bb660 0x7ff5d80ba9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:49.434 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.427+0000 7ff5d659c700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff5d80bb660 0x7ff5d80ba9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50602/0 (socket says 172.21.15.110:50602) 2021-03-25T14:17:49.435 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.427+0000 7ff5d659c700 1 -- 172.21.15.110:0/780713242 learned_addr learned my addr 172.21.15.110:0/780713242 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:49.435 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.428+0000 7ff5d6d9d700 1 --2- 172.21.15.110:0/780713242 >> v2:172.21.15.174:3300/0 conn(0x7ff5d814cdc0 0x7ff5d8148c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:49.435 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.428+0000 7ff5d659c700 1 -- 172.21.15.110:0/780713242 >> v2:172.21.15.174:3300/0 conn(0x7ff5d814cdc0 msgr2=0x7ff5d8148c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:49.435 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.428+0000 7ff5d659c700 1 --2- 172.21.15.110:0/780713242 >> v2:172.21.15.174:3300/0 conn(0x7ff5d814cdc0 0x7ff5d8148c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:49.435 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.428+0000 7ff5d659c700 1 -- 172.21.15.110:0/780713242 >> v1:172.21.15.174:6789/0 conn(0x7ff5d80bc110 legacy=0x7ff5d8067620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:49.435 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.428+0000 7ff5d659c700 1 -- 172.21.15.110:0/780713242 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d80bc620 con 0x7ff5d80bb660 2021-03-25T14:17:49.435 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.428+0000 7ff5d659c700 1 --2- 172.21.15.110:0/780713242 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5d80bb660 0x7ff5d80ba9b0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7ff5d80695a0 tx=0x7ff5c8006ee0).ready entity=mon.0 client_cookie=9dded443290a537e server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:49.435 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.428+0000 7ff5d5d9b700 1 -- 172.21.15.110:0/780713242 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c8009800 con 0x7ff5d80bb660 2021-03-25T14:17:49.435 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.428+0000 7ff5d5d9b700 1 -- 172.21.15.110:0/780713242 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c8009960 con 0x7ff5d80bb660 2021-03-25T14:17:49.436 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.428+0000 7ff5d5d9b700 1 -- 172.21.15.110:0/780713242 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c8009ce0 con 0x7ff5d80bb660 2021-03-25T14:17:49.436 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.428+0000 7ff5d759e700 1 -- 172.21.15.110:0/780713242 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5d80bb660 msgr2=0x7ff5d80ba9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:49.436 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.428+0000 7ff5d759e700 1 --2- 172.21.15.110:0/780713242 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5d80bb660 0x7ff5d80ba9b0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7ff5d80695a0 tx=0x7ff5c8006ee0).stop 2021-03-25T14:17:49.436 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.428+0000 7ff5d759e700 1 -- 172.21.15.110:0/780713242 shutdown_connections 2021-03-25T14:17:49.436 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.428+0000 7ff5d759e700 1 --2- 172.21.15.110:0/780713242 >> v2:172.21.15.174:3300/0 conn(0x7ff5d814cdc0 0x7ff5d8148c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:49.436 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.428+0000 7ff5d759e700 1 --2- 172.21.15.110:0/780713242 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5d80bb660 0x7ff5d80ba9b0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:49.436 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.428+0000 7ff5d759e700 1 -- 172.21.15.110:0/780713242 >> 172.21.15.110:0/780713242 conn(0x7ff5d8063090 msgr2=0x7ff5d80634a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:49.436 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.428+0000 7ff5d759e700 1 -- 172.21.15.110:0/780713242 shutdown_connections 2021-03-25T14:17:49.436 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.428+0000 7ff5d759e700 1 -- 172.21.15.110:0/780713242 wait complete. 2021-03-25T14:17:49.436 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.429+0000 7ff5d759e700 1 Processor -- start 2021-03-25T14:17:49.436 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.429+0000 7ff5d759e700 1 -- start start 2021-03-25T14:17:49.436 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.430+0000 7ff5d759e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5d80bb660 0x7ff5d8145790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:49.437 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.430+0000 7ff5d759e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5d80bc110 0x7ff5d80bfca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:49.437 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.430+0000 7ff5d759e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5d814cdc0 0x7ff5d80c0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:49.437 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.430+0000 7ff5d759e700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d8158f10 con 0x7ff5d814cdc0 2021-03-25T14:17:49.437 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.430+0000 7ff5d759e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d81591b0 con 0x7ff5d80bc110 2021-03-25T14:17:49.437 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.430+0000 7ff5d759e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d8159450 con 0x7ff5d80bb660 2021-03-25T14:17:49.437 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.430+0000 7ff5d6d9d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5d814cdc0 0x7ff5d80c0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:49.437 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.430+0000 7ff5d6d9d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5d814cdc0 0x7ff5d80c0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50612/0 (socket says 172.21.15.110:50612) 2021-03-25T14:17:49.437 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.430+0000 7ff5d6d9d700 1 -- 172.21.15.110:0/700007639 learned_addr learned my addr 172.21.15.110:0/700007639 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:49.437 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.430+0000 7ff5d659c700 1 --2- 172.21.15.110:0/700007639 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5d80bb660 0x7ff5d8145790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:49.437 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.430+0000 7ff5cffff700 1 --2- 172.21.15.110:0/700007639 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5d80bc110 0x7ff5d80bfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:49.437 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.431+0000 7ff5d6d9d700 1 -- 172.21.15.110:0/700007639 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5d80bb660 msgr2=0x7ff5d8145790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:49.438 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.431+0000 7ff5d6d9d700 1 --2- 172.21.15.110:0/700007639 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5d80bb660 0x7ff5d8145790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:49.438 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.431+0000 7ff5d6d9d700 1 -- 172.21.15.110:0/700007639 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5d80bc110 msgr2=0x7ff5d80bfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:49.438 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.431+0000 7ff5d6d9d700 1 --2- 172.21.15.110:0/700007639 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5d80bc110 0x7ff5d80bfca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:49.438 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.431+0000 7ff5d6d9d700 1 -- 172.21.15.110:0/700007639 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d81596f0 con 0x7ff5d814cdc0 2021-03-25T14:17:49.438 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.431+0000 7ff5d6d9d700 1 --2- 172.21.15.110:0/700007639 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5d814cdc0 0x7ff5d80c0190 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7ff5d000cb50 tx=0x7ff5d0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:49.438 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.431+0000 7ff5ce7fc700 1 -- 172.21.15.110:0/700007639 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d00078a0 con 0x7ff5d814cdc0 2021-03-25T14:17:49.438 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.431+0000 7ff5ce7fc700 1 -- 172.21.15.110:0/700007639 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d0007a00 con 0x7ff5d814cdc0 2021-03-25T14:17:49.438 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.431+0000 7ff5d759e700 1 -- 172.21.15.110:0/700007639 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d8159990 con 0x7ff5d814cdc0 2021-03-25T14:17:49.438 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.431+0000 7ff5ce7fc700 1 -- 172.21.15.110:0/700007639 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d0007da0 con 0x7ff5d814cdc0 2021-03-25T14:17:49.438 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.431+0000 7ff5d759e700 1 -- 172.21.15.110:0/700007639 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d8147ea0 con 0x7ff5d814cdc0 2021-03-25T14:17:49.438 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.432+0000 7ff5d759e700 1 -- 172.21.15.110:0/700007639 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d8159b20 con 0x7ff5d814cdc0 2021-03-25T14:17:49.439 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.432+0000 7ff5ce7fc700 1 -- 172.21.15.110:0/700007639 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7ff5d0011620 con 0x7ff5d814cdc0 2021-03-25T14:17:49.439 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.432+0000 7ff5ce7fc700 1 --2- 172.21.15.110:0/700007639 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff5bc05a0b0 0x7ff5bc05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:49.440 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.432+0000 7ff5ce7fc700 1 -- 172.21.15.110:0/700007639 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6426+0+0 (secure 0 0 0) 0x7ff5d0074170 con 0x7ff5d814cdc0 2021-03-25T14:17:49.440 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.432+0000 7ff5d659c700 1 --2- 172.21.15.110:0/700007639 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff5bc05a0b0 0x7ff5bc05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:49.440 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.433+0000 7ff5d659c700 1 --2- 172.21.15.110:0/700007639 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff5bc05a0b0 0x7ff5bc05c570 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7ff5c800b1d0 tx=0x7ff5c8016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:49.440 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.436+0000 7ff5ce7fc700 1 -- 172.21.15.110:0/700007639 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7ff5d00479b0 con 0x7ff5d814cdc0 2021-03-25T14:17:49.590 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.588+0000 7ff5d759e700 1 -- 172.21.15.110:0/700007639 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff5d8045ae0 con 0x7ff5d814cdc0 2021-03-25T14:17:49.590 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.589+0000 7ff5ce7fc700 1 -- 172.21.15.110:0/700007639 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v56) v1 ==== 100+0+10 (secure 0 0 0) 0x7ff5d004afd0 con 0x7ff5d814cdc0 2021-03-25T14:17:49.591 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:17:49.592 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.590+0000 7ff5d759e700 1 -- 172.21.15.110:0/700007639 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff5bc05a0b0 msgr2=0x7ff5bc05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:49.593 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.590+0000 7ff5d759e700 1 --2- 172.21.15.110:0/700007639 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff5bc05a0b0 0x7ff5bc05c570 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7ff5c800b1d0 tx=0x7ff5c8016000).stop 2021-03-25T14:17:49.593 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.590+0000 7ff5d759e700 1 -- 172.21.15.110:0/700007639 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5d814cdc0 msgr2=0x7ff5d80c0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:49.593 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.590+0000 7ff5d759e700 1 --2- 172.21.15.110:0/700007639 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5d814cdc0 0x7ff5d80c0190 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7ff5d000cb50 tx=0x7ff5d0008040).stop 2021-03-25T14:17:49.593 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.590+0000 7ff5d759e700 1 -- 172.21.15.110:0/700007639 shutdown_connections 2021-03-25T14:17:49.593 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.590+0000 7ff5d759e700 1 --2- 172.21.15.110:0/700007639 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7ff5bc05a0b0 0x7ff5bc05c570 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:49.593 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.590+0000 7ff5d759e700 1 --2- 172.21.15.110:0/700007639 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5d814cdc0 0x7ff5d80c0190 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:49.593 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.590+0000 7ff5d759e700 1 --2- 172.21.15.110:0/700007639 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5d80bb660 0x7ff5d8145790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:49.593 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.590+0000 7ff5d759e700 1 --2- 172.21.15.110:0/700007639 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5d80bc110 0x7ff5d80bfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:49.593 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.590+0000 7ff5d759e700 1 -- 172.21.15.110:0/700007639 >> 172.21.15.110:0/700007639 conn(0x7ff5d8063090 msgr2=0x7ff5d814d230 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:49.593 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.590+0000 7ff5d759e700 1 -- 172.21.15.110:0/700007639 shutdown_connections 2021-03-25T14:17:49.593 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.590+0000 7ff5d759e700 1 -- 172.21.15.110:0/700007639 wait complete. 2021-03-25T14:17:49.604 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-03-25T14:17:49.713 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.711+0000 7f06eb59e700 1 Processor -- start 2021-03-25T14:17:49.713 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.711+0000 7f06eb59e700 1 -- start start 2021-03-25T14:17:49.716 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.712+0000 7f06eb59e700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f06ec0baa60 0x7f06ec154170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:49.716 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.712+0000 7f06eb59e700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06ec0bbcd0 con 0x7f06ec0ba680 2021-03-25T14:17:49.716 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.712+0000 7f06eb59e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06ec0bbf70 con 0x7f06ec0b86d0 2021-03-25T14:17:49.716 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.712+0000 7f06eb59e700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06ec0baeb0 con 0x7f06ec0baa60 2021-03-25T14:17:49.716 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.712+0000 7f06ead9d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f06ec0baa60 0x7f06ec154170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:49.716 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.712+0000 7f06ead9d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f06ec0baa60 0x7f06ec154170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50620/0 (socket says 172.21.15.110:50620) 2021-03-25T14:17:49.716 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.712+0000 7f06ead9d700 1 -- 172.21.15.110:0/2153816680 learned_addr learned my addr 172.21.15.110:0/2153816680 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:49.717 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.712+0000 7f06ea59c700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f06ec0ba680 0x7f06ec0bcc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43554/0 (socket says 172.21.15.110:43554) 2021-03-25T14:17:49.717 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.713+0000 7f06ead9d700 1 -- 172.21.15.110:0/2153816680 >> v1:172.21.15.174:6789/0 conn(0x7f06ec0b86d0 legacy=0x7f06ec148d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:49.717 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.713+0000 7f06ead9d700 1 -- 172.21.15.110:0/2153816680 >> v1:172.21.15.110:6789/0 conn(0x7f06ec0ba680 legacy=0x7f06ec0bcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:49.717 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.713+0000 7f06ead9d700 1 -- 172.21.15.110:0/2153816680 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ec0bc210 con 0x7f06ec0baa60 2021-03-25T14:17:49.717 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.713+0000 7f06e9d9b700 1 -- 172.21.15.110:0/2153816680 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 149195799 0 0) 0x7f06ec0bbcd0 con 0x7f06ec0ba680 2021-03-25T14:17:49.717 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.713+0000 7f06ead9d700 1 --2- 172.21.15.110:0/2153816680 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06ec0baa60 0x7f06ec154170 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f06e4009d70 tx=0x7f06e40092b0).ready entity=mon.0 client_cookie=ddf84c8738f2e9d8 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:49.717 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.713+0000 7f06e9d9b700 1 -- 172.21.15.110:0/2153816680 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e400bc80 con 0x7f06ec0baa60 2021-03-25T14:17:49.717 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.713+0000 7f06e9d9b700 1 -- 172.21.15.110:0/2153816680 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e400bde0 con 0x7f06ec0baa60 2021-03-25T14:17:49.717 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.713+0000 7f06e9d9b700 1 -- 172.21.15.110:0/2153816680 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e4005ce0 con 0x7f06ec0baa60 2021-03-25T14:17:49.717 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.713+0000 7f06eb59e700 1 -- 172.21.15.110:0/2153816680 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06ec0baa60 msgr2=0x7f06ec154170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:49.717 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.713+0000 7f06eb59e700 1 --2- 172.21.15.110:0/2153816680 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06ec0baa60 0x7f06ec154170 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f06e4009d70 tx=0x7f06e40092b0).stop 2021-03-25T14:17:49.717 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.713+0000 7f06eb59e700 1 -- 172.21.15.110:0/2153816680 shutdown_connections 2021-03-25T14:17:49.718 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.713+0000 7f06eb59e700 1 --2- 172.21.15.110:0/2153816680 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06ec0baa60 0x7f06ec154170 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:49.718 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.713+0000 7f06eb59e700 1 -- 172.21.15.110:0/2153816680 >> 172.21.15.110:0/2153816680 conn(0x7f06ec060c40 msgr2=0x7f06ec061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:49.718 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.713+0000 7f06eb59e700 1 -- 172.21.15.110:0/2153816680 shutdown_connections 2021-03-25T14:17:49.718 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.713+0000 7f06eb59e700 1 -- 172.21.15.110:0/2153816680 wait complete. 2021-03-25T14:17:49.721 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.714+0000 7f06eb59e700 1 Processor -- start 2021-03-25T14:17:49.721 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.714+0000 7f06eb59e700 1 -- start start 2021-03-25T14:17:49.721 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.715+0000 7f06eb59e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06ec0b86d0 0x7f06ec149220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:49.721 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.715+0000 7f06eb59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06ec0ba680 0x7f06ec0a27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:49.721 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.715+0000 7f06eb59e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06ec0baa60 0x7f06ec0a2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:49.722 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.715+0000 7f06eb59e700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec0a3c80 con 0x7f06ec0baa60 2021-03-25T14:17:49.722 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.715+0000 7f06eb59e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec159d80 con 0x7f06ec0b86d0 2021-03-25T14:17:49.722 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.715+0000 7f06eb59e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec159300 con 0x7f06ec0ba680 2021-03-25T14:17:49.722 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.715+0000 7f06ead9d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06ec0baa60 0x7f06ec0a2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:49.722 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.715+0000 7f06ead9d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06ec0baa60 0x7f06ec0a2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50626/0 (socket says 172.21.15.110:50626) 2021-03-25T14:17:49.722 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.715+0000 7f06ead9d700 1 -- 172.21.15.110:0/1947348578 learned_addr learned my addr 172.21.15.110:0/1947348578 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:49.722 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.715+0000 7f06ea59c700 1 --2- 172.21.15.110:0/1947348578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06ec0b86d0 0x7f06ec149220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:49.722 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.715+0000 7f06e3fff700 1 --2- 172.21.15.110:0/1947348578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06ec0ba680 0x7f06ec0a27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:49.722 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.716+0000 7f06ead9d700 1 -- 172.21.15.110:0/1947348578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06ec0ba680 msgr2=0x7f06ec0a27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:49.722 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.716+0000 7f06ead9d700 1 --2- 172.21.15.110:0/1947348578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06ec0ba680 0x7f06ec0a27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:49.722 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.716+0000 7f06ead9d700 1 -- 172.21.15.110:0/1947348578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06ec0b86d0 msgr2=0x7f06ec149220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:49.723 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.716+0000 7f06ead9d700 1 --2- 172.21.15.110:0/1947348578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06ec0b86d0 0x7f06ec149220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:49.723 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.716+0000 7f06ead9d700 1 -- 172.21.15.110:0/1947348578 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ec1595a0 con 0x7f06ec0baa60 2021-03-25T14:17:49.723 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.716+0000 7f06e3fff700 1 --2- 172.21.15.110:0/1947348578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06ec0ba680 0x7f06ec0a27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:49.723 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.716+0000 7f06ead9d700 1 --2- 172.21.15.110:0/1947348578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06ec0baa60 0x7f06ec0a2cb0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f06e40092f0 tx=0x7f06e4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:49.723 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.716+0000 7f06e27fc700 1 -- 172.21.15.110:0/1947348578 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e400bc80 con 0x7f06ec0baa60 2021-03-25T14:17:49.723 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.716+0000 7f06e27fc700 1 -- 172.21.15.110:0/1947348578 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e4011650 con 0x7f06ec0baa60 2021-03-25T14:17:49.723 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.716+0000 7f06eb59e700 1 -- 172.21.15.110:0/1947348578 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06ec159840 con 0x7f06ec0baa60 2021-03-25T14:17:49.723 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.716+0000 7f06e27fc700 1 -- 172.21.15.110:0/1947348578 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e40119d0 con 0x7f06ec0baa60 2021-03-25T14:17:49.723 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.716+0000 7f06eb59e700 1 -- 172.21.15.110:0/1947348578 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06ec159b30 con 0x7f06ec0baa60 2021-03-25T14:17:49.723 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.717+0000 7f06eb59e700 1 -- 172.21.15.110:0/1947348578 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06ec1497d0 con 0x7f06ec0baa60 2021-03-25T14:17:49.723 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.717+0000 7f06e27fc700 1 -- 172.21.15.110:0/1947348578 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f06e4023030 con 0x7f06ec0baa60 2021-03-25T14:17:49.723 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.717+0000 7f06e27fc700 1 --2- 172.21.15.110:0/1947348578 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f06d005a0b0 0x7f06d005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:49.724 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.717+0000 7f06e27fc700 1 -- 172.21.15.110:0/1947348578 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6426+0+0 (secure 0 0 0) 0x7f06e4075630 con 0x7f06ec0baa60 2021-03-25T14:17:49.724 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.717+0000 7f06ea59c700 1 --2- 172.21.15.110:0/1947348578 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f06d005a0b0 0x7f06d005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:49.724 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.718+0000 7f06ea59c700 1 --2- 172.21.15.110:0/1947348578 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f06d005a0b0 0x7f06d005c570 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f06dc0011e0 tx=0x7f06dc007a30).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:49.724 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.721+0000 7f06e27fc700 1 -- 172.21.15.110:0/1947348578 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f06e4048d60 con 0x7f06ec0baa60 2021-03-25T14:17:49.875 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.873+0000 7f06eb59e700 1 -- 172.21.15.110:0/1947348578 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f06ec045ae0 con 0x7f06ec0baa60 2021-03-25T14:17:49.876 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.874+0000 7f06e27fc700 1 -- 172.21.15.110:0/1947348578 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v56) v1 ==== 84+0+287 (secure 0 0 0) 0x7f06e4021090 con 0x7f06ec0baa60 2021-03-25T14:17:49.876 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:49.876 INFO:teuthology.orchestra.run.smithi110.stdout:[ 2021-03-25T14:17:49.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:17:49.876 INFO:teuthology.orchestra.run.smithi110.stdout: "poolnum": 1, 2021-03-25T14:17:49.876 INFO:teuthology.orchestra.run.smithi110.stdout: "poolname": "device_health_metrics" 2021-03-25T14:17:49.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:17:49.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:17:49.876 INFO:teuthology.orchestra.run.smithi110.stdout: "poolnum": 2, 2021-03-25T14:17:49.877 INFO:teuthology.orchestra.run.smithi110.stdout: "poolname": "rbd" 2021-03-25T14:17:49.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:17:49.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:17:49.877 INFO:teuthology.orchestra.run.smithi110.stdout: "poolnum": 10, 2021-03-25T14:17:49.877 INFO:teuthology.orchestra.run.smithi110.stdout: "poolname": "cephfs_metadata" 2021-03-25T14:17:49.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:17:49.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:17:49.877 INFO:teuthology.orchestra.run.smithi110.stdout: "poolnum": 11, 2021-03-25T14:17:49.877 INFO:teuthology.orchestra.run.smithi110.stdout: "poolname": "cephfs_data" 2021-03-25T14:17:49.877 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:17:49.877 INFO:teuthology.orchestra.run.smithi110.stdout:] 2021-03-25T14:17:49.879 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.875+0000 7f06eb59e700 1 -- 172.21.15.110:0/1947348578 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f06d005a0b0 msgr2=0x7f06d005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:49.879 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.875+0000 7f06eb59e700 1 --2- 172.21.15.110:0/1947348578 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f06d005a0b0 0x7f06d005c570 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f06dc0011e0 tx=0x7f06dc007a30).stop 2021-03-25T14:17:49.879 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.875+0000 7f06eb59e700 1 -- 172.21.15.110:0/1947348578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06ec0baa60 msgr2=0x7f06ec0a2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:49.879 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.875+0000 7f06eb59e700 1 --2- 172.21.15.110:0/1947348578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06ec0baa60 0x7f06ec0a2cb0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f06e40092f0 tx=0x7f06e4016000).stop 2021-03-25T14:17:49.879 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.875+0000 7f06eb59e700 1 -- 172.21.15.110:0/1947348578 shutdown_connections 2021-03-25T14:17:49.879 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.875+0000 7f06eb59e700 1 --2- 172.21.15.110:0/1947348578 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f06d005a0b0 0x7f06d005c570 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:49.879 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.875+0000 7f06eb59e700 1 --2- 172.21.15.110:0/1947348578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06ec0b86d0 0x7f06ec149220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:49.879 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.875+0000 7f06eb59e700 1 --2- 172.21.15.110:0/1947348578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06ec0baa60 0x7f06ec0a2cb0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:49.879 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.875+0000 7f06eb59e700 1 --2- 172.21.15.110:0/1947348578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06ec0ba680 0x7f06ec0a27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:49.880 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.875+0000 7f06eb59e700 1 -- 172.21.15.110:0/1947348578 >> 172.21.15.110:0/1947348578 conn(0x7f06ec060c40 msgr2=0x7f06ec069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:49.880 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.875+0000 7f06eb59e700 1 -- 172.21.15.110:0/1947348578 shutdown_connections 2021-03-25T14:17:49.880 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:49.875+0000 7f06eb59e700 1 -- 172.21.15.110:0/1947348578 wait complete. 2021-03-25T14:17:49.889 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2021-03-25T14:17:49.889 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata 8 2021-03-25T14:17:50.003 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.001+0000 7f1db3c73700 1 Processor -- start 2021-03-25T14:17:50.003 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.001+0000 7f1db3c73700 1 -- start start 2021-03-25T14:17:50.006 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.002+0000 7f1db3c73700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1dac0b5eb0 0x7f1dac0b7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:50.006 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.002+0000 7f1db3c73700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dac0b6990 con 0x7f1dac068d50 2021-03-25T14:17:50.006 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.002+0000 7f1db3c73700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dac0692d0 con 0x7f1dac14ce50 2021-03-25T14:17:50.006 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.002+0000 7f1db3c73700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dac0b6450 con 0x7f1dac0b5eb0 2021-03-25T14:17:50.006 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.002+0000 7f1db120e700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f1dac068d50 0x7f1dac0b57a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43566/0 (socket says 172.21.15.110:43566) 2021-03-25T14:17:50.006 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.002+0000 7f1db2210700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1dac0b5eb0 0x7f1dac0b7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:50.006 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.002+0000 7f1db120e700 1 -- 172.21.15.110:0/3809430091 learned_addr learned my addr 172.21.15.110:0/3809430091 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:50.006 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.002+0000 7f1db2210700 1 -- 172.21.15.110:0/3809430091 >> v1:172.21.15.174:6789/0 conn(0x7f1dac14ce50 legacy=0x7f1dac14d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:50.006 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.002+0000 7f1db2210700 1 -- 172.21.15.110:0/3809430091 >> v1:172.21.15.110:6789/0 conn(0x7f1dac068d50 legacy=0x7f1dac0b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:50.007 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.002+0000 7f1db2210700 1 -- 172.21.15.110:0/3809430091 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dac0b66f0 con 0x7f1dac0b5eb0 2021-03-25T14:17:50.007 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.002+0000 7f1db0a0d700 1 -- 172.21.15.110:0/3809430091 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 753515824 0 0) 0x7f1dac0b6990 con 0x7f1dac068d50 2021-03-25T14:17:50.007 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.002+0000 7f1db2210700 1 --2- 172.21.15.110:0/3809430091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dac0b5eb0 0x7f1dac0b7070 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f1da4009cc0 tx=0x7f1da4009220).ready entity=mon.0 client_cookie=dbaca906da6ae2d8 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:50.007 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.003+0000 7f1db0a0d700 1 -- 172.21.15.110:0/3809430091 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da400bc40 con 0x7f1dac0b5eb0 2021-03-25T14:17:50.007 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.003+0000 7f1db0a0d700 1 -- 172.21.15.110:0/3809430091 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da400bda0 con 0x7f1dac0b5eb0 2021-03-25T14:17:50.007 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.003+0000 7f1db0a0d700 1 -- 172.21.15.110:0/3809430091 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da4011610 con 0x7f1dac0b5eb0 2021-03-25T14:17:50.007 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.003+0000 7f1db3c73700 1 -- 172.21.15.110:0/3809430091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dac0b5eb0 msgr2=0x7f1dac0b7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:50.007 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.003+0000 7f1db3c73700 1 --2- 172.21.15.110:0/3809430091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dac0b5eb0 0x7f1dac0b7070 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f1da4009cc0 tx=0x7f1da4009220).stop 2021-03-25T14:17:50.007 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.003+0000 7f1db3c73700 1 -- 172.21.15.110:0/3809430091 shutdown_connections 2021-03-25T14:17:50.007 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.003+0000 7f1db3c73700 1 --2- 172.21.15.110:0/3809430091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dac0b5eb0 0x7f1dac0b7070 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:50.007 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.003+0000 7f1db3c73700 1 -- 172.21.15.110:0/3809430091 >> 172.21.15.110:0/3809430091 conn(0x7f1dac0bc430 msgr2=0x7f1dac0bc840 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:50.008 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.003+0000 7f1db3c73700 1 -- 172.21.15.110:0/3809430091 shutdown_connections 2021-03-25T14:17:50.008 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.003+0000 7f1db3c73700 1 -- 172.21.15.110:0/3809430091 wait complete. 2021-03-25T14:17:50.008 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.004+0000 7f1db3c73700 1 Processor -- start 2021-03-25T14:17:50.008 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.004+0000 7f1db3c73700 1 -- start start 2021-03-25T14:17:50.011 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.005+0000 7f1db3c73700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1dac068d50 0x7f1dac14f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:50.011 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.005+0000 7f1db3c73700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dac0b5eb0 0x7f1dac13cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:50.011 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.005+0000 7f1db3c73700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1dac14ce50 0x7f1dac13d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:50.011 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.005+0000 7f1db3c73700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dac15cda0 con 0x7f1dac0b5eb0 2021-03-25T14:17:50.012 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.005+0000 7f1db3c73700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dac15cfd0 con 0x7f1dac068d50 2021-03-25T14:17:50.012 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.005+0000 7f1db3c73700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dac14ae00 con 0x7f1dac14ce50 2021-03-25T14:17:50.012 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.005+0000 7f1db120e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dac0b5eb0 0x7f1dac13cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:50.012 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.005+0000 7f1db120e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dac0b5eb0 0x7f1dac13cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50636/0 (socket says 172.21.15.110:50636) 2021-03-25T14:17:50.012 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.005+0000 7f1db120e700 1 -- 172.21.15.110:0/2721051756 learned_addr learned my addr 172.21.15.110:0/2721051756 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:50.012 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.005+0000 7f1db2210700 1 --2- 172.21.15.110:0/2721051756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1dac14ce50 0x7f1dac13d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:50.012 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.005+0000 7f1db1a0f700 1 --2- 172.21.15.110:0/2721051756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1dac068d50 0x7f1dac14f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:50.012 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.005+0000 7f1db120e700 1 -- 172.21.15.110:0/2721051756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1dac14ce50 msgr2=0x7f1dac13d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:50.013 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.005+0000 7f1db120e700 1 --2- 172.21.15.110:0/2721051756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1dac14ce50 0x7f1dac13d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:50.013 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.005+0000 7f1db120e700 1 -- 172.21.15.110:0/2721051756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1dac068d50 msgr2=0x7f1dac14f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:50.013 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.005+0000 7f1db120e700 1 --2- 172.21.15.110:0/2721051756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1dac068d50 0x7f1dac14f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:50.013 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.005+0000 7f1db120e700 1 -- 172.21.15.110:0/2721051756 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dac14fd40 con 0x7f1dac0b5eb0 2021-03-25T14:17:50.013 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.005+0000 7f1db120e700 1 --2- 172.21.15.110:0/2721051756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dac0b5eb0 0x7f1dac13cbf0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f1d9c00c7c0 tx=0x7f1d9c007af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:50.013 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.006+0000 7f1d99ffb700 1 -- 172.21.15.110:0/2721051756 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c007320 con 0x7f1dac0b5eb0 2021-03-25T14:17:50.013 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.006+0000 7f1d99ffb700 1 -- 172.21.15.110:0/2721051756 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9c007480 con 0x7f1dac0b5eb0 2021-03-25T14:17:50.013 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.006+0000 7f1db3c73700 1 -- 172.21.15.110:0/2721051756 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dac14c620 con 0x7f1dac0b5eb0 2021-03-25T14:17:50.013 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.006+0000 7f1d99ffb700 1 -- 172.21.15.110:0/2721051756 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c005830 con 0x7f1dac0b5eb0 2021-03-25T14:17:50.013 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.006+0000 7f1db3c73700 1 -- 172.21.15.110:0/2721051756 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dac13d5d0 con 0x7f1dac0b5eb0 2021-03-25T14:17:50.013 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.007+0000 7f1db3c73700 1 -- 172.21.15.110:0/2721051756 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dac14b1c0 con 0x7f1dac0b5eb0 2021-03-25T14:17:50.014 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.007+0000 7f1d99ffb700 1 -- 172.21.15.110:0/2721051756 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f1d9c010030 con 0x7f1dac0b5eb0 2021-03-25T14:17:50.014 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.007+0000 7f1d99ffb700 1 --2- 172.21.15.110:0/2721051756 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f1d8c05a0b0 0x7f1d8c05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:50.014 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.007+0000 7f1d99ffb700 1 -- 172.21.15.110:0/2721051756 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6426+0+0 (secure 0 0 0) 0x7f1d9c073c40 con 0x7f1dac0b5eb0 2021-03-25T14:17:50.014 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.007+0000 7f1db1a0f700 1 --2- 172.21.15.110:0/2721051756 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f1d8c05a0b0 0x7f1d8c05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:50.014 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.008+0000 7f1db1a0f700 1 --2- 172.21.15.110:0/2721051756 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f1d8c05a0b0 0x7f1d8c05c570 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f1dac14c3c0 tx=0x7f1da8008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:50.015 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.011+0000 7f1d99ffb700 1 -- 172.21.15.110:0/2721051756 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f1d9c047480 con 0x7f1dac0b5eb0 2021-03-25T14:17:50.162 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:50.161+0000 7f1db3c73700 1 -- 172.21.15.110:0/2721051756 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num": 8} v 0) v1 -- 0x7f1dac05d7b0 con 0x7f1dac0b5eb0 2021-03-25T14:17:51.163 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.161+0000 7f1d99ffb700 1 -- 172.21.15.110:0/2721051756 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num": 8}]=0 pool 'cephfs2_metadata' created v57) v1 ==== 135+0+0 (secure 0 0 0) 0x7f1d9c04aaa0 con 0x7f1dac0b5eb0 2021-03-25T14:17:51.166 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.164+0000 7f1db3c73700 1 -- 172.21.15.110:0/2721051756 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f1d8c05a0b0 msgr2=0x7f1d8c05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:51.167 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.164+0000 7f1db3c73700 1 --2- 172.21.15.110:0/2721051756 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f1d8c05a0b0 0x7f1d8c05c570 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f1dac14c3c0 tx=0x7f1da8008040).stop 2021-03-25T14:17:51.167 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.164+0000 7f1db3c73700 1 -- 172.21.15.110:0/2721051756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dac0b5eb0 msgr2=0x7f1dac13cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:51.167 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.164+0000 7f1db3c73700 1 --2- 172.21.15.110:0/2721051756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dac0b5eb0 0x7f1dac13cbf0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f1d9c00c7c0 tx=0x7f1d9c007af0).stop 2021-03-25T14:17:51.167 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.164+0000 7f1db3c73700 1 -- 172.21.15.110:0/2721051756 shutdown_connections 2021-03-25T14:17:51.167 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.164+0000 7f1db3c73700 1 --2- 172.21.15.110:0/2721051756 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f1d8c05a0b0 0x7f1d8c05c570 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:51.167 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.164+0000 7f1db3c73700 1 --2- 172.21.15.110:0/2721051756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1dac068d50 0x7f1dac14f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:51.167 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.164+0000 7f1db3c73700 1 --2- 172.21.15.110:0/2721051756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1dac14ce50 0x7f1dac13d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:51.167 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.164+0000 7f1db3c73700 1 --2- 172.21.15.110:0/2721051756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dac0b5eb0 0x7f1dac13cbf0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:51.167 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.164+0000 7f1db3c73700 1 -- 172.21.15.110:0/2721051756 >> 172.21.15.110:0/2721051756 conn(0x7f1dac0bc430 msgr2=0x7f1dac063d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:51.167 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.164+0000 7f1db3c73700 1 -- 172.21.15.110:0/2721051756 shutdown_connections 2021-03-25T14:17:51.167 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.164+0000 7f1db3c73700 1 -- 172.21.15.110:0/2721051756 wait complete. 2021-03-25T14:17:51.168 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs2_metadata' created 2021-03-25T14:17:51.180 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 8 2021-03-25T14:17:51.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.297+0000 7fe5c0c43700 1 Processor -- start 2021-03-25T14:17:51.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.297+0000 7fe5c0c43700 1 -- start start 2021-03-25T14:17:51.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.298+0000 7fe5c0c43700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe5bc0b8700 0x7fe5bc0bc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:51.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.298+0000 7fe5c0c43700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5bc0bc8f0 con 0x7fe5bc146430 2021-03-25T14:17:51.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.298+0000 7fe5c0c43700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5bc09f490 con 0x7fe5bc0b8fe0 2021-03-25T14:17:51.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.298+0000 7fe5c0c43700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc09f730 con 0x7fe5bc0b8700 2021-03-25T14:17:51.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.298+0000 7fe5bbfff700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fe5bc146430 0x7fe5bc143670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43580/0 (socket says 172.21.15.110:43580) 2021-03-25T14:17:51.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.298+0000 7fe5bbfff700 1 -- 172.21.15.110:0/3854217276 learned_addr learned my addr 172.21.15.110:0/3854217276 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:51.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.298+0000 7fe5bb7fe700 1 --2- 172.21.15.110:0/3854217276 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe5bc0b8700 0x7fe5bc0bc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:51.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.298+0000 7fe5ba7fc700 1 -- 172.21.15.110:0/3854217276 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1146867173 0 0) 0x7fe5bc0bc8f0 con 0x7fe5bc146430 2021-03-25T14:17:51.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.298+0000 7fe5ba7fc700 1 -- 172.21.15.110:0/3854217276 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5a8003270 con 0x7fe5bc146430 2021-03-25T14:17:51.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.299+0000 7fe5ba7fc700 1 -- 172.21.15.110:0/3854217276 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 89571703 0 0) 0x7fe5bc09f490 con 0x7fe5bc0b8fe0 2021-03-25T14:17:51.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.299+0000 7fe5ba7fc700 1 -- 172.21.15.110:0/3854217276 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5bc0bc8f0 con 0x7fe5bc0b8fe0 2021-03-25T14:17:51.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.299+0000 7fe5ba7fc700 1 -- 172.21.15.110:0/3854217276 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3354778791 0 0) 0x7fe5a8003270 con 0x7fe5bc146430 2021-03-25T14:17:51.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.299+0000 7fe5ba7fc700 1 -- 172.21.15.110:0/3854217276 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe5bc0b8700 msgr2=0x7fe5bc0bc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:51.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.299+0000 7fe5ba7fc700 1 --2- 172.21.15.110:0/3854217276 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe5bc0b8700 0x7fe5bc0bc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:51.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.299+0000 7fe5ba7fc700 1 -- 172.21.15.110:0/3854217276 >> v1:172.21.15.174:6789/0 conn(0x7fe5bc0b8fe0 legacy=0x7fe5bc09eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:51.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.299+0000 7fe5ba7fc700 1 -- 172.21.15.110:0/3854217276 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5bc0bba20 con 0x7fe5bc146430 2021-03-25T14:17:51.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.299+0000 7fe5ba7fc700 1 -- 172.21.15.110:0/3854217276 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7fe5b4001820 con 0x7fe5bc146430 2021-03-25T14:17:51.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.299+0000 7fe5ba7fc700 1 -- 172.21.15.110:0/3854217276 >> v1:172.21.15.110:6789/0 conn(0x7fe5bc146430 legacy=0x7fe5bc143670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:51.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.299+0000 7fe5ba7fc700 1 --2- 172.21.15.110:0/3854217276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5a8003920 0x7fe5a8003d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:51.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.299+0000 7fe5ba7fc700 1 --2- 172.21.15.110:0/3854217276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5a8004510 0x7fe5a8004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:51.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.299+0000 7fe5ba7fc700 1 --2- 172.21.15.110:0/3854217276 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe5a8004e80 0x7fe5a800b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:51.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.299+0000 7fe5ba7fc700 1 -- 172.21.15.110:0/3854217276 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc09f730 con 0x7fe5a8004510 2021-03-25T14:17:51.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.299+0000 7fe5ba7fc700 1 -- 172.21.15.110:0/3854217276 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a80053b0 con 0x7fe5a8003920 2021-03-25T14:17:51.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.299+0000 7fe5ba7fc700 1 -- 172.21.15.110:0/3854217276 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a800bca0 con 0x7fe5a8004e80 2021-03-25T14:17:51.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.299+0000 7fe5bb7fe700 1 --2- 172.21.15.110:0/3854217276 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe5bc0b8700 0x7fe5bc0bc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:17:51.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.299+0000 7fe5baffd700 1 --2- 172.21.15.110:0/3854217276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5a8004510 0x7fe5a8004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:51.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.299+0000 7fe5bbfff700 1 --2- 172.21.15.110:0/3854217276 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe5a8004e80 0x7fe5a800b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:51.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.299+0000 7fe5bb7fe700 1 --2- 172.21.15.110:0/3854217276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5a8003920 0x7fe5a8003d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:51.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.299+0000 7fe5baffd700 1 -- 172.21.15.110:0/3854217276 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe5a8004e80 msgr2=0x7fe5a800b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:51.309 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.299+0000 7fe5baffd700 1 --2- 172.21.15.110:0/3854217276 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe5a8004e80 0x7fe5a800b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:51.309 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.299+0000 7fe5baffd700 1 -- 172.21.15.110:0/3854217276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5a8003920 msgr2=0x7fe5a8003d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:51.309 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.299+0000 7fe5baffd700 1 --2- 172.21.15.110:0/3854217276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5a8003920 0x7fe5a8003d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:51.309 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.299+0000 7fe5baffd700 1 -- 172.21.15.110:0/3854217276 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a8003270 con 0x7fe5a8004510 2021-03-25T14:17:51.309 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.299+0000 7fe5baffd700 1 --2- 172.21.15.110:0/3854217276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5a8004510 0x7fe5a8004990 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7fe5b0001ae0 tx=0x7fe5b0007ba0).ready entity=mon.0 client_cookie=ef4d7ee254585c93 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:51.309 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.299+0000 7fe5ba7fc700 1 -- 172.21.15.110:0/3854217276 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b000c7e0 con 0x7fe5a8004510 2021-03-25T14:17:51.309 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.299+0000 7fe5ba7fc700 1 -- 172.21.15.110:0/3854217276 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b000c940 con 0x7fe5a8004510 2021-03-25T14:17:51.309 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.299+0000 7fe5ba7fc700 1 -- 172.21.15.110:0/3854217276 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b000ccc0 con 0x7fe5a8004510 2021-03-25T14:17:51.309 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.300+0000 7fe5c0c43700 1 -- 172.21.15.110:0/3854217276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5a8004510 msgr2=0x7fe5a8004990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:51.309 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.300+0000 7fe5c0c43700 1 --2- 172.21.15.110:0/3854217276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5a8004510 0x7fe5a8004990 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7fe5b0001ae0 tx=0x7fe5b0007ba0).stop 2021-03-25T14:17:51.309 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.300+0000 7fe5bbfff700 1 -- 172.21.15.110:0/3854217276 reap_dead start 2021-03-25T14:17:51.309 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.300+0000 7fe5c0c43700 1 -- 172.21.15.110:0/3854217276 shutdown_connections 2021-03-25T14:17:51.310 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.300+0000 7fe5c0c43700 1 -- 172.21.15.110:0/3854217276 >> 172.21.15.110:0/3854217276 conn(0x7fe5bc05c700 msgr2=0x7fe5bc0664d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:51.310 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.300+0000 7fe5c0c43700 1 -- 172.21.15.110:0/3854217276 shutdown_connections 2021-03-25T14:17:51.310 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.300+0000 7fe5c0c43700 1 -- 172.21.15.110:0/3854217276 wait complete. 2021-03-25T14:17:51.310 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.301+0000 7fe5c0c43700 1 Processor -- start 2021-03-25T14:17:51.310 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.301+0000 7fe5c0c43700 1 -- start start 2021-03-25T14:17:51.310 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.302+0000 7fe5c0c43700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe5a8004510 0x7fe5bc14d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:51.310 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.302+0000 7fe5c0c43700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5bc14d550 0x7fe5bc155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:51.310 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.302+0000 7fe5c0c43700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5bc0a1610 0x7fe5bc156260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:51.310 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.302+0000 7fe5c0c43700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc0a1330 con 0x7fe5bc0a1610 2021-03-25T14:17:51.310 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.302+0000 7fe5c0c43700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc1489c0 con 0x7fe5bc14d550 2021-03-25T14:17:51.310 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.302+0000 7fe5c0c43700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc1481e0 con 0x7fe5a8004510 2021-03-25T14:17:51.310 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.302+0000 7fe5bbfff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5bc0a1610 0x7fe5bc156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:51.311 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.302+0000 7fe5bbfff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5bc0a1610 0x7fe5bc156260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50658/0 (socket says 172.21.15.110:50658) 2021-03-25T14:17:51.311 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.302+0000 7fe5bbfff700 1 -- 172.21.15.110:0/273952974 learned_addr learned my addr 172.21.15.110:0/273952974 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:51.311 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.302+0000 7fe5bb7fe700 1 --2- 172.21.15.110:0/273952974 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe5a8004510 0x7fe5bc14d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:51.311 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.302+0000 7fe5baffd700 1 --2- 172.21.15.110:0/273952974 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5bc14d550 0x7fe5bc155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:51.311 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.302+0000 7fe5bbfff700 1 -- 172.21.15.110:0/273952974 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe5a8004510 msgr2=0x7fe5bc14d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:51.311 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.302+0000 7fe5bbfff700 1 --2- 172.21.15.110:0/273952974 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe5a8004510 0x7fe5bc14d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:51.311 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.302+0000 7fe5bbfff700 1 -- 172.21.15.110:0/273952974 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5bc14d550 msgr2=0x7fe5bc155d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:51.311 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.302+0000 7fe5bbfff700 1 --2- 172.21.15.110:0/273952974 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5bc14d550 0x7fe5bc155d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:51.311 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.302+0000 7fe5bbfff700 1 -- 172.21.15.110:0/273952974 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5bc148480 con 0x7fe5bc0a1610 2021-03-25T14:17:51.311 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.303+0000 7fe5bbfff700 1 --2- 172.21.15.110:0/273952974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5bc0a1610 0x7fe5bc156260 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7fe5bc062c40 tx=0x7fe5b40079c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:51.311 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.303+0000 7fe5a37fe700 1 -- 172.21.15.110:0/273952974 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b400fc30 con 0x7fe5bc0a1610 2021-03-25T14:17:51.311 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.303+0000 7fe5a37fe700 1 -- 172.21.15.110:0/273952974 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b400fd90 con 0x7fe5bc0a1610 2021-03-25T14:17:51.311 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.303+0000 7fe5c0c43700 1 -- 172.21.15.110:0/273952974 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5bc148720 con 0x7fe5bc0a1610 2021-03-25T14:17:51.312 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.303+0000 7fe5a37fe700 1 -- 172.21.15.110:0/273952974 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b4012560 con 0x7fe5bc0a1610 2021-03-25T14:17:51.312 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.303+0000 7fe5c0c43700 1 -- 172.21.15.110:0/273952974 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5bc147e60 con 0x7fe5bc0a1610 2021-03-25T14:17:51.312 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.304+0000 7fe5c0c43700 1 -- 172.21.15.110:0/273952974 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5bc05d540 con 0x7fe5bc0a1610 2021-03-25T14:17:51.312 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.304+0000 7fe5a37fe700 1 -- 172.21.15.110:0/273952974 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fe5b401b030 con 0x7fe5bc0a1610 2021-03-25T14:17:51.313 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.304+0000 7fe5a37fe700 1 --2- 172.21.15.110:0/273952974 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe59c05a0b0 0x7fe59c05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:51.313 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.304+0000 7fe5a37fe700 1 -- 172.21.15.110:0/273952974 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6781+0+0 (secure 0 0 0) 0x7fe5b4073b10 con 0x7fe5bc0a1610 2021-03-25T14:17:51.313 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.305+0000 7fe5bb7fe700 1 --2- 172.21.15.110:0/273952974 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe59c05a0b0 0x7fe59c05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:51.313 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.305+0000 7fe5bb7fe700 1 --2- 172.21.15.110:0/273952974 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe59c05a0b0 0x7fe59c05c570 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fe5bc1439b0 tx=0x7fe5ac008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:51.313 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.308+0000 7fe5a37fe700 1 -- 172.21.15.110:0/273952974 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fe5bc05d540 con 0x7fe5bc0a1610 2021-03-25T14:17:51.459 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:51.457+0000 7fe5c0c43700 1 -- 172.21.15.110:0/273952974 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 8} v 0) v1 -- 0x7fe5bc05d540 con 0x7fe5bc0a1610 2021-03-25T14:17:52.169 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.167+0000 7fe5a37fe700 1 -- 172.21.15.110:0/273952974 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 8}]=0 pool 'cephfs2_data' created v58) v1 ==== 127+0+0 (secure 0 0 0) 0x7fe5bc05d540 con 0x7fe5bc0a1610 2021-03-25T14:17:52.171 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.169+0000 7fe5c0c43700 1 -- 172.21.15.110:0/273952974 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe59c05a0b0 msgr2=0x7fe59c05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:52.171 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.169+0000 7fe5c0c43700 1 --2- 172.21.15.110:0/273952974 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe59c05a0b0 0x7fe59c05c570 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fe5bc1439b0 tx=0x7fe5ac008040).stop 2021-03-25T14:17:52.171 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.169+0000 7fe5c0c43700 1 -- 172.21.15.110:0/273952974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5bc0a1610 msgr2=0x7fe5bc156260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:52.172 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.169+0000 7fe5c0c43700 1 --2- 172.21.15.110:0/273952974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5bc0a1610 0x7fe5bc156260 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7fe5bc062c40 tx=0x7fe5b40079c0).stop 2021-03-25T14:17:52.172 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.169+0000 7fe5c0c43700 1 -- 172.21.15.110:0/273952974 shutdown_connections 2021-03-25T14:17:52.172 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.169+0000 7fe5c0c43700 1 --2- 172.21.15.110:0/273952974 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe59c05a0b0 0x7fe59c05c570 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:52.172 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.169+0000 7fe5c0c43700 1 --2- 172.21.15.110:0/273952974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5bc0a1610 0x7fe5bc156260 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:52.172 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.169+0000 7fe5c0c43700 1 --2- 172.21.15.110:0/273952974 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe5a8004510 0x7fe5bc14d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:52.172 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.169+0000 7fe5c0c43700 1 --2- 172.21.15.110:0/273952974 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5bc14d550 0x7fe5bc155d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:52.172 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.169+0000 7fe5c0c43700 1 -- 172.21.15.110:0/273952974 >> 172.21.15.110:0/273952974 conn(0x7fe5bc05c700 msgr2=0x7fe5bc069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:52.172 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.169+0000 7fe5c0c43700 1 -- 172.21.15.110:0/273952974 shutdown_connections 2021-03-25T14:17:52.172 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.169+0000 7fe5c0c43700 1 -- 172.21.15.110:0/273952974 wait complete. 2021-03-25T14:17:52.173 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs2_data' created 2021-03-25T14:17:52.186 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2021-03-25T14:17:52.299 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.297+0000 7f58a6a56700 1 Processor -- start 2021-03-25T14:17:52.300 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.297+0000 7f58a6a56700 1 -- start start 2021-03-25T14:17:52.305 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.298+0000 7f58a6a56700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f58a0142fe0 0x7f58a0149b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:52.305 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.298+0000 7f58a6a56700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f58a00bc570 0x7f58a00b72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:52.305 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.298+0000 7f58a6a56700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58a00b6630 con 0x7f58a01433c0 2021-03-25T14:17:52.305 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.298+0000 7f58a6a56700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a00b9320 con 0x7f58a00bc570 2021-03-25T14:17:52.305 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.298+0000 7f58a6a56700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a00b68d0 con 0x7f58a0142fe0 2021-03-25T14:17:52.305 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.298+0000 7f58a6255700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f58a00bc570 0x7f58a00b72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:52.305 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.298+0000 7f58a6255700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f58a00bc570 0x7f58a00b72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50666/0 (socket says 172.21.15.110:50666) 2021-03-25T14:17:52.305 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.298+0000 7f58a6255700 1 -- 172.21.15.110:0/1077228077 learned_addr learned my addr 172.21.15.110:0/1077228077 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:52.305 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.299+0000 7f58a5a54700 1 --2- 172.21.15.110:0/1077228077 >> v2:172.21.15.174:3300/0 conn(0x7f58a0142fe0 0x7f58a0149b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:52.305 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.299+0000 7f58a6255700 1 -- 172.21.15.110:0/1077228077 >> v2:172.21.15.174:3300/0 conn(0x7f58a0142fe0 msgr2=0x7f58a0149b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:52.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.299+0000 7f58a6255700 1 --2- 172.21.15.110:0/1077228077 >> v2:172.21.15.174:3300/0 conn(0x7f58a0142fe0 0x7f58a0149b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:52.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.299+0000 7f58a6255700 1 -- 172.21.15.110:0/1077228077 >> v1:172.21.15.174:6789/0 conn(0x7f58a01433c0 legacy=0x7f58a00b7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:52.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.299+0000 7f58a6255700 1 -- 172.21.15.110:0/1077228077 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a00b6b70 con 0x7f58a00bc570 2021-03-25T14:17:52.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.299+0000 7f58a6255700 1 --2- 172.21.15.110:0/1077228077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58a00bc570 0x7f58a00b72b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f58a00660f0 tx=0x7f58980092d0).ready entity=mon.0 client_cookie=392476f7ad6c099a server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:52.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.299+0000 7f58a4a52700 1 -- 172.21.15.110:0/1077228077 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589800bc80 con 0x7f58a00bc570 2021-03-25T14:17:52.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.299+0000 7f58a4a52700 1 -- 172.21.15.110:0/1077228077 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589800bde0 con 0x7f58a00bc570 2021-03-25T14:17:52.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.299+0000 7f58a4a52700 1 -- 172.21.15.110:0/1077228077 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5898011610 con 0x7f58a00bc570 2021-03-25T14:17:52.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.299+0000 7f58a6a56700 1 -- 172.21.15.110:0/1077228077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58a00bc570 msgr2=0x7f58a00b72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:52.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.299+0000 7f58a6a56700 1 --2- 172.21.15.110:0/1077228077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58a00bc570 0x7f58a00b72b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f58a00660f0 tx=0x7f58980092d0).stop 2021-03-25T14:17:52.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.300+0000 7f58a6a56700 1 -- 172.21.15.110:0/1077228077 shutdown_connections 2021-03-25T14:17:52.306 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.300+0000 7f58a6a56700 1 --2- 172.21.15.110:0/1077228077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58a00bc570 0x7f58a00b72b0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:52.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.300+0000 7f58a6a56700 1 --2- 172.21.15.110:0/1077228077 >> v2:172.21.15.174:3300/0 conn(0x7f58a0142fe0 0x7f58a0149b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:52.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.300+0000 7f58a6a56700 1 -- 172.21.15.110:0/1077228077 >> 172.21.15.110:0/1077228077 conn(0x7f58a005c700 msgr2=0x7f58a00664d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:52.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.300+0000 7f58a6a56700 1 -- 172.21.15.110:0/1077228077 shutdown_connections 2021-03-25T14:17:52.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.300+0000 7f58a6a56700 1 -- 172.21.15.110:0/1077228077 wait complete. 2021-03-25T14:17:52.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.301+0000 7f58a6a56700 1 Processor -- start 2021-03-25T14:17:52.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.301+0000 7f58a6a56700 1 -- start start 2021-03-25T14:17:52.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.301+0000 7f58a6a56700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58a00bc570 0x7f58a0143830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:52.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.301+0000 7f58a6a56700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58a0142fe0 0x7f58a0159790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:52.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.301+0000 7f58a6a56700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58a01433c0 0x7f58a00a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:52.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.301+0000 7f58a6a56700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a0158bc0 con 0x7f58a01433c0 2021-03-25T14:17:52.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.301+0000 7f58a6a56700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a0144460 con 0x7f58a00bc570 2021-03-25T14:17:52.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.301+0000 7f58a6a56700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a0143e60 con 0x7f58a0142fe0 2021-03-25T14:17:52.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.301+0000 7f58a6255700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58a01433c0 0x7f58a00a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:52.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.301+0000 7f58a6255700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58a01433c0 0x7f58a00a17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50672/0 (socket says 172.21.15.110:50672) 2021-03-25T14:17:52.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.301+0000 7f58a6255700 1 -- 172.21.15.110:0/3624760023 learned_addr learned my addr 172.21.15.110:0/3624760023 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:52.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.302+0000 7f58a5a54700 1 --2- 172.21.15.110:0/3624760023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58a00bc570 0x7f58a0143830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:52.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.302+0000 7f58a5253700 1 --2- 172.21.15.110:0/3624760023 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58a0142fe0 0x7f58a0159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:52.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.302+0000 7f58a6255700 1 -- 172.21.15.110:0/3624760023 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58a0142fe0 msgr2=0x7f58a0159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:52.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.302+0000 7f58a6255700 1 --2- 172.21.15.110:0/3624760023 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58a0142fe0 0x7f58a0159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:52.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.302+0000 7f58a6255700 1 -- 172.21.15.110:0/3624760023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58a00bc570 msgr2=0x7f58a0143830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:52.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.302+0000 7f58a6255700 1 --2- 172.21.15.110:0/3624760023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58a00bc570 0x7f58a0143830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:52.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.302+0000 7f58a6255700 1 -- 172.21.15.110:0/3624760023 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a0158db0 con 0x7f58a01433c0 2021-03-25T14:17:52.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.302+0000 7f58a6255700 1 --2- 172.21.15.110:0/3624760023 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58a01433c0 0x7f58a00a17e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f5898009310 tx=0x7f5898017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:52.309 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.302+0000 7f588dffb700 1 -- 172.21.15.110:0/3624760023 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589800bc80 con 0x7f58a01433c0 2021-03-25T14:17:52.309 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.302+0000 7f588dffb700 1 -- 172.21.15.110:0/3624760023 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5898011e30 con 0x7f58a01433c0 2021-03-25T14:17:52.309 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.302+0000 7f58a6a56700 1 -- 172.21.15.110:0/3624760023 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58a0159050 con 0x7f58a01433c0 2021-03-25T14:17:52.309 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.302+0000 7f588dffb700 1 -- 172.21.15.110:0/3624760023 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5898009ea0 con 0x7f58a01433c0 2021-03-25T14:17:52.309 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.302+0000 7f58a6a56700 1 -- 172.21.15.110:0/3624760023 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a00a1cd0 con 0x7f58a01433c0 2021-03-25T14:17:52.309 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.303+0000 7f58a6a56700 1 -- 172.21.15.110:0/3624760023 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58a0045ae0 con 0x7f58a01433c0 2021-03-25T14:17:52.310 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.304+0000 7f588dffb700 1 -- 172.21.15.110:0/3624760023 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f589800f070 con 0x7f58a01433c0 2021-03-25T14:17:52.310 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.304+0000 7f588dffb700 1 --2- 172.21.15.110:0/3624760023 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f588005a0b0 0x7f588005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:52.310 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.304+0000 7f588dffb700 1 -- 172.21.15.110:0/3624760023 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 7132+0+0 (secure 0 0 0) 0x7f5898075c80 con 0x7f58a01433c0 2021-03-25T14:17:52.310 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.304+0000 7f58a5a54700 1 --2- 172.21.15.110:0/3624760023 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f588005a0b0 0x7f588005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:52.310 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.304+0000 7f58a5a54700 1 --2- 172.21.15.110:0/3624760023 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f588005a0b0 0x7f588005c570 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f589c006fd0 tx=0x7f589c008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:52.310 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.308+0000 7f588dffb700 1 -- 172.21.15.110:0/3624760023 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f5898049200 con 0x7f58a01433c0 2021-03-25T14:17:52.495 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.493+0000 7f58a6a56700 1 -- 172.21.15.110:0/3624760023 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7f58a00b5ed0 con 0x7f58a01433c0 2021-03-25T14:17:52.499 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.498+0000 7f588dffb700 1 -- 172.21.15.110:0/3624760023 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 12 and data pool 13 v29) v1 ==== 177+0+0 (secure 0 0 0) 0x7f589804c820 con 0x7f58a01433c0 2021-03-25T14:17:52.504 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.500+0000 7f58a6a56700 1 -- 172.21.15.110:0/3624760023 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f588005a0b0 msgr2=0x7f588005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:52.504 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.501+0000 7f58a6a56700 1 --2- 172.21.15.110:0/3624760023 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f588005a0b0 0x7f588005c570 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f589c006fd0 tx=0x7f589c008040).stop 2021-03-25T14:17:52.504 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.501+0000 7f58a6a56700 1 -- 172.21.15.110:0/3624760023 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58a01433c0 msgr2=0x7f58a00a17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:52.504 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.501+0000 7f58a6a56700 1 --2- 172.21.15.110:0/3624760023 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58a01433c0 0x7f58a00a17e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f5898009310 tx=0x7f5898017000).stop 2021-03-25T14:17:52.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.501+0000 7f58a6a56700 1 -- 172.21.15.110:0/3624760023 shutdown_connections 2021-03-25T14:17:52.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.501+0000 7f58a6a56700 1 --2- 172.21.15.110:0/3624760023 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f588005a0b0 0x7f588005c570 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:52.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.501+0000 7f58a6a56700 1 --2- 172.21.15.110:0/3624760023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58a00bc570 0x7f58a0143830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:52.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.501+0000 7f58a6a56700 1 --2- 172.21.15.110:0/3624760023 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58a01433c0 0x7f58a00a17e0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:52.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.501+0000 7f58a6a56700 1 --2- 172.21.15.110:0/3624760023 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58a0142fe0 0x7f58a0159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:52.506 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.501+0000 7f58a6a56700 1 -- 172.21.15.110:0/3624760023 >> 172.21.15.110:0/3624760023 conn(0x7f58a005c700 msgr2=0x7f58a0066820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:52.506 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.501+0000 7f58a6a56700 1 -- 172.21.15.110:0/3624760023 shutdown_connections 2021-03-25T14:17:52.506 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.501+0000 7f58a6a56700 1 -- 172.21.15.110:0/3624760023 wait complete. 2021-03-25T14:17:52.507 INFO:teuthology.orchestra.run.smithi110.stderr:new fs with metadata pool 12 and data pool 13 2021-03-25T14:17:52.521 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:17:52.630 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.628+0000 7f05cc3e2700 1 Processor -- start 2021-03-25T14:17:52.630 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.628+0000 7f05cc3e2700 1 -- start start 2021-03-25T14:17:52.637 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.629+0000 7f05cc3e2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f05c4067840 0x7f05c4145070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:52.637 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.629+0000 7f05cc3e2700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05c40afee0 con 0x7f05c40bbca0 2021-03-25T14:17:52.637 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.629+0000 7f05cc3e2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05c4145b10 con 0x7f05c4068ac0 2021-03-25T14:17:52.637 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.629+0000 7f05cc3e2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c4067c80 con 0x7f05c4067840 2021-03-25T14:17:52.637 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.629+0000 7f05ca17e700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f05c40bbca0 0x7f05c40acf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43620/0 (socket says 172.21.15.110:43620) 2021-03-25T14:17:52.638 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.629+0000 7f05ca17e700 1 -- 172.21.15.110:0/1618374088 learned_addr learned my addr 172.21.15.110:0/1618374088 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:52.638 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.630+0000 7f05c917c700 1 -- 172.21.15.110:0/1618374088 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1860389635 0 0) 0x7f05c40afee0 con 0x7f05c40bbca0 2021-03-25T14:17:52.638 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.630+0000 7f05c917c700 1 -- 172.21.15.110:0/1618374088 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05ac003270 con 0x7f05c40bbca0 2021-03-25T14:17:52.638 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.630+0000 7f05ca97f700 1 --2- 172.21.15.110:0/1618374088 >> v2:172.21.15.174:3300/0 conn(0x7f05c4067840 0x7f05c4145070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:52.638 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.630+0000 7f05c917c700 1 -- 172.21.15.110:0/1618374088 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2397288998 0 0) 0x7f05ac003270 con 0x7f05c40bbca0 2021-03-25T14:17:52.638 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.630+0000 7f05c917c700 1 -- 172.21.15.110:0/1618374088 >> v2:172.21.15.174:3300/0 conn(0x7f05c4067840 msgr2=0x7f05c4145070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:52.638 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.630+0000 7f05c917c700 1 --2- 172.21.15.110:0/1618374088 >> v2:172.21.15.174:3300/0 conn(0x7f05c4067840 0x7f05c4145070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:52.638 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.630+0000 7f05c917c700 1 -- 172.21.15.110:0/1618374088 >> v1:172.21.15.174:6789/0 conn(0x7f05c4068ac0 legacy=0x7f05c4144960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:52.638 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.630+0000 7f05c917c700 1 -- 172.21.15.110:0/1618374088 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c4145d40 con 0x7f05c40bbca0 2021-03-25T14:17:52.638 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.630+0000 7f05c917c700 1 -- 172.21.15.110:0/1618374088 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f05b4001520 con 0x7f05c40bbca0 2021-03-25T14:17:52.638 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.630+0000 7f05c917c700 1 -- 172.21.15.110:0/1618374088 >> v1:172.21.15.110:6789/0 conn(0x7f05c40bbca0 legacy=0x7f05c40acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:52.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.630+0000 7f05c917c700 1 --2- 172.21.15.110:0/1618374088 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05ac003760 0x7f05ac003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:52.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.630+0000 7f05c917c700 1 --2- 172.21.15.110:0/1618374088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05ac004510 0x7f05ac004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:52.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.630+0000 7f05c917c700 1 --2- 172.21.15.110:0/1618374088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05ac004e80 0x7f05ac00b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:52.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.630+0000 7f05c917c700 1 -- 172.21.15.110:0/1618374088 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c4067c80 con 0x7f05ac004e80 2021-03-25T14:17:52.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.630+0000 7f05c917c700 1 -- 172.21.15.110:0/1618374088 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ac004290 con 0x7f05ac004510 2021-03-25T14:17:52.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.630+0000 7f05c917c700 1 -- 172.21.15.110:0/1618374088 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05ac00de60 con 0x7f05ac003760 2021-03-25T14:17:52.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.630+0000 7f05ca97f700 1 --2- 172.21.15.110:0/1618374088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05ac004e80 0x7f05ac00b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:52.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.630+0000 7f05c997d700 1 --2- 172.21.15.110:0/1618374088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05ac004510 0x7f05ac004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:52.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.630+0000 7f05ca17e700 1 --2- 172.21.15.110:0/1618374088 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05ac003760 0x7f05ac003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:52.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.630+0000 7f05ca97f700 1 -- 172.21.15.110:0/1618374088 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05ac003760 msgr2=0x7f05ac003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:52.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.630+0000 7f05ca97f700 1 --2- 172.21.15.110:0/1618374088 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05ac003760 0x7f05ac003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:52.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.630+0000 7f05ca97f700 1 -- 172.21.15.110:0/1618374088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05ac004510 msgr2=0x7f05ac004990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:52.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.630+0000 7f05ca97f700 1 --2- 172.21.15.110:0/1618374088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05ac004510 0x7f05ac004990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:52.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.630+0000 7f05ca97f700 1 -- 172.21.15.110:0/1618374088 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ac003270 con 0x7f05ac004e80 2021-03-25T14:17:52.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.630+0000 7f05c997d700 1 --2- 172.21.15.110:0/1618374088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05ac004510 0x7f05ac004990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:17:52.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.631+0000 7f05ca97f700 1 -- 172.21.15.110:0/1618374088 reap_dead start 2021-03-25T14:17:52.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.631+0000 7f05ca97f700 1 --2- 172.21.15.110:0/1618374088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05ac004e80 0x7f05ac00b760 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f05bc009ed0 tx=0x7f05bc009220).ready entity=mon.0 client_cookie=61f634b4ce254667 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:52.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.631+0000 7f05c917c700 1 -- 172.21.15.110:0/1618374088 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05bc0095f0 con 0x7f05ac004e80 2021-03-25T14:17:52.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.631+0000 7f05c917c700 1 -- 172.21.15.110:0/1618374088 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05bc00ec80 con 0x7f05ac004e80 2021-03-25T14:17:52.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.631+0000 7f05c917c700 1 -- 172.21.15.110:0/1618374088 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05bc0123f0 con 0x7f05ac004e80 2021-03-25T14:17:52.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.631+0000 7f05cc3e2700 1 -- 172.21.15.110:0/1618374088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05ac004e80 msgr2=0x7f05ac00b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:52.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.631+0000 7f05cc3e2700 1 --2- 172.21.15.110:0/1618374088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05ac004e80 0x7f05ac00b760 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f05bc009ed0 tx=0x7f05bc009220).stop 2021-03-25T14:17:52.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.631+0000 7f05cc3e2700 1 -- 172.21.15.110:0/1618374088 shutdown_connections 2021-03-25T14:17:52.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.631+0000 7f05cc3e2700 1 --2- 172.21.15.110:0/1618374088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05ac004e80 0x7f05ac00b760 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:52.641 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.631+0000 7f05cc3e2700 1 -- 172.21.15.110:0/1618374088 >> 172.21.15.110:0/1618374088 conn(0x7f05c4063850 msgr2=0x7f05c405c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:52.641 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.631+0000 7f05cc3e2700 1 -- 172.21.15.110:0/1618374088 shutdown_connections 2021-03-25T14:17:52.641 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.631+0000 7f05cc3e2700 1 -- 172.21.15.110:0/1618374088 wait complete. 2021-03-25T14:17:52.641 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.632+0000 7f05cc3e2700 1 Processor -- start 2021-03-25T14:17:52.641 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.632+0000 7f05cc3e2700 1 -- start start 2021-03-25T14:17:52.641 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.633+0000 7f05cc3e2700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05ac004e80 0x7f05c41546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:52.641 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.633+0000 7f05cc3e2700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05c40b01d0 0x7f05c40b9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:52.641 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.633+0000 7f05cc3e2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05c40b3630 0x7f05c41431b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:52.641 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.633+0000 7f05cc3e2700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c4154bd0 con 0x7f05c40b01d0 2021-03-25T14:17:52.641 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.633+0000 7f05cc3e2700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c40b0a00 con 0x7f05ac004e80 2021-03-25T14:17:52.641 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.633+0000 7f05cc3e2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c40b0ca0 con 0x7f05c40b3630 2021-03-25T14:17:52.641 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.633+0000 7f05c997d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05c40b01d0 0x7f05c40b9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:52.642 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.633+0000 7f05c997d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05c40b01d0 0x7f05c40b9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50698/0 (socket says 172.21.15.110:50698) 2021-03-25T14:17:52.642 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.633+0000 7f05c997d700 1 -- 172.21.15.110:0/1364782713 learned_addr learned my addr 172.21.15.110:0/1364782713 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:52.642 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.633+0000 7f05ca17e700 1 --2- 172.21.15.110:0/1364782713 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05ac004e80 0x7f05c41546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:52.642 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.633+0000 7f05ca97f700 1 --2- 172.21.15.110:0/1364782713 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05c40b3630 0x7f05c41431b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:52.642 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.633+0000 7f05c997d700 1 -- 172.21.15.110:0/1364782713 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05c40b3630 msgr2=0x7f05c41431b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:52.642 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.633+0000 7f05c997d700 1 --2- 172.21.15.110:0/1364782713 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05c40b3630 0x7f05c41431b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:52.642 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.633+0000 7f05c997d700 1 -- 172.21.15.110:0/1364782713 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05ac004e80 msgr2=0x7f05c41546e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:52.642 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.633+0000 7f05c997d700 1 --2- 172.21.15.110:0/1364782713 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05ac004e80 0x7f05c41546e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:52.642 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.633+0000 7f05c997d700 1 -- 172.21.15.110:0/1364782713 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c40b0f40 con 0x7f05c40b01d0 2021-03-25T14:17:52.642 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.634+0000 7f05c997d700 1 --2- 172.21.15.110:0/1364782713 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05c40b01d0 0x7f05c40b9910 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f05c000fb50 tx=0x7f05c0009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:52.642 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.634+0000 7f05b27fc700 1 -- 172.21.15.110:0/1364782713 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c000d850 con 0x7f05c40b01d0 2021-03-25T14:17:52.642 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.634+0000 7f05b27fc700 1 -- 172.21.15.110:0/1364782713 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c000d9b0 con 0x7f05c40b01d0 2021-03-25T14:17:52.643 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.634+0000 7f05cc3e2700 1 -- 172.21.15.110:0/1364782713 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c40b11e0 con 0x7f05c40b01d0 2021-03-25T14:17:52.643 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.634+0000 7f05b27fc700 1 -- 172.21.15.110:0/1364782713 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c000dd30 con 0x7f05c40b01d0 2021-03-25T14:17:52.643 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.634+0000 7f05cc3e2700 1 -- 172.21.15.110:0/1364782713 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c40b9e00 con 0x7f05c40b01d0 2021-03-25T14:17:52.643 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.634+0000 7f05cc3e2700 1 -- 172.21.15.110:0/1364782713 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c405d7b0 con 0x7f05c40b01d0 2021-03-25T14:17:52.643 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.635+0000 7f05b27fc700 1 -- 172.21.15.110:0/1364782713 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f05c001a030 con 0x7f05c40b01d0 2021-03-25T14:17:52.643 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.635+0000 7f05b27fc700 1 --2- 172.21.15.110:0/1364782713 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f05a405a0b0 0x7f05a405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:52.643 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.635+0000 7f05b27fc700 1 -- 172.21.15.110:0/1364782713 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 7250+0+0 (secure 0 0 0) 0x7f05c0073a30 con 0x7f05c40b01d0 2021-03-25T14:17:52.643 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.635+0000 7f05ca17e700 1 --2- 172.21.15.110:0/1364782713 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f05a405a0b0 0x7f05a405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:52.643 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.636+0000 7f05ca17e700 1 --2- 172.21.15.110:0/1364782713 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f05a405a0b0 0x7f05a405c570 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f05b4001650 tx=0x7f05c4145ed0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:52.644 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.639+0000 7f05b27fc700 1 -- 172.21.15.110:0/1364782713 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f05c0046620 con 0x7f05c40b01d0 2021-03-25T14:17:52.790 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.789+0000 7f05cc3e2700 1 -- 172.21.15.110:0/1364782713 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05c4061c50 con 0x7f05c40b01d0 2021-03-25T14:17:52.826 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.790+0000 7f05b27fc700 1 -- 172.21.15.110:0/1364782713 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+20282 (secure 0 0 0) 0x7f05c0026f50 con 0x7f05c40b01d0 2021-03-25T14:17:52.827 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:52.827 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":59,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:17:52.495270+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2021-03-25T14:17:40.271092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2021-03-25T14:17:41.271977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":12,"pool_name":"cephfs2_metadata","create_time":"2021-03-25T14:17:50.184585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}}},{"pool":13,"pool_name":"cephfs2_data","create_time":"2021-03-25T14:17:51.481411+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs2"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:17:52.829 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.791+0000 7f05cc3e2700 1 -- 172.21.15.110:0/1364782713 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f05a405a0b0 msgr2=0x7f05a405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:52.829 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.791+0000 7f05cc3e2700 1 --2- 172.21.15.110:0/1364782713 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f05a405a0b0 0x7f05a405c570 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f05b4001650 tx=0x7f05c4145ed0).stop 2021-03-25T14:17:52.829 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.791+0000 7f05cc3e2700 1 -- 172.21.15.110:0/1364782713 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05c40b01d0 msgr2=0x7f05c40b9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:52.829 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.791+0000 7f05cc3e2700 1 --2- 172.21.15.110:0/1364782713 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05c40b01d0 0x7f05c40b9910 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f05c000fb50 tx=0x7f05c0009040).stop 2021-03-25T14:17:52.829 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.791+0000 7f05cc3e2700 1 -- 172.21.15.110:0/1364782713 shutdown_connections 2021-03-25T14:17:52.829 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.791+0000 7f05cc3e2700 1 --2- 172.21.15.110:0/1364782713 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f05a405a0b0 0x7f05a405c570 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:52.829 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.791+0000 7f05cc3e2700 1 --2- 172.21.15.110:0/1364782713 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05ac004e80 0x7f05c41546e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:52.829 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.791+0000 7f05cc3e2700 1 --2- 172.21.15.110:0/1364782713 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05c40b3630 0x7f05c41431b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:52.829 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.791+0000 7f05cc3e2700 1 --2- 172.21.15.110:0/1364782713 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05c40b01d0 0x7f05c40b9910 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:52.829 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.791+0000 7f05cc3e2700 1 -- 172.21.15.110:0/1364782713 >> 172.21.15.110:0/1364782713 conn(0x7f05c4063850 msgr2=0x7f05c40acf30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:52.830 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.791+0000 7f05cc3e2700 1 -- 172.21.15.110:0/1364782713 shutdown_connections 2021-03-25T14:17:52.830 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.791+0000 7f05cc3e2700 1 -- 172.21.15.110:0/1364782713 wait complete. 2021-03-25T14:17:52.830 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:17:52.940 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.938+0000 7f063b1a3700 1 Processor -- start 2021-03-25T14:17:52.940 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.938+0000 7f063b1a3700 1 -- start start 2021-03-25T14:17:52.944 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.939+0000 7f063b1a3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f06340675d0 0x7f06340b1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:52.944 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.939+0000 7f063b1a3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06340bc220 0x7f063414cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:52.944 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.939+0000 7f063b1a3700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06340bafc0 con 0x7f063414d0a0 2021-03-25T14:17:52.944 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.939+0000 7f063b1a3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f063414d530 con 0x7f06340675d0 2021-03-25T14:17:52.944 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.939+0000 7f063b1a3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06340b1830 con 0x7f06340bc220 2021-03-25T14:17:52.944 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.939+0000 7f0639740700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f063414d0a0 0x7f0634148970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43640/0 (socket says 172.21.15.110:43640) 2021-03-25T14:17:52.944 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.939+0000 7f0639740700 1 -- 172.21.15.110:0/1509652401 learned_addr learned my addr 172.21.15.110:0/1509652401 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:52.945 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.939+0000 7f0638f3f700 1 --2- 172.21.15.110:0/1509652401 >> v2:172.21.15.174:3300/0 conn(0x7f06340675d0 0x7f06340b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:52.945 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.939+0000 7f0633fff700 1 --2- 172.21.15.110:0/1509652401 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06340bc220 0x7f063414cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:52.945 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.939+0000 7f06337fe700 1 -- 172.21.15.110:0/1509652401 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2697722326 0 0) 0x7f06340bafc0 con 0x7f063414d0a0 2021-03-25T14:17:52.945 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.939+0000 7f06337fe700 1 -- 172.21.15.110:0/1509652401 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0618003270 con 0x7f063414d0a0 2021-03-25T14:17:52.945 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.940+0000 7f06337fe700 1 -- 172.21.15.110:0/1509652401 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2466820164 0 0) 0x7f0618003270 con 0x7f063414d0a0 2021-03-25T14:17:52.945 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.940+0000 7f06337fe700 1 -- 172.21.15.110:0/1509652401 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06340bc220 msgr2=0x7f063414cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:52.945 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.940+0000 7f06337fe700 1 --2- 172.21.15.110:0/1509652401 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06340bc220 0x7f063414cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:52.945 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.940+0000 7f06337fe700 1 -- 172.21.15.110:0/1509652401 >> v2:172.21.15.174:3300/0 conn(0x7f06340675d0 msgr2=0x7f06340b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:52.945 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.940+0000 7f06337fe700 1 --2- 172.21.15.110:0/1509652401 >> v2:172.21.15.174:3300/0 conn(0x7f06340675d0 0x7f06340b1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:52.945 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.940+0000 7f06337fe700 1 -- 172.21.15.110:0/1509652401 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06340baa80 con 0x7f063414d0a0 2021-03-25T14:17:52.945 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.940+0000 7f06337fe700 1 -- 172.21.15.110:0/1509652401 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f062c0018a0 con 0x7f063414d0a0 2021-03-25T14:17:52.945 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.940+0000 7f06337fe700 1 -- 172.21.15.110:0/1509652401 >> v1:172.21.15.110:6789/0 conn(0x7f063414d0a0 legacy=0x7f0634148970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:52.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.940+0000 7f06337fe700 1 --2- 172.21.15.110:0/1509652401 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0618003760 0x7f0618003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:52.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.940+0000 7f06337fe700 1 --2- 172.21.15.110:0/1509652401 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06340bc220 0x7f0618004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:52.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.940+0000 7f06337fe700 1 --2- 172.21.15.110:0/1509652401 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0618004a00 0x7f0618004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:52.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.940+0000 7f06337fe700 1 -- 172.21.15.110:0/1509652401 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063414d530 con 0x7f0618003760 2021-03-25T14:17:52.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.940+0000 7f06337fe700 1 -- 172.21.15.110:0/1509652401 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06340b1830 con 0x7f0618004a00 2021-03-25T14:17:52.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.940+0000 7f06337fe700 1 -- 172.21.15.110:0/1509652401 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0618004200 con 0x7f06340bc220 2021-03-25T14:17:52.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.940+0000 7f0638f3f700 1 --2- 172.21.15.110:0/1509652401 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0618003760 0x7f0618003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:52.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.940+0000 7f0633fff700 1 --2- 172.21.15.110:0/1509652401 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06340bc220 0x7f0618004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:52.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.940+0000 7f0639740700 1 --2- 172.21.15.110:0/1509652401 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0618004a00 0x7f0618004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:52.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.940+0000 7f0638f3f700 1 -- 172.21.15.110:0/1509652401 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06340bc220 msgr2=0x7f0618004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:52.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.940+0000 7f0638f3f700 1 --2- 172.21.15.110:0/1509652401 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06340bc220 0x7f0618004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:52.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.940+0000 7f0638f3f700 1 -- 172.21.15.110:0/1509652401 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0618004a00 msgr2=0x7f0618004e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:52.947 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.940+0000 7f0638f3f700 1 --2- 172.21.15.110:0/1509652401 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0618004a00 0x7f0618004e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:52.947 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.940+0000 7f0638f3f700 1 -- 172.21.15.110:0/1509652401 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0618003270 con 0x7f0618003760 2021-03-25T14:17:52.947 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.940+0000 7f0638f3f700 1 --2- 172.21.15.110:0/1509652401 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0618003760 0x7f0618003b80 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f062800bc30 tx=0x7f0628006e20).ready entity=mon.0 client_cookie=5a93324c814b131e server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:52.947 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.940+0000 7f06337fe700 1 -- 172.21.15.110:0/1509652401 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062800b310 con 0x7f0618003760 2021-03-25T14:17:52.947 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.940+0000 7f06337fe700 1 -- 172.21.15.110:0/1509652401 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062800e9a0 con 0x7f0618003760 2021-03-25T14:17:52.947 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.940+0000 7f06337fe700 1 -- 172.21.15.110:0/1509652401 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062800ed20 con 0x7f0618003760 2021-03-25T14:17:52.947 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.941+0000 7f063b1a3700 1 -- 172.21.15.110:0/1509652401 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0618003760 msgr2=0x7f0618003b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:52.947 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.941+0000 7f063b1a3700 1 --2- 172.21.15.110:0/1509652401 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0618003760 0x7f0618003b80 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f062800bc30 tx=0x7f0628006e20).stop 2021-03-25T14:17:52.947 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.941+0000 7f0639740700 1 -- 172.21.15.110:0/1509652401 reap_dead start 2021-03-25T14:17:52.948 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.941+0000 7f063b1a3700 1 -- 172.21.15.110:0/1509652401 shutdown_connections 2021-03-25T14:17:52.948 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.941+0000 7f063b1a3700 1 -- 172.21.15.110:0/1509652401 >> 172.21.15.110:0/1509652401 conn(0x7f0634064a10 msgr2=0x7f063405c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:52.948 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.941+0000 7f063b1a3700 1 -- 172.21.15.110:0/1509652401 shutdown_connections 2021-03-25T14:17:52.948 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.941+0000 7f063b1a3700 1 -- 172.21.15.110:0/1509652401 wait complete. 2021-03-25T14:17:52.948 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.942+0000 7f063b1a3700 1 Processor -- start 2021-03-25T14:17:52.948 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.942+0000 7f063b1a3700 1 -- start start 2021-03-25T14:17:52.951 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.943+0000 7f063b1a3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0618003760 0x7f06341596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:52.951 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.943+0000 7f063b1a3700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0634159b90 0x7f06340bffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:52.951 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.943+0000 7f063b1a3700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0634158ed0 0x7f06340b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:52.951 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.943+0000 7f063b1a3700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06340b78e0 con 0x7f0634159b90 2021-03-25T14:17:52.951 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.943+0000 7f063b1a3700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06340b7b80 con 0x7f0634158ed0 2021-03-25T14:17:52.951 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.943+0000 7f063b1a3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06340b7e20 con 0x7f0618003760 2021-03-25T14:17:52.951 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.943+0000 7f0633fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0634159b90 0x7f06340bffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:52.951 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.943+0000 7f0633fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0634159b90 0x7f06340bffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50718/0 (socket says 172.21.15.110:50718) 2021-03-25T14:17:52.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.943+0000 7f0633fff700 1 -- 172.21.15.110:0/2848591049 learned_addr learned my addr 172.21.15.110:0/2848591049 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:52.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.943+0000 7f0638f3f700 1 --2- 172.21.15.110:0/2848591049 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0618003760 0x7f06341596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:52.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.943+0000 7f0639740700 1 --2- 172.21.15.110:0/2848591049 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0634158ed0 0x7f06340b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:52.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.943+0000 7f0633fff700 1 -- 172.21.15.110:0/2848591049 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0618003760 msgr2=0x7f06341596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:52.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.943+0000 7f0633fff700 1 --2- 172.21.15.110:0/2848591049 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0618003760 0x7f06341596a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:52.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.943+0000 7f0633fff700 1 -- 172.21.15.110:0/2848591049 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0634158ed0 msgr2=0x7f06340b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:52.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.943+0000 7f0633fff700 1 --2- 172.21.15.110:0/2848591049 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0634158ed0 0x7f06340b4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:52.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.943+0000 7f0633fff700 1 -- 172.21.15.110:0/2848591049 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063415c620 con 0x7f0634159b90 2021-03-25T14:17:52.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.943+0000 7f0639740700 1 --2- 172.21.15.110:0/2848591049 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0634158ed0 0x7f06340b4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:17:52.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.943+0000 7f0633fff700 1 --2- 172.21.15.110:0/2848591049 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0634159b90 0x7f06340bffb0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f0620011cc0 tx=0x7f0620006e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:52.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.943+0000 7f0630ff9700 1 -- 172.21.15.110:0/2848591049 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062000fa40 con 0x7f0634159b90 2021-03-25T14:17:52.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.943+0000 7f0630ff9700 1 -- 172.21.15.110:0/2848591049 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062000fba0 con 0x7f0634159b90 2021-03-25T14:17:52.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.943+0000 7f063b1a3700 1 -- 172.21.15.110:0/2848591049 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06340b74f0 con 0x7f0634159b90 2021-03-25T14:17:52.953 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.943+0000 7f0630ff9700 1 -- 172.21.15.110:0/2848591049 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0620014440 con 0x7f0634159b90 2021-03-25T14:17:52.953 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.943+0000 7f063b1a3700 1 -- 172.21.15.110:0/2848591049 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06340c06e0 con 0x7f0634159b90 2021-03-25T14:17:52.953 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.944+0000 7f063b1a3700 1 -- 172.21.15.110:0/2848591049 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0634068850 con 0x7f0634159b90 2021-03-25T14:17:52.953 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.945+0000 7f0630ff9700 1 -- 172.21.15.110:0/2848591049 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f0620024070 con 0x7f0634159b90 2021-03-25T14:17:52.953 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.945+0000 7f0630ff9700 1 --2- 172.21.15.110:0/2848591049 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f061405a0b0 0x7f061405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:52.953 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.945+0000 7f0630ff9700 1 -- 172.21.15.110:0/2848591049 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 7250+0+0 (secure 0 0 0) 0x7f0620074c30 con 0x7f0634159b90 2021-03-25T14:17:52.953 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.945+0000 7f0638f3f700 1 --2- 172.21.15.110:0/2848591049 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f061405a0b0 0x7f061405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:52.953 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.945+0000 7f0638f3f700 1 --2- 172.21.15.110:0/2848591049 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f061405a0b0 0x7f061405c570 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f0628007fd0 tx=0x7f0628019000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:52.953 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:52.949+0000 7f0630ff9700 1 -- 172.21.15.110:0/2848591049 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f0620048130 con 0x7f0634159b90 2021-03-25T14:17:53.099 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.098+0000 7f063b1a3700 1 -- 172.21.15.110:0/2848591049 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06340b7680 con 0x7f0634159b90 2021-03-25T14:17:53.100 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.099+0000 7f0630ff9700 1 -- 172.21.15.110:0/2848591049 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+20282 (secure 0 0 0) 0x7f062004b750 con 0x7f0634159b90 2021-03-25T14:17:53.101 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:53.101 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":59,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:17:52.495270+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2021-03-25T14:17:40.271092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2021-03-25T14:17:41.271977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":12,"pool_name":"cephfs2_metadata","create_time":"2021-03-25T14:17:50.184585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}}},{"pool":13,"pool_name":"cephfs2_data","create_time":"2021-03-25T14:17:51.481411+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs2"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:17:53.103 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.100+0000 7f063b1a3700 1 -- 172.21.15.110:0/2848591049 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f061405a0b0 msgr2=0x7f061405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:53.103 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.100+0000 7f063b1a3700 1 --2- 172.21.15.110:0/2848591049 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f061405a0b0 0x7f061405c570 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f0628007fd0 tx=0x7f0628019000).stop 2021-03-25T14:17:53.103 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.100+0000 7f063b1a3700 1 -- 172.21.15.110:0/2848591049 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0634159b90 msgr2=0x7f06340bffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:53.103 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.100+0000 7f063b1a3700 1 --2- 172.21.15.110:0/2848591049 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0634159b90 0x7f06340bffb0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f0620011cc0 tx=0x7f0620006e20).stop 2021-03-25T14:17:53.103 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.100+0000 7f063b1a3700 1 -- 172.21.15.110:0/2848591049 shutdown_connections 2021-03-25T14:17:53.103 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.100+0000 7f063b1a3700 1 --2- 172.21.15.110:0/2848591049 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f061405a0b0 0x7f061405c570 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:53.103 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.100+0000 7f063b1a3700 1 --2- 172.21.15.110:0/2848591049 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0634158ed0 0x7f06340b4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:53.103 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.100+0000 7f063b1a3700 1 --2- 172.21.15.110:0/2848591049 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0618003760 0x7f06341596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:53.103 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.100+0000 7f063b1a3700 1 --2- 172.21.15.110:0/2848591049 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0634159b90 0x7f06340bffb0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:53.103 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.100+0000 7f063b1a3700 1 -- 172.21.15.110:0/2848591049 >> 172.21.15.110:0/2848591049 conn(0x7f0634064a10 msgr2=0x7f06340b9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:53.103 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.101+0000 7f063b1a3700 1 -- 172.21.15.110:0/2848591049 shutdown_connections 2021-03-25T14:17:53.103 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.101+0000 7f063b1a3700 1 -- 172.21.15.110:0/2848591049 wait complete. 2021-03-25T14:17:53.115 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2021-03-25T14:17:53.229 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.227+0000 7feb61692700 1 Processor -- start 2021-03-25T14:17:53.309 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.227+0000 7feb61692700 1 -- start start 2021-03-25T14:17:53.314 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.228+0000 7feb61692700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7feb5c14d470 0x7feb5c14d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:53.314 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.228+0000 7feb61692700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb5c0685d0 0x7feb5c068a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:53.314 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.228+0000 7feb61692700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb5c0691b0 con 0x7feb5c14cc90 2021-03-25T14:17:53.314 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.228+0000 7feb61692700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb5c0bc2b0 con 0x7feb5c14d470 2021-03-25T14:17:53.314 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.228+0000 7feb61692700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb5c149dd0 con 0x7feb5c0685d0 2021-03-25T14:17:53.315 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.228+0000 7feb5affd700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7feb5c14d470 0x7feb5c14d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:53.315 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.228+0000 7feb5affd700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7feb5c14d470 0x7feb5c14d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50724/0 (socket says 172.21.15.110:50724) 2021-03-25T14:17:53.315 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.228+0000 7feb5affd700 1 -- 172.21.15.110:0/2877395784 learned_addr learned my addr 172.21.15.110:0/2877395784 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:53.315 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.228+0000 7feb53fff700 1 --1- 172.21.15.110:0/2877395784 >> v1:172.21.15.110:6789/0 conn(0x7feb5c14cc90 0x7feb5c1493c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43660/0 (socket says 172.21.15.110:43660) 2021-03-25T14:17:53.315 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.229+0000 7feb5b7fe700 1 --2- 172.21.15.110:0/2877395784 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb5c0685d0 0x7feb5c068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:53.315 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.229+0000 7feb5affd700 1 -- 172.21.15.110:0/2877395784 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb5c0685d0 msgr2=0x7feb5c068a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:53.315 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.229+0000 7feb5affd700 1 --2- 172.21.15.110:0/2877395784 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb5c0685d0 0x7feb5c068a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:53.315 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.229+0000 7feb5affd700 1 -- 172.21.15.110:0/2877395784 >> v1:172.21.15.110:6789/0 conn(0x7feb5c14cc90 legacy=0x7feb5c1493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:53.315 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.229+0000 7feb5a7fc700 1 -- 172.21.15.110:0/2877395784 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1881114763 0 0) 0x7feb5c0691b0 con 0x7feb5c14cc90 2021-03-25T14:17:53.315 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.229+0000 7feb5affd700 1 -- 172.21.15.110:0/2877395784 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb5c14a070 con 0x7feb5c14d470 2021-03-25T14:17:53.315 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.229+0000 7feb5affd700 1 --2- 172.21.15.110:0/2877395784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb5c14d470 0x7feb5c14d850 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7feb4c00ba20 tx=0x7feb4c006ee0).ready entity=mon.0 client_cookie=bad2d0a6e1b89219 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:53.315 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.229+0000 7feb5a7fc700 1 -- 172.21.15.110:0/2877395784 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4c0098d0 con 0x7feb5c14d470 2021-03-25T14:17:53.316 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.229+0000 7feb5a7fc700 1 -- 172.21.15.110:0/2877395784 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb4c009a30 con 0x7feb5c14d470 2021-03-25T14:17:53.316 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.229+0000 7feb5a7fc700 1 -- 172.21.15.110:0/2877395784 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4c009db0 con 0x7feb5c14d470 2021-03-25T14:17:53.316 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.229+0000 7feb61692700 1 -- 172.21.15.110:0/2877395784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb5c14d470 msgr2=0x7feb5c14d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:53.316 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.229+0000 7feb61692700 1 --2- 172.21.15.110:0/2877395784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb5c14d470 0x7feb5c14d850 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7feb4c00ba20 tx=0x7feb4c006ee0).stop 2021-03-25T14:17:53.316 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.229+0000 7feb61692700 1 -- 172.21.15.110:0/2877395784 shutdown_connections 2021-03-25T14:17:53.316 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.229+0000 7feb61692700 1 --2- 172.21.15.110:0/2877395784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb5c14d470 0x7feb5c14d850 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:53.316 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.229+0000 7feb61692700 1 --2- 172.21.15.110:0/2877395784 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb5c0685d0 0x7feb5c068a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:53.316 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.230+0000 7feb61692700 1 -- 172.21.15.110:0/2877395784 >> 172.21.15.110:0/2877395784 conn(0x7feb5c060c40 msgr2=0x7feb5c061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:53.316 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.230+0000 7feb61692700 1 -- 172.21.15.110:0/2877395784 shutdown_connections 2021-03-25T14:17:53.316 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.230+0000 7feb61692700 1 -- 172.21.15.110:0/2877395784 wait complete. 2021-03-25T14:17:53.316 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.231+0000 7feb61692700 1 Processor -- start 2021-03-25T14:17:53.316 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.231+0000 7feb61692700 1 -- start start 2021-03-25T14:17:53.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.231+0000 7feb61692700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb5c0685d0 0x7feb5c0a31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:53.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.231+0000 7feb61692700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb5c14cc90 0x7feb5c146cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:53.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.231+0000 7feb61692700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb5c14d470 0x7feb5c15c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:53.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.231+0000 7feb61692700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5c0a44a0 con 0x7feb5c14d470 2021-03-25T14:17:53.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.231+0000 7feb61692700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5c0a4740 con 0x7feb5c14cc90 2021-03-25T14:17:53.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.231+0000 7feb61692700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb5c0b8640 con 0x7feb5c0685d0 2021-03-25T14:17:53.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.231+0000 7feb5b7fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb5c14d470 0x7feb5c15c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:53.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.231+0000 7feb5b7fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb5c14d470 0x7feb5c15c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50734/0 (socket says 172.21.15.110:50734) 2021-03-25T14:17:53.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.231+0000 7feb5b7fe700 1 -- 172.21.15.110:0/2545056461 learned_addr learned my addr 172.21.15.110:0/2545056461 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:53.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.232+0000 7feb5affd700 1 --2- 172.21.15.110:0/2545056461 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb5c0685d0 0x7feb5c0a31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:53.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.232+0000 7feb53fff700 1 --2- 172.21.15.110:0/2545056461 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb5c14cc90 0x7feb5c146cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:53.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.232+0000 7feb5b7fe700 1 -- 172.21.15.110:0/2545056461 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb5c0685d0 msgr2=0x7feb5c0a31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:53.318 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.232+0000 7feb5b7fe700 1 --2- 172.21.15.110:0/2545056461 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb5c0685d0 0x7feb5c0a31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:53.318 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.232+0000 7feb5b7fe700 1 -- 172.21.15.110:0/2545056461 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb5c14cc90 msgr2=0x7feb5c146cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:53.318 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.232+0000 7feb5b7fe700 1 --2- 172.21.15.110:0/2545056461 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb5c14cc90 0x7feb5c146cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:53.318 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.232+0000 7feb5b7fe700 1 -- 172.21.15.110:0/2545056461 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb5c0b88e0 con 0x7feb5c14d470 2021-03-25T14:17:53.318 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.232+0000 7feb5b7fe700 1 --2- 172.21.15.110:0/2545056461 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb5c14d470 0x7feb5c15c130 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7feb5400cb20 tx=0x7feb54008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:53.318 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.232+0000 7feb52ffd700 1 -- 172.21.15.110:0/2545056461 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb540077e0 con 0x7feb5c14d470 2021-03-25T14:17:53.318 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.232+0000 7feb52ffd700 1 -- 172.21.15.110:0/2545056461 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb54007940 con 0x7feb5c14d470 2021-03-25T14:17:53.318 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.232+0000 7feb52ffd700 1 -- 172.21.15.110:0/2545056461 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb54007ce0 con 0x7feb5c14d470 2021-03-25T14:17:53.318 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.232+0000 7feb61692700 1 -- 172.21.15.110:0/2545056461 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb5c0bb390 con 0x7feb5c14d470 2021-03-25T14:17:53.318 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.232+0000 7feb61692700 1 -- 172.21.15.110:0/2545056461 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb5c0a3730 con 0x7feb5c14d470 2021-03-25T14:17:53.319 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.233+0000 7feb61692700 1 -- 172.21.15.110:0/2545056461 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb5c0b9dd0 con 0x7feb5c14d470 2021-03-25T14:17:53.319 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.233+0000 7feb52ffd700 1 -- 172.21.15.110:0/2545056461 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7feb54011620 con 0x7feb5c14d470 2021-03-25T14:17:53.319 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.234+0000 7feb52ffd700 1 --2- 172.21.15.110:0/2545056461 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7feb4005a0b0 0x7feb4005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:53.319 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.234+0000 7feb52ffd700 1 -- 172.21.15.110:0/2545056461 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 7250+0+0 (secure 0 0 0) 0x7feb540745c0 con 0x7feb5c14d470 2021-03-25T14:17:53.319 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.234+0000 7feb5affd700 1 --2- 172.21.15.110:0/2545056461 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7feb4005a0b0 0x7feb4005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:53.319 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.234+0000 7feb5affd700 1 --2- 172.21.15.110:0/2545056461 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7feb4005a0b0 0x7feb4005c570 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7feb4c00b1d0 tx=0x7feb4c016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:53.319 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.237+0000 7feb52ffd700 1 -- 172.21.15.110:0/2545056461 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7feb54047ac0 con 0x7feb5c14d470 2021-03-25T14:17:53.425 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.423+0000 7feb61692700 1 -- 172.21.15.110:0/2545056461 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7feb5c0a3920 con 0x7feb5c14d470 2021-03-25T14:17:53.500 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.498+0000 7feb52ffd700 1 -- 172.21.15.110:0/2545056461 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v30) v1 ==== 119+0+0 (secure 0 0 0) 0x7feb5404b0e0 con 0x7feb5c14d470 2021-03-25T14:17:53.502 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.500+0000 7feb61692700 1 -- 172.21.15.110:0/2545056461 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7feb4005a0b0 msgr2=0x7feb4005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:53.502 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.500+0000 7feb61692700 1 --2- 172.21.15.110:0/2545056461 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7feb4005a0b0 0x7feb4005c570 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7feb4c00b1d0 tx=0x7feb4c016000).stop 2021-03-25T14:17:53.502 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.500+0000 7feb61692700 1 -- 172.21.15.110:0/2545056461 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb5c14d470 msgr2=0x7feb5c15c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:53.502 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.500+0000 7feb61692700 1 --2- 172.21.15.110:0/2545056461 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb5c14d470 0x7feb5c15c130 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7feb5400cb20 tx=0x7feb54008040).stop 2021-03-25T14:17:53.502 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.500+0000 7feb61692700 1 -- 172.21.15.110:0/2545056461 shutdown_connections 2021-03-25T14:17:53.503 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.500+0000 7feb61692700 1 --2- 172.21.15.110:0/2545056461 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7feb4005a0b0 0x7feb4005c570 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:53.503 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.500+0000 7feb61692700 1 --2- 172.21.15.110:0/2545056461 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb5c14d470 0x7feb5c15c130 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:53.503 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.500+0000 7feb61692700 1 --2- 172.21.15.110:0/2545056461 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb5c0685d0 0x7feb5c0a31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:53.503 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.500+0000 7feb61692700 1 --2- 172.21.15.110:0/2545056461 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb5c14cc90 0x7feb5c146cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:53.503 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.500+0000 7feb61692700 1 -- 172.21.15.110:0/2545056461 >> 172.21.15.110:0/2545056461 conn(0x7feb5c060c40 msgr2=0x7feb5c0c0740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:53.503 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.500+0000 7feb61692700 1 -- 172.21.15.110:0/2545056461 shutdown_connections 2021-03-25T14:17:53.503 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.500+0000 7feb61692700 1 -- 172.21.15.110:0/2545056461 wait complete. 2021-03-25T14:17:53.514 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-03-25T14:17:53.623 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.621+0000 7fc8b59ab700 1 Processor -- start 2021-03-25T14:17:53.624 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.621+0000 7fc8b59ab700 1 -- start start 2021-03-25T14:17:53.626 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.622+0000 7fc8b59ab700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc8b00bbca0 0x7fc8b0067840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:53.626 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.622+0000 7fc8b59ab700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc8b0144960 0x7fc8b0144da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:53.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.622+0000 7fc8b59ab700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8b00afee0 con 0x7fc8b0068ac0 2021-03-25T14:17:53.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.622+0000 7fc8b59ab700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8b0145d40 con 0x7fc8b00bbca0 2021-03-25T14:17:53.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.622+0000 7fc8b59ab700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8b0145fe0 con 0x7fc8b0144960 2021-03-25T14:17:53.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.622+0000 7fc8aeffd700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc8b00bbca0 0x7fc8b0067840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:53.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.622+0000 7fc8aeffd700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc8b00bbca0 0x7fc8b0067840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50738/0 (socket says 172.21.15.110:50738) 2021-03-25T14:17:53.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.622+0000 7fc8aeffd700 1 -- 172.21.15.110:0/1891725199 learned_addr learned my addr 172.21.15.110:0/1891725199 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:53.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.622+0000 7fc8af7fe700 1 --2- 172.21.15.110:0/1891725199 >> v2:172.21.15.174:3300/0 conn(0x7fc8b0144960 0x7fc8b0144da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:53.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.623+0000 7fc8aeffd700 1 -- 172.21.15.110:0/1891725199 >> v2:172.21.15.174:3300/0 conn(0x7fc8b0144960 msgr2=0x7fc8b0144da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:53.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.623+0000 7fc8aeffd700 1 --2- 172.21.15.110:0/1891725199 >> v2:172.21.15.174:3300/0 conn(0x7fc8b0144960 0x7fc8b0144da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:53.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.623+0000 7fc8aeffd700 1 -- 172.21.15.110:0/1891725199 >> v1:172.21.15.174:6789/0 conn(0x7fc8b0068ac0 legacy=0x7fc8b00acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:53.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.623+0000 7fc8aeffd700 1 -- 172.21.15.110:0/1891725199 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b0145b10 con 0x7fc8b00bbca0 2021-03-25T14:17:53.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.623+0000 7fc8aeffd700 1 --2- 172.21.15.110:0/1891725199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8b00bbca0 0x7fc8b0067840 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7fc8b0068f40 tx=0x7fc8a0006f70).ready entity=mon.0 client_cookie=fd19564ea0813597 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:53.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.623+0000 7fc8adffb700 1 -- 172.21.15.110:0/1891725199 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a000caf0 con 0x7fc8b00bbca0 2021-03-25T14:17:53.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.623+0000 7fc8adffb700 1 -- 172.21.15.110:0/1891725199 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a000cc50 con 0x7fc8b00bbca0 2021-03-25T14:17:53.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.623+0000 7fc8adffb700 1 -- 172.21.15.110:0/1891725199 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a0010410 con 0x7fc8b00bbca0 2021-03-25T14:17:53.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.623+0000 7fc8b59ab700 1 -- 172.21.15.110:0/1891725199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8b00bbca0 msgr2=0x7fc8b0067840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:53.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.623+0000 7fc8b59ab700 1 --2- 172.21.15.110:0/1891725199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8b00bbca0 0x7fc8b0067840 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7fc8b0068f40 tx=0x7fc8a0006f70).stop 2021-03-25T14:17:53.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.623+0000 7fc8b59ab700 1 -- 172.21.15.110:0/1891725199 shutdown_connections 2021-03-25T14:17:53.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.623+0000 7fc8b59ab700 1 --2- 172.21.15.110:0/1891725199 >> v2:172.21.15.174:3300/0 conn(0x7fc8b0144960 0x7fc8b0144da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:53.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.623+0000 7fc8b59ab700 1 --2- 172.21.15.110:0/1891725199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8b00bbca0 0x7fc8b0067840 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:53.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.623+0000 7fc8b59ab700 1 -- 172.21.15.110:0/1891725199 >> 172.21.15.110:0/1891725199 conn(0x7fc8b0063850 msgr2=0x7fc8b005c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:53.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.623+0000 7fc8b59ab700 1 -- 172.21.15.110:0/1891725199 shutdown_connections 2021-03-25T14:17:53.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.623+0000 7fc8b59ab700 1 -- 172.21.15.110:0/1891725199 wait complete. 2021-03-25T14:17:53.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.625+0000 7fc8b59ab700 1 Processor -- start 2021-03-25T14:17:53.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.625+0000 7fc8b59ab700 1 -- start start 2021-03-25T14:17:53.632 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.625+0000 7fc8b59ab700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8b0068ac0 0x7fc8b00bb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:53.632 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.625+0000 7fc8b59ab700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8b00bbca0 0x7fc8b015bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:53.632 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.625+0000 7fc8b59ab700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc8b0144960 0x7fc8b015c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:53.632 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.625+0000 7fc8b59ab700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b00b66b0 con 0x7fc8b0068ac0 2021-03-25T14:17:53.632 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.625+0000 7fc8b59ab700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b0158d80 con 0x7fc8b00bbca0 2021-03-25T14:17:53.632 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.625+0000 7fc8b59ab700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b0159020 con 0x7fc8b0144960 2021-03-25T14:17:53.632 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.625+0000 7fc8aeffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8b0068ac0 0x7fc8b00bb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:53.632 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.625+0000 7fc8aeffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8b0068ac0 0x7fc8b00bb060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50744/0 (socket says 172.21.15.110:50744) 2021-03-25T14:17:53.632 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.625+0000 7fc8aeffd700 1 -- 172.21.15.110:0/1622369656 learned_addr learned my addr 172.21.15.110:0/1622369656 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:53.632 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.625+0000 7fc8af7fe700 1 --2- 172.21.15.110:0/1622369656 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc8b0144960 0x7fc8b015c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:53.633 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.626+0000 7fc8ae7fc700 1 --2- 172.21.15.110:0/1622369656 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8b00bbca0 0x7fc8b015bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:53.633 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.626+0000 7fc8aeffd700 1 -- 172.21.15.110:0/1622369656 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc8b0144960 msgr2=0x7fc8b015c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:53.633 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.626+0000 7fc8aeffd700 1 --2- 172.21.15.110:0/1622369656 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc8b0144960 0x7fc8b015c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:53.633 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.626+0000 7fc8aeffd700 1 -- 172.21.15.110:0/1622369656 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8b00bbca0 msgr2=0x7fc8b015bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:53.633 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.626+0000 7fc8aeffd700 1 --2- 172.21.15.110:0/1622369656 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8b00bbca0 0x7fc8b015bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:53.633 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.626+0000 7fc8aeffd700 1 -- 172.21.15.110:0/1622369656 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b01592c0 con 0x7fc8b0068ac0 2021-03-25T14:17:53.633 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.626+0000 7fc8ae7fc700 1 --2- 172.21.15.110:0/1622369656 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8b00bbca0 0x7fc8b015bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:53.633 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.626+0000 7fc8af7fe700 1 --2- 172.21.15.110:0/1622369656 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc8b0144960 0x7fc8b015c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:53.633 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.626+0000 7fc8aeffd700 1 --2- 172.21.15.110:0/1622369656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8b0068ac0 0x7fc8b00bb060 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7fc8a0006a20 tx=0x7fc8b00aedd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:53.633 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.626+0000 7fc896ffd700 1 -- 172.21.15.110:0/1622369656 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a001a710 con 0x7fc8b0068ac0 2021-03-25T14:17:53.633 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.626+0000 7fc896ffd700 1 -- 172.21.15.110:0/1622369656 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a001a870 con 0x7fc8b0068ac0 2021-03-25T14:17:53.633 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.626+0000 7fc8b59ab700 1 -- 172.21.15.110:0/1622369656 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8b0158a70 con 0x7fc8b0068ac0 2021-03-25T14:17:53.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.626+0000 7fc896ffd700 1 -- 172.21.15.110:0/1622369656 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a001abf0 con 0x7fc8b0068ac0 2021-03-25T14:17:53.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.626+0000 7fc8b59ab700 1 -- 172.21.15.110:0/1622369656 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8b00b6280 con 0x7fc8b0068ac0 2021-03-25T14:17:53.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.627+0000 7fc8b59ab700 1 -- 172.21.15.110:0/1622369656 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8b00b6470 con 0x7fc8b0068ac0 2021-03-25T14:17:53.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.627+0000 7fc896ffd700 1 -- 172.21.15.110:0/1622369656 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fc8a000e040 con 0x7fc8b0068ac0 2021-03-25T14:17:53.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.627+0000 7fc896ffd700 1 --2- 172.21.15.110:0/1622369656 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc89005a0b0 0x7fc89005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:53.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.627+0000 7fc896ffd700 1 -- 172.21.15.110:0/1622369656 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 7250+0+0 (secure 0 0 0) 0x7fc8a0075b80 con 0x7fc8b0068ac0 2021-03-25T14:17:53.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.628+0000 7fc8ae7fc700 1 --2- 172.21.15.110:0/1622369656 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc89005a0b0 0x7fc89005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:53.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.628+0000 7fc8ae7fc700 1 --2- 172.21.15.110:0/1622369656 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc89005a0b0 0x7fc89005c570 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fc8b00b5a70 tx=0x7fc8a4009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:53.635 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.631+0000 7fc896ffd700 1 -- 172.21.15.110:0/1622369656 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fc8b00b6470 con 0x7fc8b0068ac0 2021-03-25T14:17:53.817 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.815+0000 7fc8b59ab700 1 -- 172.21.15.110:0/1622369656 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8b00b6470 con 0x7fc8b0068ac0 2021-03-25T14:17:53.818 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.816+0000 7fc896ffd700 1 -- 172.21.15.110:0/1622369656 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+3779 (secure 0 0 0) 0x7fc8b00b6470 con 0x7fc8b0068ac0 2021-03-25T14:17:53.818 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:53.818 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4997,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/3015251726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3015251726},{"type":"v1","addr":"172.21.15.174:6835","nonce":3015251726}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":24},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/1698368640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1698368640},{"type":"v1","addr":"172.21.15.174:6833","nonce":1698368640}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-03-25T14:17:42.344725+0000","modified":"2021-03-25T14:17:43.345825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5604":{"gid":5604,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6836/426511293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":426511293},{"type":"v1","addr":"172.21.15.110:6836","nonce":426511293}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-03-25T14:17:52.495440+0000","modified":"2021-03-25T14:17:53.496776+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5601},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5601":{"gid":5601,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":5,"addr":"172.21.15.110:6837/2143874763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":2143874763},{"type":"v1","addr":"172.21.15.110:6837","nonce":2143874763}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs2","balancer":"","standby_count_wanted":0},"id":5}]} 2021-03-25T14:17:53.821 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.817+0000 7fc8b59ab700 1 -- 172.21.15.110:0/1622369656 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc89005a0b0 msgr2=0x7fc89005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:53.821 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.817+0000 7fc8b59ab700 1 --2- 172.21.15.110:0/1622369656 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc89005a0b0 0x7fc89005c570 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fc8b00b5a70 tx=0x7fc8a4009040).stop 2021-03-25T14:17:53.821 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.817+0000 7fc8b59ab700 1 -- 172.21.15.110:0/1622369656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8b0068ac0 msgr2=0x7fc8b00bb060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:53.821 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.817+0000 7fc8b59ab700 1 --2- 172.21.15.110:0/1622369656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8b0068ac0 0x7fc8b00bb060 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7fc8a0006a20 tx=0x7fc8b00aedd0).stop 2021-03-25T14:17:53.821 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.817+0000 7fc8b59ab700 1 -- 172.21.15.110:0/1622369656 shutdown_connections 2021-03-25T14:17:53.821 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.818+0000 7fc8b59ab700 1 --2- 172.21.15.110:0/1622369656 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc89005a0b0 0x7fc89005c570 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:53.821 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.818+0000 7fc8b59ab700 1 --2- 172.21.15.110:0/1622369656 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc8b0144960 0x7fc8b015c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:53.821 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.818+0000 7fc8b59ab700 1 --2- 172.21.15.110:0/1622369656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8b0068ac0 0x7fc8b00bb060 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:53.821 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.818+0000 7fc8b59ab700 1 --2- 172.21.15.110:0/1622369656 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8b00bbca0 0x7fc8b015bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:53.822 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.818+0000 7fc8b59ab700 1 -- 172.21.15.110:0/1622369656 >> 172.21.15.110:0/1622369656 conn(0x7fc8b0063850 msgr2=0x7fc8b00af3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:53.822 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.818+0000 7fc8b59ab700 1 -- 172.21.15.110:0/1622369656 shutdown_connections 2021-03-25T14:17:53.822 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.818+0000 7fc8b59ab700 1 -- 172.21.15.110:0/1622369656 wait complete. 2021-03-25T14:17:53.822 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 30 2021-03-25T14:17:53.831 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:17:53.942 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.940+0000 7fdd4ebbb700 1 Processor -- start 2021-03-25T14:17:53.942 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.940+0000 7fdd4ebbb700 1 -- start start 2021-03-25T14:17:53.944 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.941+0000 7fdd4ebbb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd480b9730 0x7fdd4814cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:53.945 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.941+0000 7fdd4ebbb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdd480667d0 0x7fdd4814d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:53.945 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.941+0000 7fdd4ebbb700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd48064840 con 0x7fdd480a1f20 2021-03-25T14:17:53.945 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.941+0000 7fdd4ebbb700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd480a1b90 con 0x7fdd480667d0 2021-03-25T14:17:53.945 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.941+0000 7fdd4ebbb700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd48064680 con 0x7fdd480b9730 2021-03-25T14:17:53.945 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.941+0000 7fdd4c957700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd480b9730 0x7fdd4814cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:53.945 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.941+0000 7fdd47fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdd480667d0 0x7fdd4814d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:53.945 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.941+0000 7fdd47fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdd480667d0 0x7fdd4814d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.110:49404/0 (socket says 172.21.15.110:49404) 2021-03-25T14:17:53.945 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.941+0000 7fdd4d158700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fdd480a1f20 0x7fdd48148b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.110:51356/0 (socket says 172.21.15.110:51356) 2021-03-25T14:17:53.945 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.941+0000 7fdd4c957700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd480b9730 0x7fdd4814cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.110:43152/0 (socket says 172.21.15.110:43152) 2021-03-25T14:17:53.945 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.941+0000 7fdd47fff700 1 -- 172.21.15.110:0/2332172775 learned_addr learned my addr 172.21.15.110:0/2332172775 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:53.945 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.941+0000 7fdd4c957700 1 -- 172.21.15.110:0/2332172775 >> v2:172.21.15.174:3300/0 conn(0x7fdd480667d0 msgr2=0x7fdd4814d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:53.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.941+0000 7fdd4c957700 1 --2- 172.21.15.110:0/2332172775 >> v2:172.21.15.174:3300/0 conn(0x7fdd480667d0 0x7fdd4814d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:53.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.941+0000 7fdd4c957700 1 -- 172.21.15.110:0/2332172775 >> v1:172.21.15.174:6789/0 conn(0x7fdd480a1f20 legacy=0x7fdd48148b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:53.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.941+0000 7fdd4c957700 1 -- 172.21.15.110:0/2332172775 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd48064ae0 con 0x7fdd480b9730 2021-03-25T14:17:53.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.941+0000 7fdd47fff700 1 --2- 172.21.15.110:0/2332172775 >> v2:172.21.15.174:3300/0 conn(0x7fdd480667d0 0x7fdd4814d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:17:53.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.942+0000 7fdd4c957700 1 --2- 172.21.15.110:0/2332172775 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd480b9730 0x7fdd4814cc40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fdd3c00b9c0 tx=0x7fdd3c006e20).ready entity=mon.2 client_cookie=5e7629cdc58de70a server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:53.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.942+0000 7fdd477fe700 1 -- 172.21.15.110:0/2332172775 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c009870 con 0x7fdd480b9730 2021-03-25T14:17:53.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.942+0000 7fdd477fe700 1 -- 172.21.15.110:0/2332172775 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3c0099d0 con 0x7fdd480b9730 2021-03-25T14:17:53.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.942+0000 7fdd477fe700 1 -- 172.21.15.110:0/2332172775 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c009d50 con 0x7fdd480b9730 2021-03-25T14:17:53.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.942+0000 7fdd4ebbb700 1 -- 172.21.15.110:0/2332172775 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd480b9730 msgr2=0x7fdd4814cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:53.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.942+0000 7fdd4ebbb700 1 --2- 172.21.15.110:0/2332172775 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd480b9730 0x7fdd4814cc40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fdd3c00b9c0 tx=0x7fdd3c006e20).stop 2021-03-25T14:17:53.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.942+0000 7fdd4ebbb700 1 -- 172.21.15.110:0/2332172775 shutdown_connections 2021-03-25T14:17:53.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.942+0000 7fdd4ebbb700 1 --2- 172.21.15.110:0/2332172775 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd480b9730 0x7fdd4814cc40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:53.947 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.942+0000 7fdd4ebbb700 1 --2- 172.21.15.110:0/2332172775 >> v2:172.21.15.174:3300/0 conn(0x7fdd480667d0 0x7fdd4814d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:53.947 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.942+0000 7fdd4ebbb700 1 -- 172.21.15.110:0/2332172775 >> 172.21.15.110:0/2332172775 conn(0x7fdd480bce50 msgr2=0x7fdd480b8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:53.947 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.942+0000 7fdd4ebbb700 1 -- 172.21.15.110:0/2332172775 shutdown_connections 2021-03-25T14:17:53.947 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.942+0000 7fdd4ebbb700 1 -- 172.21.15.110:0/2332172775 wait complete. 2021-03-25T14:17:53.950 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.943+0000 7fdd4ebbb700 1 Processor -- start 2021-03-25T14:17:53.950 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.944+0000 7fdd4ebbb700 1 -- start start 2021-03-25T14:17:53.950 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.944+0000 7fdd4ebbb700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd480667d0 0x7fdd481161f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:53.950 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.944+0000 7fdd4ebbb700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdd480a1f20 0x7fdd4814b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:53.950 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.944+0000 7fdd4ebbb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd480b9730 0x7fdd4814b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:53.950 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.944+0000 7fdd4ebbb700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4814a880 con 0x7fdd480667d0 2021-03-25T14:17:53.950 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.944+0000 7fdd4ebbb700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd48159700 con 0x7fdd480a1f20 2021-03-25T14:17:53.950 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.944+0000 7fdd4ebbb700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4814aab0 con 0x7fdd480b9730 2021-03-25T14:17:53.950 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.944+0000 7fdd4c957700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd480667d0 0x7fdd481161f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:53.950 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.944+0000 7fdd4c957700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd480667d0 0x7fdd481161f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50758/0 (socket says 172.21.15.110:50758) 2021-03-25T14:17:53.951 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.944+0000 7fdd4c957700 1 -- 172.21.15.110:0/1625003429 learned_addr learned my addr 172.21.15.110:0/1625003429 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:53.951 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.944+0000 7fdd47fff700 1 --2- 172.21.15.110:0/1625003429 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdd480a1f20 0x7fdd4814b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:53.951 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.944+0000 7fdd4d158700 1 --2- 172.21.15.110:0/1625003429 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd480b9730 0x7fdd4814b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:53.951 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.945+0000 7fdd4c957700 1 -- 172.21.15.110:0/1625003429 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd480b9730 msgr2=0x7fdd4814b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:53.951 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.945+0000 7fdd4c957700 1 --2- 172.21.15.110:0/1625003429 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd480b9730 0x7fdd4814b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:53.951 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.945+0000 7fdd4c957700 1 -- 172.21.15.110:0/1625003429 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdd480a1f20 msgr2=0x7fdd4814b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:53.951 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.945+0000 7fdd4c957700 1 --2- 172.21.15.110:0/1625003429 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdd480a1f20 0x7fdd4814b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:53.951 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.945+0000 7fdd4c957700 1 -- 172.21.15.110:0/1625003429 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd4814ad50 con 0x7fdd480667d0 2021-03-25T14:17:53.951 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.945+0000 7fdd4c957700 1 --2- 172.21.15.110:0/1625003429 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd480667d0 0x7fdd481161f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7fdd3c006e60 tx=0x7fdd3c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:53.951 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.945+0000 7fdd44ff9700 1 -- 172.21.15.110:0/1625003429 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c011c80 con 0x7fdd480667d0 2021-03-25T14:17:53.951 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.945+0000 7fdd44ff9700 1 -- 172.21.15.110:0/1625003429 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3c011de0 con 0x7fdd480667d0 2021-03-25T14:17:53.951 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.945+0000 7fdd4ebbb700 1 -- 172.21.15.110:0/1625003429 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd48116a80 con 0x7fdd480667d0 2021-03-25T14:17:53.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.945+0000 7fdd44ff9700 1 -- 172.21.15.110:0/1625003429 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c01c630 con 0x7fdd480667d0 2021-03-25T14:17:53.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.945+0000 7fdd4ebbb700 1 -- 172.21.15.110:0/1625003429 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd481166e0 con 0x7fdd480667d0 2021-03-25T14:17:53.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.946+0000 7fdd327fc700 1 -- 172.21.15.110:0/1625003429 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd24004fa0 con 0x7fdd480667d0 2021-03-25T14:17:53.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.946+0000 7fdd44ff9700 1 -- 172.21.15.110:0/1625003429 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fdd3c00f070 con 0x7fdd480667d0 2021-03-25T14:17:53.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.946+0000 7fdd44ff9700 1 --2- 172.21.15.110:0/1625003429 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fdd2805a0b0 0x7fdd2805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:53.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.947+0000 7fdd44ff9700 1 -- 172.21.15.110:0/1625003429 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 7250+0+0 (secure 0 0 0) 0x7fdd3c0755a0 con 0x7fdd480667d0 2021-03-25T14:17:53.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.947+0000 7fdd47fff700 1 --2- 172.21.15.110:0/1625003429 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fdd2805a0b0 0x7fdd2805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:53.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.947+0000 7fdd47fff700 1 --2- 172.21.15.110:0/1625003429 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fdd2805a0b0 0x7fdd2805c570 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7fdd480a0ec0 tx=0x7fdd34008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:53.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:53.950+0000 7fdd44ff9700 1 -- 172.21.15.110:0/1625003429 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fdd3c048aa0 con 0x7fdd480667d0 2021-03-25T14:17:54.104 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.102+0000 7fdd327fc700 1 -- 172.21.15.110:0/1625003429 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd24005250 con 0x7fdd480667d0 2021-03-25T14:17:54.160 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.103+0000 7fdd44ff9700 1 -- 172.21.15.110:0/1625003429 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+20269 (secure 0 0 0) 0x7fdd3c04c0c0 con 0x7fdd480667d0 2021-03-25T14:17:54.161 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:54.161 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":60,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:17:53.497087+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2021-03-25T14:17:40.271092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2021-03-25T14:17:41.271977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":12,"pool_name":"cephfs2_metadata","create_time":"2021-03-25T14:17:50.184585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}}},{"pool":13,"pool_name":"cephfs2_data","create_time":"2021-03-25T14:17:51.481411+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs2"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:17:54.162 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.105+0000 7fdd327fc700 1 -- 172.21.15.110:0/1625003429 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fdd2805a0b0 msgr2=0x7fdd2805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:54.163 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.105+0000 7fdd327fc700 1 --2- 172.21.15.110:0/1625003429 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fdd2805a0b0 0x7fdd2805c570 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7fdd480a0ec0 tx=0x7fdd34008040).stop 2021-03-25T14:17:54.163 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.105+0000 7fdd327fc700 1 -- 172.21.15.110:0/1625003429 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd480667d0 msgr2=0x7fdd481161f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:54.163 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.105+0000 7fdd327fc700 1 --2- 172.21.15.110:0/1625003429 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd480667d0 0x7fdd481161f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7fdd3c006e60 tx=0x7fdd3c016000).stop 2021-03-25T14:17:54.163 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.105+0000 7fdd327fc700 1 -- 172.21.15.110:0/1625003429 shutdown_connections 2021-03-25T14:17:54.163 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.105+0000 7fdd327fc700 1 --2- 172.21.15.110:0/1625003429 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fdd2805a0b0 0x7fdd2805c570 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:54.163 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.105+0000 7fdd327fc700 1 --2- 172.21.15.110:0/1625003429 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd480b9730 0x7fdd4814b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:54.163 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.105+0000 7fdd327fc700 1 --2- 172.21.15.110:0/1625003429 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd480667d0 0x7fdd481161f0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:54.163 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.105+0000 7fdd327fc700 1 --2- 172.21.15.110:0/1625003429 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdd480a1f20 0x7fdd4814b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:54.163 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.105+0000 7fdd327fc700 1 -- 172.21.15.110:0/1625003429 >> 172.21.15.110:0/1625003429 conn(0x7fdd480bce50 msgr2=0x7fdd48061a50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:54.163 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.105+0000 7fdd327fc700 1 -- 172.21.15.110:0/1625003429 shutdown_connections 2021-03-25T14:17:54.163 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.105+0000 7fdd327fc700 1 -- 172.21.15.110:0/1625003429 wait complete. 2021-03-25T14:17:54.164 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2021-03-25T14:17:54.280 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.278+0000 7f2129e57700 1 Processor -- start 2021-03-25T14:17:54.280 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.278+0000 7f2129e57700 1 -- start start 2021-03-25T14:17:54.289 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.279+0000 7f2129e57700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f21241433c0 0x7f2124149b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:54.289 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.279+0000 7f2129e57700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21240b6630 con 0x7f21240bc570 2021-03-25T14:17:54.289 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.279+0000 7f2129e57700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21240b68d0 con 0x7f2124142fe0 2021-03-25T14:17:54.289 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.279+0000 7f2129e57700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21240b9320 con 0x7f21241433c0 2021-03-25T14:17:54.289 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.279+0000 7f2123fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f21241433c0 0x7f2124149b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:54.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.279+0000 7f2129656700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f21240bc570 0x7f21240673e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43706/0 (socket says 172.21.15.110:43706) 2021-03-25T14:17:54.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.279+0000 7f2123fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f21241433c0 0x7f2124149b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50766/0 (socket says 172.21.15.110:50766) 2021-03-25T14:17:54.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.279+0000 7f2129656700 1 -- 172.21.15.110:0/1452022179 learned_addr learned my addr 172.21.15.110:0/1452022179 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:54.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.279+0000 7f2123fff700 1 -- 172.21.15.110:0/1452022179 >> v1:172.21.15.174:6789/0 conn(0x7f2124142fe0 legacy=0x7f21240b7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:54.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.279+0000 7f2123fff700 1 -- 172.21.15.110:0/1452022179 >> v1:172.21.15.110:6789/0 conn(0x7f21240bc570 legacy=0x7f21240673e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:54.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.279+0000 7f2123fff700 1 -- 172.21.15.110:0/1452022179 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21240b6b70 con 0x7f21241433c0 2021-03-25T14:17:54.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.279+0000 7f21237fe700 1 -- 172.21.15.110:0/1452022179 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 767166026 0 0) 0x7f21240b6630 con 0x7f21240bc570 2021-03-25T14:17:54.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.279+0000 7f2123fff700 1 --2- 172.21.15.110:0/1452022179 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21241433c0 0x7f2124149b30 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f211000b9c0 tx=0x7f2110006e20).ready entity=mon.0 client_cookie=b74e2699fa5abfbb server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:54.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.279+0000 7f21237fe700 1 -- 172.21.15.110:0/1452022179 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2110009870 con 0x7f21241433c0 2021-03-25T14:17:54.291 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.279+0000 7f21237fe700 1 -- 172.21.15.110:0/1452022179 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21100099d0 con 0x7f21241433c0 2021-03-25T14:17:54.291 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.279+0000 7f21237fe700 1 -- 172.21.15.110:0/1452022179 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2110009d50 con 0x7f21241433c0 2021-03-25T14:17:54.291 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.280+0000 7f2129e57700 1 -- 172.21.15.110:0/1452022179 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21241433c0 msgr2=0x7f2124149b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:54.291 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.280+0000 7f2129e57700 1 --2- 172.21.15.110:0/1452022179 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21241433c0 0x7f2124149b30 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f211000b9c0 tx=0x7f2110006e20).stop 2021-03-25T14:17:54.291 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.280+0000 7f2129e57700 1 -- 172.21.15.110:0/1452022179 shutdown_connections 2021-03-25T14:17:54.291 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.280+0000 7f2129e57700 1 --2- 172.21.15.110:0/1452022179 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21241433c0 0x7f2124149b30 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:54.292 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.280+0000 7f2129e57700 1 -- 172.21.15.110:0/1452022179 >> 172.21.15.110:0/1452022179 conn(0x7f212405c700 msgr2=0x7f21240664d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:54.292 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.280+0000 7f2129e57700 1 -- 172.21.15.110:0/1452022179 shutdown_connections 2021-03-25T14:17:54.292 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.280+0000 7f2129e57700 1 -- 172.21.15.110:0/1452022179 wait complete. 2021-03-25T14:17:54.292 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.281+0000 7f2129e57700 1 Processor -- start 2021-03-25T14:17:54.292 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.281+0000 7f2129e57700 1 -- start start 2021-03-25T14:17:54.292 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.282+0000 7f2129e57700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21240bc570 0x7f2124146560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:54.293 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.282+0000 7f2129e57700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2124142fe0 0x7f212413f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:54.293 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.282+0000 7f2129e57700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f21241433c0 0x7f21240b1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:54.293 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.282+0000 7f2129e57700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212409e7d0 con 0x7f2124142fe0 2021-03-25T14:17:54.293 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.282+0000 7f2129e57700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212409f070 con 0x7f21241433c0 2021-03-25T14:17:54.293 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.282+0000 7f2129e57700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f212409f540 con 0x7f21240bc570 2021-03-25T14:17:54.293 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.282+0000 7f2123fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2124142fe0 0x7f212413f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:54.294 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.282+0000 7f2123fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2124142fe0 0x7f212413f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50774/0 (socket says 172.21.15.110:50774) 2021-03-25T14:17:54.294 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.282+0000 7f2123fff700 1 -- 172.21.15.110:0/184620604 learned_addr learned my addr 172.21.15.110:0/184620604 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:54.294 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.282+0000 7f2123fff700 1 -- 172.21.15.110:0/184620604 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21240bc570 msgr2=0x7f2124146560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:54.294 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.282+0000 7f2123fff700 1 --2- 172.21.15.110:0/184620604 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21240bc570 0x7f2124146560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:54.294 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.282+0000 7f2123fff700 1 -- 172.21.15.110:0/184620604 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f21241433c0 msgr2=0x7f21240b1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:54.295 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.282+0000 7f2123fff700 1 --2- 172.21.15.110:0/184620604 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f21241433c0 0x7f21240b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:54.295 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.282+0000 7f2123fff700 1 -- 172.21.15.110:0/184620604 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f212409fe90 con 0x7f2124142fe0 2021-03-25T14:17:54.295 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.282+0000 7f2123fff700 1 --2- 172.21.15.110:0/184620604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2124142fe0 0x7f212413f9e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f21100099a0 tx=0x7f2110017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:54.295 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.282+0000 7f2120ff9700 1 -- 172.21.15.110:0/184620604 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2110024420 con 0x7f2124142fe0 2021-03-25T14:17:54.295 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.282+0000 7f2120ff9700 1 -- 172.21.15.110:0/184620604 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2110024580 con 0x7f2124142fe0 2021-03-25T14:17:54.296 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.283+0000 7f2129e57700 1 -- 172.21.15.110:0/184620604 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21240a0130 con 0x7f2124142fe0 2021-03-25T14:17:54.296 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.283+0000 7f2120ff9700 1 -- 172.21.15.110:0/184620604 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2110024730 con 0x7f2124142fe0 2021-03-25T14:17:54.296 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.283+0000 7f2129e57700 1 -- 172.21.15.110:0/184620604 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f212413fed0 con 0x7f2124142fe0 2021-03-25T14:17:54.296 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.283+0000 7f2129e57700 1 -- 172.21.15.110:0/184620604 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2124045ae0 con 0x7f2124142fe0 2021-03-25T14:17:54.296 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.284+0000 7f2120ff9700 1 -- 172.21.15.110:0/184620604 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f211000e040 con 0x7f2124142fe0 2021-03-25T14:17:54.296 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.284+0000 7f2120ff9700 1 --2- 172.21.15.110:0/184620604 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f210405a0b0 0x7f210405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:54.297 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.284+0000 7f2120ff9700 1 -- 172.21.15.110:0/184620604 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 7250+0+0 (secure 0 0 0) 0x7f2110076170 con 0x7f2124142fe0 2021-03-25T14:17:54.297 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.284+0000 7f2128e55700 1 --2- 172.21.15.110:0/184620604 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f210405a0b0 0x7f210405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:54.297 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.285+0000 7f2128e55700 1 --2- 172.21.15.110:0/184620604 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f210405a0b0 0x7f210405c570 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f21180094c0 tx=0x7f21180069e0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:54.298 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.288+0000 7f2120ff9700 1 -- 172.21.15.110:0/184620604 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f2110049670 con 0x7f2124142fe0 2021-03-25T14:17:54.495 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.493+0000 7f2129e57700 1 -- 172.21.15.110:0/184620604 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7f21240b5ed0 con 0x7f2124142fe0 2021-03-25T14:17:54.498 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.496+0000 7f2120ff9700 1 -- 172.21.15.110:0/184620604 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v14) v1 ==== 185+0+0 (secure 0 0 0) 0x7f211004cc90 con 0x7f2124142fe0 2021-03-25T14:17:54.501 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.498+0000 7f2129e57700 1 -- 172.21.15.110:0/184620604 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f210405a0b0 msgr2=0x7f210405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:54.501 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.498+0000 7f2129e57700 1 --2- 172.21.15.110:0/184620604 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f210405a0b0 0x7f210405c570 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f21180094c0 tx=0x7f21180069e0).stop 2021-03-25T14:17:54.501 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.498+0000 7f2129e57700 1 -- 172.21.15.110:0/184620604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2124142fe0 msgr2=0x7f212413f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:54.501 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.498+0000 7f2129e57700 1 --2- 172.21.15.110:0/184620604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2124142fe0 0x7f212413f9e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f21100099a0 tx=0x7f2110017000).stop 2021-03-25T14:17:54.502 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.498+0000 7f2129e57700 1 -- 172.21.15.110:0/184620604 shutdown_connections 2021-03-25T14:17:54.502 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.498+0000 7f2129e57700 1 --2- 172.21.15.110:0/184620604 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f210405a0b0 0x7f210405c570 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:54.502 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.498+0000 7f2129e57700 1 --2- 172.21.15.110:0/184620604 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f21241433c0 0x7f21240b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:54.502 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.498+0000 7f2129e57700 1 --2- 172.21.15.110:0/184620604 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21240bc570 0x7f2124146560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:54.502 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.498+0000 7f2129e57700 1 --2- 172.21.15.110:0/184620604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2124142fe0 0x7f212413f9e0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:54.503 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.498+0000 7f2129e57700 1 -- 172.21.15.110:0/184620604 >> 172.21.15.110:0/184620604 conn(0x7f212405c700 msgr2=0x7f21241496a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:54.503 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.498+0000 7f2129e57700 1 -- 172.21.15.110:0/184620604 shutdown_connections 2021-03-25T14:17:54.503 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:54.498+0000 7f2129e57700 1 -- 172.21.15.110:0/184620604 wait complete. 2021-03-25T14:17:54.503 INFO:teuthology.orchestra.run.smithi110.stderr:updated caps for client.1 2021-03-25T14:17:54.511 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2021-03-25T14:17:54.512 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-03-25T14:17:54.512 DEBUG:teuthology.orchestra.run.smithi174:> sudo umount /home/ubuntu/cephtest/mnt.1 2021-03-25T14:17:54.556 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi174.front.sepia.ceph.com 2021-03-25T14:17:54.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:54.556 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-03-25T14:17:54.617 DEBUG:teuthology.orchestra.run.smithi174:> ceph fs ls 2021-03-25T14:17:54.767 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.765+0000 7f299bc5c700 1 Processor -- start 2021-03-25T14:17:54.784 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.765+0000 7f299bc5c700 1 -- start start 2021-03-25T14:17:54.790 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.766+0000 7f299bc5c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2994067da0 0x7f29940bbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:54.790 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.766+0000 7f299bc5c700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2994068ab0 con 0x7f2994147520 2021-03-25T14:17:54.790 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.766+0000 7f299bc5c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2994069220 con 0x7f29940bbb40 2021-03-25T14:17:54.790 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.766+0000 7f299bc5c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2994068ce0 con 0x7f2994067da0 2021-03-25T14:17:54.790 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.766+0000 7f29991f7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2994067da0 0x7f29940bbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:54.790 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.766+0000 7f29999f8700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f29940bbb40 0x7f2994067260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:49464/0 (socket says 172.21.15.174:49464) 2021-03-25T14:17:54.790 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.766+0000 7f29999f8700 1 -- 172.21.15.174:0/2554729089 learned_addr learned my addr 172.21.15.174:0/2554729089 (peer_addr_for_me v1:172.21.15.174:0/0) 2021-03-25T14:17:54.790 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.766+0000 7f29991f7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2994067da0 0x7f29940bbf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:47214/0 (socket says 172.21.15.174:47214) 2021-03-25T14:17:54.790 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.767+0000 7f29991f7700 1 -- 172.21.15.174:0/2554729089 >> v1:172.21.15.174:6789/0 conn(0x7f29940bbb40 legacy=0x7f2994067260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:54.791 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.767+0000 7f29991f7700 1 -- 172.21.15.174:0/2554729089 >> v1:172.21.15.110:6789/0 conn(0x7f2994147520 legacy=0x7f29940af6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:54.791 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.767+0000 7f29989f6700 1 -- 172.21.15.174:0/2554729089 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 278240359 0 0) 0x7f2994069220 con 0x7f29940bbb40 2021-03-25T14:17:54.791 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.767+0000 7f29991f7700 1 -- 172.21.15.174:0/2554729089 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2994068f80 con 0x7f2994067da0 2021-03-25T14:17:54.791 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.767+0000 7f29991f7700 1 --2- 172.21.15.174:0/2554729089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2994067da0 0x7f29940bbf20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f298400b9c0 tx=0x7f2984006e20).ready entity=mon.1 client_cookie=5b1efb70b1a0e5bb server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:54.791 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.767+0000 7f29989f6700 1 -- 172.21.15.174:0/2554729089 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29840097e0 con 0x7f2994067da0 2021-03-25T14:17:54.791 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.767+0000 7f29989f6700 1 -- 172.21.15.174:0/2554729089 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2984009940 con 0x7f2994067da0 2021-03-25T14:17:54.791 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.767+0000 7f29989f6700 1 -- 172.21.15.174:0/2554729089 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2984009cc0 con 0x7f2994067da0 2021-03-25T14:17:54.791 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.768+0000 7f299bc5c700 1 -- 172.21.15.174:0/2554729089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2994067da0 msgr2=0x7f29940bbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:54.791 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.768+0000 7f299bc5c700 1 --2- 172.21.15.174:0/2554729089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2994067da0 0x7f29940bbf20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f298400b9c0 tx=0x7f2984006e20).stop 2021-03-25T14:17:54.791 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.768+0000 7f299bc5c700 1 -- 172.21.15.174:0/2554729089 shutdown_connections 2021-03-25T14:17:54.791 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.768+0000 7f299bc5c700 1 --2- 172.21.15.174:0/2554729089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2994067da0 0x7f29940bbf20 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:54.791 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.768+0000 7f299bc5c700 1 -- 172.21.15.174:0/2554729089 >> 172.21.15.174:0/2554729089 conn(0x7f2994062580 msgr2=0x7f2994062990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:54.792 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.768+0000 7f299bc5c700 1 -- 172.21.15.174:0/2554729089 shutdown_connections 2021-03-25T14:17:54.792 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.768+0000 7f299bc5c700 1 -- 172.21.15.174:0/2554729089 wait complete. 2021-03-25T14:17:54.792 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.769+0000 7f299bc5c700 1 Processor -- start 2021-03-25T14:17:54.792 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.769+0000 7f299bc5c700 1 -- start start 2021-03-25T14:17:54.792 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.769+0000 7f299bc5c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2994067da0 0x7f299415a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:54.792 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.769+0000 7f299bc5c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29940bbb40 0x7f299414d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:54.792 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.769+0000 7f299bc5c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2994147520 0x7f2994156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:54.792 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.769+0000 7f299bc5c700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2994144fa0 con 0x7f29940bbb40 2021-03-25T14:17:54.792 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.769+0000 7f299bc5c700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2994159fb0 con 0x7f2994147520 2021-03-25T14:17:54.792 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.769+0000 7f299bc5c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29940ba3b0 con 0x7f2994067da0 2021-03-25T14:17:54.792 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.770+0000 7f29999f8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2994067da0 0x7f299415a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:54.792 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.770+0000 7f299a1f9700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2994147520 0x7f2994156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:54.792 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.770+0000 7f299a1f9700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2994147520 0x7f2994156990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:47222/0 (socket says 172.21.15.174:47222) 2021-03-25T14:17:54.793 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.770+0000 7f29999f8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2994067da0 0x7f299415a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:34878/0 (socket says 172.21.15.174:34878) 2021-03-25T14:17:54.793 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.770+0000 7f299a1f9700 1 -- 172.21.15.174:0/2893959386 learned_addr learned my addr 172.21.15.174:0/2893959386 (peer_addr_for_me v2:172.21.15.174:0/0) 2021-03-25T14:17:54.793 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.770+0000 7f29991f7700 1 --2- 172.21.15.174:0/2893959386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29940bbb40 0x7f299414d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:54.793 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.770+0000 7f299a1f9700 1 -- 172.21.15.174:0/2893959386 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2994067da0 msgr2=0x7f299415a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:54.793 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.770+0000 7f299a1f9700 1 --2- 172.21.15.174:0/2893959386 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2994067da0 0x7f299415a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:54.793 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.770+0000 7f299a1f9700 1 -- 172.21.15.174:0/2893959386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29940bbb40 msgr2=0x7f299414d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:54.793 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.770+0000 7f299a1f9700 1 --2- 172.21.15.174:0/2893959386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29940bbb40 0x7f299414d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:54.793 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.770+0000 7f299a1f9700 1 -- 172.21.15.174:0/2893959386 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29940ba650 con 0x7f2994147520 2021-03-25T14:17:54.793 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.770+0000 7f299a1f9700 1 --2- 172.21.15.174:0/2893959386 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2994147520 0x7f2994156990 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f298c00ca90 tx=0x7f298c007f70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:54.793 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.770+0000 7f2981ffb700 1 -- 172.21.15.174:0/2893959386 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c00ce70 con 0x7f2994147520 2021-03-25T14:17:54.793 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.770+0000 7f2981ffb700 1 -- 172.21.15.174:0/2893959386 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298c00a760 con 0x7f2994147520 2021-03-25T14:17:54.793 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.770+0000 7f299bc5c700 1 -- 172.21.15.174:0/2893959386 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f299415a1e0 con 0x7f2994147520 2021-03-25T14:17:54.793 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.770+0000 7f2981ffb700 1 -- 172.21.15.174:0/2893959386 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c00aae0 con 0x7f2994147520 2021-03-25T14:17:54.794 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.771+0000 7f299bc5c700 1 -- 172.21.15.174:0/2893959386 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f299415ae90 con 0x7f2994147520 2021-03-25T14:17:54.794 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.772+0000 7f2981ffb700 1 -- 172.21.15.174:0/2893959386 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f298c019030 con 0x7f2994147520 2021-03-25T14:17:54.794 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.772+0000 7f299bc5c700 1 -- 172.21.15.174:0/2893959386 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29940ba160 con 0x7f2994147520 2021-03-25T14:17:54.794 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.772+0000 7f2981ffb700 1 --2- 172.21.15.174:0/2893959386 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f297405a0b0 0x7f297405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:54.794 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.772+0000 7f2981ffb700 1 -- 172.21.15.174:0/2893959386 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 7250+0+0 (secure 0 0 0) 0x7f298c073940 con 0x7f2994147520 2021-03-25T14:17:54.794 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.772+0000 7f29999f8700 1 --2- 172.21.15.174:0/2893959386 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f297405a0b0 0x7f297405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:54.794 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.773+0000 7f29999f8700 1 --2- 172.21.15.174:0/2893959386 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f297405a0b0 0x7f297405c570 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f2990007fd0 tx=0x7f2990007a10).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:54.794 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.776+0000 7f2981ffb700 1 -- 172.21.15.174:0/2893959386 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f298c045620 con 0x7f2994147520 2021-03-25T14:17:54.964 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.962+0000 7f299bc5c700 1 -- 172.21.15.174:0/2893959386 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f299415a640 con 0x7f2994147520 2021-03-25T14:17:54.964 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.962+0000 7f2981ffb700 1 -- 172.21.15.174:0/2893959386 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) v1 ==== 53+0+149 (secure 0 0 0) 0x7f298c046ef0 con 0x7f2994147520 2021-03-25T14:17:54.964 INFO:teuthology.orchestra.run.smithi174.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2021-03-25T14:17:54.964 INFO:teuthology.orchestra.run.smithi174.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2021-03-25T14:17:54.966 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.964+0000 7f299bc5c700 1 -- 172.21.15.174:0/2893959386 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f297405a0b0 msgr2=0x7f297405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:54.966 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.964+0000 7f299bc5c700 1 --2- 172.21.15.174:0/2893959386 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f297405a0b0 0x7f297405c570 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f2990007fd0 tx=0x7f2990007a10).stop 2021-03-25T14:17:54.967 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.964+0000 7f299bc5c700 1 -- 172.21.15.174:0/2893959386 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2994147520 msgr2=0x7f2994156990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:54.967 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.964+0000 7f299bc5c700 1 --2- 172.21.15.174:0/2893959386 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2994147520 0x7f2994156990 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f298c00ca90 tx=0x7f298c007f70).stop 2021-03-25T14:17:54.967 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.964+0000 7f299bc5c700 1 -- 172.21.15.174:0/2893959386 shutdown_connections 2021-03-25T14:17:54.967 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.964+0000 7f299bc5c700 1 --2- 172.21.15.174:0/2893959386 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f297405a0b0 0x7f297405c570 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:54.967 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.964+0000 7f299bc5c700 1 --2- 172.21.15.174:0/2893959386 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2994147520 0x7f2994156990 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:54.967 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.964+0000 7f299bc5c700 1 --2- 172.21.15.174:0/2893959386 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2994067da0 0x7f299415a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:54.967 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.964+0000 7f299bc5c700 1 --2- 172.21.15.174:0/2893959386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29940bbb40 0x7f299414d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:54.967 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.964+0000 7f299bc5c700 1 -- 172.21.15.174:0/2893959386 >> 172.21.15.174:0/2893959386 conn(0x7f2994062580 msgr2=0x7f29941409a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:54.967 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.964+0000 7f299bc5c700 1 -- 172.21.15.174:0/2893959386 shutdown_connections 2021-03-25T14:17:54.967 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:17:54.964+0000 7f299bc5c700 1 -- 172.21.15.174:0/2893959386 wait complete. 2021-03-25T14:17:54.976 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2021-03-25T14:17:54.976 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2021-03-25T14:17:54.976 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi174.front.sepia.ceph.com 2021-03-25T14:17:54.976 INFO:tasks.cephfs.mount:self.client.name = client.1 2021-03-25T14:17:54.977 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2021-03-25T14:17:54.977 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2021-03-25T14:17:54.977 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2021-03-25T14:17:54.977 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2021-03-25T14:17:54.977 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2021-03-25T14:17:54.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:54.977 DEBUG:teuthology.orchestra.run.smithi174:> ip addr 2021-03-25T14:17:54.995 INFO:teuthology.orchestra.run.smithi174.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2021-03-25T14:17:54.995 INFO:teuthology.orchestra.run.smithi174.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2021-03-25T14:17:54.995 INFO:teuthology.orchestra.run.smithi174.stdout: inet 127.0.0.1/8 scope host lo 2021-03-25T14:17:54.995 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:54.995 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 ::1/128 scope host 2021-03-25T14:17:54.995 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:54.995 INFO:teuthology.orchestra.run.smithi174.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-03-25T14:17:54.996 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:d9:36:e0 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:17:54.996 INFO:teuthology.orchestra.run.smithi174.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-03-25T14:17:54.996 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:d9:36:e1 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:17:54.996 INFO:teuthology.orchestra.run.smithi174.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-03-25T14:17:54.996 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:88:77:1a brd ff:ff:ff:ff:ff:ff 2021-03-25T14:17:54.996 INFO:teuthology.orchestra.run.smithi174.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2021-03-25T14:17:54.996 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:88:77:1b brd ff:ff:ff:ff:ff:ff 2021-03-25T14:17:54.996 INFO:teuthology.orchestra.run.smithi174.stdout: inet 172.21.15.174/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2021-03-25T14:17:54.996 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft 42527sec preferred_lft 42527sec 2021-03-25T14:17:54.996 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::ec4:7aff:fe88:771b/64 scope link 2021-03-25T14:17:54.997 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:54.997 INFO:teuthology.orchestra.run.smithi174.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2021-03-25T14:17:54.997 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 32:28:39:9e:9c:fe brd ff:ff:ff:ff:ff:ff 2021-03-25T14:17:54.997 INFO:teuthology.orchestra.run.smithi174.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2021-03-25T14:17:54.997 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:54.997 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::2843:d3ff:fe04:eed1/64 scope link 2021-03-25T14:17:54.997 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:54.997 INFO:teuthology.orchestra.run.smithi174.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2021-03-25T14:17:54.997 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 32:28:39:9e:9c:fe brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2021-03-25T14:17:54.997 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::3028:39ff:fe9e:9cfe/64 scope link 2021-03-25T14:17:54.997 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:54.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:54.998 DEBUG:teuthology.orchestra.run.smithi174:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2021-03-25T14:17:55.058 INFO:teuthology.orchestra.run.smithi174.stdout:1 2021-03-25T14:17:55.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:55.060 DEBUG:teuthology.orchestra.run.smithi174:> route 2021-03-25T14:17:55.115 INFO:teuthology.orchestra.run.smithi174.stdout:Kernel IP routing table 2021-03-25T14:17:55.184 INFO:teuthology.orchestra.run.smithi174.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2021-03-25T14:17:55.185 INFO:teuthology.orchestra.run.smithi174.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2021-03-25T14:17:55.185 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2021-03-25T14:17:55.185 INFO:teuthology.orchestra.run.smithi174.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2021-03-25T14:17:55.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:55.185 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec sudo bash -c ' 2021-03-25T14:17:55.186 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2021-03-25T14:17:55.186 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2021-03-25T14:17:55.186 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2021-03-25T14:17:55.186 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2021-03-25T14:17:55.186 DEBUG:teuthology.orchestra.run.smithi174:> ') 2021-03-25T14:17:55.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:55.243 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list 2021-03-25T14:17:55.257 INFO:teuthology.orchestra.run.smithi174.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2021-03-25T14:17:55.257 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2021-03-25T14:17:55.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:55.257 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set brx.0 up 2021-03-25T14:17:55.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:55.321 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p /home/ubuntu/cephtest/mnt.1 2021-03-25T14:17:55.375 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-03-25T14:17:55.376 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs2,norbytes 2021-03-25T14:17:55.453 INFO:teuthology.orchestra.run.smithi174.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs2,norbytes 2021-03-25T14:17:55.526 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs2,norbytes" will pass to kernel. 2021-03-25T14:17:55.527 INFO:teuthology.orchestra.run.smithi174.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs2,norbytes 2021-03-25T14:17:55.528 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs2,norbytes" will pass to kernel. 2021-03-25T14:17:55.528 INFO:tasks.cephfs.kernel_mount:mount command passed 2021-03-25T14:17:55.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:55.528 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2021-03-25T14:17:55.594 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth add client.testuser mon 'allow rw fsname=cephfs, allow rw fsname=cephfs2' osd 'allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2' mds 'allow rw fsname=cephfs' 2021-03-25T14:17:55.789 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.787+0000 7f6db6cdc700 1 Processor -- start 2021-03-25T14:17:55.789 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.787+0000 7f6db6cdc700 1 -- start start 2021-03-25T14:17:55.792 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.788+0000 7f6db6cdc700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6db00b0cc0 0x7f6db0145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:55.792 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.788+0000 7f6db6cdc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6db00b5d00 0x7f6db0067250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:55.792 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.788+0000 7f6db6cdc700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6db00648a0 0x7f6db009db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:55.793 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.788+0000 7f6db6cdc700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6db0149c50 con 0x7f6db00648a0 2021-03-25T14:17:55.793 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.788+0000 7f6db6cdc700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6db01461b0 con 0x7f6db00b0cc0 2021-03-25T14:17:55.793 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.788+0000 7f6db6cdc700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db0149e80 con 0x7f6db00b5d00 2021-03-25T14:17:55.793 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.788+0000 7f6db5279700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6db00648a0 0x7f6db009db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:55.793 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.788+0000 7f6db5279700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6db00648a0 0x7f6db009db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50784/0 (socket says 172.21.15.110:50784) 2021-03-25T14:17:55.793 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.788+0000 7f6db5279700 1 -- 172.21.15.110:0/2541995680 learned_addr learned my addr 172.21.15.110:0/2541995680 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:55.793 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.788+0000 7f6daffff700 1 --2- 172.21.15.110:0/2541995680 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6db00b5d00 0x7f6db0067250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:55.793 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.788+0000 7f6db4a78700 1 --2- 172.21.15.110:0/2541995680 >> v2:172.21.15.174:3300/0 conn(0x7f6db00b0cc0 0x7f6db0145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:55.793 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.788+0000 7f6db5279700 1 -- 172.21.15.110:0/2541995680 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6db00b5d00 msgr2=0x7f6db0067250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:55.793 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.788+0000 7f6db5279700 1 --2- 172.21.15.110:0/2541995680 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6db00b5d00 0x7f6db0067250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:55.794 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.788+0000 7f6db5279700 1 -- 172.21.15.110:0/2541995680 >> v2:172.21.15.174:3300/0 conn(0x7f6db00b0cc0 msgr2=0x7f6db0145cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:55.794 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.788+0000 7f6db5279700 1 --2- 172.21.15.110:0/2541995680 >> v2:172.21.15.174:3300/0 conn(0x7f6db00b0cc0 0x7f6db0145cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:55.794 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.788+0000 7f6db5279700 1 -- 172.21.15.110:0/2541995680 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db00b6650 con 0x7f6db00648a0 2021-03-25T14:17:55.794 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.788+0000 7f6db4a78700 1 --2- 172.21.15.110:0/2541995680 >> v2:172.21.15.174:3300/0 conn(0x7f6db00b0cc0 0x7f6db0145cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:55.794 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.788+0000 7f6daffff700 1 --2- 172.21.15.110:0/2541995680 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6db00b5d00 0x7f6db0067250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:55.794 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.789+0000 7f6db5279700 1 --2- 172.21.15.110:0/2541995680 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6db00648a0 0x7f6db009db40 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f6db0066100 tx=0x7f6da80092d0).ready entity=mon.0 client_cookie=41cf4d531a7f1d18 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:55.794 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.789+0000 7f6daf7fe700 1 -- 172.21.15.110:0/2541995680 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da800bc80 con 0x7f6db00648a0 2021-03-25T14:17:55.794 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.789+0000 7f6daf7fe700 1 -- 172.21.15.110:0/2541995680 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da800bde0 con 0x7f6db00648a0 2021-03-25T14:17:55.794 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.789+0000 7f6daf7fe700 1 -- 172.21.15.110:0/2541995680 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da8011610 con 0x7f6db00648a0 2021-03-25T14:17:55.794 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.789+0000 7f6db6cdc700 1 -- 172.21.15.110:0/2541995680 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6db00648a0 msgr2=0x7f6db009db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:55.794 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.789+0000 7f6db6cdc700 1 --2- 172.21.15.110:0/2541995680 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6db00648a0 0x7f6db009db40 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f6db0066100 tx=0x7f6da80092d0).stop 2021-03-25T14:17:55.795 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.789+0000 7f6db6cdc700 1 -- 172.21.15.110:0/2541995680 shutdown_connections 2021-03-25T14:17:55.795 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.789+0000 7f6db6cdc700 1 --2- 172.21.15.110:0/2541995680 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6db00648a0 0x7f6db009db40 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:55.795 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.789+0000 7f6db6cdc700 1 --2- 172.21.15.110:0/2541995680 >> v2:172.21.15.174:3300/0 conn(0x7f6db00b0cc0 0x7f6db0145cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:55.795 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.789+0000 7f6db6cdc700 1 --2- 172.21.15.110:0/2541995680 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6db00b5d00 0x7f6db0067250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:55.795 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.789+0000 7f6db6cdc700 1 -- 172.21.15.110:0/2541995680 >> 172.21.15.110:0/2541995680 conn(0x7f6db00664e0 msgr2=0x7f6db00668f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:55.795 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.789+0000 7f6db6cdc700 1 -- 172.21.15.110:0/2541995680 shutdown_connections 2021-03-25T14:17:55.795 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.789+0000 7f6db6cdc700 1 -- 172.21.15.110:0/2541995680 wait complete. 2021-03-25T14:17:55.795 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.790+0000 7f6db6cdc700 1 Processor -- start 2021-03-25T14:17:55.795 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.791+0000 7f6db6cdc700 1 -- start start 2021-03-25T14:17:55.798 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.791+0000 7f6db6cdc700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6db00648a0 0x7f6db0063250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:55.798 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.791+0000 7f6db6cdc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6db00b0cc0 0x7f6db0141ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:55.798 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.791+0000 7f6db6cdc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6db00b5d00 0x7f6db01424e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:55.798 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.791+0000 7f6db6cdc700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db00a1580 con 0x7f6db00b5d00 2021-03-25T14:17:55.798 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.791+0000 7f6db6cdc700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db00b4210 con 0x7f6db00648a0 2021-03-25T14:17:55.798 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.791+0000 7f6db6cdc700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db00b2820 con 0x7f6db00b0cc0 2021-03-25T14:17:55.798 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.791+0000 7f6db5279700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6db00b5d00 0x7f6db01424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:55.798 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.791+0000 7f6db4a78700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6db00648a0 0x7f6db0063250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:55.798 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.791+0000 7f6db5279700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6db00b5d00 0x7f6db01424e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50790/0 (socket says 172.21.15.110:50790) 2021-03-25T14:17:55.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.791+0000 7f6db5279700 1 -- 172.21.15.110:0/3206459466 learned_addr learned my addr 172.21.15.110:0/3206459466 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:55.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.791+0000 7f6daffff700 1 --2- 172.21.15.110:0/3206459466 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6db00b0cc0 0x7f6db0141ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:55.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.792+0000 7f6db5279700 1 -- 172.21.15.110:0/3206459466 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6db00b0cc0 msgr2=0x7f6db0141ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:55.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.792+0000 7f6db5279700 1 --2- 172.21.15.110:0/3206459466 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6db00b0cc0 0x7f6db0141ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:55.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.792+0000 7f6db5279700 1 -- 172.21.15.110:0/3206459466 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6db00648a0 msgr2=0x7f6db0063250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:55.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.792+0000 7f6db5279700 1 --2- 172.21.15.110:0/3206459466 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6db00648a0 0x7f6db0063250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:55.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.792+0000 7f6db5279700 1 -- 172.21.15.110:0/3206459466 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db00a17b0 con 0x7f6db00b5d00 2021-03-25T14:17:55.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.792+0000 7f6db4a78700 1 --2- 172.21.15.110:0/3206459466 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6db00648a0 0x7f6db0063250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:17:55.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.792+0000 7f6db5279700 1 --2- 172.21.15.110:0/3206459466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6db00b5d00 0x7f6db01424e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f6da8009130 tx=0x7f6da8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:55.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.792+0000 7f6dacff9700 1 -- 172.21.15.110:0/3206459466 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da8009ea0 con 0x7f6db00b5d00 2021-03-25T14:17:55.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.792+0000 7f6dacff9700 1 -- 172.21.15.110:0/3206459466 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da8011e70 con 0x7f6db00b5d00 2021-03-25T14:17:55.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.792+0000 7f6dacff9700 1 -- 172.21.15.110:0/3206459466 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da8010cb0 con 0x7f6db00b5d00 2021-03-25T14:17:55.799 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.792+0000 7f6db6cdc700 1 -- 172.21.15.110:0/3206459466 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6db00b4470 con 0x7f6db00b5d00 2021-03-25T14:17:55.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.792+0000 7f6db6cdc700 1 -- 172.21.15.110:0/3206459466 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db01429d0 con 0x7f6db00b5d00 2021-03-25T14:17:55.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.793+0000 7f6db6cdc700 1 -- 172.21.15.110:0/3206459466 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db0156910 con 0x7f6db00b5d00 2021-03-25T14:17:55.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.793+0000 7f6dacff9700 1 -- 172.21.15.110:0/3206459466 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f6da800f070 con 0x7f6db00b5d00 2021-03-25T14:17:55.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.793+0000 7f6dacff9700 1 --2- 172.21.15.110:0/3206459466 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6d9005a0b0 0x7f6d9005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:55.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.794+0000 7f6dacff9700 1 -- 172.21.15.110:0/3206459466 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 7250+0+0 (secure 0 0 0) 0x7f6da8075d90 con 0x7f6db00b5d00 2021-03-25T14:17:55.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.794+0000 7f6db4a78700 1 --2- 172.21.15.110:0/3206459466 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6d9005a0b0 0x7f6d9005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:55.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.794+0000 7f6db4a78700 1 --2- 172.21.15.110:0/3206459466 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6d9005a0b0 0x7f6d9005c570 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f6da400bf50 tx=0x7f6da4008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:55.800 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:55.797+0000 7f6dacff9700 1 -- 172.21.15.110:0/3206459466 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f6db0156910 con 0x7f6db00b5d00 2021-03-25T14:17:56.003 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.001+0000 7f6db6cdc700 1 -- 172.21.15.110:0/3206459466 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow rw fsname=cephfs, allow rw fsname=cephfs2", "osd", "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2", "mds", "allow rw fsname=cephfs"]} v 0) v1 -- 0x7f6db0156910 con 0x7f6db00b5d00 2021-03-25T14:17:56.006 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.005+0000 7f6dacff9700 1 -- 172.21.15.110:0/3206459466 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow rw fsname=cephfs, allow rw fsname=cephfs2", "osd", "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2", "mds", "allow rw fsname=cephfs"]}]=0 added key for client.testuser v15) v1 ==== 291+0+0 (secure 0 0 0) 0x7f6da8049290 con 0x7f6db00b5d00 2021-03-25T14:17:56.009 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.007+0000 7f6db6cdc700 1 -- 172.21.15.110:0/3206459466 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6d9005a0b0 msgr2=0x7f6d9005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:56.009 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.007+0000 7f6db6cdc700 1 --2- 172.21.15.110:0/3206459466 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6d9005a0b0 0x7f6d9005c570 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f6da400bf50 tx=0x7f6da4008040).stop 2021-03-25T14:17:56.009 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.007+0000 7f6db6cdc700 1 -- 172.21.15.110:0/3206459466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6db00b5d00 msgr2=0x7f6db01424e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:56.009 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.007+0000 7f6db6cdc700 1 --2- 172.21.15.110:0/3206459466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6db00b5d00 0x7f6db01424e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f6da8009130 tx=0x7f6da8017000).stop 2021-03-25T14:17:56.009 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.007+0000 7f6db6cdc700 1 -- 172.21.15.110:0/3206459466 shutdown_connections 2021-03-25T14:17:56.009 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.007+0000 7f6db6cdc700 1 --2- 172.21.15.110:0/3206459466 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f6d9005a0b0 0x7f6d9005c570 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:56.010 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.007+0000 7f6db6cdc700 1 --2- 172.21.15.110:0/3206459466 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6db00648a0 0x7f6db0063250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:56.010 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.007+0000 7f6db6cdc700 1 --2- 172.21.15.110:0/3206459466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6db00b5d00 0x7f6db01424e0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:56.010 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.007+0000 7f6db6cdc700 1 --2- 172.21.15.110:0/3206459466 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6db00b0cc0 0x7f6db0141ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:56.010 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.007+0000 7f6db6cdc700 1 -- 172.21.15.110:0/3206459466 >> 172.21.15.110:0/3206459466 conn(0x7f6db00664e0 msgr2=0x7f6db0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:56.010 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.007+0000 7f6db6cdc700 1 -- 172.21.15.110:0/3206459466 shutdown_connections 2021-03-25T14:17:56.010 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.007+0000 7f6db6cdc700 1 -- 172.21.15.110:0/3206459466 wait complete. 2021-03-25T14:17:56.010 INFO:teuthology.orchestra.run.smithi110.stderr:added key for client.testuser 2021-03-25T14:17:56.020 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.testuser 2021-03-25T14:17:56.137 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.129+0000 7f71eac6d700 1 Processor -- start 2021-03-25T14:17:56.210 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.129+0000 7f71eac6d700 1 -- start start 2021-03-25T14:17:56.210 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.130+0000 7f71eac6d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f71e40b1290 0x7f71e40b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:56.210 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.130+0000 7f71eac6d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f71e40b8510 0x7f71e4146940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:56.210 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.130+0000 7f71eac6d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71e40b6db0 con 0x7f71e4064440 2021-03-25T14:17:56.211 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.130+0000 7f71eac6d700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71e40b7050 con 0x7f71e40b1290 2021-03-25T14:17:56.211 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.130+0000 7f71eac6d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71e40b72f0 con 0x7f71e40b8510 2021-03-25T14:17:56.211 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.130+0000 7f71e3fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f71e40b1290 0x7f71e40b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:56.211 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.130+0000 7f71e3fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f71e40b1290 0x7f71e40b6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50796/0 (socket says 172.21.15.110:50796) 2021-03-25T14:17:56.211 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.130+0000 7f71e3fff700 1 -- 172.21.15.110:0/1057758005 learned_addr learned my addr 172.21.15.110:0/1057758005 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:56.212 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.130+0000 7f71e920a700 1 --2- 172.21.15.110:0/1057758005 >> v2:172.21.15.174:3300/0 conn(0x7f71e40b8510 0x7f71e4146940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:56.212 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.130+0000 7f71e3fff700 1 -- 172.21.15.110:0/1057758005 >> v2:172.21.15.174:3300/0 conn(0x7f71e40b8510 msgr2=0x7f71e4146940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:56.212 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.130+0000 7f71e3fff700 1 --2- 172.21.15.110:0/1057758005 >> v2:172.21.15.174:3300/0 conn(0x7f71e40b8510 0x7f71e4146940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:56.212 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.130+0000 7f71e3fff700 1 -- 172.21.15.110:0/1057758005 >> v1:172.21.15.174:6789/0 conn(0x7f71e4064440 legacy=0x7f71e40b7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:56.213 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.130+0000 7f71e3fff700 1 -- 172.21.15.110:0/1057758005 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e40b7590 con 0x7f71e40b1290 2021-03-25T14:17:56.213 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.131+0000 7f71e3fff700 1 --2- 172.21.15.110:0/1057758005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71e40b1290 0x7f71e40b6780 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f71e4045c50 tx=0x7f71d0006ee0).ready entity=mon.0 client_cookie=e8153555f0727bf server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:56.213 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.131+0000 7f71e37fe700 1 -- 172.21.15.110:0/1057758005 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d0009840 con 0x7f71e40b1290 2021-03-25T14:17:56.213 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.131+0000 7f71e37fe700 1 -- 172.21.15.110:0/1057758005 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d00099a0 con 0x7f71e40b1290 2021-03-25T14:17:56.213 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.131+0000 7f71e37fe700 1 -- 172.21.15.110:0/1057758005 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d0009d20 con 0x7f71e40b1290 2021-03-25T14:17:56.213 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.131+0000 7f71eac6d700 1 -- 172.21.15.110:0/1057758005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71e40b1290 msgr2=0x7f71e40b6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:56.213 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.131+0000 7f71eac6d700 1 --2- 172.21.15.110:0/1057758005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71e40b1290 0x7f71e40b6780 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f71e4045c50 tx=0x7f71d0006ee0).stop 2021-03-25T14:17:56.213 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.131+0000 7f71eac6d700 1 -- 172.21.15.110:0/1057758005 shutdown_connections 2021-03-25T14:17:56.213 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.131+0000 7f71eac6d700 1 --2- 172.21.15.110:0/1057758005 >> v2:172.21.15.174:3300/0 conn(0x7f71e40b8510 0x7f71e4146940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:56.213 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.131+0000 7f71eac6d700 1 --2- 172.21.15.110:0/1057758005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71e40b1290 0x7f71e40b6780 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:56.213 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.131+0000 7f71eac6d700 1 -- 172.21.15.110:0/1057758005 >> 172.21.15.110:0/1057758005 conn(0x7f71e40663f0 msgr2=0x7f71e4066800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:56.213 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.131+0000 7f71eac6d700 1 -- 172.21.15.110:0/1057758005 shutdown_connections 2021-03-25T14:17:56.214 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.131+0000 7f71eac6d700 1 -- 172.21.15.110:0/1057758005 wait complete. 2021-03-25T14:17:56.214 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.132+0000 7f71eac6d700 1 Processor -- start 2021-03-25T14:17:56.214 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.132+0000 7f71eac6d700 1 -- start start 2021-03-25T14:17:56.214 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.133+0000 7f71eac6d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71e4064440 0x7f71e409eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:56.214 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.133+0000 7f71eac6d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71e40b1290 0x7f71e4146c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:56.214 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.133+0000 7f71eac6d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f71e40b8510 0x7f71e4159200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:56.214 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.133+0000 7f71eac6d700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e409f150 con 0x7f71e40b1290 2021-03-25T14:17:56.214 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.133+0000 7f71eac6d700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e415c840 con 0x7f71e4064440 2021-03-25T14:17:56.214 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.133+0000 7f71eac6d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71e415cae0 con 0x7f71e40b8510 2021-03-25T14:17:56.214 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.133+0000 7f71e3fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71e40b1290 0x7f71e4146c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:56.214 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.133+0000 7f71e3fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71e40b1290 0x7f71e4146c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50804/0 (socket says 172.21.15.110:50804) 2021-03-25T14:17:56.214 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.133+0000 7f71e3fff700 1 -- 172.21.15.110:0/3422930144 learned_addr learned my addr 172.21.15.110:0/3422930144 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:56.215 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.133+0000 7f71e920a700 1 --2- 172.21.15.110:0/3422930144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f71e40b8510 0x7f71e4159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:56.215 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.133+0000 7f71e8a09700 1 --2- 172.21.15.110:0/3422930144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71e4064440 0x7f71e409eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:56.215 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.134+0000 7f71e3fff700 1 -- 172.21.15.110:0/3422930144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f71e40b8510 msgr2=0x7f71e4159200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:56.215 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.134+0000 7f71e3fff700 1 --2- 172.21.15.110:0/3422930144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f71e40b8510 0x7f71e4159200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:56.215 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.134+0000 7f71e3fff700 1 -- 172.21.15.110:0/3422930144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71e4064440 msgr2=0x7f71e409eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:56.215 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.134+0000 7f71e3fff700 1 --2- 172.21.15.110:0/3422930144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71e4064440 0x7f71e409eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:56.215 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.134+0000 7f71e3fff700 1 -- 172.21.15.110:0/3422930144 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e415cd80 con 0x7f71e40b1290 2021-03-25T14:17:56.215 INFO:tasks.ceph.mds.c.smithi110.stderr:2021-03-25T14:17:56.134+0000 7f26adbe7700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2021-03-25T14:17:56.217 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.134+0000 7f71e3fff700 1 --2- 172.21.15.110:0/3422930144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71e40b1290 0x7f71e4146c80 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f71e40b95d0 tx=0x7f71d0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:56.217 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.134+0000 7f71e0ff9700 1 -- 172.21.15.110:0/3422930144 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d0012d40 con 0x7f71e40b1290 2021-03-25T14:17:56.217 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.134+0000 7f71e0ff9700 1 -- 172.21.15.110:0/3422930144 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d001c420 con 0x7f71e40b1290 2021-03-25T14:17:56.217 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.134+0000 7f71eac6d700 1 -- 172.21.15.110:0/3422930144 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71e415d020 con 0x7f71e40b1290 2021-03-25T14:17:56.217 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.134+0000 7f71e0ff9700 1 -- 172.21.15.110:0/3422930144 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d0012ea0 con 0x7f71e40b1290 2021-03-25T14:17:56.217 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.134+0000 7f71eac6d700 1 -- 172.21.15.110:0/3422930144 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71e4147170 con 0x7f71e40b1290 2021-03-25T14:17:56.218 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.135+0000 7f71eac6d700 1 -- 172.21.15.110:0/3422930144 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71e40b1750 con 0x7f71e40b1290 2021-03-25T14:17:56.218 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.135+0000 7f71e0ff9700 1 -- 172.21.15.110:0/3422930144 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f71d000f070 con 0x7f71e40b1290 2021-03-25T14:17:56.218 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.135+0000 7f71e0ff9700 1 --2- 172.21.15.110:0/3422930144 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f71c405a0e0 0x7f71c405c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:56.218 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.135+0000 7f71e0ff9700 1 -- 172.21.15.110:0/3422930144 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 7250+0+0 (secure 0 0 0) 0x7f71d00756f0 con 0x7f71e40b1290 2021-03-25T14:17:56.218 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.136+0000 7f71e8a09700 1 --2- 172.21.15.110:0/3422930144 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f71c405a0e0 0x7f71c405c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:56.218 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.136+0000 7f71e8a09700 1 --2- 172.21.15.110:0/3422930144 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f71c405a0e0 0x7f71c405c5a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f71d8003780 tx=0x7f71d8007bc0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:56.218 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.139+0000 7f71e0ff9700 1 -- 172.21.15.110:0/3422930144 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f71d0048bf0 con 0x7f71e40b1290 2021-03-25T14:17:56.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.347+0000 7f71eac6d700 1 -- 172.21.15.110:0/3422930144 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.testuser"} v 0) v1 -- 0x7f71e405d7b0 con 0x7f71e40b1290 2021-03-25T14:17:56.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.347+0000 7f71e0ff9700 1 -- 172.21.15.110:0/3422930144 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.testuser"}]=0 exported keyring for client.testuser v15) v1 ==== 121+0+245 (secure 0 0 0) 0x7f71d0006a70 con 0x7f71e40b1290 2021-03-25T14:17:56.349 INFO:teuthology.orchestra.run.smithi110.stdout:[client.testuser] 2021-03-25T14:17:56.349 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCUm1xgyGE0ABAApeS6A64YWd5WKKCc5/rHFg== 2021-03-25T14:17:56.349 INFO:teuthology.orchestra.run.smithi110.stdout: caps mds = "allow rw fsname=cephfs" 2021-03-25T14:17:56.349 INFO:teuthology.orchestra.run.smithi110.stdout: caps mon = "allow rw fsname=cephfs, allow rw fsname=cephfs2" 2021-03-25T14:17:56.350 INFO:teuthology.orchestra.run.smithi110.stdout: caps osd = "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2021-03-25T14:17:56.351 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.349+0000 7f71eac6d700 1 -- 172.21.15.110:0/3422930144 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f71c405a0e0 msgr2=0x7f71c405c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:56.351 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.349+0000 7f71eac6d700 1 --2- 172.21.15.110:0/3422930144 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f71c405a0e0 0x7f71c405c5a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f71d8003780 tx=0x7f71d8007bc0).stop 2021-03-25T14:17:56.351 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.349+0000 7f71eac6d700 1 -- 172.21.15.110:0/3422930144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71e40b1290 msgr2=0x7f71e4146c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:56.351 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.349+0000 7f71eac6d700 1 --2- 172.21.15.110:0/3422930144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71e40b1290 0x7f71e4146c80 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f71e40b95d0 tx=0x7f71d0016000).stop 2021-03-25T14:17:56.351 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.349+0000 7f71eac6d700 1 -- 172.21.15.110:0/3422930144 shutdown_connections 2021-03-25T14:17:56.351 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.349+0000 7f71eac6d700 1 --2- 172.21.15.110:0/3422930144 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f71c405a0e0 0x7f71c405c5a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:56.351 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.349+0000 7f71eac6d700 1 --2- 172.21.15.110:0/3422930144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71e4064440 0x7f71e409eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:56.351 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.349+0000 7f71eac6d700 1 --2- 172.21.15.110:0/3422930144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f71e40b8510 0x7f71e4159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:56.351 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.349+0000 7f71eac6d700 1 --2- 172.21.15.110:0/3422930144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71e40b1290 0x7f71e4146c80 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:56.351 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.349+0000 7f71eac6d700 1 -- 172.21.15.110:0/3422930144 >> 172.21.15.110:0/3422930144 conn(0x7f71e40663f0 msgr2=0x7f71e4067580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:56.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.349+0000 7f71eac6d700 1 -- 172.21.15.110:0/3422930144 shutdown_connections 2021-03-25T14:17:56.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.349+0000 7f71eac6d700 1 -- 172.21.15.110:0/3422930144 wait complete. 2021-03-25T14:17:56.352 INFO:teuthology.orchestra.run.smithi110.stderr:exported keyring for client.testuser 2021-03-25T14:17:56.364 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2021-03-25T14:17:56.378 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.iGjEGfq3fe 2021-03-25T14:17:56.378 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2021-03-25T14:17:56.378 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/tmp/tmp.iGjEGfq3fe 2021-03-25T14:17:56.442 DEBUG:teuthology.orchestra.run.smithi110:> chmod 644 /tmp/tmp.iGjEGfq3fe 2021-03-25T14:17:56.497 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2021-03-25T14:17:56.543 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-03-25T14:17:56.543 DEBUG:teuthology.orchestra.run.smithi110:> sudo umount /home/ubuntu/cephtest/mnt.0 2021-03-25T14:17:56.583 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi110.front.sepia.ceph.com 2021-03-25T14:17:56.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:56.583 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-03-25T14:17:56.637 DEBUG:teuthology.orchestra.run.smithi110:> ceph fs ls 2021-03-25T14:17:56.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.772+0000 7f5cf86b0700 1 Processor -- start 2021-03-25T14:17:56.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.772+0000 7f5cf86b0700 1 -- start start 2021-03-25T14:17:56.780 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.773+0000 7f5cf86b0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5cf00bde80 0x7f5cf00b8960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:56.781 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.773+0000 7f5cf86b0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5cf00664b0 0x7f5cf00b8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:56.781 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.773+0000 7f5cf86b0700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cf00b7d30 con 0x7f5cf0065110 2021-03-25T14:17:56.781 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.773+0000 7f5cf86b0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cf00b7fd0 con 0x7f5cf00664b0 2021-03-25T14:17:56.781 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.773+0000 7f5cf86b0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf00649d0 con 0x7f5cf00bde80 2021-03-25T14:17:56.781 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.773+0000 7f5cf6c4d700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f5cf0065110 0x7f5cf00ba7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43744/0 (socket says 172.21.15.110:43744) 2021-03-25T14:17:56.781 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.773+0000 7f5cf6c4d700 1 -- 172.21.15.110:0/3295112059 learned_addr learned my addr 172.21.15.110:0/3295112059 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:56.781 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.773+0000 7f5cf544a700 1 -- 172.21.15.110:0/3295112059 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1437232653 0 0) 0x7f5cf00b7d30 con 0x7f5cf0065110 2021-03-25T14:17:56.781 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.773+0000 7f5cf544a700 1 -- 172.21.15.110:0/3295112059 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cd8003270 con 0x7f5cf0065110 2021-03-25T14:17:56.781 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.773+0000 7f5cf644c700 1 --2- 172.21.15.110:0/3295112059 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5cf00bde80 0x7f5cf00b8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:56.781 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.773+0000 7f5cf5c4b700 1 --2- 172.21.15.110:0/3295112059 >> v2:172.21.15.174:3300/0 conn(0x7f5cf00664b0 0x7f5cf00b8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:56.781 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.774+0000 7f5cf544a700 1 -- 172.21.15.110:0/3295112059 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1589037279 0 0) 0x7f5cd8003270 con 0x7f5cf0065110 2021-03-25T14:17:56.782 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.774+0000 7f5cf544a700 1 -- 172.21.15.110:0/3295112059 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5cf00bde80 msgr2=0x7f5cf00b8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:56.782 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.774+0000 7f5cf544a700 1 --2- 172.21.15.110:0/3295112059 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5cf00bde80 0x7f5cf00b8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:56.782 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.774+0000 7f5cf544a700 1 -- 172.21.15.110:0/3295112059 >> v2:172.21.15.174:3300/0 conn(0x7f5cf00664b0 msgr2=0x7f5cf00b8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:56.782 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.774+0000 7f5cf544a700 1 --2- 172.21.15.110:0/3295112059 >> v2:172.21.15.174:3300/0 conn(0x7f5cf00664b0 0x7f5cf00b8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:56.782 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.774+0000 7f5cf544a700 1 -- 172.21.15.110:0/3295112059 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf0064c70 con 0x7f5cf0065110 2021-03-25T14:17:56.782 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.774+0000 7f5cf544a700 1 -- 172.21.15.110:0/3295112059 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f5ce80018a0 con 0x7f5cf0065110 2021-03-25T14:17:56.782 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.774+0000 7f5cf544a700 1 -- 172.21.15.110:0/3295112059 >> v1:172.21.15.110:6789/0 conn(0x7f5cf0065110 legacy=0x7f5cf00ba7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:56.782 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.774+0000 7f5cf544a700 1 --2- 172.21.15.110:0/3295112059 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cd8003760 0x7f5cd8003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:56.782 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.774+0000 7f5cf544a700 1 --2- 172.21.15.110:0/3295112059 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cd8004510 0x7f5cd8004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:56.782 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.774+0000 7f5cf544a700 1 --2- 172.21.15.110:0/3295112059 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5cf00bde80 0x7f5cd8004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:56.782 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.774+0000 7f5cf544a700 1 -- 172.21.15.110:0/3295112059 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf00b7fd0 con 0x7f5cd8003760 2021-03-25T14:17:56.782 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.774+0000 7f5cf544a700 1 -- 172.21.15.110:0/3295112059 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf00649d0 con 0x7f5cd8004510 2021-03-25T14:17:56.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.774+0000 7f5cf544a700 1 -- 172.21.15.110:0/3295112059 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd80042a0 con 0x7f5cf00bde80 2021-03-25T14:17:56.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.774+0000 7f5cf644c700 1 --2- 172.21.15.110:0/3295112059 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cd8003760 0x7f5cd8003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:56.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.774+0000 7f5cf5c4b700 1 --2- 172.21.15.110:0/3295112059 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cd8004510 0x7f5cd8004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:56.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.774+0000 7f5cf6c4d700 1 --2- 172.21.15.110:0/3295112059 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5cf00bde80 0x7f5cd8004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:56.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.774+0000 7f5cf644c700 1 -- 172.21.15.110:0/3295112059 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5cf00bde80 msgr2=0x7f5cd8004e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:56.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.774+0000 7f5cf644c700 1 --2- 172.21.15.110:0/3295112059 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5cf00bde80 0x7f5cd8004e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:56.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.774+0000 7f5cf644c700 1 -- 172.21.15.110:0/3295112059 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cd8004510 msgr2=0x7f5cd8004990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:56.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.774+0000 7f5cf644c700 1 --2- 172.21.15.110:0/3295112059 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cd8004510 0x7f5cd8004990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:56.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.774+0000 7f5cf644c700 1 -- 172.21.15.110:0/3295112059 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd8003270 con 0x7f5cd8003760 2021-03-25T14:17:56.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.774+0000 7f5cf644c700 1 --2- 172.21.15.110:0/3295112059 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cd8003760 0x7f5cd8003b80 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f5cec00bc30 tx=0x7f5cec006e20).ready entity=mon.0 client_cookie=730455d2772d4492 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:56.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.774+0000 7f5cf544a700 1 -- 172.21.15.110:0/3295112059 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec00b310 con 0x7f5cd8003760 2021-03-25T14:17:56.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.774+0000 7f5cf544a700 1 -- 172.21.15.110:0/3295112059 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cec00ea00 con 0x7f5cd8003760 2021-03-25T14:17:56.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.774+0000 7f5cf544a700 1 -- 172.21.15.110:0/3295112059 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec00ed80 con 0x7f5cd8003760 2021-03-25T14:17:56.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.775+0000 7f5cf86b0700 1 -- 172.21.15.110:0/3295112059 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cd8003760 msgr2=0x7f5cd8003b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:56.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.775+0000 7f5cf86b0700 1 --2- 172.21.15.110:0/3295112059 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cd8003760 0x7f5cd8003b80 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f5cec00bc30 tx=0x7f5cec006e20).stop 2021-03-25T14:17:56.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.775+0000 7f5cf6c4d700 1 -- 172.21.15.110:0/3295112059 reap_dead start 2021-03-25T14:17:56.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.775+0000 7f5cf86b0700 1 -- 172.21.15.110:0/3295112059 shutdown_connections 2021-03-25T14:17:56.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.775+0000 7f5cf86b0700 1 -- 172.21.15.110:0/3295112059 >> 172.21.15.110:0/3295112059 conn(0x7f5cf0062480 msgr2=0x7f5cf0062890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:56.785 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.775+0000 7f5cf86b0700 1 -- 172.21.15.110:0/3295112059 shutdown_connections 2021-03-25T14:17:56.785 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.775+0000 7f5cf86b0700 1 -- 172.21.15.110:0/3295112059 wait complete. 2021-03-25T14:17:56.785 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.776+0000 7f5cf86b0700 1 Processor -- start 2021-03-25T14:17:56.785 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.776+0000 7f5cf86b0700 1 -- start start 2021-03-25T14:17:56.785 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.777+0000 7f5cf86b0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5cd8003760 0x7f5cf0149610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:56.785 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.777+0000 7f5cf86b0700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cf01444e0 0x7f5cf0144940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:56.785 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.777+0000 7f5cf86b0700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cf014b480 0x7f5cf014b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:56.785 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.777+0000 7f5cf86b0700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf0149cb0 con 0x7f5cf01444e0 2021-03-25T14:17:56.785 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.777+0000 7f5cf86b0700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf0148720 con 0x7f5cf014b480 2021-03-25T14:17:56.786 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.777+0000 7f5cf86b0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf01489c0 con 0x7f5cd8003760 2021-03-25T14:17:56.786 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.777+0000 7f5cf5c4b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cf01444e0 0x7f5cf0144940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:56.786 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.777+0000 7f5cf5c4b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cf01444e0 0x7f5cf0144940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50822/0 (socket says 172.21.15.110:50822) 2021-03-25T14:17:56.786 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.777+0000 7f5cf5c4b700 1 -- 172.21.15.110:0/1227115711 learned_addr learned my addr 172.21.15.110:0/1227115711 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:56.786 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.777+0000 7f5cf644c700 1 --2- 172.21.15.110:0/1227115711 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5cd8003760 0x7f5cf0149610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:56.786 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.777+0000 7f5cf6c4d700 1 --2- 172.21.15.110:0/1227115711 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cf014b480 0x7f5cf014b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:56.786 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.777+0000 7f5cf5c4b700 1 -- 172.21.15.110:0/1227115711 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5cd8003760 msgr2=0x7f5cf0149610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:56.786 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.777+0000 7f5cf5c4b700 1 --2- 172.21.15.110:0/1227115711 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5cd8003760 0x7f5cf0149610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:56.786 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.777+0000 7f5cf5c4b700 1 -- 172.21.15.110:0/1227115711 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cf014b480 msgr2=0x7f5cf014b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:56.786 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.777+0000 7f5cf5c4b700 1 --2- 172.21.15.110:0/1227115711 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cf014b480 0x7f5cf014b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:56.786 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.777+0000 7f5cf5c4b700 1 -- 172.21.15.110:0/1227115711 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf0148c60 con 0x7f5cf01444e0 2021-03-25T14:17:56.787 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.777+0000 7f5cf6c4d700 1 --2- 172.21.15.110:0/1227115711 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cf014b480 0x7f5cf014b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:56.787 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.777+0000 7f5cf5c4b700 1 --2- 172.21.15.110:0/1227115711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cf01444e0 0x7f5cf0144940 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f5ce0011cc0 tx=0x7f5ce0006e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:56.787 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.777+0000 7f5cde7fc700 1 -- 172.21.15.110:0/1227115711 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce000b3e0 con 0x7f5cf01444e0 2021-03-25T14:17:56.787 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.777+0000 7f5cde7fc700 1 -- 172.21.15.110:0/1227115711 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce000fa40 con 0x7f5cf01444e0 2021-03-25T14:17:56.787 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.777+0000 7f5cf86b0700 1 -- 172.21.15.110:0/1227115711 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf014afe0 con 0x7f5cf01444e0 2021-03-25T14:17:56.787 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.777+0000 7f5cde7fc700 1 -- 172.21.15.110:0/1227115711 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce000fdc0 con 0x7f5cf01444e0 2021-03-25T14:17:56.787 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.777+0000 7f5cf86b0700 1 -- 172.21.15.110:0/1227115711 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf014bdd0 con 0x7f5cf01444e0 2021-03-25T14:17:56.787 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.778+0000 7f5cf86b0700 1 -- 172.21.15.110:0/1227115711 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cf014b170 con 0x7f5cf01444e0 2021-03-25T14:17:56.787 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.779+0000 7f5cde7fc700 1 -- 172.21.15.110:0/1227115711 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f5ce0014650 con 0x7f5cf01444e0 2021-03-25T14:17:56.787 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.779+0000 7f5cde7fc700 1 --2- 172.21.15.110:0/1227115711 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5cd005a0e0 0x7f5cd005c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:56.787 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.779+0000 7f5cde7fc700 1 -- 172.21.15.110:0/1227115711 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 7250+0+0 (secure 0 0 0) 0x7f5ce0074ba0 con 0x7f5cf01444e0 2021-03-25T14:17:56.787 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.779+0000 7f5cf644c700 1 --2- 172.21.15.110:0/1227115711 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5cd005a0e0 0x7f5cd005c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:56.788 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.779+0000 7f5cf644c700 1 --2- 172.21.15.110:0/1227115711 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5cd005a0e0 0x7f5cd005c5a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f5cec007fd0 tx=0x7f5cec019000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:56.789 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.783+0000 7f5cde7fc700 1 -- 172.21.15.110:0/1227115711 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f5ce00480a0 con 0x7f5cf01444e0 2021-03-25T14:17:56.972 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.970+0000 7f5cf86b0700 1 -- 172.21.15.110:0/1227115711 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5cf006aaa0 con 0x7f5cf01444e0 2021-03-25T14:17:56.973 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.970+0000 7f5cde7fc700 1 -- 172.21.15.110:0/1227115711 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) v1 ==== 53+0+149 (secure 0 0 0) 0x7f5ce004b6c0 con 0x7f5cf01444e0 2021-03-25T14:17:56.973 INFO:teuthology.orchestra.run.smithi110.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2021-03-25T14:17:56.974 INFO:teuthology.orchestra.run.smithi110.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2021-03-25T14:17:56.975 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.972+0000 7f5cf86b0700 1 -- 172.21.15.110:0/1227115711 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5cd005a0e0 msgr2=0x7f5cd005c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:56.976 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.972+0000 7f5cf86b0700 1 --2- 172.21.15.110:0/1227115711 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5cd005a0e0 0x7f5cd005c5a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f5cec007fd0 tx=0x7f5cec019000).stop 2021-03-25T14:17:56.976 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.972+0000 7f5cf86b0700 1 -- 172.21.15.110:0/1227115711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cf01444e0 msgr2=0x7f5cf0144940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:56.976 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.972+0000 7f5cf86b0700 1 --2- 172.21.15.110:0/1227115711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cf01444e0 0x7f5cf0144940 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f5ce0011cc0 tx=0x7f5ce0006e20).stop 2021-03-25T14:17:56.976 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.972+0000 7f5cf86b0700 1 -- 172.21.15.110:0/1227115711 shutdown_connections 2021-03-25T14:17:56.977 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.972+0000 7f5cf86b0700 1 --2- 172.21.15.110:0/1227115711 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5cd005a0e0 0x7f5cd005c5a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:56.977 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.972+0000 7f5cf86b0700 1 --2- 172.21.15.110:0/1227115711 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cf014b480 0x7f5cf014b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:56.977 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.972+0000 7f5cf86b0700 1 --2- 172.21.15.110:0/1227115711 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5cd8003760 0x7f5cf0149610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:56.977 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.972+0000 7f5cf86b0700 1 --2- 172.21.15.110:0/1227115711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cf01444e0 0x7f5cf0144940 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:56.977 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.972+0000 7f5cf86b0700 1 -- 172.21.15.110:0/1227115711 >> 172.21.15.110:0/1227115711 conn(0x7f5cf0062480 msgr2=0x7f5cf0145350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:56.978 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.972+0000 7f5cf86b0700 1 -- 172.21.15.110:0/1227115711 shutdown_connections 2021-03-25T14:17:56.978 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:56.972+0000 7f5cf86b0700 1 -- 172.21.15.110:0/1227115711 wait complete. 2021-03-25T14:17:56.984 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2021-03-25T14:17:56.985 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2021-03-25T14:17:56.985 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi110.front.sepia.ceph.com 2021-03-25T14:17:56.985 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2021-03-25T14:17:56.985 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2021-03-25T14:17:56.985 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2021-03-25T14:17:56.985 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2021-03-25T14:17:56.985 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.iGjEGfq3fe 2021-03-25T14:17:56.986 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2021-03-25T14:17:57.009 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.CDY1hNHZvG 2021-03-25T14:17:57.009 DEBUG:teuthology.orchestra.run.smithi110:> sudo cp /tmp/tmp.iGjEGfq3fe /tmp/tmp.CDY1hNHZvG 2021-03-25T14:17:57.074 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.CDY1hNHZvG 2021-03-25T14:17:57.198 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.CDY1hNHZvG is 245B 2021-03-25T14:17:57.246 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.CDY1hNHZvG 2021-03-25T14:17:57.260 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQCUm1xgyGE0ABAApeS6A64YWd5WKKCc5/rHFg== caps mds = "allow rw fsname=cephfs" caps mon = "allow rw fsname=cephfs, allow rw fsname=cephfs2" caps osd = "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2021-03-25T14:17:57.260 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2021-03-25T14:17:57.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:57.261 DEBUG:teuthology.orchestra.run.smithi110:> ip addr 2021-03-25T14:17:57.314 INFO:teuthology.orchestra.run.smithi110.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2021-03-25T14:17:57.314 INFO:teuthology.orchestra.run.smithi110.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2021-03-25T14:17:57.314 INFO:teuthology.orchestra.run.smithi110.stdout: inet 127.0.0.1/8 scope host lo 2021-03-25T14:17:57.314 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:57.314 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 ::1/128 scope host 2021-03-25T14:17:57.314 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:57.315 INFO:teuthology.orchestra.run.smithi110.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-03-25T14:17:57.315 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:14 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:17:57.315 INFO:teuthology.orchestra.run.smithi110.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-03-25T14:17:57.315 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:15 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:17:57.315 INFO:teuthology.orchestra.run.smithi110.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-03-25T14:17:57.315 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:34 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:17:57.315 INFO:teuthology.orchestra.run.smithi110.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2021-03-25T14:17:57.315 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:35 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:17:57.315 INFO:teuthology.orchestra.run.smithi110.stdout: inet 172.21.15.110/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2021-03-25T14:17:57.315 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft 42524sec preferred_lft 42524sec 2021-03-25T14:17:57.315 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::ec4:7aff:fe8f:cc35/64 scope link 2021-03-25T14:17:57.316 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:57.316 INFO:teuthology.orchestra.run.smithi110.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2021-03-25T14:17:57.316 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 1a:d9:4b:2f:6c:02 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:17:57.316 INFO:teuthology.orchestra.run.smithi110.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2021-03-25T14:17:57.316 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:57.316 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::1835:66ff:feca:f994/64 scope link 2021-03-25T14:17:57.316 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:57.316 INFO:teuthology.orchestra.run.smithi110.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2021-03-25T14:17:57.316 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 1a:d9:4b:2f:6c:02 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2021-03-25T14:17:57.316 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::18d9:4bff:fe2f:6c02/64 scope link 2021-03-25T14:17:57.316 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:17:57.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:57.317 DEBUG:teuthology.orchestra.run.smithi110:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2021-03-25T14:17:57.377 INFO:teuthology.orchestra.run.smithi110.stdout:1 2021-03-25T14:17:57.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:57.378 DEBUG:teuthology.orchestra.run.smithi110:> route 2021-03-25T14:17:57.435 INFO:teuthology.orchestra.run.smithi110.stdout:Kernel IP routing table 2021-03-25T14:17:57.435 INFO:teuthology.orchestra.run.smithi110.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2021-03-25T14:17:57.435 INFO:teuthology.orchestra.run.smithi110.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2021-03-25T14:17:57.436 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2021-03-25T14:17:57.436 INFO:teuthology.orchestra.run.smithi110.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2021-03-25T14:17:57.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:57.436 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec sudo bash -c ' 2021-03-25T14:17:57.436 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2021-03-25T14:17:57.436 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2021-03-25T14:17:57.437 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2021-03-25T14:17:57.437 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2021-03-25T14:17:57.437 DEBUG:teuthology.orchestra.run.smithi110:> ') 2021-03-25T14:17:57.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:57.533 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2021-03-25T14:17:57.548 INFO:teuthology.orchestra.run.smithi110.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2021-03-25T14:17:57.548 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2021-03-25T14:17:57.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:57.548 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set brx.0 up 2021-03-25T14:17:57.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:57.613 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p /home/ubuntu/cephtest/mnt.0 2021-03-25T14:17:57.667 DEBUG:teuthology.orchestra.run.smithi110:> sudo cat /tmp/tmp.iGjEGfq3fe 2021-03-25T14:17:57.729 INFO:teuthology.orchestra.run.smithi110.stdout:[client.testuser] 2021-03-25T14:17:57.729 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCUm1xgyGE0ABAApeS6A64YWd5WKKCc5/rHFg== 2021-03-25T14:17:57.729 INFO:teuthology.orchestra.run.smithi110.stdout: caps mds = "allow rw fsname=cephfs" 2021-03-25T14:17:57.729 INFO:teuthology.orchestra.run.smithi110.stdout: caps mon = "allow rw fsname=cephfs, allow rw fsname=cephfs2" 2021-03-25T14:17:57.729 INFO:teuthology.orchestra.run.smithi110.stdout: caps osd = "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2021-03-25T14:17:57.730 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-03-25T14:17:57.730 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=testuser,secret=AQCUm1xgyGE0ABAApeS6A64YWd5WKKCc5/rHFg==,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs2,norbytes 2021-03-25T14:17:57.810 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,name=testuser,secret=AQCUm1xgyGE0ABAApeS6A64YWd5WKKCc5/rHFg==,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs2,norbytes 2021-03-25T14:17:57.810 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,name=testuser,mds_namespace=cephfs2,norbytes" will pass to kernel. 2021-03-25T14:17:57.811 INFO:teuthology.orchestra.run.smithi110.stdout:keyring.get_secret failed 2021-03-25T14:17:57.863 INFO:teuthology.orchestra.run.smithi110.stderr:mount error 13 = Permission denied 2021-03-25T14:17:57.864 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,name=testuser,secret=AQCUm1xgyGE0ABAApeS6A64YWd5WKKCc5/rHFg==,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs2,norbytes 2021-03-25T14:17:57.864 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,name=testuser,mds_namespace=cephfs2,norbytes" will pass to kernel. 2021-03-25T14:17:57.866 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-03-25T14:17:57.867 INFO:tasks.cephfs.kernel_mount:mount command failed 2021-03-25T14:17:57.867 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-03-25T14:17:57.867 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-03-25T14:17:57.933 DEBUG:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-03-25T14:17:57.965 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-03-25T14:17:57.965 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2021-03-25T14:17:57.966 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-03-25T14:17:57.966 DEBUG:teuthology.orchestra.run.smithi174:> sudo umount /home/ubuntu/cephtest/mnt.1 2021-03-25T14:17:58.045 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi174.front.sepia.ceph.com 2021-03-25T14:17:58.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:17:58.046 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-03-25T14:17:58.101 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-03-25T14:17:58.213 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.212+0000 7f27ebfff700 1 Processor -- start 2021-03-25T14:17:58.213 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.212+0000 7f27ebfff700 1 -- start start 2021-03-25T14:17:58.219 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.212+0000 7f27ebfff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f27ec064d80 0x7f27ec065160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:58.219 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.212+0000 7f27ebfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27ec068980 0x7f27ec0bd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:58.219 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.212+0000 7f27ebfff700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27ec14cd90 con 0x7f27ec0bd600 2021-03-25T14:17:58.219 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.212+0000 7f27ebfff700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27ec143d60 con 0x7f27ec064d80 2021-03-25T14:17:58.219 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.212+0000 7f27ebfff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec14d030 con 0x7f27ec068980 2021-03-25T14:17:58.220 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.212+0000 7f27eaffd700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f27ec064d80 0x7f27ec065160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:58.220 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.212+0000 7f27eaffd700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f27ec064d80 0x7f27ec065160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50832/0 (socket says 172.21.15.110:50832) 2021-03-25T14:17:58.220 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.212+0000 7f27eaffd700 1 -- 172.21.15.110:0/1563046487 learned_addr learned my addr 172.21.15.110:0/1563046487 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:58.220 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.212+0000 7f27ea7fc700 1 --2- 172.21.15.110:0/1563046487 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27ec068980 0x7f27ec0bd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:58.220 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.212+0000 7f27eaffd700 1 -- 172.21.15.110:0/1563046487 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27ec068980 msgr2=0x7f27ec0bd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:58.220 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.212+0000 7f27eaffd700 1 --2- 172.21.15.110:0/1563046487 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27ec068980 0x7f27ec0bd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:58.220 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.212+0000 7f27eaffd700 1 -- 172.21.15.110:0/1563046487 >> v1:172.21.15.110:6789/0 conn(0x7f27ec0bd600 legacy=0x7f27ec149910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:58.220 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.212+0000 7f27eaffd700 1 -- 172.21.15.110:0/1563046487 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ec14d2d0 con 0x7f27ec064d80 2021-03-25T14:17:58.220 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.212+0000 7f27e9ffb700 1 -- 172.21.15.110:0/1563046487 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 835734389 0 0) 0x7f27ec14cd90 con 0x7f27ec0bd600 2021-03-25T14:17:58.221 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.212+0000 7f27eaffd700 1 --2- 172.21.15.110:0/1563046487 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27ec064d80 0x7f27ec065160 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f27e000ba50 tx=0x7f27e0006ee0).ready entity=mon.0 client_cookie=207a7b379075a928 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:58.221 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.212+0000 7f27e9ffb700 1 -- 172.21.15.110:0/1563046487 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e0009800 con 0x7f27ec064d80 2021-03-25T14:17:58.221 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.212+0000 7f27e9ffb700 1 -- 172.21.15.110:0/1563046487 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e0009960 con 0x7f27ec064d80 2021-03-25T14:17:58.221 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.212+0000 7f27e9ffb700 1 -- 172.21.15.110:0/1563046487 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e0009ce0 con 0x7f27ec064d80 2021-03-25T14:17:58.221 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.213+0000 7f27ebfff700 1 -- 172.21.15.110:0/1563046487 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27ec064d80 msgr2=0x7f27ec065160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:58.221 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.213+0000 7f27ebfff700 1 --2- 172.21.15.110:0/1563046487 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27ec064d80 0x7f27ec065160 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f27e000ba50 tx=0x7f27e0006ee0).stop 2021-03-25T14:17:58.221 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.213+0000 7f27ebfff700 1 -- 172.21.15.110:0/1563046487 shutdown_connections 2021-03-25T14:17:58.221 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.213+0000 7f27ebfff700 1 --2- 172.21.15.110:0/1563046487 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27ec064d80 0x7f27ec065160 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:58.221 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.213+0000 7f27ebfff700 1 --2- 172.21.15.110:0/1563046487 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27ec068980 0x7f27ec0bd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:58.221 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.213+0000 7f27ebfff700 1 -- 172.21.15.110:0/1563046487 >> 172.21.15.110:0/1563046487 conn(0x7f27ec062820 msgr2=0x7f27ec0bca00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:58.222 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.213+0000 7f27ebfff700 1 -- 172.21.15.110:0/1563046487 shutdown_connections 2021-03-25T14:17:58.222 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.213+0000 7f27ebfff700 1 -- 172.21.15.110:0/1563046487 wait complete. 2021-03-25T14:17:58.222 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.214+0000 7f27ebfff700 1 Processor -- start 2021-03-25T14:17:58.222 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.214+0000 7f27ebfff700 1 -- start start 2021-03-25T14:17:58.222 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.216+0000 7f27ebfff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27ec064d80 0x7f27ec0b3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:58.222 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.216+0000 7f27ebfff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27ec068980 0x7f27ec0b3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:58.222 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.216+0000 7f27ebfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27ec0bd600 0x7f27ec0a11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:58.222 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.216+0000 7f27ebfff700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec0a0b10 con 0x7f27ec068980 2021-03-25T14:17:58.222 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.216+0000 7f27ebfff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec0b8970 con 0x7f27ec064d80 2021-03-25T14:17:58.222 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.216+0000 7f27ebfff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec09c9d0 con 0x7f27ec0bd600 2021-03-25T14:17:58.223 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.216+0000 7f27ea7fc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27ec068980 0x7f27ec0b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:58.223 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.216+0000 7f27ea7fc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27ec068980 0x7f27ec0b3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50840/0 (socket says 172.21.15.110:50840) 2021-03-25T14:17:58.223 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.216+0000 7f27ea7fc700 1 -- 172.21.15.110:0/4041173142 learned_addr learned my addr 172.21.15.110:0/4041173142 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:58.223 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.216+0000 7f27ea7fc700 1 -- 172.21.15.110:0/4041173142 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27ec0bd600 msgr2=0x7f27ec0a11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:58.223 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.216+0000 7f27ea7fc700 1 --2- 172.21.15.110:0/4041173142 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27ec0bd600 0x7f27ec0a11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:58.223 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.216+0000 7f27ea7fc700 1 -- 172.21.15.110:0/4041173142 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27ec064d80 msgr2=0x7f27ec0b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:58.223 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.216+0000 7f27ea7fc700 1 --2- 172.21.15.110:0/4041173142 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27ec064d80 0x7f27ec0b3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:58.223 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.216+0000 7f27ea7fc700 1 -- 172.21.15.110:0/4041173142 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ec09cc70 con 0x7f27ec068980 2021-03-25T14:17:58.223 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.216+0000 7f27ea7fc700 1 --2- 172.21.15.110:0/4041173142 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27ec068980 0x7f27ec0b3550 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f27dc00db60 tx=0x7f27dc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:58.223 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.216+0000 7f27d2ffd700 1 -- 172.21.15.110:0/4041173142 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc009820 con 0x7f27ec068980 2021-03-25T14:17:58.224 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.216+0000 7f27d2ffd700 1 -- 172.21.15.110:0/4041173142 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27dc009980 con 0x7f27ec068980 2021-03-25T14:17:58.224 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.216+0000 7f27ebfff700 1 -- 172.21.15.110:0/4041173142 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27ec09cf10 con 0x7f27ec068980 2021-03-25T14:17:58.224 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.216+0000 7f27d2ffd700 1 -- 172.21.15.110:0/4041173142 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc009d00 con 0x7f27ec068980 2021-03-25T14:17:58.224 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.216+0000 7f27ebfff700 1 -- 172.21.15.110:0/4041173142 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27ec0b1ba0 con 0x7f27ec068980 2021-03-25T14:17:58.224 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.216+0000 7f27ebfff700 1 -- 172.21.15.110:0/4041173142 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27ec045ae0 con 0x7f27ec068980 2021-03-25T14:17:58.224 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.216+0000 7f27d2ffd700 1 -- 172.21.15.110:0/4041173142 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f27dc013690 con 0x7f27ec068980 2021-03-25T14:17:58.224 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.217+0000 7f27d2ffd700 1 --2- 172.21.15.110:0/4041173142 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f27cc05a0b0 0x7f27cc05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:58.224 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.217+0000 7f27d2ffd700 1 -- 172.21.15.110:0/4041173142 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 7250+0+0 (secure 0 0 0) 0x7f27dc074860 con 0x7f27ec068980 2021-03-25T14:17:58.224 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.217+0000 7f27eaffd700 1 --2- 172.21.15.110:0/4041173142 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f27cc05a0b0 0x7f27cc05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:58.224 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.217+0000 7f27eaffd700 1 --2- 172.21.15.110:0/4041173142 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f27cc05a0b0 0x7f27cc05c570 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f27e000b1d0 tx=0x7f27e0016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:58.225 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.221+0000 7f27d2ffd700 1 -- 172.21.15.110:0/4041173142 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f27dc047d00 con 0x7f27ec068980 2021-03-25T14:17:58.408 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.406+0000 7f27ebfff700 1 -- 172.21.15.110:0/4041173142 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27ec0a0db0 con 0x7f27ec068980 2021-03-25T14:17:58.408 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.406+0000 7f27d2ffd700 1 -- 172.21.15.110:0/4041173142 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+3779 (secure 0 0 0) 0x7f27dc009e60 con 0x7f27ec068980 2021-03-25T14:17:58.408 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:58.408 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4997,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/3015251726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3015251726},{"type":"v1","addr":"172.21.15.174:6835","nonce":3015251726}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":24},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/1698368640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1698368640},{"type":"v1","addr":"172.21.15.174:6833","nonce":1698368640}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-03-25T14:17:42.344725+0000","modified":"2021-03-25T14:17:43.345825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5604":{"gid":5604,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6836/426511293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":426511293},{"type":"v1","addr":"172.21.15.110:6836","nonce":426511293}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-03-25T14:17:52.495440+0000","modified":"2021-03-25T14:17:53.496776+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5601},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5601":{"gid":5601,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":5,"addr":"172.21.15.110:6837/2143874763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":2143874763},{"type":"v1","addr":"172.21.15.110:6837","nonce":2143874763}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs2","balancer":"","standby_count_wanted":0},"id":5}]} 2021-03-25T14:17:58.410 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.408+0000 7f27ebfff700 1 -- 172.21.15.110:0/4041173142 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f27cc05a0b0 msgr2=0x7f27cc05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:58.410 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.408+0000 7f27ebfff700 1 --2- 172.21.15.110:0/4041173142 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f27cc05a0b0 0x7f27cc05c570 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f27e000b1d0 tx=0x7f27e0016000).stop 2021-03-25T14:17:58.410 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.408+0000 7f27ebfff700 1 -- 172.21.15.110:0/4041173142 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27ec068980 msgr2=0x7f27ec0b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:58.410 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.408+0000 7f27ebfff700 1 --2- 172.21.15.110:0/4041173142 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27ec068980 0x7f27ec0b3550 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f27dc00db60 tx=0x7f27dc008040).stop 2021-03-25T14:17:58.410 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.408+0000 7f27ebfff700 1 -- 172.21.15.110:0/4041173142 shutdown_connections 2021-03-25T14:17:58.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.408+0000 7f27ebfff700 1 --2- 172.21.15.110:0/4041173142 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f27cc05a0b0 0x7f27cc05c570 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:58.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.408+0000 7f27ebfff700 1 --2- 172.21.15.110:0/4041173142 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27ec064d80 0x7f27ec0b3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:58.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.408+0000 7f27ebfff700 1 --2- 172.21.15.110:0/4041173142 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27ec0bd600 0x7f27ec0a11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:58.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.408+0000 7f27ebfff700 1 --2- 172.21.15.110:0/4041173142 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27ec068980 0x7f27ec0b3550 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:58.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.408+0000 7f27ebfff700 1 -- 172.21.15.110:0/4041173142 >> 172.21.15.110:0/4041173142 conn(0x7f27ec062820 msgr2=0x7f27ec060c40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:58.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.408+0000 7f27ebfff700 1 -- 172.21.15.110:0/4041173142 shutdown_connections 2021-03-25T14:17:58.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.408+0000 7f27ebfff700 1 -- 172.21.15.110:0/4041173142 wait complete. 2021-03-25T14:17:58.411 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 30 2021-03-25T14:17:58.422 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:17:58.531 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.529+0000 7f880ae51700 1 Processor -- start 2021-03-25T14:17:58.531 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.529+0000 7f880ae51700 1 -- start start 2021-03-25T14:17:58.534 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.530+0000 7f880ae51700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f88040b85a0 0x7f8804145fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:58.534 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.530+0000 7f880ae51700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8804068a20 con 0x7f880409f5a0 2021-03-25T14:17:58.535 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.530+0000 7f880ae51700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f880405ca10 con 0x7f88040a19a0 2021-03-25T14:17:58.535 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.530+0000 7f880ae51700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8804066a50 con 0x7f88040b85a0 2021-03-25T14:17:58.535 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.530+0000 7f8808bed700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f880409f5a0 0x7f88040b9570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43786/0 (socket says 172.21.15.110:43786) 2021-03-25T14:17:58.535 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.530+0000 7f8808bed700 1 -- 172.21.15.110:0/3938315845 learned_addr learned my addr 172.21.15.110:0/3938315845 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:58.535 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.530+0000 7f88093ee700 1 --2- 172.21.15.110:0/3938315845 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f88040b85a0 0x7f8804145fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:58.535 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.530+0000 7f88037fe700 1 -- 172.21.15.110:0/3938315845 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2576654799 0 0) 0x7f8804068a20 con 0x7f880409f5a0 2021-03-25T14:17:58.535 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.531+0000 7f88037fe700 1 -- 172.21.15.110:0/3938315845 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87e8003270 con 0x7f880409f5a0 2021-03-25T14:17:58.535 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.531+0000 7f88037fe700 1 -- 172.21.15.110:0/3938315845 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 169789352 0 0) 0x7f880405ca10 con 0x7f88040a19a0 2021-03-25T14:17:58.535 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.531+0000 7f88037fe700 1 -- 172.21.15.110:0/3938315845 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8804068a20 con 0x7f88040a19a0 2021-03-25T14:17:58.535 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.531+0000 7f88037fe700 1 -- 172.21.15.110:0/3938315845 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2495342836 0 0) 0x7f87e8003270 con 0x7f880409f5a0 2021-03-25T14:17:58.535 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.531+0000 7f88093ee700 1 -- 172.21.15.110:0/3938315845 >> v1:172.21.15.174:6789/0 conn(0x7f88040a19a0 legacy=0x7f88041458b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:58.535 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.531+0000 7f88093ee700 1 -- 172.21.15.110:0/3938315845 >> v1:172.21.15.110:6789/0 conn(0x7f880409f5a0 legacy=0x7f88040b9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:58.536 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.531+0000 7f88093ee700 1 -- 172.21.15.110:0/3938315845 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f880405ccb0 con 0x7f88040b85a0 2021-03-25T14:17:58.536 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.531+0000 7f88093ee700 1 --2- 172.21.15.110:0/3938315845 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f88040b85a0 0x7f8804145fc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f87fc009cf0 tx=0x7f87fc009220).ready entity=mon.2 client_cookie=e26f4abe676e8f52 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:58.536 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.531+0000 7f88037fe700 1 -- 172.21.15.110:0/3938315845 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f8001520 con 0x7f88040b85a0 2021-03-25T14:17:58.536 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.531+0000 7f88037fe700 1 -- 172.21.15.110:0/3938315845 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87fc00b680 con 0x7f88040b85a0 2021-03-25T14:17:58.536 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.531+0000 7f88037fe700 1 -- 172.21.15.110:0/3938315845 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc00ba00 con 0x7f88040b85a0 2021-03-25T14:17:58.536 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.532+0000 7f880ae51700 1 -- 172.21.15.110:0/3938315845 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f88040b85a0 msgr2=0x7f8804145fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:58.536 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.532+0000 7f880ae51700 1 --2- 172.21.15.110:0/3938315845 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f88040b85a0 0x7f8804145fc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f87fc009cf0 tx=0x7f87fc009220).stop 2021-03-25T14:17:58.536 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.532+0000 7f880ae51700 1 -- 172.21.15.110:0/3938315845 shutdown_connections 2021-03-25T14:17:58.536 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.532+0000 7f880ae51700 1 --2- 172.21.15.110:0/3938315845 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f88040b85a0 0x7f8804145fc0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:58.536 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.532+0000 7f880ae51700 1 -- 172.21.15.110:0/3938315845 >> 172.21.15.110:0/3938315845 conn(0x7f88040bce50 msgr2=0x7f88040b8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:58.536 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.532+0000 7f880ae51700 1 -- 172.21.15.110:0/3938315845 shutdown_connections 2021-03-25T14:17:58.536 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.532+0000 7f880ae51700 1 -- 172.21.15.110:0/3938315845 wait complete. 2021-03-25T14:17:58.536 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.533+0000 7f880ae51700 1 Processor -- start 2021-03-25T14:17:58.537 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.533+0000 7f880ae51700 1 -- start start 2021-03-25T14:17:58.539 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.533+0000 7f880ae51700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f880409f5a0 0x7f88040b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:58.539 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.533+0000 7f880ae51700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f88040a19a0 0x7f880415c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:58.540 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.533+0000 7f880ae51700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88040b85a0 0x7f880415cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:58.540 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.533+0000 7f880ae51700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8804148c80 con 0x7f88040b85a0 2021-03-25T14:17:58.540 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.533+0000 7f880ae51700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8804147dc0 con 0x7f880409f5a0 2021-03-25T14:17:58.540 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.533+0000 7f880ae51700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f880415d080 con 0x7f88040a19a0 2021-03-25T14:17:58.540 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.534+0000 7f88093ee700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88040b85a0 0x7f880415cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:58.540 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.534+0000 7f88093ee700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88040b85a0 0x7f880415cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50854/0 (socket says 172.21.15.110:50854) 2021-03-25T14:17:58.540 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.534+0000 7f88093ee700 1 -- 172.21.15.110:0/2028530776 learned_addr learned my addr 172.21.15.110:0/2028530776 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:58.540 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.534+0000 7f8808bed700 1 --2- 172.21.15.110:0/2028530776 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f880409f5a0 0x7f88040b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:58.540 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.534+0000 7f8803fff700 1 --2- 172.21.15.110:0/2028530776 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f88040a19a0 0x7f880415c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:58.540 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.534+0000 7f88093ee700 1 -- 172.21.15.110:0/2028530776 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f88040a19a0 msgr2=0x7f880415c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:58.540 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.534+0000 7f88093ee700 1 --2- 172.21.15.110:0/2028530776 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f88040a19a0 0x7f880415c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:58.540 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.534+0000 7f88093ee700 1 -- 172.21.15.110:0/2028530776 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f880409f5a0 msgr2=0x7f88040b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:58.541 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.534+0000 7f88093ee700 1 --2- 172.21.15.110:0/2028530776 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f880409f5a0 0x7f88040b5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:58.541 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.534+0000 7f88093ee700 1 -- 172.21.15.110:0/2028530776 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88041491b0 con 0x7f88040b85a0 2021-03-25T14:17:58.541 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.534+0000 7f8803fff700 1 --2- 172.21.15.110:0/2028530776 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f88040a19a0 0x7f880415c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:58.541 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.534+0000 7f88093ee700 1 --2- 172.21.15.110:0/2028530776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88040b85a0 0x7f880415cb40 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f87fc0090b0 tx=0x7f87fc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:58.541 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.534+0000 7f8800ff9700 1 -- 172.21.15.110:0/2028530776 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc011e00 con 0x7f88040b85a0 2021-03-25T14:17:58.541 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.534+0000 7f8800ff9700 1 -- 172.21.15.110:0/2028530776 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87fc01c630 con 0x7f88040b85a0 2021-03-25T14:17:58.541 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.534+0000 7f880ae51700 1 -- 172.21.15.110:0/2028530776 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88041496c0 con 0x7f88040b85a0 2021-03-25T14:17:58.541 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.534+0000 7f8800ff9700 1 -- 172.21.15.110:0/2028530776 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc01c9d0 con 0x7f88040b85a0 2021-03-25T14:17:58.541 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.534+0000 7f880ae51700 1 -- 172.21.15.110:0/2028530776 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f880415c1b0 con 0x7f88040b85a0 2021-03-25T14:17:58.541 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.535+0000 7f880ae51700 1 -- 172.21.15.110:0/2028530776 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f880409fbb0 con 0x7f88040b85a0 2021-03-25T14:17:58.541 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.536+0000 7f8800ff9700 1 -- 172.21.15.110:0/2028530776 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f87fc02c070 con 0x7f88040b85a0 2021-03-25T14:17:58.541 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.536+0000 7f8800ff9700 1 --2- 172.21.15.110:0/2028530776 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f87e405a0e0 0x7f87e405c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:58.541 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.536+0000 7f8800ff9700 1 -- 172.21.15.110:0/2028530776 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 7250+0+0 (secure 0 0 0) 0x7f87fc076210 con 0x7f88040b85a0 2021-03-25T14:17:58.542 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.536+0000 7f8808bed700 1 --2- 172.21.15.110:0/2028530776 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f87e405a0e0 0x7f87e405c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:58.542 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.536+0000 7f8808bed700 1 --2- 172.21.15.110:0/2028530776 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f87e405a0e0 0x7f87e405c5a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f87f8001650 tx=0x7f87f8000bc0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:58.542 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.540+0000 7f8800ff9700 1 -- 172.21.15.110:0/2028530776 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f87fc049710 con 0x7f88040b85a0 2021-03-25T14:17:58.693 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.691+0000 7f880ae51700 1 -- 172.21.15.110:0/2028530776 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f880415c370 con 0x7f88040b85a0 2021-03-25T14:17:58.694 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.692+0000 7f8800ff9700 1 -- 172.21.15.110:0/2028530776 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+20269 (secure 0 0 0) 0x7f87fc020070 con 0x7f88040b85a0 2021-03-25T14:17:58.694 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:17:58.694 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":60,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:17:53.497087+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2021-03-25T14:17:40.271092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2021-03-25T14:17:41.271977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":12,"pool_name":"cephfs2_metadata","create_time":"2021-03-25T14:17:50.184585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}}},{"pool":13,"pool_name":"cephfs2_data","create_time":"2021-03-25T14:17:51.481411+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs2"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:17:58.696 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.693+0000 7f880ae51700 1 -- 172.21.15.110:0/2028530776 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f87e405a0e0 msgr2=0x7f87e405c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:58.696 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.693+0000 7f880ae51700 1 --2- 172.21.15.110:0/2028530776 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f87e405a0e0 0x7f87e405c5a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f87f8001650 tx=0x7f87f8000bc0).stop 2021-03-25T14:17:58.696 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.693+0000 7f880ae51700 1 -- 172.21.15.110:0/2028530776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88040b85a0 msgr2=0x7f880415cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:58.696 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.693+0000 7f880ae51700 1 --2- 172.21.15.110:0/2028530776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88040b85a0 0x7f880415cb40 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f87fc0090b0 tx=0x7f87fc017000).stop 2021-03-25T14:17:58.696 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.693+0000 7f880ae51700 1 -- 172.21.15.110:0/2028530776 shutdown_connections 2021-03-25T14:17:58.696 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.693+0000 7f880ae51700 1 --2- 172.21.15.110:0/2028530776 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f87e405a0e0 0x7f87e405c5a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:58.696 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.693+0000 7f880ae51700 1 --2- 172.21.15.110:0/2028530776 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f880409f5a0 0x7f88040b5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:58.697 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.693+0000 7f880ae51700 1 --2- 172.21.15.110:0/2028530776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88040b85a0 0x7f880415cb40 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:58.697 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.693+0000 7f880ae51700 1 --2- 172.21.15.110:0/2028530776 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f88040a19a0 0x7f880415c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:58.697 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.693+0000 7f880ae51700 1 -- 172.21.15.110:0/2028530776 >> 172.21.15.110:0/2028530776 conn(0x7f88040bce50 msgr2=0x7f8804067a10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:58.697 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.694+0000 7f880ae51700 1 -- 172.21.15.110:0/2028530776 shutdown_connections 2021-03-25T14:17:58.697 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.694+0000 7f880ae51700 1 -- 172.21.15.110:0/2028530776 wait complete. 2021-03-25T14:17:58.708 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-03-25T14:15:59.047299+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-03-25T14:16:00.537926+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2021-03-25T14:17:40.271092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2021-03-25T14:17:41.271977+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 12, 'pool_name': 'cephfs2_metadata', 'create_time': '2021-03-25T14:17:50.184585+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}}, {'pool': 13, 'pool_name': 'cephfs2_data', 'create_time': '2021-03-25T14:17:51.481411+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}}] 2021-03-25T14:17:58.708 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-03-25T14:17:58.821 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.819+0000 7f3a5ba20700 1 Processor -- start 2021-03-25T14:17:58.821 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.819+0000 7f3a5ba20700 1 -- start start 2021-03-25T14:17:58.823 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.820+0000 7f3a5ba20700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3a540b5d00 0x7f3a54145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:58.823 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.820+0000 7f3a5ba20700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a540648a0 0x7f3a5409db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:58.824 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.820+0000 7f3a5ba20700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a54149c50 con 0x7f3a540b0cc0 2021-03-25T14:17:58.824 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.820+0000 7f3a5ba20700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a54067960 con 0x7f3a540b5d00 2021-03-25T14:17:58.824 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.820+0000 7f3a5ba20700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a541461b0 con 0x7f3a540648a0 2021-03-25T14:17:58.824 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.820+0000 7f3a58fbb700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3a540b5d00 0x7f3a54145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:58.824 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.820+0000 7f3a58fbb700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3a540b5d00 0x7f3a54145cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50860/0 (socket says 172.21.15.110:50860) 2021-03-25T14:17:58.824 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.820+0000 7f3a58fbb700 1 -- 172.21.15.110:0/665904391 learned_addr learned my addr 172.21.15.110:0/665904391 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:58.824 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.820+0000 7f3a59fbd700 1 --2- 172.21.15.110:0/665904391 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a540648a0 0x7f3a5409db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:58.824 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.820+0000 7f3a58fbb700 1 -- 172.21.15.110:0/665904391 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a540648a0 msgr2=0x7f3a5409db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:58.824 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.820+0000 7f3a58fbb700 1 --2- 172.21.15.110:0/665904391 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a540648a0 0x7f3a5409db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:58.824 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.820+0000 7f3a58fbb700 1 -- 172.21.15.110:0/665904391 >> v1:172.21.15.174:6789/0 conn(0x7f3a540b0cc0 legacy=0x7f3a54067250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:58.824 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.820+0000 7f3a58fbb700 1 -- 172.21.15.110:0/665904391 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a54149e80 con 0x7f3a540b5d00 2021-03-25T14:17:58.824 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.820+0000 7f3a58fbb700 1 --2- 172.21.15.110:0/665904391 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a540b5d00 0x7f3a54145cc0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f3a5000ba20 tx=0x7f3a50006ee0).ready entity=mon.0 client_cookie=c58b833efe808855 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:58.825 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.821+0000 7f3a43fff700 1 -- 172.21.15.110:0/665904391 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a50009890 con 0x7f3a540b5d00 2021-03-25T14:17:58.825 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.821+0000 7f3a43fff700 1 -- 172.21.15.110:0/665904391 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a500099f0 con 0x7f3a540b5d00 2021-03-25T14:17:58.825 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.821+0000 7f3a43fff700 1 -- 172.21.15.110:0/665904391 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a50009d70 con 0x7f3a540b5d00 2021-03-25T14:17:58.825 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.821+0000 7f3a5ba20700 1 -- 172.21.15.110:0/665904391 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a540b5d00 msgr2=0x7f3a54145cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:58.825 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.821+0000 7f3a5ba20700 1 --2- 172.21.15.110:0/665904391 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a540b5d00 0x7f3a54145cc0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f3a5000ba20 tx=0x7f3a50006ee0).stop 2021-03-25T14:17:58.825 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.821+0000 7f3a5ba20700 1 -- 172.21.15.110:0/665904391 shutdown_connections 2021-03-25T14:17:58.825 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.821+0000 7f3a5ba20700 1 --2- 172.21.15.110:0/665904391 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a540648a0 0x7f3a5409db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:58.825 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.821+0000 7f3a5ba20700 1 --2- 172.21.15.110:0/665904391 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a540b5d00 0x7f3a54145cc0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:58.825 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.821+0000 7f3a5ba20700 1 -- 172.21.15.110:0/665904391 >> 172.21.15.110:0/665904391 conn(0x7f3a540664e0 msgr2=0x7f3a540668f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:58.825 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.821+0000 7f3a5ba20700 1 -- 172.21.15.110:0/665904391 shutdown_connections 2021-03-25T14:17:58.825 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.821+0000 7f3a5ba20700 1 -- 172.21.15.110:0/665904391 wait complete. 2021-03-25T14:17:58.828 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.822+0000 7f3a5ba20700 1 Processor -- start 2021-03-25T14:17:58.828 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.822+0000 7f3a5ba20700 1 -- start start 2021-03-25T14:17:58.829 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.823+0000 7f3a5ba20700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a540648a0 0x7f3a540b26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:58.829 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.823+0000 7f3a5ba20700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3a540b0cc0 0x7f3a540b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:58.829 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.823+0000 7f3a5ba20700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a540b5d00 0x7f3a541596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:58.829 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.823+0000 7f3a5ba20700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a54159b90 con 0x7f3a540648a0 2021-03-25T14:17:58.829 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.823+0000 7f3a5ba20700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a540b54a0 con 0x7f3a540b0cc0 2021-03-25T14:17:58.829 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.823+0000 7f3a5ba20700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a540b5740 con 0x7f3a540b5d00 2021-03-25T14:17:58.829 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.823+0000 7f3a597bc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a540648a0 0x7f3a540b26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:58.829 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.823+0000 7f3a597bc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a540648a0 0x7f3a540b26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50866/0 (socket says 172.21.15.110:50866) 2021-03-25T14:17:58.829 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.823+0000 7f3a597bc700 1 -- 172.21.15.110:0/2436568821 learned_addr learned my addr 172.21.15.110:0/2436568821 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:58.829 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.823+0000 7f3a59fbd700 1 --2- 172.21.15.110:0/2436568821 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a540b5d00 0x7f3a541596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:58.829 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.823+0000 7f3a58fbb700 1 --2- 172.21.15.110:0/2436568821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3a540b0cc0 0x7f3a540b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:58.829 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.823+0000 7f3a597bc700 1 -- 172.21.15.110:0/2436568821 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a540b5d00 msgr2=0x7f3a541596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:58.830 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.823+0000 7f3a597bc700 1 --2- 172.21.15.110:0/2436568821 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a540b5d00 0x7f3a541596a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:58.830 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.823+0000 7f3a597bc700 1 -- 172.21.15.110:0/2436568821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3a540b0cc0 msgr2=0x7f3a540b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:58.830 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.823+0000 7f3a597bc700 1 --2- 172.21.15.110:0/2436568821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3a540b0cc0 0x7f3a540b4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:58.830 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.823+0000 7f3a597bc700 1 -- 172.21.15.110:0/2436568821 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a540b59e0 con 0x7f3a540648a0 2021-03-25T14:17:58.830 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.824+0000 7f3a597bc700 1 --2- 172.21.15.110:0/2436568821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a540648a0 0x7f3a540b26d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f3a44009760 tx=0x7f3a44006e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:58.830 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.824+0000 7f3a417fa700 1 -- 172.21.15.110:0/2436568821 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4400d520 con 0x7f3a540648a0 2021-03-25T14:17:58.830 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.824+0000 7f3a417fa700 1 -- 172.21.15.110:0/2436568821 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a4400d6a0 con 0x7f3a540648a0 2021-03-25T14:17:58.830 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.824+0000 7f3a5ba20700 1 -- 172.21.15.110:0/2436568821 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a5409eb30 con 0x7f3a540648a0 2021-03-25T14:17:58.830 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.824+0000 7f3a417fa700 1 -- 172.21.15.110:0/2436568821 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4400da60 con 0x7f3a540648a0 2021-03-25T14:17:58.830 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.824+0000 7f3a5ba20700 1 -- 172.21.15.110:0/2436568821 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a5409f270 con 0x7f3a540648a0 2021-03-25T14:17:58.830 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.825+0000 7f3a5ba20700 1 -- 172.21.15.110:0/2436568821 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a5405d7b0 con 0x7f3a540648a0 2021-03-25T14:17:58.830 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.825+0000 7f3a417fa700 1 -- 172.21.15.110:0/2436568821 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f3a44012440 con 0x7f3a540648a0 2021-03-25T14:17:58.831 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.826+0000 7f3a417fa700 1 --2- 172.21.15.110:0/2436568821 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3a3405a0b0 0x7f3a3405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:58.831 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.826+0000 7f3a417fa700 1 -- 172.21.15.110:0/2436568821 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 7250+0+0 (secure 0 0 0) 0x7f3a44074230 con 0x7f3a540648a0 2021-03-25T14:17:58.831 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.826+0000 7f3a58fbb700 1 --2- 172.21.15.110:0/2436568821 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3a3405a0b0 0x7f3a3405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:58.831 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.826+0000 7f3a58fbb700 1 --2- 172.21.15.110:0/2436568821 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3a3405a0b0 0x7f3a3405c570 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f3a540b2be0 tx=0x7f3a50016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:58.831 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.830+0000 7f3a417fa700 1 -- 172.21.15.110:0/2436568821 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f3a4404b100 con 0x7f3a540648a0 2021-03-25T14:17:58.981 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.979+0000 7f3a5ba20700 1 -- 172.21.15.110:0/2436568821 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3a540b77e0 con 0x7f3a540648a0 2021-03-25T14:17:58.981 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.980+0000 7f3a417fa700 1 -- 172.21.15.110:0/2436568821 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v60) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3a4404acf0 con 0x7f3a540648a0 2021-03-25T14:17:58.982 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 1 2021-03-25T14:17:58.983 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.981+0000 7f3a5ba20700 1 -- 172.21.15.110:0/2436568821 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3a3405a0b0 msgr2=0x7f3a3405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:58.984 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.981+0000 7f3a5ba20700 1 --2- 172.21.15.110:0/2436568821 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3a3405a0b0 0x7f3a3405c570 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f3a540b2be0 tx=0x7f3a50016000).stop 2021-03-25T14:17:58.984 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.981+0000 7f3a5ba20700 1 -- 172.21.15.110:0/2436568821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a540648a0 msgr2=0x7f3a540b26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:58.984 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.981+0000 7f3a5ba20700 1 --2- 172.21.15.110:0/2436568821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a540648a0 0x7f3a540b26d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f3a44009760 tx=0x7f3a44006e20).stop 2021-03-25T14:17:58.984 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.981+0000 7f3a5ba20700 1 -- 172.21.15.110:0/2436568821 shutdown_connections 2021-03-25T14:17:58.984 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.981+0000 7f3a5ba20700 1 --2- 172.21.15.110:0/2436568821 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3a3405a0b0 0x7f3a3405c570 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:58.984 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.981+0000 7f3a5ba20700 1 --2- 172.21.15.110:0/2436568821 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a540b5d00 0x7f3a541596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:58.984 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.981+0000 7f3a5ba20700 1 --2- 172.21.15.110:0/2436568821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a540648a0 0x7f3a540b26d0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:58.984 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.981+0000 7f3a5ba20700 1 --2- 172.21.15.110:0/2436568821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3a540b0cc0 0x7f3a540b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:58.984 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.981+0000 7f3a5ba20700 1 -- 172.21.15.110:0/2436568821 >> 172.21.15.110:0/2436568821 conn(0x7f3a540664e0 msgr2=0x7f3a54068720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:58.984 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.981+0000 7f3a5ba20700 1 -- 172.21.15.110:0/2436568821 shutdown_connections 2021-03-25T14:17:58.984 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:58.981+0000 7f3a5ba20700 1 -- 172.21.15.110:0/2436568821 wait complete. 2021-03-25T14:17:58.995 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-03-25T14:17:59.109 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.108+0000 7f1fcd492700 1 Processor -- start 2021-03-25T14:17:59.109 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.108+0000 7f1fcd492700 1 -- start start 2021-03-25T14:17:59.114 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.108+0000 7f1fcd492700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1fc814d470 0x7f1fc814d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:59.114 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.108+0000 7f1fcd492700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1fc814cc90 0x7f1fc81493c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:59.115 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.108+0000 7f1fcd492700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fc80691b0 con 0x7f1fc81498b0 2021-03-25T14:17:59.115 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.108+0000 7f1fcd492700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fc80bc2b0 con 0x7f1fc814cc90 2021-03-25T14:17:59.115 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.108+0000 7f1fcd492700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fc8149dd0 con 0x7f1fc814d470 2021-03-25T14:17:59.115 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.109+0000 7f1fc67fc700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1fc814cc90 0x7f1fc81493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:59.115 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.109+0000 7f1fc67fc700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1fc814cc90 0x7f1fc81493c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50874/0 (socket says 172.21.15.110:50874) 2021-03-25T14:17:59.115 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.109+0000 7f1fc67fc700 1 -- 172.21.15.110:0/4091394429 learned_addr learned my addr 172.21.15.110:0/4091394429 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:59.115 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.109+0000 7f1fc77fe700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f1fc81498b0 0x7f1fc80685d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43810/0 (socket says 172.21.15.110:43810) 2021-03-25T14:17:59.115 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.109+0000 7f1fc6ffd700 1 --2- 172.21.15.110:0/4091394429 >> v2:172.21.15.174:3300/0 conn(0x7f1fc814d470 0x7f1fc814d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:59.115 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.109+0000 7f1fc67fc700 1 -- 172.21.15.110:0/4091394429 >> v2:172.21.15.174:3300/0 conn(0x7f1fc814d470 msgr2=0x7f1fc814d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:59.115 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.109+0000 7f1fc67fc700 1 --2- 172.21.15.110:0/4091394429 >> v2:172.21.15.174:3300/0 conn(0x7f1fc814d470 0x7f1fc814d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:59.115 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.109+0000 7f1fc67fc700 1 -- 172.21.15.110:0/4091394429 >> v1:172.21.15.110:6789/0 conn(0x7f1fc81498b0 legacy=0x7f1fc80685d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:59.116 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.109+0000 7f1fc67fc700 1 -- 172.21.15.110:0/4091394429 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc814a070 con 0x7f1fc814cc90 2021-03-25T14:17:59.116 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.109+0000 7f1fc5ffb700 1 -- 172.21.15.110:0/4091394429 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3084179417 0 0) 0x7f1fc80691b0 con 0x7f1fc81498b0 2021-03-25T14:17:59.116 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.109+0000 7f1fc67fc700 1 --2- 172.21.15.110:0/4091394429 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fc814cc90 0x7f1fc81493c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f1fc8061fa0 tx=0x7f1fb8006ee0).ready entity=mon.0 client_cookie=5cb14a6d8456f1d4 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:59.116 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.109+0000 7f1fc5ffb700 1 -- 172.21.15.110:0/4091394429 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb8009840 con 0x7f1fc814cc90 2021-03-25T14:17:59.116 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.109+0000 7f1fc5ffb700 1 -- 172.21.15.110:0/4091394429 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb80099a0 con 0x7f1fc814cc90 2021-03-25T14:17:59.116 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.109+0000 7f1fc5ffb700 1 -- 172.21.15.110:0/4091394429 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb8009d20 con 0x7f1fc814cc90 2021-03-25T14:17:59.116 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.110+0000 7f1fcd492700 1 -- 172.21.15.110:0/4091394429 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fc814cc90 msgr2=0x7f1fc81493c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:59.116 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.110+0000 7f1fcd492700 1 --2- 172.21.15.110:0/4091394429 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fc814cc90 0x7f1fc81493c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f1fc8061fa0 tx=0x7f1fb8006ee0).stop 2021-03-25T14:17:59.116 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.110+0000 7f1fcd492700 1 -- 172.21.15.110:0/4091394429 shutdown_connections 2021-03-25T14:17:59.116 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.110+0000 7f1fcd492700 1 --2- 172.21.15.110:0/4091394429 >> v2:172.21.15.174:3300/0 conn(0x7f1fc814d470 0x7f1fc814d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:59.116 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.110+0000 7f1fcd492700 1 --2- 172.21.15.110:0/4091394429 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fc814cc90 0x7f1fc81493c0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:59.116 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.110+0000 7f1fcd492700 1 -- 172.21.15.110:0/4091394429 >> 172.21.15.110:0/4091394429 conn(0x7f1fc8060c40 msgr2=0x7f1fc8061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:59.117 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.110+0000 7f1fcd492700 1 -- 172.21.15.110:0/4091394429 shutdown_connections 2021-03-25T14:17:59.117 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.110+0000 7f1fcd492700 1 -- 172.21.15.110:0/4091394429 wait complete. 2021-03-25T14:17:59.117 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.111+0000 7f1fcd492700 1 Processor -- start 2021-03-25T14:17:59.117 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.111+0000 7f1fcd492700 1 -- start start 2021-03-25T14:17:59.117 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.111+0000 7f1fcd492700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fc81498b0 0x7f1fc8064e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:59.117 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.111+0000 7f1fcd492700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fc814cc90 0x7f1fc80bf120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:59.117 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.111+0000 7f1fcd492700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1fc814d470 0x7f1fc8145440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:59.117 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.111+0000 7f1fcd492700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc8064ba0 con 0x7f1fc81498b0 2021-03-25T14:17:59.117 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.111+0000 7f1fcd492700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc80a3aa0 con 0x7f1fc814cc90 2021-03-25T14:17:59.117 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.111+0000 7f1fcd492700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc8064900 con 0x7f1fc814d470 2021-03-25T14:17:59.117 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.112+0000 7f1fc6ffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fc81498b0 0x7f1fc8064e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:59.117 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.112+0000 7f1fc6ffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fc81498b0 0x7f1fc8064e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50878/0 (socket says 172.21.15.110:50878) 2021-03-25T14:17:59.117 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.112+0000 7f1fc6ffd700 1 -- 172.21.15.110:0/1421255880 learned_addr learned my addr 172.21.15.110:0/1421255880 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:59.118 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.112+0000 7f1fc67fc700 1 --2- 172.21.15.110:0/1421255880 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fc814cc90 0x7f1fc80bf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:59.118 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.112+0000 7f1fc77fe700 1 --2- 172.21.15.110:0/1421255880 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1fc814d470 0x7f1fc8145440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:59.118 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.112+0000 7f1fc6ffd700 1 -- 172.21.15.110:0/1421255880 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1fc814d470 msgr2=0x7f1fc8145440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:59.118 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.112+0000 7f1fc6ffd700 1 --2- 172.21.15.110:0/1421255880 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1fc814d470 0x7f1fc8145440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:59.118 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.112+0000 7f1fc6ffd700 1 -- 172.21.15.110:0/1421255880 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fc814cc90 msgr2=0x7f1fc80bf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:59.118 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.112+0000 7f1fc6ffd700 1 --2- 172.21.15.110:0/1421255880 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fc814cc90 0x7f1fc80bf120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:59.118 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.112+0000 7f1fc6ffd700 1 -- 172.21.15.110:0/1421255880 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc80a3050 con 0x7f1fc81498b0 2021-03-25T14:17:59.118 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.112+0000 7f1fc67fc700 1 --2- 172.21.15.110:0/1421255880 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fc814cc90 0x7f1fc80bf120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:17:59.118 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.112+0000 7f1fc77fe700 1 --2- 172.21.15.110:0/1421255880 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1fc814d470 0x7f1fc8145440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:17:59.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.112+0000 7f1fc6ffd700 1 --2- 172.21.15.110:0/1421255880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fc81498b0 0x7f1fc8064e10 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f1fbc00ebd0 tx=0x7f1fbc006e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:59.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.112+0000 7f1faeffd700 1 -- 172.21.15.110:0/1421255880 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc00c9d0 con 0x7f1fc81498b0 2021-03-25T14:17:59.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.112+0000 7f1faeffd700 1 -- 172.21.15.110:0/1421255880 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fbc00cb30 con 0x7f1fc81498b0 2021-03-25T14:17:59.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.112+0000 7f1fcd492700 1 -- 172.21.15.110:0/1421255880 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fc80a5b70 con 0x7f1fc81498b0 2021-03-25T14:17:59.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.112+0000 7f1faeffd700 1 -- 172.21.15.110:0/1421255880 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc00ceb0 con 0x7f1fc81498b0 2021-03-25T14:17:59.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.112+0000 7f1fcd492700 1 -- 172.21.15.110:0/1421255880 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fc80a34f0 con 0x7f1fc81498b0 2021-03-25T14:17:59.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.113+0000 7f1fcd492700 1 -- 172.21.15.110:0/1421255880 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fc805d7b0 con 0x7f1fc81498b0 2021-03-25T14:17:59.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.113+0000 7f1faeffd700 1 -- 172.21.15.110:0/1421255880 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f1fbc012600 con 0x7f1fc81498b0 2021-03-25T14:17:59.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.114+0000 7f1faeffd700 1 --2- 172.21.15.110:0/1421255880 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f1fa805a0b0 0x7f1fa805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:59.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.114+0000 7f1faeffd700 1 -- 172.21.15.110:0/1421255880 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 7250+0+0 (secure 0 0 0) 0x7f1fbc074630 con 0x7f1fc81498b0 2021-03-25T14:17:59.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.114+0000 7f1fc67fc700 1 --2- 172.21.15.110:0/1421255880 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f1fa805a0b0 0x7f1fa805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:59.120 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.114+0000 7f1fc67fc700 1 --2- 172.21.15.110:0/1421255880 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f1fa805a0b0 0x7f1fa805c570 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f1fc8064020 tx=0x7f1fb8016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:59.120 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.117+0000 7f1faeffd700 1 -- 172.21.15.110:0/1421255880 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f1fbc047b30 con 0x7f1fc81498b0 2021-03-25T14:17:59.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.269+0000 7f1fcd492700 1 -- 172.21.15.110:0/1421255880 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1fc8061c50 con 0x7f1fc81498b0 2021-03-25T14:17:59.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.270+0000 7f1faeffd700 1 -- 172.21.15.110:0/1421255880 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v60) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1fbc04b150 con 0x7f1fc81498b0 2021-03-25T14:17:59.271 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:17:59.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.271+0000 7f1fcd492700 1 -- 172.21.15.110:0/1421255880 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f1fa805a0b0 msgr2=0x7f1fa805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:59.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.271+0000 7f1fcd492700 1 --2- 172.21.15.110:0/1421255880 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f1fa805a0b0 0x7f1fa805c570 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f1fc8064020 tx=0x7f1fb8016000).stop 2021-03-25T14:17:59.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.271+0000 7f1fcd492700 1 -- 172.21.15.110:0/1421255880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fc81498b0 msgr2=0x7f1fc8064e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:59.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.271+0000 7f1fcd492700 1 --2- 172.21.15.110:0/1421255880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fc81498b0 0x7f1fc8064e10 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f1fbc00ebd0 tx=0x7f1fbc006e20).stop 2021-03-25T14:17:59.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.271+0000 7f1fcd492700 1 -- 172.21.15.110:0/1421255880 shutdown_connections 2021-03-25T14:17:59.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.271+0000 7f1fcd492700 1 --2- 172.21.15.110:0/1421255880 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f1fa805a0b0 0x7f1fa805c570 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:59.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.271+0000 7f1fcd492700 1 --2- 172.21.15.110:0/1421255880 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1fc814d470 0x7f1fc8145440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:59.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.271+0000 7f1fcd492700 1 --2- 172.21.15.110:0/1421255880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fc81498b0 0x7f1fc8064e10 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:59.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.271+0000 7f1fcd492700 1 --2- 172.21.15.110:0/1421255880 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fc814cc90 0x7f1fc80bf120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:59.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.271+0000 7f1fcd492700 1 -- 172.21.15.110:0/1421255880 >> 172.21.15.110:0/1421255880 conn(0x7f1fc8060c40 msgr2=0x7f1fc8146fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:59.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.271+0000 7f1fcd492700 1 -- 172.21.15.110:0/1421255880 shutdown_connections 2021-03-25T14:17:59.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.271+0000 7f1fcd492700 1 -- 172.21.15.110:0/1421255880 wait complete. 2021-03-25T14:17:59.284 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-03-25T14:17:59.397 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.396+0000 7f55fe6a0700 1 Processor -- start 2021-03-25T14:17:59.397 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.396+0000 7f55fe6a0700 1 -- start start 2021-03-25T14:17:59.400 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.397+0000 7f55fe6a0700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f55f81471c0 0x7f55f80be2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:59.400 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.397+0000 7f55fe6a0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f55f80be7c0 0x7f55f80b4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:59.400 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.397+0000 7f55fe6a0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55f814ab30 0x7f55f80b4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:59.400 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.397+0000 7f55fe6a0700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55f80b3ba0 con 0x7f55f81471c0 2021-03-25T14:17:59.400 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.397+0000 7f55fe6a0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55f8148a30 con 0x7f55f80be7c0 2021-03-25T14:17:59.400 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.397+0000 7f55fe6a0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f814b0b0 con 0x7f55f814ab30 2021-03-25T14:17:59.400 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.397+0000 7f55f7fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f55f81471c0 0x7f55f80be2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:59.400 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.397+0000 7f55f7fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f55f81471c0 0x7f55f80be2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50884/0 (socket says 172.21.15.110:50884) 2021-03-25T14:17:59.400 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.397+0000 7f55f7fff700 1 -- 172.21.15.110:0/3719777083 learned_addr learned my addr 172.21.15.110:0/3719777083 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:59.401 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.397+0000 7f55f77fe700 1 --2- 172.21.15.110:0/3719777083 >> v2:172.21.15.174:3300/0 conn(0x7f55f80be7c0 0x7f55f80b4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:59.401 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.397+0000 7f55fcc3d700 1 --2- 172.21.15.110:0/3719777083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55f814ab30 0x7f55f80b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:59.401 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.397+0000 7f55f7fff700 1 -- 172.21.15.110:0/3719777083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55f814ab30 msgr2=0x7f55f80b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:59.401 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.397+0000 7f55f7fff700 1 --2- 172.21.15.110:0/3719777083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55f814ab30 0x7f55f80b4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:59.401 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.397+0000 7f55f7fff700 1 -- 172.21.15.110:0/3719777083 >> v2:172.21.15.174:3300/0 conn(0x7f55f80be7c0 msgr2=0x7f55f80b4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:59.401 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.397+0000 7f55f7fff700 1 --2- 172.21.15.110:0/3719777083 >> v2:172.21.15.174:3300/0 conn(0x7f55f80be7c0 0x7f55f80b4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:59.401 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.397+0000 7f55f7fff700 1 -- 172.21.15.110:0/3719777083 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f814b350 con 0x7f55f81471c0 2021-03-25T14:17:59.401 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.397+0000 7f55f77fe700 1 --2- 172.21.15.110:0/3719777083 >> v2:172.21.15.174:3300/0 conn(0x7f55f80be7c0 0x7f55f80b4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:59.401 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.397+0000 7f55f7fff700 1 --2- 172.21.15.110:0/3719777083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55f81471c0 0x7f55f80be2d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f55f80a0a00 tx=0x7f55ec006ee0).ready entity=mon.0 client_cookie=949ee0be42f0d68f server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:59.401 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.397+0000 7f55f6ffd700 1 -- 172.21.15.110:0/3719777083 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec009840 con 0x7f55f81471c0 2021-03-25T14:17:59.401 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.397+0000 7f55f6ffd700 1 -- 172.21.15.110:0/3719777083 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ec0099a0 con 0x7f55f81471c0 2021-03-25T14:17:59.401 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.397+0000 7f55f6ffd700 1 -- 172.21.15.110:0/3719777083 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec009d20 con 0x7f55f81471c0 2021-03-25T14:17:59.402 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.398+0000 7f55fe6a0700 1 -- 172.21.15.110:0/3719777083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55f81471c0 msgr2=0x7f55f80be2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:59.402 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.398+0000 7f55fe6a0700 1 --2- 172.21.15.110:0/3719777083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55f81471c0 0x7f55f80be2d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f55f80a0a00 tx=0x7f55ec006ee0).stop 2021-03-25T14:17:59.402 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.398+0000 7f55fe6a0700 1 -- 172.21.15.110:0/3719777083 shutdown_connections 2021-03-25T14:17:59.402 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.398+0000 7f55fe6a0700 1 --2- 172.21.15.110:0/3719777083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55f814ab30 0x7f55f80b4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:59.402 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.398+0000 7f55fe6a0700 1 --2- 172.21.15.110:0/3719777083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55f81471c0 0x7f55f80be2d0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:59.402 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.398+0000 7f55fe6a0700 1 --2- 172.21.15.110:0/3719777083 >> v2:172.21.15.174:3300/0 conn(0x7f55f80be7c0 0x7f55f80b4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:59.402 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.398+0000 7f55fe6a0700 1 -- 172.21.15.110:0/3719777083 >> 172.21.15.110:0/3719777083 conn(0x7f55f80686f0 msgr2=0x7f55f8068b00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:59.402 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.398+0000 7f55fe6a0700 1 -- 172.21.15.110:0/3719777083 shutdown_connections 2021-03-25T14:17:59.402 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.398+0000 7f55fe6a0700 1 -- 172.21.15.110:0/3719777083 wait complete. 2021-03-25T14:17:59.402 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.399+0000 7f55fe6a0700 1 Processor -- start 2021-03-25T14:17:59.402 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.399+0000 7f55fe6a0700 1 -- start start 2021-03-25T14:17:59.405 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.400+0000 7f55fe6a0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55f80be7c0 0x7f55f80b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:59.405 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.400+0000 7f55fe6a0700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55f81471c0 0x7f55f815a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:59.405 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.400+0000 7f55fe6a0700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55f814ab30 0x7f55f8145f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:59.405 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.400+0000 7f55fe6a0700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f80a3710 con 0x7f55f814ab30 2021-03-25T14:17:59.405 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.400+0000 7f55fe6a0700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f80a34f0 con 0x7f55f81471c0 2021-03-25T14:17:59.405 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.400+0000 7f55fe6a0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f80b62f0 con 0x7f55f80be7c0 2021-03-25T14:17:59.405 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.400+0000 7f55fcc3d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55f814ab30 0x7f55f8145f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:59.405 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.400+0000 7f55fcc3d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55f814ab30 0x7f55f8145f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50894/0 (socket says 172.21.15.110:50894) 2021-03-25T14:17:59.406 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.400+0000 7f55fcc3d700 1 -- 172.21.15.110:0/2157530877 learned_addr learned my addr 172.21.15.110:0/2157530877 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:59.406 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.400+0000 7f55f7fff700 1 --2- 172.21.15.110:0/2157530877 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55f80be7c0 0x7f55f80b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:59.406 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.400+0000 7f55f77fe700 1 --2- 172.21.15.110:0/2157530877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55f81471c0 0x7f55f815a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:59.406 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.400+0000 7f55fcc3d700 1 -- 172.21.15.110:0/2157530877 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55f80be7c0 msgr2=0x7f55f80b7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:59.406 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.400+0000 7f55fcc3d700 1 --2- 172.21.15.110:0/2157530877 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55f80be7c0 0x7f55f80b7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:59.406 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.400+0000 7f55fcc3d700 1 -- 172.21.15.110:0/2157530877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55f81471c0 msgr2=0x7f55f815a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:59.406 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.400+0000 7f55fcc3d700 1 --2- 172.21.15.110:0/2157530877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55f81471c0 0x7f55f815a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:59.406 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.400+0000 7f55fcc3d700 1 -- 172.21.15.110:0/2157530877 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f80a3970 con 0x7f55f814ab30 2021-03-25T14:17:59.406 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.400+0000 7f55fcc3d700 1 --2- 172.21.15.110:0/2157530877 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55f814ab30 0x7f55f8145f60 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f55f000db60 tx=0x7f55f0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:59.406 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.400+0000 7f55dffff700 1 -- 172.21.15.110:0/2157530877 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f0017070 con 0x7f55f814ab30 2021-03-25T14:17:59.406 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.400+0000 7f55dffff700 1 -- 172.21.15.110:0/2157530877 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f000b970 con 0x7f55f814ab30 2021-03-25T14:17:59.406 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.400+0000 7f55dffff700 1 -- 172.21.15.110:0/2157530877 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f000bd10 con 0x7f55f814ab30 2021-03-25T14:17:59.407 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.401+0000 7f55fe6a0700 1 -- 172.21.15.110:0/2157530877 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f815ae30 con 0x7f55f814ab30 2021-03-25T14:17:59.407 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.401+0000 7f55fe6a0700 1 -- 172.21.15.110:0/2157530877 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f8146450 con 0x7f55f814ab30 2021-03-25T14:17:59.407 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.401+0000 7f55fe6a0700 1 -- 172.21.15.110:0/2157530877 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55f80a3b70 con 0x7f55f814ab30 2021-03-25T14:17:59.407 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.402+0000 7f55dffff700 1 -- 172.21.15.110:0/2157530877 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f55f0013690 con 0x7f55f814ab30 2021-03-25T14:17:59.407 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.402+0000 7f55dffff700 1 --2- 172.21.15.110:0/2157530877 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f55d805a0e0 0x7f55d805c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:59.407 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.402+0000 7f55dffff700 1 -- 172.21.15.110:0/2157530877 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 7250+0+0 (secure 0 0 0) 0x7f55f0074480 con 0x7f55f814ab30 2021-03-25T14:17:59.407 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.402+0000 7f55f7fff700 1 --2- 172.21.15.110:0/2157530877 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f55d805a0e0 0x7f55d805c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:59.407 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.402+0000 7f55f7fff700 1 --2- 172.21.15.110:0/2157530877 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f55d805a0e0 0x7f55d805c5a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f55ec006f20 tx=0x7f55ec016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:59.407 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.406+0000 7f55dffff700 1 -- 172.21.15.110:0/2157530877 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f55f0047980 con 0x7f55f814ab30 2021-03-25T14:17:59.556 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.556+0000 7f55fe6a0700 1 -- 172.21.15.110:0/2157530877 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f55f815afc0 con 0x7f55f814ab30 2021-03-25T14:17:59.557 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.556+0000 7f55dffff700 1 -- 172.21.15.110:0/2157530877 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v60) v1 ==== 104+0+10 (secure 0 0 0) 0x7f55f004afa0 con 0x7f55f814ab30 2021-03-25T14:17:59.557 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:17:59.559 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.558+0000 7f55fe6a0700 1 -- 172.21.15.110:0/2157530877 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f55d805a0e0 msgr2=0x7f55d805c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:59.559 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.558+0000 7f55fe6a0700 1 --2- 172.21.15.110:0/2157530877 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f55d805a0e0 0x7f55d805c5a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f55ec006f20 tx=0x7f55ec016000).stop 2021-03-25T14:17:59.559 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.558+0000 7f55fe6a0700 1 -- 172.21.15.110:0/2157530877 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55f814ab30 msgr2=0x7f55f8145f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:59.559 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.558+0000 7f55fe6a0700 1 --2- 172.21.15.110:0/2157530877 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55f814ab30 0x7f55f8145f60 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f55f000db60 tx=0x7f55f0008040).stop 2021-03-25T14:17:59.559 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.558+0000 7f55fe6a0700 1 -- 172.21.15.110:0/2157530877 shutdown_connections 2021-03-25T14:17:59.559 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.558+0000 7f55fe6a0700 1 --2- 172.21.15.110:0/2157530877 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f55d805a0e0 0x7f55d805c5a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:59.559 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.558+0000 7f55fe6a0700 1 --2- 172.21.15.110:0/2157530877 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55f814ab30 0x7f55f8145f60 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:59.559 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.558+0000 7f55fe6a0700 1 --2- 172.21.15.110:0/2157530877 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55f80be7c0 0x7f55f80b7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:59.560 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.558+0000 7f55fe6a0700 1 --2- 172.21.15.110:0/2157530877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55f81471c0 0x7f55f815a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:59.560 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.558+0000 7f55fe6a0700 1 -- 172.21.15.110:0/2157530877 >> 172.21.15.110:0/2157530877 conn(0x7f55f80686f0 msgr2=0x7f55f80bad70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:59.560 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.558+0000 7f55fe6a0700 1 -- 172.21.15.110:0/2157530877 shutdown_connections 2021-03-25T14:17:59.560 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.558+0000 7f55fe6a0700 1 -- 172.21.15.110:0/2157530877 wait complete. 2021-03-25T14:17:59.570 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-03-25T14:17:59.683 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.682+0000 7f568779e700 1 Processor -- start 2021-03-25T14:17:59.683 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.682+0000 7f568779e700 1 -- start start 2021-03-25T14:17:59.689 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.683+0000 7f568779e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f568014d850 0x7f56800bc710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:59.689 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.683+0000 7f568779e700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56800691b0 con 0x7f568014d470 2021-03-25T14:17:59.689 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.683+0000 7f568779e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56800bc2b0 con 0x7f568014cc90 2021-03-25T14:17:59.689 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.683+0000 7f568779e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5680149dd0 con 0x7f568014d850 2021-03-25T14:17:59.690 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.683+0000 7f568553a700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f568014d470 0x7f56801493c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43834/0 (socket says 172.21.15.110:43834) 2021-03-25T14:17:59.690 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.683+0000 7f568553a700 1 -- 172.21.15.110:0/2694825747 learned_addr learned my addr 172.21.15.110:0/2694825747 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:59.690 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.683+0000 7f5685d3b700 1 --2- 172.21.15.110:0/2694825747 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f568014d850 0x7f56800bc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:59.690 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.683+0000 7f566ffff700 1 -- 172.21.15.110:0/2694825747 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2311880787 0 0) 0x7f56800691b0 con 0x7f568014d470 2021-03-25T14:17:59.690 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.683+0000 7f566ffff700 1 -- 172.21.15.110:0/2694825747 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5668003270 con 0x7f568014d470 2021-03-25T14:17:59.690 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.683+0000 7f566ffff700 1 -- 172.21.15.110:0/2694825747 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 119458704 0 0) 0x7f5668003270 con 0x7f568014d470 2021-03-25T14:17:59.690 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.683+0000 7f566ffff700 1 -- 172.21.15.110:0/2694825747 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f568014d850 msgr2=0x7f56800bc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:59.690 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.683+0000 7f566ffff700 1 --2- 172.21.15.110:0/2694825747 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f568014d850 0x7f56800bc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:59.690 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.683+0000 7f566ffff700 1 -- 172.21.15.110:0/2694825747 >> v1:172.21.15.174:6789/0 conn(0x7f568014cc90 legacy=0x7f56800685d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:59.690 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.683+0000 7f566ffff700 1 -- 172.21.15.110:0/2694825747 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568014a070 con 0x7f568014d470 2021-03-25T14:17:59.690 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.683+0000 7f566ffff700 1 -- 172.21.15.110:0/2694825747 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f5670001520 con 0x7f568014d470 2021-03-25T14:17:59.690 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.683+0000 7f566ffff700 1 -- 172.21.15.110:0/2694825747 >> v1:172.21.15.110:6789/0 conn(0x7f568014d470 legacy=0x7f56801493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:59.691 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.683+0000 7f566ffff700 1 --2- 172.21.15.110:0/2694825747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5668003790 0x7f5668003bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:59.691 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.683+0000 7f566ffff700 1 --2- 172.21.15.110:0/2694825747 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f568014d850 0x7f5668004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:59.691 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.683+0000 7f566ffff700 1 --2- 172.21.15.110:0/2694825747 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5668004a00 0x7f5668004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:59.691 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.683+0000 7f566ffff700 1 -- 172.21.15.110:0/2694825747 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5680149dd0 con 0x7f5668003790 2021-03-25T14:17:59.691 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.683+0000 7f566ffff700 1 -- 172.21.15.110:0/2694825747 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5668004230 con 0x7f5668004a00 2021-03-25T14:17:59.691 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.683+0000 7f566ffff700 1 -- 172.21.15.110:0/2694825747 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f566800b760 con 0x7f568014d850 2021-03-25T14:17:59.691 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.684+0000 7f568553a700 1 --2- 172.21.15.110:0/2694825747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5668003790 0x7f5668003bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:59.691 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.684+0000 7f5684d39700 1 --2- 172.21.15.110:0/2694825747 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f568014d850 0x7f5668004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:59.691 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.684+0000 7f5685d3b700 1 --2- 172.21.15.110:0/2694825747 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5668004a00 0x7f5668004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:59.691 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.684+0000 7f568553a700 1 -- 172.21.15.110:0/2694825747 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f568014d850 msgr2=0x7f5668004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:59.691 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.684+0000 7f568553a700 1 --2- 172.21.15.110:0/2694825747 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f568014d850 0x7f5668004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:59.691 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.684+0000 7f568553a700 1 -- 172.21.15.110:0/2694825747 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5668004a00 msgr2=0x7f5668004e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:59.692 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.684+0000 7f568553a700 1 --2- 172.21.15.110:0/2694825747 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5668004a00 0x7f5668004e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:59.692 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.684+0000 7f568553a700 1 -- 172.21.15.110:0/2694825747 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5668003270 con 0x7f5668003790 2021-03-25T14:17:59.692 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.684+0000 7f5685d3b700 1 --2- 172.21.15.110:0/2694825747 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5668004a00 0x7f5668004e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:59.692 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.684+0000 7f568553a700 1 --2- 172.21.15.110:0/2694825747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5668003790 0x7f5668003bb0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f567000c470 tx=0x7f568014a200).ready entity=mon.0 client_cookie=de1f976a5fa0b89e server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:59.692 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.684+0000 7f566ffff700 1 -- 172.21.15.110:0/2694825747 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567000ce30 con 0x7f5668003790 2021-03-25T14:17:59.692 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.684+0000 7f566ffff700 1 -- 172.21.15.110:0/2694825747 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56700072e0 con 0x7f5668003790 2021-03-25T14:17:59.692 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.684+0000 7f566ffff700 1 -- 172.21.15.110:0/2694825747 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5670005620 con 0x7f5668003790 2021-03-25T14:17:59.692 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.685+0000 7f568779e700 1 -- 172.21.15.110:0/2694825747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5668003790 msgr2=0x7f5668003bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:59.692 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.685+0000 7f568779e700 1 --2- 172.21.15.110:0/2694825747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5668003790 0x7f5668003bb0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f567000c470 tx=0x7f568014a200).stop 2021-03-25T14:17:59.692 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.685+0000 7f5685d3b700 1 -- 172.21.15.110:0/2694825747 reap_dead start 2021-03-25T14:17:59.692 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.685+0000 7f568779e700 1 -- 172.21.15.110:0/2694825747 shutdown_connections 2021-03-25T14:17:59.692 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.685+0000 7f568779e700 1 -- 172.21.15.110:0/2694825747 >> 172.21.15.110:0/2694825747 conn(0x7f5680060c40 msgr2=0x7f5680061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:59.693 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.685+0000 7f568779e700 1 -- 172.21.15.110:0/2694825747 shutdown_connections 2021-03-25T14:17:59.693 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.685+0000 7f568779e700 1 -- 172.21.15.110:0/2694825747 wait complete. 2021-03-25T14:17:59.693 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.686+0000 7f568779e700 1 Processor -- start 2021-03-25T14:17:59.693 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.686+0000 7f568779e700 1 -- start start 2021-03-25T14:17:59.693 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.687+0000 7f568779e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56800a4cc0 0x7f56800a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:59.693 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.687+0000 7f568779e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f568014c490 0x7f5680063bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:59.693 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.687+0000 7f568779e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56800a31f0 0x7f56800a3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:59.693 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.687+0000 7f568779e700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5680146390 con 0x7f56800a4cc0 2021-03-25T14:17:59.693 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.687+0000 7f568779e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56800640e0 con 0x7f56800a31f0 2021-03-25T14:17:59.693 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.687+0000 7f568779e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5680159850 con 0x7f568014c490 2021-03-25T14:17:59.693 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.687+0000 7f568553a700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56800a4cc0 0x7f56800a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:59.693 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.687+0000 7f568553a700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56800a4cc0 0x7f56800a50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50910/0 (socket says 172.21.15.110:50910) 2021-03-25T14:17:59.693 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.687+0000 7f568553a700 1 -- 172.21.15.110:0/1190973237 learned_addr learned my addr 172.21.15.110:0/1190973237 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:59.694 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.687+0000 7f568553a700 1 -- 172.21.15.110:0/1190973237 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f568014c490 msgr2=0x7f5680063bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:59.694 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.687+0000 7f568553a700 1 --2- 172.21.15.110:0/1190973237 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f568014c490 0x7f5680063bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:59.694 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.687+0000 7f568553a700 1 -- 172.21.15.110:0/1190973237 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56800a31f0 msgr2=0x7f56800a3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:59.694 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.687+0000 7f568553a700 1 --2- 172.21.15.110:0/1190973237 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56800a31f0 0x7f56800a3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:59.694 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.687+0000 7f568553a700 1 -- 172.21.15.110:0/1190973237 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5680063210 con 0x7f56800a4cc0 2021-03-25T14:17:59.694 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.687+0000 7f568553a700 1 --2- 172.21.15.110:0/1190973237 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56800a4cc0 0x7f56800a50a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f5668005460 tx=0x7f5670013000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:59.694 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.687+0000 7f566d7fa700 1 -- 172.21.15.110:0/1190973237 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567001b070 con 0x7f56800a4cc0 2021-03-25T14:17:59.694 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.687+0000 7f566d7fa700 1 -- 172.21.15.110:0/1190973237 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5670001700 con 0x7f56800a4cc0 2021-03-25T14:17:59.694 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.687+0000 7f568779e700 1 -- 172.21.15.110:0/1190973237 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56800634b0 con 0x7f56800a4cc0 2021-03-25T14:17:59.694 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.687+0000 7f566d7fa700 1 -- 172.21.15.110:0/1190973237 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5670013680 con 0x7f56800a4cc0 2021-03-25T14:17:59.694 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.687+0000 7f568779e700 1 -- 172.21.15.110:0/1190973237 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5680159540 con 0x7f56800a4cc0 2021-03-25T14:17:59.694 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.688+0000 7f568779e700 1 -- 172.21.15.110:0/1190973237 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5680063910 con 0x7f56800a4cc0 2021-03-25T14:17:59.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.688+0000 7f566d7fa700 1 -- 172.21.15.110:0/1190973237 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f5670010070 con 0x7f56800a4cc0 2021-03-25T14:17:59.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.689+0000 7f566d7fa700 1 --2- 172.21.15.110:0/1190973237 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f566005a0b0 0x7f566005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:59.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.689+0000 7f566d7fa700 1 -- 172.21.15.110:0/1190973237 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 7250+0+0 (secure 0 0 0) 0x7f5670074f00 con 0x7f56800a4cc0 2021-03-25T14:17:59.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.689+0000 7f5684d39700 1 --2- 172.21.15.110:0/1190973237 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f566005a0b0 0x7f566005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:59.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.689+0000 7f5684d39700 1 --2- 172.21.15.110:0/1190973237 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f566005a0b0 0x7f566005c570 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f56801488c0 tx=0x7f567c007bc0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:59.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.692+0000 7f566d7fa700 1 -- 172.21.15.110:0/1190973237 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f5670048400 con 0x7f56800a4cc0 2021-03-25T14:17:59.843 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.842+0000 7f568779e700 1 -- 172.21.15.110:0/1190973237 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f568005d7b0 con 0x7f56800a4cc0 2021-03-25T14:17:59.843 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.842+0000 7f566d7fa700 1 -- 172.21.15.110:0/1190973237 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v60) v1 ==== 100+0+10 (secure 0 0 0) 0x7f567004ba20 con 0x7f56800a4cc0 2021-03-25T14:17:59.843 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:17:59.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.844+0000 7f568779e700 1 -- 172.21.15.110:0/1190973237 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f566005a0b0 msgr2=0x7f566005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:59.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.844+0000 7f568779e700 1 --2- 172.21.15.110:0/1190973237 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f566005a0b0 0x7f566005c570 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f56801488c0 tx=0x7f567c007bc0).stop 2021-03-25T14:17:59.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.844+0000 7f568779e700 1 -- 172.21.15.110:0/1190973237 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56800a4cc0 msgr2=0x7f56800a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:59.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.844+0000 7f568779e700 1 --2- 172.21.15.110:0/1190973237 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56800a4cc0 0x7f56800a50a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f5668005460 tx=0x7f5670013000).stop 2021-03-25T14:17:59.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.844+0000 7f568779e700 1 -- 172.21.15.110:0/1190973237 shutdown_connections 2021-03-25T14:17:59.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.844+0000 7f568779e700 1 --2- 172.21.15.110:0/1190973237 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f566005a0b0 0x7f566005c570 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:59.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.844+0000 7f568779e700 1 --2- 172.21.15.110:0/1190973237 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56800a31f0 0x7f56800a3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:59.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.844+0000 7f568779e700 1 --2- 172.21.15.110:0/1190973237 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56800a4cc0 0x7f56800a50a0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:59.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.844+0000 7f568779e700 1 --2- 172.21.15.110:0/1190973237 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f568014c490 0x7f5680063bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:17:59.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.844+0000 7f568779e700 1 -- 172.21.15.110:0/1190973237 >> 172.21.15.110:0/1190973237 conn(0x7f5680060c40 msgr2=0x7f56800baef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:59.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.844+0000 7f568779e700 1 -- 172.21.15.110:0/1190973237 shutdown_connections 2021-03-25T14:17:59.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.844+0000 7f568779e700 1 -- 172.21.15.110:0/1190973237 wait complete. 2021-03-25T14:17:59.856 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2021-03-25T14:17:59.968 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.967+0000 7f39b11b5700 1 Processor -- start 2021-03-25T14:17:59.969 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.967+0000 7f39b11b5700 1 -- start start 2021-03-25T14:17:59.974 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.968+0000 7f39b11b5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39ac14aaa0 0x7f39ac0bbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:59.974 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.968+0000 7f39b11b5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f39ac144750 0x7f39ac144be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:59.974 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.968+0000 7f39b11b5700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39ac0bba20 con 0x7f39ac0a0890 2021-03-25T14:17:59.974 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.968+0000 7f39b11b5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39ac14af20 con 0x7f39ac144750 2021-03-25T14:17:59.974 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.968+0000 7f39b11b5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39ac066190 con 0x7f39ac14aaa0 2021-03-25T14:17:59.974 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.968+0000 7f39abfff700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f39ac0a0890 0x7f39ac0a19a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43854/0 (socket says 172.21.15.110:43854) 2021-03-25T14:17:59.975 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.968+0000 7f39abfff700 1 -- 172.21.15.110:0/705349354 learned_addr learned my addr 172.21.15.110:0/705349354 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:17:59.975 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.968+0000 7f39ab7fe700 1 --2- 172.21.15.110:0/705349354 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39ac14aaa0 0x7f39ac0bbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:59.975 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.968+0000 7f39b09b4700 1 --2- 172.21.15.110:0/705349354 >> v2:172.21.15.174:3300/0 conn(0x7f39ac144750 0x7f39ac144be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:59.975 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.969+0000 7f39aaffd700 1 -- 172.21.15.110:0/705349354 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2041348259 0 0) 0x7f39ac0bba20 con 0x7f39ac0a0890 2021-03-25T14:17:59.975 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.969+0000 7f39aaffd700 1 -- 172.21.15.110:0/705349354 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3998003270 con 0x7f39ac0a0890 2021-03-25T14:17:59.975 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.969+0000 7f39ab7fe700 1 -- 172.21.15.110:0/705349354 >> v2:172.21.15.174:3300/0 conn(0x7f39ac144750 msgr2=0x7f39ac144be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:17:59.975 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.969+0000 7f39ab7fe700 1 --2- 172.21.15.110:0/705349354 >> v2:172.21.15.174:3300/0 conn(0x7f39ac144750 0x7f39ac144be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:59.975 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.969+0000 7f39ab7fe700 1 -- 172.21.15.110:0/705349354 >> v1:172.21.15.110:6789/0 conn(0x7f39ac0a0890 legacy=0x7f39ac0a19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:59.975 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.969+0000 7f39ab7fe700 1 -- 172.21.15.110:0/705349354 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39ac0b6550 con 0x7f39ac14aaa0 2021-03-25T14:17:59.975 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.969+0000 7f39ab7fe700 1 --2- 172.21.15.110:0/705349354 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39ac14aaa0 0x7f39ac0bbe50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f39a000b9c0 tx=0x7f39a0006e20).ready entity=mon.2 client_cookie=7da77a69060ee67c server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:59.975 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.969+0000 7f39aaffd700 1 -- 172.21.15.110:0/705349354 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a0009690 con 0x7f39ac14aaa0 2021-03-25T14:17:59.975 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.969+0000 7f39aaffd700 1 -- 172.21.15.110:0/705349354 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a00097f0 con 0x7f39ac14aaa0 2021-03-25T14:17:59.975 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.969+0000 7f39aaffd700 1 -- 172.21.15.110:0/705349354 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a0009b70 con 0x7f39ac14aaa0 2021-03-25T14:17:59.976 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.970+0000 7f39b11b5700 1 -- 172.21.15.110:0/705349354 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39ac14aaa0 msgr2=0x7f39ac0bbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:59.976 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.970+0000 7f39b11b5700 1 --2- 172.21.15.110:0/705349354 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39ac14aaa0 0x7f39ac0bbe50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f39a000b9c0 tx=0x7f39a0006e20).stop 2021-03-25T14:17:59.976 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.970+0000 7f39b11b5700 1 -- 172.21.15.110:0/705349354 shutdown_connections 2021-03-25T14:17:59.976 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.970+0000 7f39b11b5700 1 --2- 172.21.15.110:0/705349354 >> v2:172.21.15.174:3300/0 conn(0x7f39ac144750 0x7f39ac144be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:59.976 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.970+0000 7f39b11b5700 1 --2- 172.21.15.110:0/705349354 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39ac14aaa0 0x7f39ac0bbe50 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:59.976 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.970+0000 7f39b11b5700 1 -- 172.21.15.110:0/705349354 >> 172.21.15.110:0/705349354 conn(0x7f39ac05c700 msgr2=0x7f39ac0664d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:17:59.976 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.970+0000 7f39b11b5700 1 -- 172.21.15.110:0/705349354 shutdown_connections 2021-03-25T14:17:59.976 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.970+0000 7f39b11b5700 1 -- 172.21.15.110:0/705349354 wait complete. 2021-03-25T14:17:59.976 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.971+0000 7f39b11b5700 1 Processor -- start 2021-03-25T14:17:59.976 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.971+0000 7f39b11b5700 1 -- start start 2021-03-25T14:17:59.977 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.971+0000 7f39b11b5700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39ac0a0890 0x7f39ac1455c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:59.978 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.972+0000 7f39b11b5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39ac144750 0x7f39ac14a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:59.978 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.972+0000 7f39b11b5700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39ac14aaa0 0x7f39ac145b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:59.978 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.972+0000 7f39b11b5700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39ac0a04e0 con 0x7f39ac0a0890 2021-03-25T14:17:59.978 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.972+0000 7f39b11b5700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39ac0a0170 con 0x7f39ac14aaa0 2021-03-25T14:17:59.978 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.972+0000 7f39b11b5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39ac145190 con 0x7f39ac144750 2021-03-25T14:17:59.978 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.972+0000 7f39abfff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39ac0a0890 0x7f39ac1455c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:59.978 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.972+0000 7f39abfff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39ac0a0890 0x7f39ac1455c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50924/0 (socket says 172.21.15.110:50924) 2021-03-25T14:17:59.978 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.972+0000 7f39abfff700 1 -- 172.21.15.110:0/715488571 learned_addr learned my addr 172.21.15.110:0/715488571 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:17:59.978 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.972+0000 7f39ab7fe700 1 --2- 172.21.15.110:0/715488571 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39ac144750 0x7f39ac14a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:59.978 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.972+0000 7f39b09b4700 1 --2- 172.21.15.110:0/715488571 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39ac14aaa0 0x7f39ac145b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:59.978 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.972+0000 7f39abfff700 1 -- 172.21.15.110:0/715488571 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39ac144750 msgr2=0x7f39ac14a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:59.979 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.972+0000 7f39abfff700 1 --2- 172.21.15.110:0/715488571 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39ac144750 0x7f39ac14a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:59.979 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.972+0000 7f39abfff700 1 -- 172.21.15.110:0/715488571 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39ac14aaa0 msgr2=0x7f39ac145b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:17:59.979 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.972+0000 7f39abfff700 1 --2- 172.21.15.110:0/715488571 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39ac14aaa0 0x7f39ac145b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:17:59.979 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.972+0000 7f39abfff700 1 -- 172.21.15.110:0/715488571 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39ac09fed0 con 0x7f39ac0a0890 2021-03-25T14:17:59.979 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.972+0000 7f39ab7fe700 1 --2- 172.21.15.110:0/715488571 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39ac144750 0x7f39ac14a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:17:59.979 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.972+0000 7f39abfff700 1 --2- 172.21.15.110:0/715488571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39ac0a0890 0x7f39ac1455c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f399c00c740 tx=0x7f399c007af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:59.979 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.972+0000 7f3993fff700 1 -- 172.21.15.110:0/715488571 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c007320 con 0x7f39ac0a0890 2021-03-25T14:17:59.979 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.972+0000 7f3993fff700 1 -- 172.21.15.110:0/715488571 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399c007480 con 0x7f39ac0a0890 2021-03-25T14:17:59.979 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.972+0000 7f39b11b5700 1 -- 172.21.15.110:0/715488571 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39ac14cf40 con 0x7f39ac0a0890 2021-03-25T14:17:59.979 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.972+0000 7f3993fff700 1 -- 172.21.15.110:0/715488571 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c005850 con 0x7f39ac0a0890 2021-03-25T14:17:59.979 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.972+0000 7f39b11b5700 1 -- 172.21.15.110:0/715488571 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39ac144de0 con 0x7f39ac0a0890 2021-03-25T14:17:59.979 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.973+0000 7f39b11b5700 1 -- 172.21.15.110:0/715488571 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39ac14b9d0 con 0x7f39ac0a0890 2021-03-25T14:17:59.980 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.974+0000 7f3993fff700 1 -- 172.21.15.110:0/715488571 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f399c019020 con 0x7f39ac0a0890 2021-03-25T14:17:59.980 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.974+0000 7f3993fff700 1 --2- 172.21.15.110:0/715488571 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f398c05a0b0 0x7f398c05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:17:59.981 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.974+0000 7f3993fff700 1 -- 172.21.15.110:0/715488571 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 7250+0+0 (secure 0 0 0) 0x7f399c073a20 con 0x7f39ac0a0890 2021-03-25T14:17:59.981 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.974+0000 7f39ab7fe700 1 --2- 172.21.15.110:0/715488571 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f398c05a0b0 0x7f398c05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:17:59.981 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.974+0000 7f39ab7fe700 1 --2- 172.21.15.110:0/715488571 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f398c05a0b0 0x7f398c05c570 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f39a0007fd0 tx=0x7f39a0016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:17:59.981 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:17:59.978+0000 7f3993fff700 1 -- 172.21.15.110:0/715488571 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f399c046f20 con 0x7f39ac0a0890 2021-03-25T14:18:00.129 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.128+0000 7f39b11b5700 1 -- 172.21.15.110:0/715488571 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f39ac045ae0 con 0x7f39ac0a0890 2021-03-25T14:18:00.129 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.129+0000 7f3993fff700 1 -- 172.21.15.110:0/715488571 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v60) v1 ==== 105+0+10 (secure 0 0 0) 0x7f399c04a540 con 0x7f39ac0a0890 2021-03-25T14:18:00.130 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:18:00.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.130+0000 7f39b11b5700 1 -- 172.21.15.110:0/715488571 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f398c05a0b0 msgr2=0x7f398c05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:00.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.130+0000 7f39b11b5700 1 --2- 172.21.15.110:0/715488571 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f398c05a0b0 0x7f398c05c570 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f39a0007fd0 tx=0x7f39a0016000).stop 2021-03-25T14:18:00.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.130+0000 7f39b11b5700 1 -- 172.21.15.110:0/715488571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39ac0a0890 msgr2=0x7f39ac1455c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:00.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.130+0000 7f39b11b5700 1 --2- 172.21.15.110:0/715488571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39ac0a0890 0x7f39ac1455c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f399c00c740 tx=0x7f399c007af0).stop 2021-03-25T14:18:00.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.130+0000 7f39b11b5700 1 -- 172.21.15.110:0/715488571 shutdown_connections 2021-03-25T14:18:00.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.130+0000 7f39b11b5700 1 --2- 172.21.15.110:0/715488571 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f398c05a0b0 0x7f398c05c570 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:00.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.130+0000 7f39b11b5700 1 --2- 172.21.15.110:0/715488571 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39ac14aaa0 0x7f39ac145b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:00.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.130+0000 7f39b11b5700 1 --2- 172.21.15.110:0/715488571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39ac0a0890 0x7f39ac1455c0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:00.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.130+0000 7f39b11b5700 1 --2- 172.21.15.110:0/715488571 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39ac144750 0x7f39ac14a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:00.133 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.130+0000 7f39b11b5700 1 -- 172.21.15.110:0/715488571 >> 172.21.15.110:0/715488571 conn(0x7f39ac05c700 msgr2=0x7f39ac1414d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:00.133 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.130+0000 7f39b11b5700 1 -- 172.21.15.110:0/715488571 shutdown_connections 2021-03-25T14:18:00.133 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.131+0000 7f39b11b5700 1 -- 172.21.15.110:0/715488571 wait complete. 2021-03-25T14:18:00.143 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2021-03-25T14:18:00.269 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.258+0000 7f2e8d95d700 1 Processor -- start 2021-03-25T14:18:00.269 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.258+0000 7f2e8d95d700 1 -- start start 2021-03-25T14:18:00.269 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.259+0000 7f2e8d95d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2e880be3a0 0x7f2e880b4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:00.269 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.259+0000 7f2e8d95d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2e880b47a0 0x7f2e88148c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:00.269 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.259+0000 7f2e8d95d700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e880b4c20 con 0x7f2e88149120 2021-03-25T14:18:00.269 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.259+0000 7f2e8d95d700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e88149960 con 0x7f2e880b47a0 2021-03-25T14:18:00.269 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.259+0000 7f2e8d95d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e88149c00 con 0x7f2e880be3a0 2021-03-25T14:18:00.269 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.259+0000 7f2e867fc700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2e880b47a0 0x7f2e88148c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:00.269 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.259+0000 7f2e877fe700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f2e88149120 0x7f2e880b8cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43868/0 (socket says 172.21.15.110:43868) 2021-03-25T14:18:00.269 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.259+0000 7f2e877fe700 1 -- 172.21.15.110:0/1188700678 learned_addr learned my addr 172.21.15.110:0/1188700678 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:18:00.270 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.259+0000 7f2e86ffd700 1 --2- 172.21.15.110:0/1188700678 >> v2:172.21.15.174:3300/0 conn(0x7f2e880be3a0 0x7f2e880b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:00.270 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.259+0000 7f2e867fc700 1 -- 172.21.15.110:0/1188700678 >> v2:172.21.15.174:3300/0 conn(0x7f2e880be3a0 msgr2=0x7f2e880b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:00.270 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.259+0000 7f2e85ffb700 1 -- 172.21.15.110:0/1188700678 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 785078931 0 0) 0x7f2e880b4c20 con 0x7f2e88149120 2021-03-25T14:18:00.270 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.259+0000 7f2e867fc700 1 --2- 172.21.15.110:0/1188700678 >> v2:172.21.15.174:3300/0 conn(0x7f2e880be3a0 0x7f2e880b4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:00.270 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.259+0000 7f2e867fc700 1 -- 172.21.15.110:0/1188700678 >> v1:172.21.15.110:6789/0 conn(0x7f2e88149120 legacy=0x7f2e880b8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:00.270 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.259+0000 7f2e867fc700 1 -- 172.21.15.110:0/1188700678 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e88149ea0 con 0x7f2e880b47a0 2021-03-25T14:18:00.270 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.259+0000 7f2e867fc700 1 --2- 172.21.15.110:0/1188700678 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e880b47a0 0x7f2e88148c30 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f2e88068250 tx=0x7f2e7c006e20).ready entity=mon.0 client_cookie=3f45717ad327900 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:00.270 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.259+0000 7f2e85ffb700 1 -- 172.21.15.110:0/1188700678 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c0097e0 con 0x7f2e880b47a0 2021-03-25T14:18:00.270 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.259+0000 7f2e85ffb700 1 -- 172.21.15.110:0/1188700678 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e7c009940 con 0x7f2e880b47a0 2021-03-25T14:18:00.270 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.259+0000 7f2e85ffb700 1 -- 172.21.15.110:0/1188700678 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c009cc0 con 0x7f2e880b47a0 2021-03-25T14:18:00.270 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.260+0000 7f2e8d95d700 1 -- 172.21.15.110:0/1188700678 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e880b47a0 msgr2=0x7f2e88148c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:00.270 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.260+0000 7f2e8d95d700 1 --2- 172.21.15.110:0/1188700678 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e880b47a0 0x7f2e88148c30 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f2e88068250 tx=0x7f2e7c006e20).stop 2021-03-25T14:18:00.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.260+0000 7f2e8d95d700 1 -- 172.21.15.110:0/1188700678 shutdown_connections 2021-03-25T14:18:00.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.260+0000 7f2e8d95d700 1 --2- 172.21.15.110:0/1188700678 >> v2:172.21.15.174:3300/0 conn(0x7f2e880be3a0 0x7f2e880b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:00.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.260+0000 7f2e8d95d700 1 --2- 172.21.15.110:0/1188700678 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e880b47a0 0x7f2e88148c30 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:00.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.260+0000 7f2e8d95d700 1 -- 172.21.15.110:0/1188700678 >> 172.21.15.110:0/1188700678 conn(0x7f2e880686f0 msgr2=0x7f2e88068b00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:00.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.260+0000 7f2e8d95d700 1 -- 172.21.15.110:0/1188700678 shutdown_connections 2021-03-25T14:18:00.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.260+0000 7f2e8d95d700 1 -- 172.21.15.110:0/1188700678 wait complete. 2021-03-25T14:18:00.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.261+0000 7f2e8d95d700 1 Processor -- start 2021-03-25T14:18:00.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.261+0000 7f2e8d95d700 1 -- start start 2021-03-25T14:18:00.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.262+0000 7f2e8d95d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e880b47a0 0x7f2e88144bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:00.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.262+0000 7f2e8d95d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2e880be3a0 0x7f2e88150520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:00.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.262+0000 7f2e8d95d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e88149120 0x7f2e8814b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:00.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.262+0000 7f2e8d95d700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8815c1a0 con 0x7f2e880b47a0 2021-03-25T14:18:00.271 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.262+0000 7f2e8d95d700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8815c440 con 0x7f2e88149120 2021-03-25T14:18:00.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.262+0000 7f2e8d95d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8815c6e0 con 0x7f2e880be3a0 2021-03-25T14:18:00.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.262+0000 7f2e86ffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e880b47a0 0x7f2e88144bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:00.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.262+0000 7f2e86ffd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e880b47a0 0x7f2e88144bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50938/0 (socket says 172.21.15.110:50938) 2021-03-25T14:18:00.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.262+0000 7f2e86ffd700 1 -- 172.21.15.110:0/606521982 learned_addr learned my addr 172.21.15.110:0/606521982 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:00.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.262+0000 7f2e867fc700 1 --2- 172.21.15.110:0/606521982 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2e880be3a0 0x7f2e88150520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:00.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.262+0000 7f2e877fe700 1 --2- 172.21.15.110:0/606521982 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e88149120 0x7f2e8814b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:00.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.262+0000 7f2e86ffd700 1 -- 172.21.15.110:0/606521982 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2e880be3a0 msgr2=0x7f2e88150520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:00.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.262+0000 7f2e86ffd700 1 --2- 172.21.15.110:0/606521982 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2e880be3a0 0x7f2e88150520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:00.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.262+0000 7f2e86ffd700 1 -- 172.21.15.110:0/606521982 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e88149120 msgr2=0x7f2e8814b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:00.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.262+0000 7f2e86ffd700 1 --2- 172.21.15.110:0/606521982 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e88149120 0x7f2e8814b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:00.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.262+0000 7f2e86ffd700 1 -- 172.21.15.110:0/606521982 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e8815c980 con 0x7f2e880b47a0 2021-03-25T14:18:00.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.262+0000 7f2e86ffd700 1 --2- 172.21.15.110:0/606521982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e880b47a0 0x7f2e88144bf0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f2e7800c920 tx=0x7f2e78008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:00.272 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.263+0000 7f2e6effd700 1 -- 172.21.15.110:0/606521982 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7800cec0 con 0x7f2e880b47a0 2021-03-25T14:18:00.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.263+0000 7f2e6effd700 1 -- 172.21.15.110:0/606521982 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e78007740 con 0x7f2e880b47a0 2021-03-25T14:18:00.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.263+0000 7f2e8d95d700 1 -- 172.21.15.110:0/606521982 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e8815cc20 con 0x7f2e880b47a0 2021-03-25T14:18:00.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.263+0000 7f2e6effd700 1 -- 172.21.15.110:0/606521982 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e78007ac0 con 0x7f2e880b47a0 2021-03-25T14:18:00.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.263+0000 7f2e8d95d700 1 -- 172.21.15.110:0/606521982 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e880bc540 con 0x7f2e880b47a0 2021-03-25T14:18:00.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.263+0000 7f2e8d95d700 1 -- 172.21.15.110:0/606521982 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e8805d7b0 con 0x7f2e880b47a0 2021-03-25T14:18:00.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.264+0000 7f2e6effd700 1 -- 172.21.15.110:0/606521982 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f2e7801b460 con 0x7f2e880b47a0 2021-03-25T14:18:00.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.264+0000 7f2e6effd700 1 --2- 172.21.15.110:0/606521982 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f2e6805a0b0 0x7f2e6805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:00.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.264+0000 7f2e6effd700 1 -- 172.21.15.110:0/606521982 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 7250+0+0 (secure 0 0 0) 0x7f2e780742c0 con 0x7f2e880b47a0 2021-03-25T14:18:00.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.264+0000 7f2e867fc700 1 --2- 172.21.15.110:0/606521982 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f2e6805a0b0 0x7f2e6805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:00.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.264+0000 7f2e867fc700 1 --2- 172.21.15.110:0/606521982 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f2e6805a0b0 0x7f2e6805c570 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f2e7c006e60 tx=0x7f2e7c016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:00.273 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.268+0000 7f2e6effd700 1 -- 172.21.15.110:0/606521982 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f2e780477c0 con 0x7f2e880b47a0 2021-03-25T14:18:00.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.416+0000 7f2e8d95d700 1 -- 172.21.15.110:0/606521982 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f2e88065080 con 0x7f2e880b47a0 2021-03-25T14:18:00.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.417+0000 7f2e6effd700 1 -- 172.21.15.110:0/606521982 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v60) v1 ==== 101+0+10 (secure 0 0 0) 0x7f2e7804ade0 con 0x7f2e880b47a0 2021-03-25T14:18:00.418 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:18:00.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.418+0000 7f2e8d95d700 1 -- 172.21.15.110:0/606521982 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f2e6805a0b0 msgr2=0x7f2e6805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:00.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.418+0000 7f2e8d95d700 1 --2- 172.21.15.110:0/606521982 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f2e6805a0b0 0x7f2e6805c570 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f2e7c006e60 tx=0x7f2e7c016000).stop 2021-03-25T14:18:00.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.418+0000 7f2e8d95d700 1 -- 172.21.15.110:0/606521982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e880b47a0 msgr2=0x7f2e88144bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:00.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.418+0000 7f2e8d95d700 1 --2- 172.21.15.110:0/606521982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e880b47a0 0x7f2e88144bf0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f2e7800c920 tx=0x7f2e78008040).stop 2021-03-25T14:18:00.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.418+0000 7f2e8d95d700 1 -- 172.21.15.110:0/606521982 shutdown_connections 2021-03-25T14:18:00.420 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.418+0000 7f2e8d95d700 1 --2- 172.21.15.110:0/606521982 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f2e6805a0b0 0x7f2e6805c570 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:00.420 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.418+0000 7f2e8d95d700 1 --2- 172.21.15.110:0/606521982 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e88149120 0x7f2e8814b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:00.420 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.418+0000 7f2e8d95d700 1 --2- 172.21.15.110:0/606521982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e880b47a0 0x7f2e88144bf0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:00.420 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.418+0000 7f2e8d95d700 1 --2- 172.21.15.110:0/606521982 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2e880be3a0 0x7f2e88150520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:00.420 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.418+0000 7f2e8d95d700 1 -- 172.21.15.110:0/606521982 >> 172.21.15.110:0/606521982 conn(0x7f2e880686f0 msgr2=0x7f2e880b8b10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:00.420 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.418+0000 7f2e8d95d700 1 -- 172.21.15.110:0/606521982 shutdown_connections 2021-03-25T14:18:00.420 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.418+0000 7f2e8d95d700 1 -- 172.21.15.110:0/606521982 wait complete. 2021-03-25T14:18:00.431 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-03-25T14:18:00.542 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.540+0000 7f750395e700 1 Processor -- start 2021-03-25T14:18:00.542 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.541+0000 7f750395e700 1 -- start start 2021-03-25T14:18:00.554 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.541+0000 7f750395e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74fc0be0c0 0x7f74fc143200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:00.554 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.541+0000 7f750395e700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f74fc1436f0 0x7f74fc1495b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:00.554 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.541+0000 7f750395e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74fc0b8150 con 0x7f74fc0bdce0 2021-03-25T14:18:00.554 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.541+0000 7f750395e700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74fc143b60 con 0x7f74fc1436f0 2021-03-25T14:18:00.555 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.541+0000 7f750395e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc14cd00 con 0x7f74fc0be0c0 2021-03-25T14:18:00.555 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.541+0000 7f7501efb700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f74fc1436f0 0x7f74fc1495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:00.555 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.542+0000 7f7501efb700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f74fc1436f0 0x7f74fc1495b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50950/0 (socket says 172.21.15.110:50950) 2021-03-25T14:18:00.555 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.542+0000 7f7501efb700 1 -- 172.21.15.110:0/1174655103 learned_addr learned my addr 172.21.15.110:0/1174655103 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:00.555 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.542+0000 7f7500ef9700 1 --2- 172.21.15.110:0/1174655103 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74fc0be0c0 0x7f74fc143200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:00.556 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.542+0000 7f7501efb700 1 -- 172.21.15.110:0/1174655103 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74fc0be0c0 msgr2=0x7f74fc143200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:00.556 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.542+0000 7f7501efb700 1 --2- 172.21.15.110:0/1174655103 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74fc0be0c0 0x7f74fc143200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:00.556 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.542+0000 7f7501efb700 1 -- 172.21.15.110:0/1174655103 >> v1:172.21.15.174:6789/0 conn(0x7f74fc0bdce0 legacy=0x7f74fc0b7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:00.556 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.542+0000 7f7501efb700 1 -- 172.21.15.110:0/1174655103 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74fc14cfa0 con 0x7f74fc1436f0 2021-03-25T14:18:00.557 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.542+0000 7f7500ef9700 1 --2- 172.21.15.110:0/1174655103 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74fc0be0c0 0x7f74fc143200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:18:00.557 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.542+0000 7f7501efb700 1 --2- 172.21.15.110:0/1174655103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74fc1436f0 0x7f74fc1495b0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f74f4009d90 tx=0x7f74f40092d0).ready entity=mon.0 client_cookie=e1d4348f5e40181d server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:00.557 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.542+0000 7f74effff700 1 -- 172.21.15.110:0/1174655103 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f400bc80 con 0x7f74fc1436f0 2021-03-25T14:18:00.557 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.542+0000 7f74effff700 1 -- 172.21.15.110:0/1174655103 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f400bde0 con 0x7f74fc1436f0 2021-03-25T14:18:00.557 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.542+0000 7f74effff700 1 -- 172.21.15.110:0/1174655103 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f4011610 con 0x7f74fc1436f0 2021-03-25T14:18:00.557 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.542+0000 7f750395e700 1 -- 172.21.15.110:0/1174655103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74fc1436f0 msgr2=0x7f74fc1495b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:00.558 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.542+0000 7f750395e700 1 --2- 172.21.15.110:0/1174655103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74fc1436f0 0x7f74fc1495b0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f74f4009d90 tx=0x7f74f40092d0).stop 2021-03-25T14:18:00.558 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.542+0000 7f750395e700 1 -- 172.21.15.110:0/1174655103 shutdown_connections 2021-03-25T14:18:00.558 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.542+0000 7f750395e700 1 --2- 172.21.15.110:0/1174655103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74fc1436f0 0x7f74fc1495b0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:00.558 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.542+0000 7f750395e700 1 --2- 172.21.15.110:0/1174655103 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74fc0be0c0 0x7f74fc143200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:00.558 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.542+0000 7f750395e700 1 -- 172.21.15.110:0/1174655103 >> 172.21.15.110:0/1174655103 conn(0x7f74fc0686a0 msgr2=0x7f74fc068ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:00.559 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.543+0000 7f750395e700 1 -- 172.21.15.110:0/1174655103 shutdown_connections 2021-03-25T14:18:00.559 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.543+0000 7f750395e700 1 -- 172.21.15.110:0/1174655103 wait complete. 2021-03-25T14:18:00.559 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.544+0000 7f750395e700 1 Processor -- start 2021-03-25T14:18:00.559 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.544+0000 7f750395e700 1 -- start start 2021-03-25T14:18:00.559 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.544+0000 7f750395e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f74fc0bdce0 0x7f74fc1593b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:00.560 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.544+0000 7f750395e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74fc0be0c0 0x7f74fc09f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:00.560 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.544+0000 7f750395e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74fc1436f0 0x7f74fc09fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:00.560 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.544+0000 7f750395e700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc144170 con 0x7f74fc0be0c0 2021-03-25T14:18:00.560 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.544+0000 7f750395e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc1443a0 con 0x7f74fc0bdce0 2021-03-25T14:18:00.560 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.544+0000 7f750395e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc144640 con 0x7f74fc1436f0 2021-03-25T14:18:00.561 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.544+0000 7f7500ef9700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74fc0be0c0 0x7f74fc09f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:00.561 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.545+0000 7f7500ef9700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74fc0be0c0 0x7f74fc09f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50956/0 (socket says 172.21.15.110:50956) 2021-03-25T14:18:00.561 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.545+0000 7f7500ef9700 1 -- 172.21.15.110:0/78862062 learned_addr learned my addr 172.21.15.110:0/78862062 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:00.561 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.545+0000 7f7501efb700 1 --2- 172.21.15.110:0/78862062 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74fc1436f0 0x7f74fc09fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:00.561 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.545+0000 7f75016fa700 1 --2- 172.21.15.110:0/78862062 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f74fc0bdce0 0x7f74fc1593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:00.562 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.545+0000 7f7500ef9700 1 -- 172.21.15.110:0/78862062 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74fc1436f0 msgr2=0x7f74fc09fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:00.562 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.545+0000 7f7500ef9700 1 --2- 172.21.15.110:0/78862062 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74fc1436f0 0x7f74fc09fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:00.562 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.545+0000 7f7500ef9700 1 -- 172.21.15.110:0/78862062 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f74fc0bdce0 msgr2=0x7f74fc1593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:00.562 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.545+0000 7f7500ef9700 1 --2- 172.21.15.110:0/78862062 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f74fc0bdce0 0x7f74fc1593b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:00.562 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.545+0000 7f7500ef9700 1 -- 172.21.15.110:0/78862062 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74fc1448e0 con 0x7f74fc0be0c0 2021-03-25T14:18:00.563 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.545+0000 7f75016fa700 1 --2- 172.21.15.110:0/78862062 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f74fc0bdce0 0x7f74fc1593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:18:00.563 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.545+0000 7f7500ef9700 1 --2- 172.21.15.110:0/78862062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74fc0be0c0 0x7f74fc09f720 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f74f000db60 tx=0x7f74f0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:00.563 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.545+0000 7f74ed7fa700 1 -- 172.21.15.110:0/78862062 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f0009820 con 0x7f74fc0be0c0 2021-03-25T14:18:00.563 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.545+0000 7f74ed7fa700 1 -- 172.21.15.110:0/78862062 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f0009980 con 0x7f74fc0be0c0 2021-03-25T14:18:00.563 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.545+0000 7f750395e700 1 -- 172.21.15.110:0/78862062 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74fc144b80 con 0x7f74fc0be0c0 2021-03-25T14:18:00.564 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.545+0000 7f74ed7fa700 1 -- 172.21.15.110:0/78862062 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f0009d40 con 0x7f74fc0be0c0 2021-03-25T14:18:00.564 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.545+0000 7f750395e700 1 -- 172.21.15.110:0/78862062 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74fc143d70 con 0x7f74fc0be0c0 2021-03-25T14:18:00.564 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.546+0000 7f750395e700 1 -- 172.21.15.110:0/78862062 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74fc144d10 con 0x7f74fc0be0c0 2021-03-25T14:18:00.564 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.546+0000 7f74ed7fa700 1 -- 172.21.15.110:0/78862062 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f74f0013690 con 0x7f74fc0be0c0 2021-03-25T14:18:00.564 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.547+0000 7f74ed7fa700 1 --2- 172.21.15.110:0/78862062 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f74dc05a0b0 0x7f74dc05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:00.564 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.547+0000 7f74ed7fa700 1 -- 172.21.15.110:0/78862062 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 7250+0+0 (secure 0 0 0) 0x7f74f00748e0 con 0x7f74fc0be0c0 2021-03-25T14:18:00.565 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.547+0000 7f75016fa700 1 --2- 172.21.15.110:0/78862062 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f74dc05a0b0 0x7f74dc05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:00.565 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.547+0000 7f75016fa700 1 --2- 172.21.15.110:0/78862062 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f74dc05a0b0 0x7f74dc05c570 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f74f8001550 tx=0x7f74f8009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:00.565 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.551+0000 7f74ed7fa700 1 -- 172.21.15.110:0/78862062 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f74f0047d80 con 0x7f74fc0be0c0 2021-03-25T14:18:00.738 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.737+0000 7f750395e700 1 -- 172.21.15.110:0/78862062 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f74fc05d7b0 con 0x7f74fc0be0c0 2021-03-25T14:18:00.739 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.738+0000 7f74ed7fa700 1 -- 172.21.15.110:0/78862062 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+3779 (secure 0 0 0) 0x7f74f004b3a0 con 0x7f74fc0be0c0 2021-03-25T14:18:00.739 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:18:00.739 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4997,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/3015251726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3015251726},{"type":"v1","addr":"172.21.15.174:6835","nonce":3015251726}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":24},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/1698368640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1698368640},{"type":"v1","addr":"172.21.15.174:6833","nonce":1698368640}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-03-25T14:17:42.344725+0000","modified":"2021-03-25T14:17:43.345825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5604":{"gid":5604,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6836/426511293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":426511293},{"type":"v1","addr":"172.21.15.110:6836","nonce":426511293}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-03-25T14:17:52.495440+0000","modified":"2021-03-25T14:17:53.496776+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5601},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5601":{"gid":5601,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":5,"addr":"172.21.15.110:6837/2143874763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":2143874763},{"type":"v1","addr":"172.21.15.110:6837","nonce":2143874763}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs2","balancer":"","standby_count_wanted":0},"id":5}]} 2021-03-25T14:18:00.740 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.739+0000 7f750395e700 1 -- 172.21.15.110:0/78862062 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f74dc05a0b0 msgr2=0x7f74dc05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:00.741 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.739+0000 7f750395e700 1 --2- 172.21.15.110:0/78862062 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f74dc05a0b0 0x7f74dc05c570 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f74f8001550 tx=0x7f74f8009040).stop 2021-03-25T14:18:00.741 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.739+0000 7f750395e700 1 -- 172.21.15.110:0/78862062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74fc0be0c0 msgr2=0x7f74fc09f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:00.741 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.739+0000 7f750395e700 1 --2- 172.21.15.110:0/78862062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74fc0be0c0 0x7f74fc09f720 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f74f000db60 tx=0x7f74f0008040).stop 2021-03-25T14:18:00.741 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.739+0000 7f750395e700 1 -- 172.21.15.110:0/78862062 shutdown_connections 2021-03-25T14:18:00.741 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.739+0000 7f750395e700 1 --2- 172.21.15.110:0/78862062 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f74dc05a0b0 0x7f74dc05c570 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:00.741 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.739+0000 7f750395e700 1 --2- 172.21.15.110:0/78862062 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f74fc0bdce0 0x7f74fc1593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:00.741 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.739+0000 7f750395e700 1 --2- 172.21.15.110:0/78862062 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74fc1436f0 0x7f74fc09fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:00.741 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.739+0000 7f750395e700 1 --2- 172.21.15.110:0/78862062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74fc0be0c0 0x7f74fc09f720 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:00.741 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.739+0000 7f750395e700 1 -- 172.21.15.110:0/78862062 >> 172.21.15.110:0/78862062 conn(0x7f74fc0686a0 msgr2=0x7f74fc140ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:00.741 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.739+0000 7f750395e700 1 -- 172.21.15.110:0/78862062 shutdown_connections 2021-03-25T14:18:00.741 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.739+0000 7f750395e700 1 -- 172.21.15.110:0/78862062 wait complete. 2021-03-25T14:18:00.741 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 30 2021-03-25T14:18:00.752 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:18:00.861 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.860+0000 7fb4ec5be700 1 Processor -- start 2021-03-25T14:18:00.861 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.860+0000 7fb4ec5be700 1 -- start start 2021-03-25T14:18:00.868 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.861+0000 7fb4ec5be700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb4e414cee0 0x7fb4e414d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:00.869 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.861+0000 7fb4ec5be700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4e4067510 con 0x7fb4e40b1340 2021-03-25T14:18:00.869 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.861+0000 7fb4ec5be700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4e40677b0 con 0x7fb4e40b1720 2021-03-25T14:18:00.869 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.861+0000 7fb4ec5be700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4e4067a50 con 0x7fb4e414cee0 2021-03-25T14:18:00.869 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.861+0000 7fb4ea35a700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fb4e40b1340 0x7fb4e4066420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43898/0 (socket says 172.21.15.110:43898) 2021-03-25T14:18:00.869 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.861+0000 7fb4ea35a700 1 -- 172.21.15.110:0/256245538 learned_addr learned my addr 172.21.15.110:0/256245538 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:18:00.869 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.861+0000 7fb4eab5b700 1 --2- 172.21.15.110:0/256245538 >> v2:172.21.15.174:3300/0 conn(0x7fb4e414cee0 0x7fb4e414d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:00.869 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.861+0000 7fb4e9358700 1 -- 172.21.15.110:0/256245538 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1255881082 0 0) 0x7fb4e4067510 con 0x7fb4e40b1340 2021-03-25T14:18:00.870 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.861+0000 7fb4e9358700 1 -- 172.21.15.110:0/256245538 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4cc003270 con 0x7fb4e40b1340 2021-03-25T14:18:00.870 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.862+0000 7fb4e9358700 1 -- 172.21.15.110:0/256245538 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2657153730 0 0) 0x7fb4cc003270 con 0x7fb4e40b1340 2021-03-25T14:18:00.870 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.862+0000 7fb4e9358700 1 -- 172.21.15.110:0/256245538 >> v2:172.21.15.174:3300/0 conn(0x7fb4e414cee0 msgr2=0x7fb4e414d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:00.870 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.862+0000 7fb4e9358700 1 --2- 172.21.15.110:0/256245538 >> v2:172.21.15.174:3300/0 conn(0x7fb4e414cee0 0x7fb4e414d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:00.870 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.862+0000 7fb4e9358700 1 -- 172.21.15.110:0/256245538 >> v1:172.21.15.174:6789/0 conn(0x7fb4e40b1720 legacy=0x7fb4e4149cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:00.870 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.862+0000 7fb4e9358700 1 -- 172.21.15.110:0/256245538 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e4067cf0 con 0x7fb4e40b1340 2021-03-25T14:18:00.870 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.862+0000 7fb4e9358700 1 -- 172.21.15.110:0/256245538 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7fb4e0001520 con 0x7fb4e40b1340 2021-03-25T14:18:00.870 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.862+0000 7fb4e9358700 1 -- 172.21.15.110:0/256245538 >> v1:172.21.15.110:6789/0 conn(0x7fb4e40b1340 legacy=0x7fb4e4066420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:00.870 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.862+0000 7fb4e9358700 1 --2- 172.21.15.110:0/256245538 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb4cc003760 0x7fb4cc003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:00.871 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.862+0000 7fb4e9358700 1 --2- 172.21.15.110:0/256245538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4cc004510 0x7fb4cc004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:00.871 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.862+0000 7fb4e9358700 1 --2- 172.21.15.110:0/256245538 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4cc004e80 0x7fb4cc00b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:00.871 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.862+0000 7fb4e9358700 1 -- 172.21.15.110:0/256245538 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e4067a50 con 0x7fb4cc004510 2021-03-25T14:18:00.871 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.862+0000 7fb4e9358700 1 -- 172.21.15.110:0/256245538 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4cc004290 con 0x7fb4cc003760 2021-03-25T14:18:00.871 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.862+0000 7fb4e9358700 1 -- 172.21.15.110:0/256245538 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4cc00bc50 con 0x7fb4cc004e80 2021-03-25T14:18:00.871 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.862+0000 7fb4e9b59700 1 --2- 172.21.15.110:0/256245538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4cc004510 0x7fb4cc004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:00.871 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.862+0000 7fb4ea35a700 1 --2- 172.21.15.110:0/256245538 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb4cc003760 0x7fb4cc003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:00.871 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.862+0000 7fb4eab5b700 1 --2- 172.21.15.110:0/256245538 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4cc004e80 0x7fb4cc00b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:00.871 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.862+0000 7fb4e9b59700 1 -- 172.21.15.110:0/256245538 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4cc004e80 msgr2=0x7fb4cc00b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:00.871 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.862+0000 7fb4e9b59700 1 --2- 172.21.15.110:0/256245538 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4cc004e80 0x7fb4cc00b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:00.871 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.862+0000 7fb4e9b59700 1 -- 172.21.15.110:0/256245538 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb4cc003760 msgr2=0x7fb4cc003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:00.872 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.862+0000 7fb4e9b59700 1 --2- 172.21.15.110:0/256245538 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb4cc003760 0x7fb4cc003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:00.872 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.862+0000 7fb4e9b59700 1 -- 172.21.15.110:0/256245538 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4cc003270 con 0x7fb4cc004510 2021-03-25T14:18:00.872 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.862+0000 7fb4eab5b700 1 -- 172.21.15.110:0/256245538 reap_dead start 2021-03-25T14:18:00.872 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.862+0000 7fb4e9b59700 1 --2- 172.21.15.110:0/256245538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4cc004510 0x7fb4cc004990 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fb4d4001960 tx=0x7fb4d4007bc0).ready entity=mon.0 client_cookie=5996ebf2205eae18 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:00.872 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.862+0000 7fb4e9358700 1 -- 172.21.15.110:0/256245538 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d4007020 con 0x7fb4cc004510 2021-03-25T14:18:00.872 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.862+0000 7fb4e9358700 1 -- 172.21.15.110:0/256245538 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d4007180 con 0x7fb4cc004510 2021-03-25T14:18:00.872 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.862+0000 7fb4e9358700 1 -- 172.21.15.110:0/256245538 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d400c860 con 0x7fb4cc004510 2021-03-25T14:18:00.872 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.863+0000 7fb4ec5be700 1 -- 172.21.15.110:0/256245538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4cc004510 msgr2=0x7fb4cc004990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:00.872 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.863+0000 7fb4ec5be700 1 --2- 172.21.15.110:0/256245538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4cc004510 0x7fb4cc004990 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fb4d4001960 tx=0x7fb4d4007bc0).stop 2021-03-25T14:18:00.872 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.863+0000 7fb4ec5be700 1 -- 172.21.15.110:0/256245538 shutdown_connections 2021-03-25T14:18:00.872 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.863+0000 7fb4ec5be700 1 --2- 172.21.15.110:0/256245538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4cc004510 0x7fb4cc004990 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:00.873 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.863+0000 7fb4ec5be700 1 -- 172.21.15.110:0/256245538 >> 172.21.15.110:0/256245538 conn(0x7fb4e40649a0 msgr2=0x7fb4e405c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:00.873 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.863+0000 7fb4ec5be700 1 -- 172.21.15.110:0/256245538 shutdown_connections 2021-03-25T14:18:00.873 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.863+0000 7fb4ec5be700 1 -- 172.21.15.110:0/256245538 wait complete. 2021-03-25T14:18:00.873 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.864+0000 7fb4ec5be700 1 Processor -- start 2021-03-25T14:18:00.873 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.864+0000 7fb4ec5be700 1 -- start start 2021-03-25T14:18:00.873 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.865+0000 7fb4ec5be700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb4cc004510 0x7fb4e414ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:00.873 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.865+0000 7fb4ec5be700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4e40b3cd0 0x7fb4e415c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:00.873 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.865+0000 7fb4ec5be700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4e41439a0 0x7fb4e415cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:00.873 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.865+0000 7fb4ec5be700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e415c330 con 0x7fb4e40b3cd0 2021-03-25T14:18:00.874 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.865+0000 7fb4ec5be700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e41597d0 con 0x7fb4cc004510 2021-03-25T14:18:00.874 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.865+0000 7fb4ec5be700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e41479d0 con 0x7fb4e41439a0 2021-03-25T14:18:00.874 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.865+0000 7fb4e9b59700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4e40b3cd0 0x7fb4e415c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:00.874 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.865+0000 7fb4e9b59700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4e40b3cd0 0x7fb4e415c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50974/0 (socket says 172.21.15.110:50974) 2021-03-25T14:18:00.874 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.865+0000 7fb4e9b59700 1 -- 172.21.15.110:0/674139269 learned_addr learned my addr 172.21.15.110:0/674139269 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:00.874 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.865+0000 7fb4eab5b700 1 --2- 172.21.15.110:0/674139269 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4e41439a0 0x7fb4e415cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:00.874 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.865+0000 7fb4ea35a700 1 --2- 172.21.15.110:0/674139269 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb4cc004510 0x7fb4e414ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:00.874 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.865+0000 7fb4e9b59700 1 -- 172.21.15.110:0/674139269 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4e41439a0 msgr2=0x7fb4e415cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:00.874 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.865+0000 7fb4e9b59700 1 --2- 172.21.15.110:0/674139269 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4e41439a0 0x7fb4e415cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:00.874 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.865+0000 7fb4e9b59700 1 -- 172.21.15.110:0/674139269 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb4cc004510 msgr2=0x7fb4e414ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:00.874 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.865+0000 7fb4e9b59700 1 --2- 172.21.15.110:0/674139269 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb4cc004510 0x7fb4e414ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:00.875 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.865+0000 7fb4e9b59700 1 -- 172.21.15.110:0/674139269 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e4159a30 con 0x7fb4e40b3cd0 2021-03-25T14:18:00.875 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.865+0000 7fb4e9b59700 1 --2- 172.21.15.110:0/674139269 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4e40b3cd0 0x7fb4e415c760 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7fb4d400c3c0 tx=0x7fb4d4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:00.875 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.865+0000 7fb4d27fc700 1 -- 172.21.15.110:0/674139269 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d4013a20 con 0x7fb4e40b3cd0 2021-03-25T14:18:00.875 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.865+0000 7fb4d27fc700 1 -- 172.21.15.110:0/674139269 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d4013b80 con 0x7fb4e40b3cd0 2021-03-25T14:18:00.875 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.865+0000 7fb4ec5be700 1 -- 172.21.15.110:0/674139269 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4e4146aa0 con 0x7fb4e40b3cd0 2021-03-25T14:18:00.875 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.865+0000 7fb4d27fc700 1 -- 172.21.15.110:0/674139269 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d4020440 con 0x7fb4e40b3cd0 2021-03-25T14:18:00.875 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.865+0000 7fb4ec5be700 1 -- 172.21.15.110:0/674139269 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e415d140 con 0x7fb4e40b3cd0 2021-03-25T14:18:00.875 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.866+0000 7fb4ec5be700 1 -- 172.21.15.110:0/674139269 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4e405d7b0 con 0x7fb4e40b3cd0 2021-03-25T14:18:00.876 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.866+0000 7fb4d27fc700 1 -- 172.21.15.110:0/674139269 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fb4d4026020 con 0x7fb4e40b3cd0 2021-03-25T14:18:00.876 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.867+0000 7fb4d27fc700 1 --2- 172.21.15.110:0/674139269 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb4c405a0b0 0x7fb4c405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:00.876 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.867+0000 7fb4d27fc700 1 -- 172.21.15.110:0/674139269 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 7250+0+0 (secure 0 0 0) 0x7fb4d4075770 con 0x7fb4e40b3cd0 2021-03-25T14:18:00.876 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.867+0000 7fb4ea35a700 1 --2- 172.21.15.110:0/674139269 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb4c405a0b0 0x7fb4c405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:00.876 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.867+0000 7fb4ea35a700 1 --2- 172.21.15.110:0/674139269 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb4c405a0b0 0x7fb4c405c570 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fb4e0001650 tx=0x7fb4e40676a0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:00.876 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:00.871+0000 7fb4d27fc700 1 -- 172.21.15.110:0/674139269 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fb4d4048c70 con 0x7fb4e40b3cd0 2021-03-25T14:18:01.022 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.021+0000 7fb4ec5be700 1 -- 172.21.15.110:0/674139269 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4e40bbd70 con 0x7fb4e40b3cd0 2021-03-25T14:18:01.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.022+0000 7fb4d27fc700 1 -- 172.21.15.110:0/674139269 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+20269 (secure 0 0 0) 0x7fb4d404c290 con 0x7fb4e40b3cd0 2021-03-25T14:18:01.024 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:18:01.024 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":60,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:17:53.497087+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2021-03-25T14:17:40.271092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2021-03-25T14:17:41.271977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":12,"pool_name":"cephfs2_metadata","create_time":"2021-03-25T14:17:50.184585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}}},{"pool":13,"pool_name":"cephfs2_data","create_time":"2021-03-25T14:17:51.481411+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs2"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:18:01.026 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.024+0000 7fb4ec5be700 1 -- 172.21.15.110:0/674139269 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb4c405a0b0 msgr2=0x7fb4c405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:01.026 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.024+0000 7fb4ec5be700 1 --2- 172.21.15.110:0/674139269 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb4c405a0b0 0x7fb4c405c570 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fb4e0001650 tx=0x7fb4e40676a0).stop 2021-03-25T14:18:01.026 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.024+0000 7fb4ec5be700 1 -- 172.21.15.110:0/674139269 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4e40b3cd0 msgr2=0x7fb4e415c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:01.026 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.024+0000 7fb4ec5be700 1 --2- 172.21.15.110:0/674139269 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4e40b3cd0 0x7fb4e415c760 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7fb4d400c3c0 tx=0x7fb4d4015000).stop 2021-03-25T14:18:01.026 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.024+0000 7fb4ec5be700 1 -- 172.21.15.110:0/674139269 shutdown_connections 2021-03-25T14:18:01.027 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.024+0000 7fb4ec5be700 1 --2- 172.21.15.110:0/674139269 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb4c405a0b0 0x7fb4c405c570 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:01.027 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.024+0000 7fb4ec5be700 1 --2- 172.21.15.110:0/674139269 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb4cc004510 0x7fb4e414ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:01.027 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.024+0000 7fb4ec5be700 1 --2- 172.21.15.110:0/674139269 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4e41439a0 0x7fb4e415cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:01.027 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.024+0000 7fb4ec5be700 1 --2- 172.21.15.110:0/674139269 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4e40b3cd0 0x7fb4e415c760 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:01.027 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.024+0000 7fb4ec5be700 1 -- 172.21.15.110:0/674139269 >> 172.21.15.110:0/674139269 conn(0x7fb4e40649a0 msgr2=0x7fb4e40bcc10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:01.028 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.024+0000 7fb4ec5be700 1 -- 172.21.15.110:0/674139269 shutdown_connections 2021-03-25T14:18:01.028 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.024+0000 7fb4ec5be700 1 -- 172.21.15.110:0/674139269 wait complete. 2021-03-25T14:18:01.037 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2021-03-25T14:18:01.037 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-03-25T14:18:01.147 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.146+0000 7fd1c455d700 1 Processor -- start 2021-03-25T14:18:01.147 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.146+0000 7fd1c455d700 1 -- start start 2021-03-25T14:18:01.150 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.147+0000 7fd1c455d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd1bc067840 0x7fd1bc145070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:01.150 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.147+0000 7fd1c455d700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1bc0afee0 con 0x7fd1bc0bbca0 2021-03-25T14:18:01.150 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.147+0000 7fd1c455d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1bc145b10 con 0x7fd1bc068ac0 2021-03-25T14:18:01.150 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.147+0000 7fd1c455d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1bc067c80 con 0x7fd1bc067840 2021-03-25T14:18:01.150 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.147+0000 7fd1c22f9700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fd1bc0bbca0 0x7fd1bc0acf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43918/0 (socket says 172.21.15.110:43918) 2021-03-25T14:18:01.150 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.147+0000 7fd1c22f9700 1 -- 172.21.15.110:0/913480322 learned_addr learned my addr 172.21.15.110:0/913480322 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:18:01.150 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.147+0000 7fd1c2afa700 1 --2- 172.21.15.110:0/913480322 >> v2:172.21.15.174:3300/0 conn(0x7fd1bc067840 0x7fd1bc145070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:01.151 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.148+0000 7fd1c12f7700 1 -- 172.21.15.110:0/913480322 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3465287896 0 0) 0x7fd1bc0afee0 con 0x7fd1bc0bbca0 2021-03-25T14:18:01.151 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.148+0000 7fd1c12f7700 1 -- 172.21.15.110:0/913480322 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1a4003270 con 0x7fd1bc0bbca0 2021-03-25T14:18:01.151 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.148+0000 7fd1c12f7700 1 -- 172.21.15.110:0/913480322 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 132996759 0 0) 0x7fd1a4003270 con 0x7fd1bc0bbca0 2021-03-25T14:18:01.151 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.148+0000 7fd1c2afa700 1 -- 172.21.15.110:0/913480322 >> v1:172.21.15.174:6789/0 conn(0x7fd1bc068ac0 legacy=0x7fd1bc144960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:01.151 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.148+0000 7fd1c2afa700 1 -- 172.21.15.110:0/913480322 >> v1:172.21.15.110:6789/0 conn(0x7fd1bc0bbca0 legacy=0x7fd1bc0acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:01.151 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.148+0000 7fd1c2afa700 1 -- 172.21.15.110:0/913480322 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1bc145d40 con 0x7fd1bc067840 2021-03-25T14:18:01.151 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.148+0000 7fd1c2afa700 1 --2- 172.21.15.110:0/913480322 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1bc067840 0x7fd1bc145070 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fd1b400ae60 tx=0x7fd1b400a3c0).ready entity=mon.1 client_cookie=54ee5f4607a9b9f3 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:01.151 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.148+0000 7fd1c12f7700 1 -- 172.21.15.110:0/913480322 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac001520 con 0x7fd1bc067840 2021-03-25T14:18:01.151 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.148+0000 7fd1c12f7700 1 -- 172.21.15.110:0/913480322 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b400c9f0 con 0x7fd1bc067840 2021-03-25T14:18:01.151 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.148+0000 7fd1c12f7700 1 -- 172.21.15.110:0/913480322 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b400cd90 con 0x7fd1bc067840 2021-03-25T14:18:01.151 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.149+0000 7fd1c455d700 1 -- 172.21.15.110:0/913480322 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1bc067840 msgr2=0x7fd1bc145070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:01.152 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.149+0000 7fd1c455d700 1 --2- 172.21.15.110:0/913480322 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1bc067840 0x7fd1bc145070 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fd1b400ae60 tx=0x7fd1b400a3c0).stop 2021-03-25T14:18:01.152 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.149+0000 7fd1c455d700 1 -- 172.21.15.110:0/913480322 shutdown_connections 2021-03-25T14:18:01.152 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.149+0000 7fd1c455d700 1 --2- 172.21.15.110:0/913480322 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1bc067840 0x7fd1bc145070 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:01.152 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.149+0000 7fd1c455d700 1 -- 172.21.15.110:0/913480322 >> 172.21.15.110:0/913480322 conn(0x7fd1bc063850 msgr2=0x7fd1bc05c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:01.152 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.149+0000 7fd1c455d700 1 -- 172.21.15.110:0/913480322 shutdown_connections 2021-03-25T14:18:01.152 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.149+0000 7fd1c455d700 1 -- 172.21.15.110:0/913480322 wait complete. 2021-03-25T14:18:01.155 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.150+0000 7fd1c455d700 1 Processor -- start 2021-03-25T14:18:01.155 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.150+0000 7fd1c455d700 1 -- start start 2021-03-25T14:18:01.155 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.150+0000 7fd1c455d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1bc067840 0x7fd1bc1586c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:01.155 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.150+0000 7fd1c455d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1bc068ac0 0x7fd1bc143be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:01.156 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.150+0000 7fd1c455d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1bc0bbca0 0x7fd1bc142940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:01.156 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.150+0000 7fd1c455d700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc141cc0 con 0x7fd1bc0bbca0 2021-03-25T14:18:01.156 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.150+0000 7fd1c455d700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc141f60 con 0x7fd1bc068ac0 2021-03-25T14:18:01.156 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.150+0000 7fd1c455d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc142200 con 0x7fd1bc067840 2021-03-25T14:18:01.156 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.151+0000 7fd1c2afa700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1bc0bbca0 0x7fd1bc142940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:01.156 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.151+0000 7fd1c2afa700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1bc0bbca0 0x7fd1bc142940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50990/0 (socket says 172.21.15.110:50990) 2021-03-25T14:18:01.156 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.151+0000 7fd1c2afa700 1 -- 172.21.15.110:0/1004119294 learned_addr learned my addr 172.21.15.110:0/1004119294 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:01.156 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.151+0000 7fd1c1af8700 1 --2- 172.21.15.110:0/1004119294 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1bc068ac0 0x7fd1bc143be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:01.156 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.151+0000 7fd1c22f9700 1 --2- 172.21.15.110:0/1004119294 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1bc067840 0x7fd1bc1586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:01.156 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.151+0000 7fd1c2afa700 1 -- 172.21.15.110:0/1004119294 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1bc067840 msgr2=0x7fd1bc1586c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:01.156 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.151+0000 7fd1c2afa700 1 --2- 172.21.15.110:0/1004119294 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1bc067840 0x7fd1bc1586c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:01.157 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.151+0000 7fd1c2afa700 1 -- 172.21.15.110:0/1004119294 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1bc068ac0 msgr2=0x7fd1bc143be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:01.157 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.151+0000 7fd1c2afa700 1 --2- 172.21.15.110:0/1004119294 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1bc068ac0 0x7fd1bc143be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:01.157 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.151+0000 7fd1c2afa700 1 -- 172.21.15.110:0/1004119294 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1bc1424a0 con 0x7fd1bc0bbca0 2021-03-25T14:18:01.157 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.151+0000 7fd1c2afa700 1 --2- 172.21.15.110:0/1004119294 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1bc0bbca0 0x7fd1bc142940 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7fd1bc065e30 tx=0x7fd1bc145a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:01.157 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.151+0000 7fd1aa7fc700 1 -- 172.21.15.110:0/1004119294 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b401f070 con 0x7fd1bc0bbca0 2021-03-25T14:18:01.157 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.151+0000 7fd1aa7fc700 1 -- 172.21.15.110:0/1004119294 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b4019630 con 0x7fd1bc0bbca0 2021-03-25T14:18:01.157 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.151+0000 7fd1c455d700 1 -- 172.21.15.110:0/1004119294 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1bc155a90 con 0x7fd1bc0bbca0 2021-03-25T14:18:01.157 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.151+0000 7fd1aa7fc700 1 -- 172.21.15.110:0/1004119294 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b40199d0 con 0x7fd1bc0bbca0 2021-03-25T14:18:01.157 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.151+0000 7fd1c455d700 1 -- 172.21.15.110:0/1004119294 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1bc1440d0 con 0x7fd1bc0bbca0 2021-03-25T14:18:01.157 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.152+0000 7fd1c455d700 1 -- 172.21.15.110:0/1004119294 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1bc05d0b0 con 0x7fd1bc0bbca0 2021-03-25T14:18:01.157 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.152+0000 7fd1aa7fc700 1 -- 172.21.15.110:0/1004119294 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fd1b400e040 con 0x7fd1bc0bbca0 2021-03-25T14:18:01.157 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.153+0000 7fd1aa7fc700 1 --2- 172.21.15.110:0/1004119294 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd19c05a0e0 0x7fd19c05c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:01.157 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.153+0000 7fd1aa7fc700 1 -- 172.21.15.110:0/1004119294 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 7250+0+0 (secure 0 0 0) 0x7fd1b4076970 con 0x7fd1bc0bbca0 2021-03-25T14:18:01.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.153+0000 7fd1c22f9700 1 --2- 172.21.15.110:0/1004119294 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd19c05a0e0 0x7fd19c05c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:01.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.153+0000 7fd1c22f9700 1 --2- 172.21.15.110:0/1004119294 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd19c05a0e0 0x7fd19c05c5a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7fd1ac001650 tx=0x7fd1ac000bc0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:01.158 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.156+0000 7fd1aa7fc700 1 -- 172.21.15.110:0/1004119294 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fd1bc05d0b0 con 0x7fd1bc0bbca0 2021-03-25T14:18:01.343 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.342+0000 7fd1c455d700 1 -- 172.21.15.110:0/1004119294 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1bc05d7b0 con 0x7fd1bc0bbca0 2021-03-25T14:18:01.343 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.343+0000 7fd1aa7fc700 1 -- 172.21.15.110:0/1004119294 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+3779 (secure 0 0 0) 0x7fd1b4028090 con 0x7fd1bc0bbca0 2021-03-25T14:18:01.344 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:18:01.344 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4997,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/3015251726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3015251726},{"type":"v1","addr":"172.21.15.174:6835","nonce":3015251726}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":24},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/1698368640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1698368640},{"type":"v1","addr":"172.21.15.174:6833","nonce":1698368640}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-03-25T14:17:42.344725+0000","modified":"2021-03-25T14:17:43.345825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5604":{"gid":5604,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6836/426511293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":426511293},{"type":"v1","addr":"172.21.15.110:6836","nonce":426511293}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-03-25T14:17:52.495440+0000","modified":"2021-03-25T14:17:53.496776+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5601},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5601":{"gid":5601,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":5,"addr":"172.21.15.110:6837/2143874763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":2143874763},{"type":"v1","addr":"172.21.15.110:6837","nonce":2143874763}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs2","balancer":"","standby_count_wanted":0},"id":5}]} 2021-03-25T14:18:01.345 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.344+0000 7fd1c455d700 1 -- 172.21.15.110:0/1004119294 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd19c05a0e0 msgr2=0x7fd19c05c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:01.345 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.344+0000 7fd1c455d700 1 --2- 172.21.15.110:0/1004119294 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd19c05a0e0 0x7fd19c05c5a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7fd1ac001650 tx=0x7fd1ac000bc0).stop 2021-03-25T14:18:01.345 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.344+0000 7fd1c455d700 1 -- 172.21.15.110:0/1004119294 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1bc0bbca0 msgr2=0x7fd1bc142940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:01.345 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.344+0000 7fd1c455d700 1 --2- 172.21.15.110:0/1004119294 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1bc0bbca0 0x7fd1bc142940 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7fd1bc065e30 tx=0x7fd1bc145a00).stop 2021-03-25T14:18:01.345 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.344+0000 7fd1c455d700 1 -- 172.21.15.110:0/1004119294 shutdown_connections 2021-03-25T14:18:01.346 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.344+0000 7fd1c455d700 1 --2- 172.21.15.110:0/1004119294 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fd19c05a0e0 0x7fd19c05c5a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:01.346 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.344+0000 7fd1c455d700 1 --2- 172.21.15.110:0/1004119294 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1bc0bbca0 0x7fd1bc142940 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:01.346 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.344+0000 7fd1c455d700 1 --2- 172.21.15.110:0/1004119294 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1bc067840 0x7fd1bc1586c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:01.346 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.344+0000 7fd1c455d700 1 --2- 172.21.15.110:0/1004119294 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1bc068ac0 0x7fd1bc143be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:01.346 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.344+0000 7fd1c455d700 1 -- 172.21.15.110:0/1004119294 >> 172.21.15.110:0/1004119294 conn(0x7fd1bc063850 msgr2=0x7fd1bc0b9880 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:01.346 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.344+0000 7fd1c455d700 1 -- 172.21.15.110:0/1004119294 shutdown_connections 2021-03-25T14:18:01.346 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.344+0000 7fd1c455d700 1 -- 172.21.15.110:0/1004119294 wait complete. 2021-03-25T14:18:01.347 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 30 2021-03-25T14:18:01.356 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-03-25T14:18:01.466 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.465+0000 7f7b437a0700 1 Processor -- start 2021-03-25T14:18:01.466 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.465+0000 7f7b437a0700 1 -- start start 2021-03-25T14:18:01.469 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.466+0000 7f7b437a0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7b3c0bcd90 0x7f7b3c14d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:01.469 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.466+0000 7f7b437a0700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7b3c0b7620 0x7f7b3c148ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:01.469 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.466+0000 7f7b437a0700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b3c0b9140 con 0x7f7b3c0b1340 2021-03-25T14:18:01.469 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.466+0000 7f7b437a0700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b3c0692a0 con 0x7f7b3c0b7620 2021-03-25T14:18:01.470 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.466+0000 7f7b437a0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b3c0b93e0 con 0x7f7b3c0bcd90 2021-03-25T14:18:01.470 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.466+0000 7f7b41d3d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7b3c0b7620 0x7f7b3c148ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:01.470 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.466+0000 7f7b41d3d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7b3c0b7620 0x7f7b3c148ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50996/0 (socket says 172.21.15.110:50996) 2021-03-25T14:18:01.470 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.466+0000 7f7b41d3d700 1 -- 172.21.15.110:0/2776001877 learned_addr learned my addr 172.21.15.110:0/2776001877 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:01.470 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.466+0000 7f7b40d3b700 1 --1- 172.21.15.110:0/2776001877 >> v1:172.21.15.110:6789/0 conn(0x7f7b3c0b1340 0x7f7b3c060c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43934/0 (socket says 172.21.15.110:43934) 2021-03-25T14:18:01.470 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.466+0000 7f7b4153c700 1 --2- 172.21.15.110:0/2776001877 >> v2:172.21.15.174:3300/0 conn(0x7f7b3c0bcd90 0x7f7b3c14d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:01.470 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.466+0000 7f7b41d3d700 1 -- 172.21.15.110:0/2776001877 >> v2:172.21.15.174:3300/0 conn(0x7f7b3c0bcd90 msgr2=0x7f7b3c14d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:01.470 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.466+0000 7f7b41d3d700 1 --2- 172.21.15.110:0/2776001877 >> v2:172.21.15.174:3300/0 conn(0x7f7b3c0bcd90 0x7f7b3c14d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:01.470 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.466+0000 7f7b41d3d700 1 -- 172.21.15.110:0/2776001877 >> v1:172.21.15.110:6789/0 conn(0x7f7b3c0b1340 legacy=0x7f7b3c060c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:01.470 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.467+0000 7f7b2bfff700 1 -- 172.21.15.110:0/2776001877 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1429346789 0 0) 0x7f7b3c0b9140 con 0x7f7b3c0b1340 2021-03-25T14:18:01.470 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.467+0000 7f7b41d3d700 1 -- 172.21.15.110:0/2776001877 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b3c14cda0 con 0x7f7b3c0b7620 2021-03-25T14:18:01.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.467+0000 7f7b4153c700 1 --2- 172.21.15.110:0/2776001877 >> v2:172.21.15.174:3300/0 conn(0x7f7b3c0bcd90 0x7f7b3c14d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:18:01.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.467+0000 7f7b41d3d700 1 --2- 172.21.15.110:0/2776001877 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b3c0b7620 0x7f7b3c148ab0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f7b3c065280 tx=0x7f7b340092d0).ready entity=mon.0 client_cookie=75a434d38881408d server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:01.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.467+0000 7f7b2bfff700 1 -- 172.21.15.110:0/2776001877 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3400bbf0 con 0x7f7b3c0b7620 2021-03-25T14:18:01.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.467+0000 7f7b2bfff700 1 -- 172.21.15.110:0/2776001877 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3400bd50 con 0x7f7b3c0b7620 2021-03-25T14:18:01.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.467+0000 7f7b2bfff700 1 -- 172.21.15.110:0/2776001877 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b34011610 con 0x7f7b3c0b7620 2021-03-25T14:18:01.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.467+0000 7f7b437a0700 1 -- 172.21.15.110:0/2776001877 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b3c0b7620 msgr2=0x7f7b3c148ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:01.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.467+0000 7f7b437a0700 1 --2- 172.21.15.110:0/2776001877 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b3c0b7620 0x7f7b3c148ab0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f7b3c065280 tx=0x7f7b340092d0).stop 2021-03-25T14:18:01.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.467+0000 7f7b437a0700 1 -- 172.21.15.110:0/2776001877 shutdown_connections 2021-03-25T14:18:01.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.467+0000 7f7b437a0700 1 --2- 172.21.15.110:0/2776001877 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b3c0b7620 0x7f7b3c148ab0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:01.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.467+0000 7f7b437a0700 1 --2- 172.21.15.110:0/2776001877 >> v2:172.21.15.174:3300/0 conn(0x7f7b3c0bcd90 0x7f7b3c14d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:01.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.467+0000 7f7b437a0700 1 -- 172.21.15.110:0/2776001877 >> 172.21.15.110:0/2776001877 conn(0x7f7b3c063720 msgr2=0x7f7b3c063b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:01.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.467+0000 7f7b437a0700 1 -- 172.21.15.110:0/2776001877 shutdown_connections 2021-03-25T14:18:01.471 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.467+0000 7f7b437a0700 1 -- 172.21.15.110:0/2776001877 wait complete. 2021-03-25T14:18:01.472 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.468+0000 7f7b437a0700 1 Processor -- start 2021-03-25T14:18:01.472 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.469+0000 7f7b437a0700 1 -- start start 2021-03-25T14:18:01.474 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.469+0000 7f7b437a0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b3c0b1340 0x7f7b3c0b6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:01.475 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.469+0000 7f7b437a0700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b3c0b7620 0x7f7b3c0b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:01.475 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.469+0000 7f7b437a0700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b3c0bcd90 0x7f7b3c148880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:01.475 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.469+0000 7f7b437a0700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3c14a4e0 con 0x7f7b3c0b7620 2021-03-25T14:18:01.475 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.469+0000 7f7b437a0700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3c15c200 con 0x7f7b3c0bcd90 2021-03-25T14:18:01.475 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.469+0000 7f7b437a0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3c15c4a0 con 0x7f7b3c0b1340 2021-03-25T14:18:01.475 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.469+0000 7f7b40d3b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b3c0b7620 0x7f7b3c0b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:01.475 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.469+0000 7f7b40d3b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b3c0b7620 0x7f7b3c0b6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51002/0 (socket says 172.21.15.110:51002) 2021-03-25T14:18:01.475 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.469+0000 7f7b40d3b700 1 -- 172.21.15.110:0/849039327 learned_addr learned my addr 172.21.15.110:0/849039327 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:01.475 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.470+0000 7f7b4153c700 1 --2- 172.21.15.110:0/849039327 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b3c0b1340 0x7f7b3c0b6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:01.475 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.470+0000 7f7b41d3d700 1 --2- 172.21.15.110:0/849039327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b3c0bcd90 0x7f7b3c148880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:01.475 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.470+0000 7f7b40d3b700 1 -- 172.21.15.110:0/849039327 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b3c0b1340 msgr2=0x7f7b3c0b6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:01.476 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.470+0000 7f7b40d3b700 1 --2- 172.21.15.110:0/849039327 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b3c0b1340 0x7f7b3c0b6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:01.476 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.470+0000 7f7b40d3b700 1 -- 172.21.15.110:0/849039327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b3c0bcd90 msgr2=0x7f7b3c148880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:01.476 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.470+0000 7f7b40d3b700 1 --2- 172.21.15.110:0/849039327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b3c0bcd90 0x7f7b3c148880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:01.476 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.470+0000 7f7b40d3b700 1 -- 172.21.15.110:0/849039327 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b3c15c740 con 0x7f7b3c0b7620 2021-03-25T14:18:01.476 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.470+0000 7f7b40d3b700 1 --2- 172.21.15.110:0/849039327 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b3c0b7620 0x7f7b3c0b6b70 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f7b2c00c760 tx=0x7f7b2c007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:01.476 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.470+0000 7f7b297fa700 1 -- 172.21.15.110:0/849039327 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2c0072e0 con 0x7f7b3c0b7620 2021-03-25T14:18:01.476 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.470+0000 7f7b297fa700 1 -- 172.21.15.110:0/849039327 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2c007440 con 0x7f7b3c0b7620 2021-03-25T14:18:01.476 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.470+0000 7f7b437a0700 1 -- 172.21.15.110:0/849039327 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b3c15c9e0 con 0x7f7b3c0b7620 2021-03-25T14:18:01.476 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.470+0000 7f7b297fa700 1 -- 172.21.15.110:0/849039327 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2c0057b0 con 0x7f7b3c0b7620 2021-03-25T14:18:01.476 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.470+0000 7f7b437a0700 1 -- 172.21.15.110:0/849039327 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b3c14a160 con 0x7f7b3c0b7620 2021-03-25T14:18:01.476 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.471+0000 7f7b437a0700 1 -- 172.21.15.110:0/849039327 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b3c15cb70 con 0x7f7b3c0b7620 2021-03-25T14:18:01.476 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.471+0000 7f7b297fa700 1 -- 172.21.15.110:0/849039327 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f7b2c010070 con 0x7f7b3c0b7620 2021-03-25T14:18:01.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.472+0000 7f7b297fa700 1 --2- 172.21.15.110:0/849039327 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f7b1c05a0b0 0x7f7b1c05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:01.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.472+0000 7f7b297fa700 1 -- 172.21.15.110:0/849039327 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 7250+0+0 (secure 0 0 0) 0x7f7b2c073930 con 0x7f7b3c0b7620 2021-03-25T14:18:01.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.472+0000 7f7b4153c700 1 --2- 172.21.15.110:0/849039327 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f7b1c05a0b0 0x7f7b1c05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:01.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.472+0000 7f7b4153c700 1 --2- 172.21.15.110:0/849039327 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f7b1c05a0b0 0x7f7b1c05c570 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f7b38006fd0 tx=0x7f7b38008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:01.477 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.475+0000 7f7b297fa700 1 -- 172.21.15.110:0/849039327 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f7b2c046e30 con 0x7f7b3c0b7620 2021-03-25T14:18:01.660 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.659+0000 7f7b437a0700 1 -- 172.21.15.110:0/849039327 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b3c05d7b0 con 0x7f7b3c0b7620 2021-03-25T14:18:01.722 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.659+0000 7f7b297fa700 1 -- 172.21.15.110:0/849039327 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+3779 (secure 0 0 0) 0x7f7b2c04a450 con 0x7f7b3c0b7620 2021-03-25T14:18:01.722 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:18:01.723 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4997,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/3015251726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3015251726},{"type":"v1","addr":"172.21.15.174:6835","nonce":3015251726}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":24},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/1698368640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1698368640},{"type":"v1","addr":"172.21.15.174:6833","nonce":1698368640}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-03-25T14:17:42.344725+0000","modified":"2021-03-25T14:17:43.345825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5604":{"gid":5604,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6836/426511293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":426511293},{"type":"v1","addr":"172.21.15.110:6836","nonce":426511293}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-03-25T14:17:52.495440+0000","modified":"2021-03-25T14:17:53.496776+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5601},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5601":{"gid":5601,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":5,"addr":"172.21.15.110:6837/2143874763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":2143874763},{"type":"v1","addr":"172.21.15.110:6837","nonce":2143874763}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs2","balancer":"","standby_count_wanted":0},"id":5}]} 2021-03-25T14:18:01.724 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.661+0000 7f7b437a0700 1 -- 172.21.15.110:0/849039327 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f7b1c05a0b0 msgr2=0x7f7b1c05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:01.725 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.661+0000 7f7b437a0700 1 --2- 172.21.15.110:0/849039327 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f7b1c05a0b0 0x7f7b1c05c570 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f7b38006fd0 tx=0x7f7b38008040).stop 2021-03-25T14:18:01.725 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.661+0000 7f7b437a0700 1 -- 172.21.15.110:0/849039327 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b3c0b7620 msgr2=0x7f7b3c0b6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:01.725 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.661+0000 7f7b437a0700 1 --2- 172.21.15.110:0/849039327 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b3c0b7620 0x7f7b3c0b6b70 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f7b2c00c760 tx=0x7f7b2c007c60).stop 2021-03-25T14:18:01.725 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.661+0000 7f7b437a0700 1 -- 172.21.15.110:0/849039327 shutdown_connections 2021-03-25T14:18:01.725 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.661+0000 7f7b437a0700 1 --2- 172.21.15.110:0/849039327 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f7b1c05a0b0 0x7f7b1c05c570 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:01.725 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.661+0000 7f7b437a0700 1 --2- 172.21.15.110:0/849039327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b3c0bcd90 0x7f7b3c148880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:01.725 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.661+0000 7f7b437a0700 1 --2- 172.21.15.110:0/849039327 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b3c0b1340 0x7f7b3c0b6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:01.726 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.661+0000 7f7b437a0700 1 --2- 172.21.15.110:0/849039327 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b3c0b7620 0x7f7b3c0b6b70 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:01.726 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.661+0000 7f7b437a0700 1 -- 172.21.15.110:0/849039327 >> 172.21.15.110:0/849039327 conn(0x7f7b3c063720 msgr2=0x7f7b3c0bab80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:01.726 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.661+0000 7f7b437a0700 1 -- 172.21.15.110:0/849039327 shutdown_connections 2021-03-25T14:18:01.726 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.661+0000 7f7b437a0700 1 -- 172.21.15.110:0/849039327 wait complete. 2021-03-25T14:18:01.726 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 30 2021-03-25T14:18:01.727 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:18:01.838 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.837+0000 7f09e0c34700 1 Processor -- start 2021-03-25T14:18:01.838 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.837+0000 7f09e0c34700 1 -- start start 2021-03-25T14:18:01.844 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.838+0000 7f09e0c34700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f09dc0b99b0 0x7f09dc0ba4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:01.844 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.838+0000 7f09e0c34700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09dc14a050 0x7f09dc1488b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:01.844 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.838+0000 7f09e0c34700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f09dc148da0 0x7f09dc0a3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:01.844 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.838+0000 7f09e0c34700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09dc0ba9e0 con 0x7f09dc0b99b0 2021-03-25T14:18:01.844 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.838+0000 7f09e0c34700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09dc0babc0 con 0x7f09dc148da0 2021-03-25T14:18:01.844 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.838+0000 7f09e0c34700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc0bae60 con 0x7f09dc14a050 2021-03-25T14:18:01.844 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.838+0000 7f09da59c700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f09dc0b99b0 0x7f09dc0ba4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:01.844 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.838+0000 7f09da59c700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f09dc0b99b0 0x7f09dc0ba4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51010/0 (socket says 172.21.15.110:51010) 2021-03-25T14:18:01.844 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.838+0000 7f09da59c700 1 -- 172.21.15.110:0/4126249721 learned_addr learned my addr 172.21.15.110:0/4126249721 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:01.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.838+0000 7f09d9d9b700 1 --2- 172.21.15.110:0/4126249721 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09dc14a050 0x7f09dc1488b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:01.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.838+0000 7f09dad9d700 1 --2- 172.21.15.110:0/4126249721 >> v2:172.21.15.174:3300/0 conn(0x7f09dc148da0 0x7f09dc0a3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:01.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.838+0000 7f09da59c700 1 -- 172.21.15.110:0/4126249721 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09dc14a050 msgr2=0x7f09dc1488b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:01.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.838+0000 7f09da59c700 1 --2- 172.21.15.110:0/4126249721 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09dc14a050 0x7f09dc1488b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:01.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.838+0000 7f09da59c700 1 -- 172.21.15.110:0/4126249721 >> v2:172.21.15.174:3300/0 conn(0x7f09dc148da0 msgr2=0x7f09dc0a3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:01.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.838+0000 7f09da59c700 1 --2- 172.21.15.110:0/4126249721 >> v2:172.21.15.174:3300/0 conn(0x7f09dc148da0 0x7f09dc0a3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:01.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.838+0000 7f09da59c700 1 -- 172.21.15.110:0/4126249721 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09dc0a2a50 con 0x7f09dc0b99b0 2021-03-25T14:18:01.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.838+0000 7f09da59c700 1 --2- 172.21.15.110:0/4126249721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09dc0b99b0 0x7f09dc0ba4f0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7f09dc062e10 tx=0x7f09cc006e80).ready entity=mon.0 client_cookie=b1952f242c41cfc0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:01.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.838+0000 7f09d959a700 1 -- 172.21.15.110:0/4126249721 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09cc00be80 con 0x7f09dc0b99b0 2021-03-25T14:18:01.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.839+0000 7f09d959a700 1 -- 172.21.15.110:0/4126249721 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09cc006030 con 0x7f09dc0b99b0 2021-03-25T14:18:01.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.839+0000 7f09d959a700 1 -- 172.21.15.110:0/4126249721 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09cc0063b0 con 0x7f09dc0b99b0 2021-03-25T14:18:01.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.839+0000 7f09e0c34700 1 -- 172.21.15.110:0/4126249721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09dc0b99b0 msgr2=0x7f09dc0ba4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:01.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.839+0000 7f09e0c34700 1 --2- 172.21.15.110:0/4126249721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09dc0b99b0 0x7f09dc0ba4f0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7f09dc062e10 tx=0x7f09cc006e80).stop 2021-03-25T14:18:01.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.839+0000 7f09e0c34700 1 -- 172.21.15.110:0/4126249721 shutdown_connections 2021-03-25T14:18:01.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.839+0000 7f09e0c34700 1 --2- 172.21.15.110:0/4126249721 >> v2:172.21.15.174:3300/0 conn(0x7f09dc148da0 0x7f09dc0a3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:01.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.839+0000 7f09e0c34700 1 --2- 172.21.15.110:0/4126249721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09dc0b99b0 0x7f09dc0ba4f0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:01.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.839+0000 7f09e0c34700 1 --2- 172.21.15.110:0/4126249721 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09dc14a050 0x7f09dc1488b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:01.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.839+0000 7f09e0c34700 1 -- 172.21.15.110:0/4126249721 >> 172.21.15.110:0/4126249721 conn(0x7f09dc060c40 msgr2=0x7f09dc061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:01.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.839+0000 7f09e0c34700 1 -- 172.21.15.110:0/4126249721 shutdown_connections 2021-03-25T14:18:01.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.839+0000 7f09e0c34700 1 -- 172.21.15.110:0/4126249721 wait complete. 2021-03-25T14:18:01.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.840+0000 7f09e0c34700 1 Processor -- start 2021-03-25T14:18:01.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.840+0000 7f09e0c34700 1 -- start start 2021-03-25T14:18:01.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.841+0000 7f09e0c34700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f09dc0b99b0 0x7f09dc0bdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:01.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.841+0000 7f09e0c34700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09dc148da0 0x7f09dc0651e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:01.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.841+0000 7f09e0c34700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09dc14a050 0x7f09dc0b3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:01.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.841+0000 7f09e0c34700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc0b5aa0 con 0x7f09dc14a050 2021-03-25T14:18:01.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.841+0000 7f09e0c34700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc0b2ea0 con 0x7f09dc0b99b0 2021-03-25T14:18:01.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.841+0000 7f09e0c34700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc15d0d0 con 0x7f09dc148da0 2021-03-25T14:18:01.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.841+0000 7f09dad9d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09dc14a050 0x7f09dc0b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:01.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.841+0000 7f09dad9d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09dc14a050 0x7f09dc0b3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51018/0 (socket says 172.21.15.110:51018) 2021-03-25T14:18:01.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.841+0000 7f09dad9d700 1 -- 172.21.15.110:0/1201068555 learned_addr learned my addr 172.21.15.110:0/1201068555 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:01.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.841+0000 7f09d9d9b700 1 --2- 172.21.15.110:0/1201068555 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09dc148da0 0x7f09dc0651e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:01.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.841+0000 7f09da59c700 1 --2- 172.21.15.110:0/1201068555 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f09dc0b99b0 0x7f09dc0bdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:01.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.841+0000 7f09dad9d700 1 -- 172.21.15.110:0/1201068555 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09dc148da0 msgr2=0x7f09dc0651e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:01.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.841+0000 7f09dad9d700 1 --2- 172.21.15.110:0/1201068555 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09dc148da0 0x7f09dc0651e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:01.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.841+0000 7f09dad9d700 1 -- 172.21.15.110:0/1201068555 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f09dc0b99b0 msgr2=0x7f09dc0bdaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:01.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.841+0000 7f09dad9d700 1 --2- 172.21.15.110:0/1201068555 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f09dc0b99b0 0x7f09dc0bdaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:01.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.841+0000 7f09dad9d700 1 -- 172.21.15.110:0/1201068555 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09dc0be190 con 0x7f09dc14a050 2021-03-25T14:18:01.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.841+0000 7f09dad9d700 1 --2- 172.21.15.110:0/1201068555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09dc14a050 0x7f09dc0b3300 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f09d400ef80 tx=0x7f09d4009220).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:01.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.841+0000 7f09ca7fc700 1 -- 172.21.15.110:0/1201068555 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d400cc00 con 0x7f09dc14a050 2021-03-25T14:18:01.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.841+0000 7f09ca7fc700 1 -- 172.21.15.110:0/1201068555 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d400cd60 con 0x7f09dc14a050 2021-03-25T14:18:01.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.841+0000 7f09e0c34700 1 -- 172.21.15.110:0/1201068555 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09dc0bccf0 con 0x7f09dc14a050 2021-03-25T14:18:01.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.841+0000 7f09ca7fc700 1 -- 172.21.15.110:0/1201068555 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d4012620 con 0x7f09dc14a050 2021-03-25T14:18:01.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.841+0000 7f09e0c34700 1 -- 172.21.15.110:0/1201068555 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09dc0bd230 con 0x7f09dc14a050 2021-03-25T14:18:01.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.842+0000 7f09e0c34700 1 -- 172.21.15.110:0/1201068555 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09dc05d7b0 con 0x7f09dc14a050 2021-03-25T14:18:01.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.843+0000 7f09ca7fc700 1 -- 172.21.15.110:0/1201068555 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f09d4022070 con 0x7f09dc14a050 2021-03-25T14:18:01.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.843+0000 7f09ca7fc700 1 --2- 172.21.15.110:0/1201068555 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f09b805a0e0 0x7f09b805c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:01.849 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.843+0000 7f09ca7fc700 1 -- 172.21.15.110:0/1201068555 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 7250+0+0 (secure 0 0 0) 0x7f09d4074900 con 0x7f09dc14a050 2021-03-25T14:18:01.849 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.843+0000 7f09da59c700 1 --2- 172.21.15.110:0/1201068555 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f09b805a0e0 0x7f09b805c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:01.849 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.843+0000 7f09da59c700 1 --2- 172.21.15.110:0/1201068555 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f09b805a0e0 0x7f09b805c5a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f09cc006ec0 tx=0x7f09cc015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:01.849 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.847+0000 7f09ca7fc700 1 -- 172.21.15.110:0/1201068555 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f09d4047e00 con 0x7f09dc14a050 2021-03-25T14:18:01.999 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.998+0000 7f09e0c34700 1 -- 172.21.15.110:0/1201068555 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09dc0a4000 con 0x7f09dc14a050 2021-03-25T14:18:02.000 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:01.999+0000 7f09ca7fc700 1 -- 172.21.15.110:0/1201068555 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+20269 (secure 0 0 0) 0x7f09d4016070 con 0x7f09dc14a050 2021-03-25T14:18:02.000 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:18:02.000 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":60,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:17:53.497087+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2021-03-25T14:17:40.271092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2021-03-25T14:17:41.271977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":12,"pool_name":"cephfs2_metadata","create_time":"2021-03-25T14:17:50.184585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}}},{"pool":13,"pool_name":"cephfs2_data","create_time":"2021-03-25T14:17:51.481411+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs2"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:18:02.002 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.000+0000 7f09e0c34700 1 -- 172.21.15.110:0/1201068555 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f09b805a0e0 msgr2=0x7f09b805c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:02.002 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.000+0000 7f09e0c34700 1 --2- 172.21.15.110:0/1201068555 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f09b805a0e0 0x7f09b805c5a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f09cc006ec0 tx=0x7f09cc015000).stop 2021-03-25T14:18:02.002 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.000+0000 7f09e0c34700 1 -- 172.21.15.110:0/1201068555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09dc14a050 msgr2=0x7f09dc0b3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:02.002 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.000+0000 7f09e0c34700 1 --2- 172.21.15.110:0/1201068555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09dc14a050 0x7f09dc0b3300 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f09d400ef80 tx=0x7f09d4009220).stop 2021-03-25T14:18:02.002 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.001+0000 7f09e0c34700 1 -- 172.21.15.110:0/1201068555 shutdown_connections 2021-03-25T14:18:02.002 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.001+0000 7f09e0c34700 1 --2- 172.21.15.110:0/1201068555 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f09b805a0e0 0x7f09b805c5a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:02.002 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.001+0000 7f09e0c34700 1 --2- 172.21.15.110:0/1201068555 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f09dc0b99b0 0x7f09dc0bdaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:02.002 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.001+0000 7f09e0c34700 1 --2- 172.21.15.110:0/1201068555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09dc14a050 0x7f09dc0b3300 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:02.002 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.001+0000 7f09e0c34700 1 --2- 172.21.15.110:0/1201068555 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09dc148da0 0x7f09dc0651e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:02.002 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.001+0000 7f09e0c34700 1 -- 172.21.15.110:0/1201068555 >> 172.21.15.110:0/1201068555 conn(0x7f09dc060c40 msgr2=0x7f09dc149230 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:02.002 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.001+0000 7f09e0c34700 1 -- 172.21.15.110:0/1201068555 shutdown_connections 2021-03-25T14:18:02.003 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.001+0000 7f09e0c34700 1 -- 172.21.15.110:0/1201068555 wait complete. 2021-03-25T14:18:02.013 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-03-25T14:18:02.143 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.126+0000 7f287f075700 1 Processor -- start 2021-03-25T14:18:02.144 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.126+0000 7f287f075700 1 -- start start 2021-03-25T14:18:02.144 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.126+0000 7f287f075700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f28780be5a0 0x7f287809d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:02.144 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.126+0000 7f287f075700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f287814d0e0 con 0x7f2878143980 2021-03-25T14:18:02.144 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.126+0000 7f287f075700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f287814d380 con 0x7f28780b9ba0 2021-03-25T14:18:02.144 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.126+0000 7f287f075700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f287814d620 con 0x7f28780be5a0 2021-03-25T14:18:02.144 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.126+0000 7f287d612700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f2878143980 0x7f2878149a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43958/0 (socket says 172.21.15.110:43958) 2021-03-25T14:18:02.144 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.127+0000 7f287d612700 1 -- 172.21.15.110:0/1988040676 learned_addr learned my addr 172.21.15.110:0/1988040676 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:18:02.144 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.127+0000 7f287ce11700 1 --2- 172.21.15.110:0/1988040676 >> v2:172.21.15.174:3300/0 conn(0x7f28780be5a0 0x7f287809d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:02.144 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.127+0000 7f28777fe700 1 -- 172.21.15.110:0/1988040676 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3723897546 0 0) 0x7f287814d0e0 con 0x7f2878143980 2021-03-25T14:18:02.144 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.127+0000 7f28777fe700 1 -- 172.21.15.110:0/1988040676 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f285c003270 con 0x7f2878143980 2021-03-25T14:18:02.144 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.127+0000 7f28777fe700 1 -- 172.21.15.110:0/1988040676 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 342062695 0 0) 0x7f285c003270 con 0x7f2878143980 2021-03-25T14:18:02.144 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.127+0000 7f28777fe700 1 -- 172.21.15.110:0/1988040676 >> v2:172.21.15.174:3300/0 conn(0x7f28780be5a0 msgr2=0x7f287809d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:02.145 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.127+0000 7f28777fe700 1 --2- 172.21.15.110:0/1988040676 >> v2:172.21.15.174:3300/0 conn(0x7f28780be5a0 0x7f287809d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:02.145 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.127+0000 7f28777fe700 1 -- 172.21.15.110:0/1988040676 >> v1:172.21.15.174:6789/0 conn(0x7f28780b9ba0 legacy=0x7f2878143270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:02.145 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.127+0000 7f28777fe700 1 -- 172.21.15.110:0/1988040676 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287814d8c0 con 0x7f2878143980 2021-03-25T14:18:02.145 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.127+0000 7f28777fe700 1 -- 172.21.15.110:0/1988040676 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f28700018a0 con 0x7f2878143980 2021-03-25T14:18:02.145 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.127+0000 7f28777fe700 1 -- 172.21.15.110:0/1988040676 >> v1:172.21.15.110:6789/0 conn(0x7f2878143980 legacy=0x7f2878149a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:02.145 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.127+0000 7f28777fe700 1 --2- 172.21.15.110:0/1988040676 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f285c003760 0x7f285c003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:02.145 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.127+0000 7f28777fe700 1 --2- 172.21.15.110:0/1988040676 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f285c004510 0x7f285c004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:02.145 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.127+0000 7f28777fe700 1 --2- 172.21.15.110:0/1988040676 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f285c004e80 0x7f285c00b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:02.145 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.127+0000 7f28777fe700 1 -- 172.21.15.110:0/1988040676 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287814d620 con 0x7f285c004e80 2021-03-25T14:18:02.145 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.127+0000 7f28777fe700 1 -- 172.21.15.110:0/1988040676 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285c004290 con 0x7f285c003760 2021-03-25T14:18:02.145 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.127+0000 7f28777fe700 1 -- 172.21.15.110:0/1988040676 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f285c00bc50 con 0x7f285c004510 2021-03-25T14:18:02.145 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.127+0000 7f287d612700 1 --2- 172.21.15.110:0/1988040676 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f285c004e80 0x7f285c00b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:02.145 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.127+0000 7f287ce11700 1 --2- 172.21.15.110:0/1988040676 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f285c003760 0x7f285c003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:02.146 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.127+0000 7f2877fff700 1 --2- 172.21.15.110:0/1988040676 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f285c004510 0x7f285c004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:02.146 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.128+0000 7f287d612700 1 -- 172.21.15.110:0/1988040676 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f285c004510 msgr2=0x7f285c004990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:02.146 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.128+0000 7f287d612700 1 --2- 172.21.15.110:0/1988040676 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f285c004510 0x7f285c004990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:02.146 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.128+0000 7f287d612700 1 -- 172.21.15.110:0/1988040676 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f285c003760 msgr2=0x7f285c003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:02.146 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.128+0000 7f287d612700 1 --2- 172.21.15.110:0/1988040676 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f285c003760 0x7f285c003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:02.146 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.128+0000 7f287d612700 1 -- 172.21.15.110:0/1988040676 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f285c003270 con 0x7f285c004e80 2021-03-25T14:18:02.146 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.128+0000 7f287d612700 1 -- 172.21.15.110:0/1988040676 reap_dead start 2021-03-25T14:18:02.146 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.128+0000 7f287d612700 1 --2- 172.21.15.110:0/1988040676 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f285c004e80 0x7f285c00b760 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f287000c830 tx=0x7f2870007b80).ready entity=mon.0 client_cookie=933cc57c28a1ec6a server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:02.146 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.128+0000 7f28777fe700 1 -- 172.21.15.110:0/1988040676 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2870005bb0 con 0x7f285c004e80 2021-03-25T14:18:02.146 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.128+0000 7f28777fe700 1 -- 172.21.15.110:0/1988040676 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2870005d10 con 0x7f285c004e80 2021-03-25T14:18:02.147 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.128+0000 7f28777fe700 1 -- 172.21.15.110:0/1988040676 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28700072e0 con 0x7f285c004e80 2021-03-25T14:18:02.147 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.128+0000 7f287f075700 1 -- 172.21.15.110:0/1988040676 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f285c004e80 msgr2=0x7f285c00b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:02.147 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.128+0000 7f287f075700 1 --2- 172.21.15.110:0/1988040676 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f285c004e80 0x7f285c00b760 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f287000c830 tx=0x7f2870007b80).stop 2021-03-25T14:18:02.147 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.128+0000 7f287f075700 1 -- 172.21.15.110:0/1988040676 shutdown_connections 2021-03-25T14:18:02.147 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.128+0000 7f287f075700 1 --2- 172.21.15.110:0/1988040676 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f285c004e80 0x7f285c00b760 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:02.147 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.128+0000 7f287f075700 1 -- 172.21.15.110:0/1988040676 >> 172.21.15.110:0/1988040676 conn(0x7f28780616d0 msgr2=0x7f28780bdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:02.147 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.128+0000 7f287f075700 1 -- 172.21.15.110:0/1988040676 shutdown_connections 2021-03-25T14:18:02.147 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.128+0000 7f287f075700 1 -- 172.21.15.110:0/1988040676 wait complete. 2021-03-25T14:18:02.147 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.129+0000 7f287f075700 1 Processor -- start 2021-03-25T14:18:02.147 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.130+0000 7f287f075700 1 -- start start 2021-03-25T14:18:02.147 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.130+0000 7f287f075700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f285c004e80 0x7f28780a2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:02.147 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.130+0000 7f287f075700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28781441e0 0x7f2878144660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:02.148 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.130+0000 7f287f075700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2878144b50 0x7f287815c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:02.148 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.130+0000 7f287f075700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2878146890 con 0x7f28781441e0 2021-03-25T14:18:02.148 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.130+0000 7f287f075700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2878066fa0 con 0x7f285c004e80 2021-03-25T14:18:02.148 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.130+0000 7f287f075700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2878146a80 con 0x7f2878144b50 2021-03-25T14:18:02.148 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.130+0000 7f2877fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28781441e0 0x7f2878144660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:02.148 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.130+0000 7f2877fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28781441e0 0x7f2878144660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51038/0 (socket says 172.21.15.110:51038) 2021-03-25T14:18:02.148 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.130+0000 7f2877fff700 1 -- 172.21.15.110:0/4278173391 learned_addr learned my addr 172.21.15.110:0/4278173391 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:02.148 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.130+0000 7f287ce11700 1 --2- 172.21.15.110:0/4278173391 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f285c004e80 0x7f28780a2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:02.148 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.130+0000 7f287d612700 1 --2- 172.21.15.110:0/4278173391 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2878144b50 0x7f287815c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:02.148 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.131+0000 7f2877fff700 1 -- 172.21.15.110:0/4278173391 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2878144b50 msgr2=0x7f287815c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:02.148 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.131+0000 7f2877fff700 1 --2- 172.21.15.110:0/4278173391 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2878144b50 0x7f287815c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:02.148 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.131+0000 7f2877fff700 1 -- 172.21.15.110:0/4278173391 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f285c004e80 msgr2=0x7f28780a2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:02.148 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.131+0000 7f2877fff700 1 --2- 172.21.15.110:0/4278173391 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f285c004e80 0x7f28780a2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:02.149 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.131+0000 7f2877fff700 1 -- 172.21.15.110:0/4278173391 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2878146d20 con 0x7f28781441e0 2021-03-25T14:18:02.149 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.131+0000 7f2877fff700 1 --2- 172.21.15.110:0/4278173391 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28781441e0 0x7f2878144660 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f286400e700 tx=0x7f2864009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:02.149 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.131+0000 7f2874ff9700 1 -- 172.21.15.110:0/4278173391 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2864010490 con 0x7f28781441e0 2021-03-25T14:18:02.149 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.131+0000 7f2874ff9700 1 -- 172.21.15.110:0/4278173391 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2864010040 con 0x7f28781441e0 2021-03-25T14:18:02.149 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.131+0000 7f2874ff9700 1 -- 172.21.15.110:0/4278173391 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2864010800 con 0x7f28781441e0 2021-03-25T14:18:02.149 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.131+0000 7f287f075700 1 -- 172.21.15.110:0/4278173391 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2878146fc0 con 0x7f28781441e0 2021-03-25T14:18:02.149 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.131+0000 7f287f075700 1 -- 172.21.15.110:0/4278173391 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28780a3560 con 0x7f28781441e0 2021-03-25T14:18:02.149 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.132+0000 7f287f075700 1 -- 172.21.15.110:0/4278173391 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2878147150 con 0x7f28781441e0 2021-03-25T14:18:02.149 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.132+0000 7f2874ff9700 1 -- 172.21.15.110:0/4278173391 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f2864010b70 con 0x7f28781441e0 2021-03-25T14:18:02.149 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.132+0000 7f2874ff9700 1 --2- 172.21.15.110:0/4278173391 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f285805a0e0 0x7f285805c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:02.150 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.133+0000 7f2874ff9700 1 -- 172.21.15.110:0/4278173391 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 7250+0+0 (secure 0 0 0) 0x7f2864074090 con 0x7f28781441e0 2021-03-25T14:18:02.150 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.133+0000 7f287ce11700 1 --2- 172.21.15.110:0/4278173391 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f285805a0e0 0x7f285805c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:02.150 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.133+0000 7f287ce11700 1 --2- 172.21.15.110:0/4278173391 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f285805a0e0 0x7f285805c5a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f286c006890 tx=0x7f286c006e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:02.150 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.136+0000 7f2874ff9700 1 -- 172.21.15.110:0/4278173391 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f2864047530 con 0x7f28781441e0 2021-03-25T14:18:02.326 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:02.326+0000 7f287f075700 1 -- 172.21.15.110:0/4278173391 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f287805d7b0 con 0x7f28781441e0 2021-03-25T14:18:03.197 INFO:tasks.ceph.mon.a.smithi110.stderr:2021-03-25T14:18:03.196+0000 7f2dd9594700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-03-25T14:18:03.203 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.203+0000 7f2874ff9700 1 -- 172.21.15.110:0/4278173391 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v31) v1 ==== 161+0+0 (secure 0 0 0) 0x7f286404ab50 con 0x7f28781441e0 2021-03-25T14:18:03.205 INFO:tasks.ceph.mds.a.smithi110.stderr: -502> 2021-03-25T14:17:47.419+0000 7f39586a2700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2021-03-25T14:18:03.206 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.205+0000 7f287f075700 1 -- 172.21.15.110:0/4278173391 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f285805a0e0 msgr2=0x7f285805c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:03.207 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.205+0000 7f287f075700 1 --2- 172.21.15.110:0/4278173391 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f285805a0e0 0x7f285805c5a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f286c006890 tx=0x7f286c006e20).stop 2021-03-25T14:18:03.207 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.205+0000 7f287f075700 1 -- 172.21.15.110:0/4278173391 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28781441e0 msgr2=0x7f2878144660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:03.207 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.205+0000 7f287f075700 1 --2- 172.21.15.110:0/4278173391 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28781441e0 0x7f2878144660 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f286400e700 tx=0x7f2864009040).stop 2021-03-25T14:18:03.207 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.205+0000 7f287f075700 1 -- 172.21.15.110:0/4278173391 shutdown_connections 2021-03-25T14:18:03.207 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.205+0000 7f287f075700 1 --2- 172.21.15.110:0/4278173391 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f285805a0e0 0x7f285805c5a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:03.207 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.205+0000 7f287f075700 1 --2- 172.21.15.110:0/4278173391 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f285c004e80 0x7f28780a2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:03.207 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.205+0000 7f287f075700 1 --2- 172.21.15.110:0/4278173391 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2878144b50 0x7f287815c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:03.207 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.205+0000 7f287f075700 1 --2- 172.21.15.110:0/4278173391 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28781441e0 0x7f2878144660 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:03.207 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.205+0000 7f287f075700 1 -- 172.21.15.110:0/4278173391 >> 172.21.15.110:0/4278173391 conn(0x7f28780616d0 msgr2=0x7f287814a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:03.207 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.205+0000 7f287f075700 1 -- 172.21.15.110:0/4278173391 shutdown_connections 2021-03-25T14:18:03.207 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.205+0000 7f287f075700 1 -- 172.21.15.110:0/4278173391 wait complete. 2021-03-25T14:18:03.208 INFO:teuthology.orchestra.run.smithi110.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-03-25T14:18:03.221 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-03-25T14:18:03.226 INFO:tasks.ceph.mds.a.smithi110.stdout:starting mds.a at 2021-03-25T14:18:03.339 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.338+0000 7f4d42bea700 1 Processor -- start 2021-03-25T14:18:03.339 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.338+0000 7f4d42bea700 1 -- start start 2021-03-25T14:18:03.341 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.339+0000 7f4d42bea700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d3c060e00 0x7f4d3c0a2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:03.342 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.339+0000 7f4d42bea700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4d3c068440 0x7f4d3c14da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:03.342 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.339+0000 7f4d42bea700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4d3c149970 0x7f4d3c1434b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:03.342 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.339+0000 7f4d42bea700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d3c0b6c90 con 0x7f4d3c068440 2021-03-25T14:18:03.342 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.339+0000 7f4d42bea700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d3c068ca0 con 0x7f4d3c149970 2021-03-25T14:18:03.342 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.339+0000 7f4d42bea700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c0a2d40 con 0x7f4d3c060e00 2021-03-25T14:18:03.342 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.339+0000 7f4d3bfff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4d3c068440 0x7f4d3c14da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:03.342 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.339+0000 7f4d3bfff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4d3c068440 0x7f4d3c14da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51056/0 (socket says 172.21.15.110:51056) 2021-03-25T14:18:03.342 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.339+0000 7f4d3bfff700 1 -- 172.21.15.110:0/3431574318 learned_addr learned my addr 172.21.15.110:0/3431574318 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:03.342 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.339+0000 7f4d40986700 1 --2- 172.21.15.110:0/3431574318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d3c060e00 0x7f4d3c0a2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:03.342 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.339+0000 7f4d41187700 1 --2- 172.21.15.110:0/3431574318 >> v2:172.21.15.174:3300/0 conn(0x7f4d3c149970 0x7f4d3c1434b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:03.342 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.339+0000 7f4d3bfff700 1 -- 172.21.15.110:0/3431574318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d3c060e00 msgr2=0x7f4d3c0a2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:03.343 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.339+0000 7f4d3bfff700 1 --2- 172.21.15.110:0/3431574318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d3c060e00 0x7f4d3c0a2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:03.343 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.339+0000 7f4d3bfff700 1 -- 172.21.15.110:0/3431574318 >> v2:172.21.15.174:3300/0 conn(0x7f4d3c149970 msgr2=0x7f4d3c1434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:03.343 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.339+0000 7f4d3bfff700 1 --2- 172.21.15.110:0/3431574318 >> v2:172.21.15.174:3300/0 conn(0x7f4d3c149970 0x7f4d3c1434b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:03.343 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.339+0000 7f4d3bfff700 1 -- 172.21.15.110:0/3431574318 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d3c0a2fe0 con 0x7f4d3c068440 2021-03-25T14:18:03.343 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.339+0000 7f4d3bfff700 1 --2- 172.21.15.110:0/3431574318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d3c068440 0x7f4d3c14da00 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f4d3c0688c0 tx=0x7f4d28006ee0).ready entity=mon.0 client_cookie=bb6d6d29ac80d996 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:03.343 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.339+0000 7f4d3b7fe700 1 -- 172.21.15.110:0/3431574318 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d280098d0 con 0x7f4d3c068440 2021-03-25T14:18:03.343 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.340+0000 7f4d3b7fe700 1 -- 172.21.15.110:0/3431574318 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d28009a30 con 0x7f4d3c068440 2021-03-25T14:18:03.343 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.340+0000 7f4d3b7fe700 1 -- 172.21.15.110:0/3431574318 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d28009db0 con 0x7f4d3c068440 2021-03-25T14:18:03.343 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.340+0000 7f4d42bea700 1 -- 172.21.15.110:0/3431574318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d3c068440 msgr2=0x7f4d3c14da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:03.343 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.340+0000 7f4d42bea700 1 --2- 172.21.15.110:0/3431574318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d3c068440 0x7f4d3c14da00 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f4d3c0688c0 tx=0x7f4d28006ee0).stop 2021-03-25T14:18:03.343 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.340+0000 7f4d42bea700 1 -- 172.21.15.110:0/3431574318 shutdown_connections 2021-03-25T14:18:03.343 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.340+0000 7f4d42bea700 1 --2- 172.21.15.110:0/3431574318 >> v2:172.21.15.174:3300/0 conn(0x7f4d3c149970 0x7f4d3c1434b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:03.343 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.340+0000 7f4d42bea700 1 --2- 172.21.15.110:0/3431574318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d3c060e00 0x7f4d3c0a2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:03.344 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.340+0000 7f4d42bea700 1 --2- 172.21.15.110:0/3431574318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d3c068440 0x7f4d3c14da00 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:03.344 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.340+0000 7f4d42bea700 1 -- 172.21.15.110:0/3431574318 >> 172.21.15.110:0/3431574318 conn(0x7f4d3c061d50 msgr2=0x7f4d3c062160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:03.344 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.340+0000 7f4d42bea700 1 -- 172.21.15.110:0/3431574318 shutdown_connections 2021-03-25T14:18:03.344 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.340+0000 7f4d42bea700 1 -- 172.21.15.110:0/3431574318 wait complete. 2021-03-25T14:18:03.344 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.341+0000 7f4d42bea700 1 Processor -- start 2021-03-25T14:18:03.347 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.341+0000 7f4d42bea700 1 -- start start 2021-03-25T14:18:03.347 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.342+0000 7f4d42bea700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d3c060e00 0x7f4d3c1406b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:03.347 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.342+0000 7f4d42bea700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d3c068440 0x7f4d3c147690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:03.347 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.342+0000 7f4d42bea700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d3c149970 0x7f4d3c144160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:03.347 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.342+0000 7f4d42bea700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c140020 con 0x7f4d3c149970 2021-03-25T14:18:03.347 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.342+0000 7f4d42bea700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c140ba0 con 0x7f4d3c068440 2021-03-25T14:18:03.347 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.342+0000 7f4d42bea700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c1485b0 con 0x7f4d3c060e00 2021-03-25T14:18:03.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.342+0000 7f4d41187700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d3c149970 0x7f4d3c144160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:03.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.342+0000 7f4d41187700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d3c149970 0x7f4d3c144160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51062/0 (socket says 172.21.15.110:51062) 2021-03-25T14:18:03.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.342+0000 7f4d41187700 1 -- 172.21.15.110:0/1358365416 learned_addr learned my addr 172.21.15.110:0/1358365416 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:03.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.342+0000 7f4d40986700 1 --2- 172.21.15.110:0/1358365416 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d3c060e00 0x7f4d3c1406b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:03.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.342+0000 7f4d3bfff700 1 --2- 172.21.15.110:0/1358365416 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d3c068440 0x7f4d3c147690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:03.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.342+0000 7f4d41187700 1 -- 172.21.15.110:0/1358365416 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d3c060e00 msgr2=0x7f4d3c1406b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:03.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.342+0000 7f4d41187700 1 --2- 172.21.15.110:0/1358365416 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d3c060e00 0x7f4d3c1406b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:03.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.342+0000 7f4d41187700 1 -- 172.21.15.110:0/1358365416 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d3c068440 msgr2=0x7f4d3c147690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:03.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.342+0000 7f4d41187700 1 --2- 172.21.15.110:0/1358365416 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d3c068440 0x7f4d3c147690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:03.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.342+0000 7f4d41187700 1 -- 172.21.15.110:0/1358365416 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d3c148850 con 0x7f4d3c149970 2021-03-25T14:18:03.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.342+0000 7f4d41187700 1 --2- 172.21.15.110:0/1358365416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d3c149970 0x7f4d3c144160 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f4d3400db90 tx=0x7f4d34008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:03.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.343+0000 7f4d38ff9700 1 -- 172.21.15.110:0/1358365416 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d34017070 con 0x7f4d3c149970 2021-03-25T14:18:03.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.343+0000 7f4d38ff9700 1 -- 172.21.15.110:0/1358365416 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3400b7e0 con 0x7f4d3c149970 2021-03-25T14:18:03.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.343+0000 7f4d42bea700 1 -- 172.21.15.110:0/1358365416 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d3c148af0 con 0x7f4d3c149970 2021-03-25T14:18:03.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.343+0000 7f4d38ff9700 1 -- 172.21.15.110:0/1358365416 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3400bb80 con 0x7f4d3c149970 2021-03-25T14:18:03.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.343+0000 7f4d42bea700 1 -- 172.21.15.110:0/1358365416 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d3c147b80 con 0x7f4d3c149970 2021-03-25T14:18:03.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.343+0000 7f4d42bea700 1 -- 172.21.15.110:0/1358365416 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d3c05d7b0 con 0x7f4d3c149970 2021-03-25T14:18:03.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.344+0000 7f4d38ff9700 1 -- 172.21.15.110:0/1358365416 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f4d34013480 con 0x7f4d3c149970 2021-03-25T14:18:03.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.344+0000 7f4d38ff9700 1 --2- 172.21.15.110:0/1358365416 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4d1c05a0b0 0x7f4d1c05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:03.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.344+0000 7f4d38ff9700 1 -- 172.21.15.110:0/1358365416 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 7336+0+0 (secure 0 0 0) 0x7f4d34074250 con 0x7f4d3c149970 2021-03-25T14:18:03.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.344+0000 7f4d40986700 1 --2- 172.21.15.110:0/1358365416 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4d1c05a0b0 0x7f4d1c05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:03.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.345+0000 7f4d40986700 1 --2- 172.21.15.110:0/1358365416 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4d1c05a0b0 0x7f4d1c05c570 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f4d30006fd0 tx=0x7f4d30008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:03.350 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.348+0000 7f4d38ff9700 1 -- 172.21.15.110:0/1358365416 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f4d340476a0 con 0x7f4d3c149970 2021-03-25T14:18:03.533 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:03.532+0000 7f4d42bea700 1 -- 172.21.15.110:0/1358365416 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4d3c05d0e0 con 0x7f4d3c149970 2021-03-25T14:18:04.205 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.204+0000 7f4d38ff9700 1 -- 172.21.15.110:0/1358365416 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v32) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4d3404acc0 con 0x7f4d3c149970 2021-03-25T14:18:04.208 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.207+0000 7f4d42bea700 1 -- 172.21.15.110:0/1358365416 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4d1c05a0b0 msgr2=0x7f4d1c05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:04.208 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.207+0000 7f4d42bea700 1 --2- 172.21.15.110:0/1358365416 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4d1c05a0b0 0x7f4d1c05c570 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f4d30006fd0 tx=0x7f4d30008040).stop 2021-03-25T14:18:04.208 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.207+0000 7f4d42bea700 1 -- 172.21.15.110:0/1358365416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d3c149970 msgr2=0x7f4d3c144160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:04.208 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.207+0000 7f4d42bea700 1 --2- 172.21.15.110:0/1358365416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d3c149970 0x7f4d3c144160 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f4d3400db90 tx=0x7f4d34008040).stop 2021-03-25T14:18:04.208 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.207+0000 7f4d42bea700 1 -- 172.21.15.110:0/1358365416 shutdown_connections 2021-03-25T14:18:04.208 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.207+0000 7f4d42bea700 1 --2- 172.21.15.110:0/1358365416 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4d1c05a0b0 0x7f4d1c05c570 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:04.208 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.207+0000 7f4d42bea700 1 --2- 172.21.15.110:0/1358365416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d3c149970 0x7f4d3c144160 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:04.208 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.207+0000 7f4d42bea700 1 --2- 172.21.15.110:0/1358365416 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d3c060e00 0x7f4d3c1406b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:04.208 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.207+0000 7f4d42bea700 1 --2- 172.21.15.110:0/1358365416 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d3c068440 0x7f4d3c147690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:04.208 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.207+0000 7f4d42bea700 1 -- 172.21.15.110:0/1358365416 >> 172.21.15.110:0/1358365416 conn(0x7f4d3c061d50 msgr2=0x7f4d3c14b780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:04.209 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.207+0000 7f4d42bea700 1 -- 172.21.15.110:0/1358365416 shutdown_connections 2021-03-25T14:18:04.209 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.207+0000 7f4d42bea700 1 -- 172.21.15.110:0/1358365416 wait complete. 2021-03-25T14:18:04.222 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-03-25T14:18:04.384 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.383+0000 7eff9839b700 1 Processor -- start 2021-03-25T14:18:04.384 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.383+0000 7eff9839b700 1 -- start start 2021-03-25T14:18:04.387 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.384+0000 7eff9839b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7eff900b1da0 0x7eff90149780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:04.387 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.384+0000 7eff9839b700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7eff90149c70 0x7eff90145c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:04.387 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.384+0000 7eff9839b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff900b13d0 con 0x7eff901493a0 2021-03-25T14:18:04.387 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.384+0000 7eff9839b700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff9014a0e0 con 0x7eff90149c70 2021-03-25T14:18:04.387 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.384+0000 7eff9839b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff900b7100 con 0x7eff900b1da0 2021-03-25T14:18:04.387 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.384+0000 7eff96938700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7eff90149c70 0x7eff90145c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:04.387 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.385+0000 7eff96938700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7eff90149c70 0x7eff90145c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51074/0 (socket says 172.21.15.110:51074) 2021-03-25T14:18:04.387 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.385+0000 7eff96938700 1 -- 172.21.15.110:0/2890833085 learned_addr learned my addr 172.21.15.110:0/2890833085 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:04.387 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.385+0000 7eff95936700 1 --2- 172.21.15.110:0/2890833085 >> v2:172.21.15.174:3300/0 conn(0x7eff900b1da0 0x7eff90149780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:04.388 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.385+0000 7eff96938700 1 -- 172.21.15.110:0/2890833085 >> v2:172.21.15.174:3300/0 conn(0x7eff900b1da0 msgr2=0x7eff90149780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:04.388 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.385+0000 7eff96938700 1 --2- 172.21.15.110:0/2890833085 >> v2:172.21.15.174:3300/0 conn(0x7eff900b1da0 0x7eff90149780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:04.388 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.385+0000 7eff96938700 1 -- 172.21.15.110:0/2890833085 >> v1:172.21.15.174:6789/0 conn(0x7eff901493a0 legacy=0x7eff90063090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:04.388 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.385+0000 7eff96938700 1 -- 172.21.15.110:0/2890833085 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff900b73a0 con 0x7eff90149c70 2021-03-25T14:18:04.388 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.385+0000 7eff96938700 1 --2- 172.21.15.110:0/2890833085 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff90149c70 0x7eff90145c90 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7eff900a1cb0 tx=0x7eff880092d0).ready entity=mon.0 client_cookie=16ad5e7d4577e1b1 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:04.388 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.385+0000 7eff95135700 1 -- 172.21.15.110:0/2890833085 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8800bc40 con 0x7eff90149c70 2021-03-25T14:18:04.388 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.385+0000 7eff95135700 1 -- 172.21.15.110:0/2890833085 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8800bda0 con 0x7eff90149c70 2021-03-25T14:18:04.388 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.385+0000 7eff95135700 1 -- 172.21.15.110:0/2890833085 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff88011610 con 0x7eff90149c70 2021-03-25T14:18:04.388 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.385+0000 7eff9839b700 1 -- 172.21.15.110:0/2890833085 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff90149c70 msgr2=0x7eff90145c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:04.388 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.385+0000 7eff9839b700 1 --2- 172.21.15.110:0/2890833085 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff90149c70 0x7eff90145c90 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7eff900a1cb0 tx=0x7eff880092d0).stop 2021-03-25T14:18:04.388 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.386+0000 7eff9839b700 1 -- 172.21.15.110:0/2890833085 shutdown_connections 2021-03-25T14:18:04.388 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.386+0000 7eff9839b700 1 --2- 172.21.15.110:0/2890833085 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff90149c70 0x7eff90145c90 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:04.389 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.386+0000 7eff9839b700 1 --2- 172.21.15.110:0/2890833085 >> v2:172.21.15.174:3300/0 conn(0x7eff900b1da0 0x7eff90149780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:04.389 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.386+0000 7eff9839b700 1 -- 172.21.15.110:0/2890833085 >> 172.21.15.110:0/2890833085 conn(0x7eff90061710 msgr2=0x7eff900bbac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:04.389 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.386+0000 7eff9839b700 1 -- 172.21.15.110:0/2890833085 shutdown_connections 2021-03-25T14:18:04.389 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.386+0000 7eff9839b700 1 -- 172.21.15.110:0/2890833085 wait complete. 2021-03-25T14:18:04.392 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.387+0000 7eff9839b700 1 Processor -- start 2021-03-25T14:18:04.392 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.387+0000 7eff9839b700 1 -- start start 2021-03-25T14:18:04.392 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.387+0000 7eff9839b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff900b1da0 0x7eff900a0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:04.392 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.387+0000 7eff9839b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff901493a0 0x7eff900a14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:04.392 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.387+0000 7eff9839b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff90149c70 0x7eff90147080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:04.392 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.387+0000 7eff9839b700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9013c010 con 0x7eff900b1da0 2021-03-25T14:18:04.392 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.387+0000 7eff9839b700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9013c270 con 0x7eff901493a0 2021-03-25T14:18:04.392 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.387+0000 7eff9839b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff90067090 con 0x7eff90149c70 2021-03-25T14:18:04.392 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.387+0000 7eff96137700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff900b1da0 0x7eff900a0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:04.392 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.387+0000 7eff96137700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff900b1da0 0x7eff900a0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51076/0 (socket says 172.21.15.110:51076) 2021-03-25T14:18:04.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.387+0000 7eff96137700 1 -- 172.21.15.110:0/2870478935 learned_addr learned my addr 172.21.15.110:0/2870478935 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:04.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.387+0000 7eff95936700 1 --2- 172.21.15.110:0/2870478935 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff901493a0 0x7eff900a14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:04.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.388+0000 7eff96938700 1 --2- 172.21.15.110:0/2870478935 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff90149c70 0x7eff90147080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:04.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.388+0000 7eff96137700 1 -- 172.21.15.110:0/2870478935 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff90149c70 msgr2=0x7eff90147080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:04.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.388+0000 7eff96137700 1 --2- 172.21.15.110:0/2870478935 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff90149c70 0x7eff90147080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:04.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.388+0000 7eff96137700 1 -- 172.21.15.110:0/2870478935 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff901493a0 msgr2=0x7eff900a14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:04.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.388+0000 7eff96137700 1 --2- 172.21.15.110:0/2870478935 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff901493a0 0x7eff900a14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:04.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.388+0000 7eff96137700 1 -- 172.21.15.110:0/2870478935 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff90067330 con 0x7eff900b1da0 2021-03-25T14:18:04.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.388+0000 7eff96137700 1 --2- 172.21.15.110:0/2870478935 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff900b1da0 0x7eff900a0fc0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7eff8c00c760 tx=0x7eff8c007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:04.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.388+0000 7eff7e7fc700 1 -- 172.21.15.110:0/2870478935 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c00e4a0 con 0x7eff900b1da0 2021-03-25T14:18:04.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.388+0000 7eff7e7fc700 1 -- 172.21.15.110:0/2870478935 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8c00e620 con 0x7eff900b1da0 2021-03-25T14:18:04.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.388+0000 7eff9839b700 1 -- 172.21.15.110:0/2870478935 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff9009e0b0 con 0x7eff900b1da0 2021-03-25T14:18:04.394 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.388+0000 7eff7e7fc700 1 -- 172.21.15.110:0/2870478935 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c00e9e0 con 0x7eff900b1da0 2021-03-25T14:18:04.394 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.388+0000 7eff9839b700 1 -- 172.21.15.110:0/2870478935 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff90068a80 con 0x7eff900b1da0 2021-03-25T14:18:04.394 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.389+0000 7eff9839b700 1 -- 172.21.15.110:0/2870478935 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff9013c470 con 0x7eff900b1da0 2021-03-25T14:18:04.394 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.389+0000 7eff7e7fc700 1 -- 172.21.15.110:0/2870478935 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7eff8c010030 con 0x7eff900b1da0 2021-03-25T14:18:04.394 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.389+0000 7eff7e7fc700 1 --2- 172.21.15.110:0/2870478935 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7eff7005a0b0 0x7eff7005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:04.394 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.389+0000 7eff7e7fc700 1 -- 172.21.15.110:0/2870478935 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 7336+0+0 (secure 0 0 0) 0x7eff8c073ea0 con 0x7eff900b1da0 2021-03-25T14:18:04.394 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.390+0000 7eff95936700 1 --2- 172.21.15.110:0/2870478935 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7eff7005a0b0 0x7eff7005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:04.394 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.390+0000 7eff95936700 1 --2- 172.21.15.110:0/2870478935 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7eff7005a0b0 0x7eff7005c570 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7eff900a0b30 tx=0x7eff80008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:04.395 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.393+0000 7eff7e7fc700 1 -- 172.21.15.110:0/2870478935 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7eff8c047350 con 0x7eff900b1da0 2021-03-25T14:18:04.542 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:04.541+0000 7eff9839b700 1 -- 172.21.15.110:0/2870478935 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7eff9005d7b0 con 0x7eff900b1da0 2021-03-25T14:18:05.205 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.204+0000 7eff7e7fc700 1 -- 172.21.15.110:0/2870478935 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v62) v1 ==== 181+0+0 (secure 0 0 0) 0x7eff8c002e60 con 0x7eff900b1da0 2021-03-25T14:18:05.208 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.207+0000 7eff9839b700 1 -- 172.21.15.110:0/2870478935 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7eff7005a0b0 msgr2=0x7eff7005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:05.208 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.207+0000 7eff9839b700 1 --2- 172.21.15.110:0/2870478935 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7eff7005a0b0 0x7eff7005c570 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7eff900a0b30 tx=0x7eff80008040).stop 2021-03-25T14:18:05.209 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.207+0000 7eff9839b700 1 -- 172.21.15.110:0/2870478935 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff900b1da0 msgr2=0x7eff900a0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:05.209 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.207+0000 7eff9839b700 1 --2- 172.21.15.110:0/2870478935 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff900b1da0 0x7eff900a0fc0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7eff8c00c760 tx=0x7eff8c007c60).stop 2021-03-25T14:18:05.209 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.207+0000 7eff9839b700 1 -- 172.21.15.110:0/2870478935 shutdown_connections 2021-03-25T14:18:05.209 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.207+0000 7eff9839b700 1 --2- 172.21.15.110:0/2870478935 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7eff7005a0b0 0x7eff7005c570 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:05.209 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.207+0000 7eff9839b700 1 --2- 172.21.15.110:0/2870478935 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff90149c70 0x7eff90147080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:05.209 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.207+0000 7eff9839b700 1 --2- 172.21.15.110:0/2870478935 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff900b1da0 0x7eff900a0fc0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:05.209 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.207+0000 7eff9839b700 1 --2- 172.21.15.110:0/2870478935 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff901493a0 0x7eff900a14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:05.209 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.207+0000 7eff9839b700 1 -- 172.21.15.110:0/2870478935 >> 172.21.15.110:0/2870478935 conn(0x7eff90061710 msgr2=0x7eff900b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:05.209 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.207+0000 7eff9839b700 1 -- 172.21.15.110:0/2870478935 shutdown_connections 2021-03-25T14:18:05.209 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.207+0000 7eff9839b700 1 -- 172.21.15.110:0/2870478935 wait complete. 2021-03-25T14:18:05.210 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs_metadata' removed 2021-03-25T14:18:05.221 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-03-25T14:18:05.337 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.336+0000 7fb1ff59e700 1 Processor -- start 2021-03-25T14:18:05.337 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.336+0000 7fb1ff59e700 1 -- start start 2021-03-25T14:18:05.339 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.337+0000 7fb1ff59e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb2000c0130 0x7fb20014aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:05.339 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.337+0000 7fb1ff59e700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb2000672a0 0x7fb2001431e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:05.339 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.337+0000 7fb1ff59e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2000bb060 con 0x7fb2000bfd50 2021-03-25T14:18:05.339 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.337+0000 7fb1ff59e700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2000bab20 con 0x7fb2000672a0 2021-03-25T14:18:05.340 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.337+0000 7fb1ff59e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2000badc0 con 0x7fb2000c0130 2021-03-25T14:18:05.340 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.337+0000 7fb1fed9d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb2000672a0 0x7fb2001431e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:05.340 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.337+0000 7fb1fed9d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb2000672a0 0x7fb2001431e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51084/0 (socket says 172.21.15.110:51084) 2021-03-25T14:18:05.340 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.337+0000 7fb1fed9d700 1 -- 172.21.15.110:0/3304703402 learned_addr learned my addr 172.21.15.110:0/3304703402 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:05.340 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.337+0000 7fb1fdd9b700 1 --2- 172.21.15.110:0/3304703402 >> v2:172.21.15.174:3300/0 conn(0x7fb2000c0130 0x7fb20014aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:05.340 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.337+0000 7fb1fed9d700 1 -- 172.21.15.110:0/3304703402 >> v2:172.21.15.174:3300/0 conn(0x7fb2000c0130 msgr2=0x7fb20014aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:05.340 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.337+0000 7fb1fed9d700 1 --2- 172.21.15.110:0/3304703402 >> v2:172.21.15.174:3300/0 conn(0x7fb2000c0130 0x7fb20014aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:05.340 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.337+0000 7fb1fed9d700 1 -- 172.21.15.110:0/3304703402 >> v1:172.21.15.174:6789/0 conn(0x7fb2000bfd50 legacy=0x7fb200149e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:05.340 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.337+0000 7fb1fed9d700 1 -- 172.21.15.110:0/3304703402 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2001496d0 con 0x7fb2000672a0 2021-03-25T14:18:05.340 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.337+0000 7fb1fdd9b700 1 --2- 172.21.15.110:0/3304703402 >> v2:172.21.15.174:3300/0 conn(0x7fb2000c0130 0x7fb20014aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:18:05.340 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.338+0000 7fb1fed9d700 1 --2- 172.21.15.110:0/3304703402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2000672a0 0x7fb2001431e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7fb200064320 tx=0x7fb1f80092d0).ready entity=mon.0 client_cookie=97a3e9cb36071e6a server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:05.340 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.338+0000 7fb1fd59a700 1 -- 172.21.15.110:0/3304703402 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f800bc40 con 0x7fb2000672a0 2021-03-25T14:18:05.340 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.338+0000 7fb1fd59a700 1 -- 172.21.15.110:0/3304703402 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f800bda0 con 0x7fb2000672a0 2021-03-25T14:18:05.341 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.338+0000 7fb1fd59a700 1 -- 172.21.15.110:0/3304703402 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f8011610 con 0x7fb2000672a0 2021-03-25T14:18:05.341 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.338+0000 7fb1ff59e700 1 -- 172.21.15.110:0/3304703402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2000672a0 msgr2=0x7fb2001431e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:05.341 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.338+0000 7fb1ff59e700 1 --2- 172.21.15.110:0/3304703402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2000672a0 0x7fb2001431e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7fb200064320 tx=0x7fb1f80092d0).stop 2021-03-25T14:18:05.341 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.338+0000 7fb1ff59e700 1 -- 172.21.15.110:0/3304703402 shutdown_connections 2021-03-25T14:18:05.341 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.338+0000 7fb1ff59e700 1 --2- 172.21.15.110:0/3304703402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2000672a0 0x7fb2001431e0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:05.341 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.338+0000 7fb1ff59e700 1 --2- 172.21.15.110:0/3304703402 >> v2:172.21.15.174:3300/0 conn(0x7fb2000c0130 0x7fb20014aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:05.341 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.338+0000 7fb1ff59e700 1 -- 172.21.15.110:0/3304703402 >> 172.21.15.110:0/3304703402 conn(0x7fb200066370 msgr2=0x7fb200066780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:05.341 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.338+0000 7fb1ff59e700 1 -- 172.21.15.110:0/3304703402 shutdown_connections 2021-03-25T14:18:05.341 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.338+0000 7fb1ff59e700 1 -- 172.21.15.110:0/3304703402 wait complete. 2021-03-25T14:18:05.344 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.339+0000 7fb1ff59e700 1 Processor -- start 2021-03-25T14:18:05.344 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.339+0000 7fb1ff59e700 1 -- start start 2021-03-25T14:18:05.344 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.340+0000 7fb1ff59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2000672a0 0x7fb200148ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:05.345 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.340+0000 7fb1ff59e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2000bfd50 0x7fb2000b8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:05.345 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.340+0000 7fb1ff59e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2000c0130 0x7fb2000b22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:05.345 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.340+0000 7fb1ff59e700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2000b6e90 con 0x7fb2000bfd50 2021-03-25T14:18:05.345 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.340+0000 7fb1ff59e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2000b80e0 con 0x7fb2000c0130 2021-03-25T14:18:05.345 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.340+0000 7fb1ff59e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2000b8ee0 con 0x7fb2000672a0 2021-03-25T14:18:05.345 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.340+0000 7fb1fdd9b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2000bfd50 0x7fb2000b8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:05.345 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.340+0000 7fb1fdd9b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2000bfd50 0x7fb2000b8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51090/0 (socket says 172.21.15.110:51090) 2021-03-25T14:18:05.345 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.340+0000 7fb1fdd9b700 1 -- 172.21.15.110:0/678651591 learned_addr learned my addr 172.21.15.110:0/678651591 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:05.345 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.340+0000 7fb1fed9d700 1 --2- 172.21.15.110:0/678651591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2000c0130 0x7fb2000b22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:05.345 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.340+0000 7fb1fe59c700 1 --2- 172.21.15.110:0/678651591 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2000672a0 0x7fb200148ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:05.345 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.340+0000 7fb1fdd9b700 1 -- 172.21.15.110:0/678651591 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2000672a0 msgr2=0x7fb200148ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:05.345 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.340+0000 7fb1fdd9b700 1 --2- 172.21.15.110:0/678651591 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2000672a0 0x7fb200148ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:05.345 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.340+0000 7fb1fdd9b700 1 -- 172.21.15.110:0/678651591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2000c0130 msgr2=0x7fb2000b22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:05.346 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.340+0000 7fb1fdd9b700 1 --2- 172.21.15.110:0/678651591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2000c0130 0x7fb2000b22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:05.346 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.340+0000 7fb1fdd9b700 1 -- 172.21.15.110:0/678651591 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2000b9180 con 0x7fb2000bfd50 2021-03-25T14:18:05.346 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.340+0000 7fb1fed9d700 1 --2- 172.21.15.110:0/678651591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2000c0130 0x7fb2000b22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:18:05.346 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.340+0000 7fb1fe59c700 1 --2- 172.21.15.110:0/678651591 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2000672a0 0x7fb200148ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:18:05.346 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.340+0000 7fb1fdd9b700 1 --2- 172.21.15.110:0/678651591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2000bfd50 0x7fb2000b8660 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7fb1f400c920 tx=0x7fb1f4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:05.346 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.341+0000 7fb1ee7fc700 1 -- 172.21.15.110:0/678651591 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f400cec0 con 0x7fb2000bfd50 2021-03-25T14:18:05.346 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.341+0000 7fb1ee7fc700 1 -- 172.21.15.110:0/678651591 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f4007740 con 0x7fb2000bfd50 2021-03-25T14:18:05.346 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.341+0000 7fb1ff59e700 1 -- 172.21.15.110:0/678651591 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2000b9420 con 0x7fb2000bfd50 2021-03-25T14:18:05.346 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.341+0000 7fb1ee7fc700 1 -- 172.21.15.110:0/678651591 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f4007ac0 con 0x7fb2000bfd50 2021-03-25T14:18:05.346 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.341+0000 7fb1ff59e700 1 -- 172.21.15.110:0/678651591 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2000b8b50 con 0x7fb2000bfd50 2021-03-25T14:18:05.346 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.341+0000 7fb1ff59e700 1 -- 172.21.15.110:0/678651591 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2000b9880 con 0x7fb2000bfd50 2021-03-25T14:18:05.346 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.342+0000 7fb1ee7fc700 1 -- 172.21.15.110:0/678651591 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fb1f401b460 con 0x7fb2000bfd50 2021-03-25T14:18:05.347 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.342+0000 7fb1ee7fc700 1 --2- 172.21.15.110:0/678651591 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb1dc05a0b0 0x7fb1dc05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:05.347 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.342+0000 7fb1ee7fc700 1 -- 172.21.15.110:0/678651591 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6898+0+0 (secure 0 0 0) 0x7fb1f4074250 con 0x7fb2000bfd50 2021-03-25T14:18:05.347 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.342+0000 7fb1fe59c700 1 --2- 172.21.15.110:0/678651591 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb1dc05a0b0 0x7fb1dc05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:05.347 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.343+0000 7fb1fe59c700 1 --2- 172.21.15.110:0/678651591 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb1dc05a0b0 0x7fb1dc05c570 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7fb1f00025f0 tx=0x7fb1f0009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:05.347 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.346+0000 7fb1ee7fc700 1 -- 172.21.15.110:0/678651591 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fb1f4047850 con 0x7fb2000bfd50 2021-03-25T14:18:05.496 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:05.496+0000 7fb1ff59e700 1 -- 172.21.15.110:0/678651591 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb200045ae0 con 0x7fb2000bfd50 2021-03-25T14:18:06.210 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.209+0000 7fb1ee7fc700 1 -- 172.21.15.110:0/678651591 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v63) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb1f404ae70 con 0x7fb2000bfd50 2021-03-25T14:18:06.213 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.212+0000 7fb1ff59e700 1 -- 172.21.15.110:0/678651591 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb1dc05a0b0 msgr2=0x7fb1dc05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:06.214 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.212+0000 7fb1ff59e700 1 --2- 172.21.15.110:0/678651591 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb1dc05a0b0 0x7fb1dc05c570 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7fb1f00025f0 tx=0x7fb1f0009040).stop 2021-03-25T14:18:06.214 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.212+0000 7fb1ff59e700 1 -- 172.21.15.110:0/678651591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2000bfd50 msgr2=0x7fb2000b8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:06.214 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.212+0000 7fb1ff59e700 1 --2- 172.21.15.110:0/678651591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2000bfd50 0x7fb2000b8660 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7fb1f400c920 tx=0x7fb1f4008040).stop 2021-03-25T14:18:06.214 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.212+0000 7fb1ff59e700 1 -- 172.21.15.110:0/678651591 shutdown_connections 2021-03-25T14:18:06.214 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.212+0000 7fb1ff59e700 1 --2- 172.21.15.110:0/678651591 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb1dc05a0b0 0x7fb1dc05c570 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:06.214 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.212+0000 7fb1ff59e700 1 --2- 172.21.15.110:0/678651591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2000c0130 0x7fb2000b22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:06.214 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.212+0000 7fb1ff59e700 1 --2- 172.21.15.110:0/678651591 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2000672a0 0x7fb200148ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:06.214 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.212+0000 7fb1ff59e700 1 --2- 172.21.15.110:0/678651591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2000bfd50 0x7fb2000b8660 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:06.214 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.212+0000 7fb1ff59e700 1 -- 172.21.15.110:0/678651591 >> 172.21.15.110:0/678651591 conn(0x7fb200066370 msgr2=0x7fb2000bf1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:06.214 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.212+0000 7fb1ff59e700 1 -- 172.21.15.110:0/678651591 shutdown_connections 2021-03-25T14:18:06.215 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.212+0000 7fb1ff59e700 1 -- 172.21.15.110:0/678651591 wait complete. 2021-03-25T14:18:06.215 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs_data' removed 2021-03-25T14:18:06.227 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:18:06.341 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.340+0000 7fcd03f76700 1 Processor -- start 2021-03-25T14:18:06.341 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.340+0000 7fcd03f76700 1 -- start start 2021-03-25T14:18:06.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.341+0000 7fcd03f76700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fccfc0b1340 0x7fccfc0b1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:06.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.341+0000 7fcd03f76700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccfc067510 con 0x7fccfc0668a0 2021-03-25T14:18:06.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.341+0000 7fcd03f76700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccfc0677b0 con 0x7fccfc066420 2021-03-25T14:18:06.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.341+0000 7fcd03f76700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc067a50 con 0x7fccfc0b1340 2021-03-25T14:18:06.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.341+0000 7fcd02513700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fccfc0668a0 0x7fccfc14cee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44034/0 (socket says 172.21.15.110:44034) 2021-03-25T14:18:06.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.341+0000 7fcd02513700 1 -- 172.21.15.110:0/3895483500 learned_addr learned my addr 172.21.15.110:0/3895483500 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:18:06.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.341+0000 7fcd00d10700 1 -- 172.21.15.110:0/3895483500 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3860782851 0 0) 0x7fccfc067510 con 0x7fccfc0668a0 2021-03-25T14:18:06.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.341+0000 7fcd00d10700 1 -- 172.21.15.110:0/3895483500 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcce4003270 con 0x7fccfc0668a0 2021-03-25T14:18:06.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.341+0000 7fcd01d12700 1 --2- 172.21.15.110:0/3895483500 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fccfc0b1340 0x7fccfc0b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:06.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.342+0000 7fcd00d10700 1 -- 172.21.15.110:0/3895483500 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1095809259 0 0) 0x7fcce4003270 con 0x7fccfc0668a0 2021-03-25T14:18:06.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.342+0000 7fcd00d10700 1 -- 172.21.15.110:0/3895483500 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fccfc0b1340 msgr2=0x7fccfc0b1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:06.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.342+0000 7fcd00d10700 1 --2- 172.21.15.110:0/3895483500 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fccfc0b1340 0x7fccfc0b1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:06.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.342+0000 7fcd00d10700 1 -- 172.21.15.110:0/3895483500 >> v1:172.21.15.174:6789/0 conn(0x7fccfc066420 legacy=0x7fccfc149cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:06.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.342+0000 7fcd00d10700 1 -- 172.21.15.110:0/3895483500 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccfc067cf0 con 0x7fccfc0668a0 2021-03-25T14:18:06.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.342+0000 7fcd00d10700 1 -- 172.21.15.110:0/3895483500 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7fccf40018a0 con 0x7fccfc0668a0 2021-03-25T14:18:06.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.342+0000 7fcd00d10700 1 -- 172.21.15.110:0/3895483500 >> v1:172.21.15.110:6789/0 conn(0x7fccfc0668a0 legacy=0x7fccfc14cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:06.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.342+0000 7fcd00d10700 1 --2- 172.21.15.110:0/3895483500 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fccfc0b1340 0x7fcce4003790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:06.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.342+0000 7fcd00d10700 1 --2- 172.21.15.110:0/3895483500 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcce4003ca0 0x7fcce4004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:06.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.342+0000 7fcd00d10700 1 --2- 172.21.15.110:0/3895483500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcce4004a00 0x7fcce4004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:06.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.342+0000 7fcd00d10700 1 -- 172.21.15.110:0/3895483500 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc067a50 con 0x7fcce4004a00 2021-03-25T14:18:06.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.342+0000 7fcd00d10700 1 -- 172.21.15.110:0/3895483500 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce4004230 con 0x7fcce4003ca0 2021-03-25T14:18:06.350 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.342+0000 7fcd00d10700 1 -- 172.21.15.110:0/3895483500 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce400b760 con 0x7fccfc0b1340 2021-03-25T14:18:06.350 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.342+0000 7fcd02513700 1 --2- 172.21.15.110:0/3895483500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcce4004a00 0x7fcce4004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:06.350 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.342+0000 7fcd01d12700 1 --2- 172.21.15.110:0/3895483500 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fccfc0b1340 0x7fcce4003790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:06.350 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.342+0000 7fcd01511700 1 --2- 172.21.15.110:0/3895483500 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcce4003ca0 0x7fcce4004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:06.350 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.342+0000 7fcd02513700 1 -- 172.21.15.110:0/3895483500 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fccfc0b1340 msgr2=0x7fcce4003790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:06.350 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.342+0000 7fcd02513700 1 --2- 172.21.15.110:0/3895483500 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fccfc0b1340 0x7fcce4003790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:06.350 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.342+0000 7fcd02513700 1 -- 172.21.15.110:0/3895483500 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcce4003ca0 msgr2=0x7fcce4004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:06.350 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.342+0000 7fcd02513700 1 --2- 172.21.15.110:0/3895483500 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcce4003ca0 0x7fcce4004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:06.350 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.342+0000 7fcd02513700 1 -- 172.21.15.110:0/3895483500 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce4003270 con 0x7fcce4004a00 2021-03-25T14:18:06.350 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.342+0000 7fcd02513700 1 --2- 172.21.15.110:0/3895483500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcce4004a00 0x7fcce4004e80 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7fccf400c840 tx=0x7fccfc067940).ready entity=mon.0 client_cookie=68d4c4e02e413c86 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:06.350 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.342+0000 7fcd00d10700 1 -- 172.21.15.110:0/3895483500 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf4005bb0 con 0x7fcce4004a00 2021-03-25T14:18:06.350 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.342+0000 7fcd00d10700 1 -- 172.21.15.110:0/3895483500 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf4005d10 con 0x7fcce4004a00 2021-03-25T14:18:06.350 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.342+0000 7fcd00d10700 1 -- 172.21.15.110:0/3895483500 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf40072e0 con 0x7fcce4004a00 2021-03-25T14:18:06.351 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.343+0000 7fcd03f76700 1 -- 172.21.15.110:0/3895483500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcce4004a00 msgr2=0x7fcce4004e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:06.351 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.343+0000 7fcd03f76700 1 --2- 172.21.15.110:0/3895483500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcce4004a00 0x7fcce4004e80 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7fccf400c840 tx=0x7fccfc067940).stop 2021-03-25T14:18:06.351 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.343+0000 7fcd02513700 1 -- 172.21.15.110:0/3895483500 reap_dead start 2021-03-25T14:18:06.351 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.343+0000 7fcd03f76700 1 -- 172.21.15.110:0/3895483500 shutdown_connections 2021-03-25T14:18:06.351 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.343+0000 7fcd03f76700 1 -- 172.21.15.110:0/3895483500 >> 172.21.15.110:0/3895483500 conn(0x7fccfc0649a0 msgr2=0x7fccfc05c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:06.351 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.343+0000 7fcd03f76700 1 -- 172.21.15.110:0/3895483500 shutdown_connections 2021-03-25T14:18:06.351 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.343+0000 7fcd03f76700 1 -- 172.21.15.110:0/3895483500 wait complete. 2021-03-25T14:18:06.351 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.344+0000 7fcd03f76700 1 Processor -- start 2021-03-25T14:18:06.351 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.344+0000 7fcd03f76700 1 -- start start 2021-03-25T14:18:06.351 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.345+0000 7fcd03f76700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fccfc14b310 0x7fccfc14f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:06.351 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.345+0000 7fcd03f76700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fccfc159670 0x7fccfc14b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:06.351 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.345+0000 7fcd03f76700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fccfc0bece0 0x7fccfc0bf160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:06.351 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.345+0000 7fcd03f76700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc0bf650 con 0x7fccfc0bece0 2021-03-25T14:18:06.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.345+0000 7fcd03f76700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc0bbb80 con 0x7fccfc159670 2021-03-25T14:18:06.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.345+0000 7fcd03f76700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc0bb640 con 0x7fccfc14b310 2021-03-25T14:18:06.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.345+0000 7fcd02513700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fccfc0bece0 0x7fccfc0bf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:06.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.345+0000 7fcd02513700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fccfc0bece0 0x7fccfc0bf160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51114/0 (socket says 172.21.15.110:51114) 2021-03-25T14:18:06.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.345+0000 7fcd02513700 1 -- 172.21.15.110:0/2267038042 learned_addr learned my addr 172.21.15.110:0/2267038042 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:06.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.345+0000 7fcd01511700 1 --2- 172.21.15.110:0/2267038042 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fccfc159670 0x7fccfc14b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:06.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.345+0000 7fcd01d12700 1 --2- 172.21.15.110:0/2267038042 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fccfc14b310 0x7fccfc14f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:06.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.345+0000 7fcd02513700 1 -- 172.21.15.110:0/2267038042 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fccfc14b310 msgr2=0x7fccfc14f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:06.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.345+0000 7fcd02513700 1 --2- 172.21.15.110:0/2267038042 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fccfc14b310 0x7fccfc14f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:06.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.345+0000 7fcd02513700 1 -- 172.21.15.110:0/2267038042 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fccfc159670 msgr2=0x7fccfc14b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:06.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.345+0000 7fcd02513700 1 --2- 172.21.15.110:0/2267038042 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fccfc159670 0x7fccfc14b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:06.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.345+0000 7fcd02513700 1 -- 172.21.15.110:0/2267038042 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccfc0bb8e0 con 0x7fccfc0bece0 2021-03-25T14:18:06.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.345+0000 7fcd01511700 1 --2- 172.21.15.110:0/2267038042 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fccfc159670 0x7fccfc14b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:18:06.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.345+0000 7fcd02513700 1 --2- 172.21.15.110:0/2267038042 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fccfc0bece0 0x7fccfc0bf160 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7fccf400a000 tx=0x7fccf4013000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:06.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.345+0000 7fcce9ffb700 1 -- 172.21.15.110:0/2267038042 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf401a070 con 0x7fccfc0bece0 2021-03-25T14:18:06.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.345+0000 7fcce9ffb700 1 -- 172.21.15.110:0/2267038042 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf40152e0 con 0x7fccfc0bece0 2021-03-25T14:18:06.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.345+0000 7fcd03f76700 1 -- 172.21.15.110:0/2267038042 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccfc1468c0 con 0x7fccfc0bece0 2021-03-25T14:18:06.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.345+0000 7fcce9ffb700 1 -- 172.21.15.110:0/2267038042 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf4005bb0 con 0x7fccfc0bece0 2021-03-25T14:18:06.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.346+0000 7fcd03f76700 1 -- 172.21.15.110:0/2267038042 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccfc146d60 con 0x7fccfc0bece0 2021-03-25T14:18:06.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.347+0000 7fcd03f76700 1 -- 172.21.15.110:0/2267038042 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccfc159bc0 con 0x7fccfc0bece0 2021-03-25T14:18:06.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.347+0000 7fcce9ffb700 1 -- 172.21.15.110:0/2267038042 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fccf4010070 con 0x7fccfc0bece0 2021-03-25T14:18:06.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.347+0000 7fcce9ffb700 1 --2- 172.21.15.110:0/2267038042 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fccdc05a0b0 0x7fccdc05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:06.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.347+0000 7fcce9ffb700 1 -- 172.21.15.110:0/2267038042 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6516+0+0 (secure 0 0 0) 0x7fccf4074310 con 0x7fccfc0bece0 2021-03-25T14:18:06.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.347+0000 7fcd01d12700 1 --2- 172.21.15.110:0/2267038042 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fccdc05a0b0 0x7fccdc05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:06.354 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.348+0000 7fcd01d12700 1 --2- 172.21.15.110:0/2267038042 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fccdc05a0b0 0x7fccdc05c570 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7fccf8006fa0 tx=0x7fccf8008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:06.354 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.351+0000 7fcce9ffb700 1 -- 172.21.15.110:0/2267038042 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fccfc159bc0 con 0x7fccfc0bece0 2021-03-25T14:18:06.502 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.501+0000 7fcd03f76700 1 -- 172.21.15.110:0/2267038042 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fccfc159bc0 con 0x7fccfc0bece0 2021-03-25T14:18:06.503 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.502+0000 7fcce9ffb700 1 -- 172.21.15.110:0/2267038042 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+17245 (secure 0 0 0) 0x7fccfc159bc0 con 0x7fccfc0bece0 2021-03-25T14:18:06.503 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:18:06.503 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":63,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:18:06.204376+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":12,"pool_name":"cephfs2_metadata","create_time":"2021-03-25T14:17:50.184585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}}},{"pool":13,"pool_name":"cephfs2_data","create_time":"2021-03-25T14:17:51.481411+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs2"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:6836/426511293":"2021-03-26T14:18:02.326774+0000","172.21.15.110:6834/426511293":"2021-03-26T14:18:02.326774+0000"},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:18:06.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.504+0000 7fcd03f76700 1 -- 172.21.15.110:0/2267038042 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fccdc05a0b0 msgr2=0x7fccdc05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:06.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.504+0000 7fcd03f76700 1 --2- 172.21.15.110:0/2267038042 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fccdc05a0b0 0x7fccdc05c570 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7fccf8006fa0 tx=0x7fccf8008040).stop 2021-03-25T14:18:06.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.504+0000 7fcd03f76700 1 -- 172.21.15.110:0/2267038042 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fccfc0bece0 msgr2=0x7fccfc0bf160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:06.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.504+0000 7fcd03f76700 1 --2- 172.21.15.110:0/2267038042 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fccfc0bece0 0x7fccfc0bf160 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7fccf400a000 tx=0x7fccf4013000).stop 2021-03-25T14:18:06.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.504+0000 7fcd03f76700 1 -- 172.21.15.110:0/2267038042 shutdown_connections 2021-03-25T14:18:06.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.504+0000 7fcd03f76700 1 --2- 172.21.15.110:0/2267038042 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fccdc05a0b0 0x7fccdc05c570 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:06.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.504+0000 7fcd03f76700 1 --2- 172.21.15.110:0/2267038042 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fccfc0bece0 0x7fccfc0bf160 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:06.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.504+0000 7fcd03f76700 1 --2- 172.21.15.110:0/2267038042 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fccfc14b310 0x7fccfc14f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:06.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.504+0000 7fcd03f76700 1 --2- 172.21.15.110:0/2267038042 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fccfc159670 0x7fccfc14b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:06.506 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.504+0000 7fcd03f76700 1 -- 172.21.15.110:0/2267038042 >> 172.21.15.110:0/2267038042 conn(0x7fccfc0649a0 msgr2=0x7fccfc0b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:06.506 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.504+0000 7fcd03f76700 1 -- 172.21.15.110:0/2267038042 shutdown_connections 2021-03-25T14:18:06.506 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.504+0000 7fcd03f76700 1 -- 172.21.15.110:0/2267038042 wait complete. 2021-03-25T14:18:06.516 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-03-25T14:15:59.047299+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-03-25T14:16:00.537926+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 12, 'pool_name': 'cephfs2_metadata', 'create_time': '2021-03-25T14:17:50.184585+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}}, {'pool': 13, 'pool_name': 'cephfs2_data', 'create_time': '2021-03-25T14:17:51.481411+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}}] 2021-03-25T14:18:06.516 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-03-25T14:18:06.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.628+0000 7f884866d700 1 Processor -- start 2021-03-25T14:18:06.678 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.628+0000 7f884866d700 1 -- start start 2021-03-25T14:18:06.683 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.629+0000 7f884866d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f88400ba8f0 0x7f88400655b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:06.683 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.629+0000 7f884866d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8840066d20 0x7f8840146b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:06.683 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.629+0000 7f884866d700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88400671b0 con 0x7f88400b2c60 2021-03-25T14:18:06.683 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.629+0000 7f884866d700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f884009d070 con 0x7f88400ba8f0 2021-03-25T14:18:06.684 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.629+0000 7f884866d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f884009d310 con 0x7f8840066d20 2021-03-25T14:18:06.684 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.629+0000 7f8846409700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f88400ba8f0 0x7f88400655b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:06.684 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.629+0000 7f8845c08700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f88400b2c60 0x7f8840147f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44054/0 (socket says 172.21.15.110:44054) 2021-03-25T14:18:06.684 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.629+0000 7f8845c08700 1 -- 172.21.15.110:0/736671692 learned_addr learned my addr 172.21.15.110:0/736671692 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:18:06.684 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.629+0000 7f8846c0a700 1 --2- 172.21.15.110:0/736671692 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8840066d20 0x7f8840146b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:06.684 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.629+0000 7f8846409700 1 -- 172.21.15.110:0/736671692 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8840066d20 msgr2=0x7f8840146b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:06.684 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.629+0000 7f8846409700 1 --2- 172.21.15.110:0/736671692 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8840066d20 0x7f8840146b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:06.684 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.629+0000 7f8845407700 1 -- 172.21.15.110:0/736671692 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2676563115 0 0) 0x7f88400671b0 con 0x7f88400b2c60 2021-03-25T14:18:06.684 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.629+0000 7f8846409700 1 -- 172.21.15.110:0/736671692 >> v1:172.21.15.110:6789/0 conn(0x7f88400b2c60 legacy=0x7f8840147f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:06.684 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.629+0000 7f8846409700 1 -- 172.21.15.110:0/736671692 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884009d5b0 con 0x7f88400ba8f0 2021-03-25T14:18:06.684 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.629+0000 7f8846409700 1 --2- 172.21.15.110:0/736671692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88400ba8f0 0x7f88400655b0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f883c00b9c0 tx=0x7f883c006e20).ready entity=mon.0 client_cookie=e021eed32708ba08 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:06.684 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.629+0000 7f8845407700 1 -- 172.21.15.110:0/736671692 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c009870 con 0x7f88400ba8f0 2021-03-25T14:18:06.684 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.629+0000 7f8845407700 1 -- 172.21.15.110:0/736671692 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883c0099d0 con 0x7f88400ba8f0 2021-03-25T14:18:06.685 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.629+0000 7f8845407700 1 -- 172.21.15.110:0/736671692 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c009d50 con 0x7f88400ba8f0 2021-03-25T14:18:06.685 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.630+0000 7f884866d700 1 -- 172.21.15.110:0/736671692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88400ba8f0 msgr2=0x7f88400655b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:06.685 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.630+0000 7f884866d700 1 --2- 172.21.15.110:0/736671692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88400ba8f0 0x7f88400655b0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f883c00b9c0 tx=0x7f883c006e20).stop 2021-03-25T14:18:06.685 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.630+0000 7f884866d700 1 -- 172.21.15.110:0/736671692 shutdown_connections 2021-03-25T14:18:06.685 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.630+0000 7f884866d700 1 --2- 172.21.15.110:0/736671692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88400ba8f0 0x7f88400655b0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:06.685 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.630+0000 7f884866d700 1 --2- 172.21.15.110:0/736671692 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8840066d20 0x7f8840146b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:06.685 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.630+0000 7f884866d700 1 -- 172.21.15.110:0/736671692 >> 172.21.15.110:0/736671692 conn(0x7f8840060c40 msgr2=0x7f8840061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:06.685 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.630+0000 7f884866d700 1 -- 172.21.15.110:0/736671692 shutdown_connections 2021-03-25T14:18:06.685 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.630+0000 7f884866d700 1 -- 172.21.15.110:0/736671692 wait complete. 2021-03-25T14:18:06.685 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.631+0000 7f884866d700 1 Processor -- start 2021-03-25T14:18:06.685 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.631+0000 7f884866d700 1 -- start start 2021-03-25T14:18:06.685 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.632+0000 7f884866d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8840066d20 0x7f884014b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:06.686 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.632+0000 7f884866d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f88400b2c60 0x7f8840144730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:06.686 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.632+0000 7f884866d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88400ba8f0 0x7f8840141950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:06.686 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.632+0000 7f884866d700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88400a1c30 con 0x7f8840066d20 2021-03-25T14:18:06.686 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.632+0000 7f884866d700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884014b7d0 con 0x7f88400ba8f0 2021-03-25T14:18:06.686 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.632+0000 7f884866d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88400a1450 con 0x7f88400b2c60 2021-03-25T14:18:06.686 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.632+0000 7f8846409700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8840066d20 0x7f884014b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:06.686 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.632+0000 7f8846409700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8840066d20 0x7f884014b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51124/0 (socket says 172.21.15.110:51124) 2021-03-25T14:18:06.686 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.632+0000 7f8846409700 1 -- 172.21.15.110:0/4024302190 learned_addr learned my addr 172.21.15.110:0/4024302190 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:06.686 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.632+0000 7f8846409700 1 -- 172.21.15.110:0/4024302190 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f88400b2c60 msgr2=0x7f8840144730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:06.686 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.632+0000 7f8846409700 1 --2- 172.21.15.110:0/4024302190 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f88400b2c60 0x7f8840144730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:18:06.686 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.632+0000 7f8846409700 1 -- 172.21.15.110:0/4024302190 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88400ba8f0 msgr2=0x7f8840141950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:06.686 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.632+0000 7f8846409700 1 --2- 172.21.15.110:0/4024302190 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88400ba8f0 0x7f8840141950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:18:06.687 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.632+0000 7f8846409700 1 -- 172.21.15.110:0/4024302190 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88400a16f0 con 0x7f8840066d20 2021-03-25T14:18:06.687 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.632+0000 7f8846409700 1 --2- 172.21.15.110:0/4024302190 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8840066d20 0x7f884014b130 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f883c00b170 tx=0x7f883c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:06.687 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.632+0000 7f882e7fc700 1 -- 172.21.15.110:0/4024302190 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c01c420 con 0x7f8840066d20 2021-03-25T14:18:06.687 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.632+0000 7f882e7fc700 1 -- 172.21.15.110:0/4024302190 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883c01c580 con 0x7f8840066d20 2021-03-25T14:18:06.687 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.632+0000 7f884866d700 1 -- 172.21.15.110:0/4024302190 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88400a1990 con 0x7f8840066d20 2021-03-25T14:18:06.687 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.632+0000 7f882e7fc700 1 -- 172.21.15.110:0/4024302190 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c01c920 con 0x7f8840066d20 2021-03-25T14:18:06.687 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.632+0000 7f884866d700 1 -- 172.21.15.110:0/4024302190 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8840144c20 con 0x7f8840066d20 2021-03-25T14:18:06.687 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.633+0000 7f884866d700 1 -- 172.21.15.110:0/4024302190 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f884005d7b0 con 0x7f8840066d20 2021-03-25T14:18:06.687 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.633+0000 7f882e7fc700 1 -- 172.21.15.110:0/4024302190 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f883c00f070 con 0x7f8840066d20 2021-03-25T14:18:06.687 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.634+0000 7f882e7fc700 1 --2- 172.21.15.110:0/4024302190 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f882005a0b0 0x7f882005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:06.687 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.634+0000 7f882e7fc700 1 -- 172.21.15.110:0/4024302190 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f883c0756c0 con 0x7f8840066d20 2021-03-25T14:18:06.687 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.634+0000 7f8845c08700 1 --2- 172.21.15.110:0/4024302190 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f882005a0b0 0x7f882005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:06.688 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.634+0000 7f8845c08700 1 --2- 172.21.15.110:0/4024302190 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f882005a0b0 0x7f882005c570 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f88300011e0 tx=0x7f88300076d0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:06.688 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.638+0000 7f882e7fc700 1 -- 172.21.15.110:0/4024302190 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f883c048f50 con 0x7f8840066d20 2021-03-25T14:18:06.794 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.793+0000 7f884866d700 1 -- 172.21.15.110:0/4024302190 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f88400b8330 con 0x7f8840066d20 2021-03-25T14:18:06.794 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.793+0000 7f882e7fc700 1 -- 172.21.15.110:0/4024302190 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v63) v1 ==== 110+0+10 (secure 0 0 0) 0x7f883c04c570 con 0x7f8840066d20 2021-03-25T14:18:06.795 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 1 2021-03-25T14:18:06.796 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.795+0000 7f884866d700 1 -- 172.21.15.110:0/4024302190 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f882005a0b0 msgr2=0x7f882005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:06.796 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.795+0000 7f884866d700 1 --2- 172.21.15.110:0/4024302190 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f882005a0b0 0x7f882005c570 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f88300011e0 tx=0x7f88300076d0).stop 2021-03-25T14:18:06.797 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.795+0000 7f884866d700 1 -- 172.21.15.110:0/4024302190 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8840066d20 msgr2=0x7f884014b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:06.797 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.795+0000 7f884866d700 1 --2- 172.21.15.110:0/4024302190 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8840066d20 0x7f884014b130 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f883c00b170 tx=0x7f883c016000).stop 2021-03-25T14:18:06.797 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.795+0000 7f884866d700 1 -- 172.21.15.110:0/4024302190 shutdown_connections 2021-03-25T14:18:06.797 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.795+0000 7f884866d700 1 --2- 172.21.15.110:0/4024302190 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f882005a0b0 0x7f882005c570 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:06.797 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.795+0000 7f884866d700 1 --2- 172.21.15.110:0/4024302190 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88400ba8f0 0x7f8840141950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:18:06.797 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.795+0000 7f884866d700 1 --2- 172.21.15.110:0/4024302190 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8840066d20 0x7f884014b130 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:06.797 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.795+0000 7f884866d700 1 --2- 172.21.15.110:0/4024302190 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f88400b2c60 0x7f8840144730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:18:06.797 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.795+0000 7f884866d700 1 -- 172.21.15.110:0/4024302190 >> 172.21.15.110:0/4024302190 conn(0x7f8840060c40 msgr2=0x7f88400a0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:06.797 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.795+0000 7f884866d700 1 -- 172.21.15.110:0/4024302190 shutdown_connections 2021-03-25T14:18:06.797 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.795+0000 7f884866d700 1 -- 172.21.15.110:0/4024302190 wait complete. 2021-03-25T14:18:06.808 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-03-25T14:18:06.920 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.920+0000 7efd24ba8700 1 Processor -- start 2021-03-25T14:18:06.945 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.920+0000 7efd24ba8700 1 -- start start 2021-03-25T14:18:06.950 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.920+0000 7efd24ba8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efd200be3a0 0x7efd200b4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:06.950 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.920+0000 7efd24ba8700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efd200b47a0 0x7efd20148c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:06.950 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.921+0000 7efd24ba8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd200b4c20 con 0x7efd20149120 2021-03-25T14:18:06.950 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.921+0000 7efd24ba8700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd20149960 con 0x7efd200b47a0 2021-03-25T14:18:06.950 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.921+0000 7efd24ba8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd20149c00 con 0x7efd200be3a0 2021-03-25T14:18:06.951 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.921+0000 7efd1dd9b700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efd200b47a0 0x7efd20148c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:06.951 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.921+0000 7efd1dd9b700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efd200b47a0 0x7efd20148c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51132/0 (socket says 172.21.15.110:51132) 2021-03-25T14:18:06.951 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.921+0000 7efd1dd9b700 1 -- 172.21.15.110:0/422624190 learned_addr learned my addr 172.21.15.110:0/422624190 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:06.951 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.921+0000 7efd1e59c700 1 --2- 172.21.15.110:0/422624190 >> v2:172.21.15.174:3300/0 conn(0x7efd200be3a0 0x7efd200b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:06.951 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.921+0000 7efd1dd9b700 1 -- 172.21.15.110:0/422624190 >> v2:172.21.15.174:3300/0 conn(0x7efd200be3a0 msgr2=0x7efd200b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:06.951 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.921+0000 7efd1dd9b700 1 --2- 172.21.15.110:0/422624190 >> v2:172.21.15.174:3300/0 conn(0x7efd200be3a0 0x7efd200b4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:06.951 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.921+0000 7efd1dd9b700 1 -- 172.21.15.110:0/422624190 >> v1:172.21.15.174:6789/0 conn(0x7efd20149120 legacy=0x7efd200b8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:06.951 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.921+0000 7efd1dd9b700 1 -- 172.21.15.110:0/422624190 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd20149ea0 con 0x7efd200b47a0 2021-03-25T14:18:06.951 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.921+0000 7efd1dd9b700 1 --2- 172.21.15.110:0/422624190 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd200b47a0 0x7efd20148c30 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7efd20068250 tx=0x7efd10006ee0).ready entity=mon.0 client_cookie=ae7ab6bd3afe49cb server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:06.951 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.921+0000 7efd1d59a700 1 -- 172.21.15.110:0/422624190 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd10009800 con 0x7efd200b47a0 2021-03-25T14:18:06.951 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.921+0000 7efd1d59a700 1 -- 172.21.15.110:0/422624190 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd10009960 con 0x7efd200b47a0 2021-03-25T14:18:06.951 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.921+0000 7efd1d59a700 1 -- 172.21.15.110:0/422624190 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd10009ce0 con 0x7efd200b47a0 2021-03-25T14:18:06.951 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.922+0000 7efd24ba8700 1 -- 172.21.15.110:0/422624190 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd200b47a0 msgr2=0x7efd20148c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:06.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.922+0000 7efd24ba8700 1 --2- 172.21.15.110:0/422624190 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd200b47a0 0x7efd20148c30 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7efd20068250 tx=0x7efd10006ee0).stop 2021-03-25T14:18:06.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.922+0000 7efd24ba8700 1 -- 172.21.15.110:0/422624190 shutdown_connections 2021-03-25T14:18:06.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.922+0000 7efd24ba8700 1 --2- 172.21.15.110:0/422624190 >> v2:172.21.15.174:3300/0 conn(0x7efd200be3a0 0x7efd200b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:06.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.922+0000 7efd24ba8700 1 --2- 172.21.15.110:0/422624190 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd200b47a0 0x7efd20148c30 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:06.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.922+0000 7efd24ba8700 1 -- 172.21.15.110:0/422624190 >> 172.21.15.110:0/422624190 conn(0x7efd200686f0 msgr2=0x7efd20068b00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:06.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.922+0000 7efd24ba8700 1 -- 172.21.15.110:0/422624190 shutdown_connections 2021-03-25T14:18:06.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.922+0000 7efd24ba8700 1 -- 172.21.15.110:0/422624190 wait complete. 2021-03-25T14:18:06.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.923+0000 7efd24ba8700 1 Processor -- start 2021-03-25T14:18:06.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.923+0000 7efd24ba8700 1 -- start start 2021-03-25T14:18:06.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.923+0000 7efd24ba8700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd200b47a0 0x7efd20147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:06.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.923+0000 7efd24ba8700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd200be3a0 0x7efd20144fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:06.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.923+0000 7efd24ba8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efd20149120 0x7efd201454b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:06.953 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.924+0000 7efd24ba8700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd200b7b80 con 0x7efd200b47a0 2021-03-25T14:18:06.953 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.924+0000 7efd24ba8700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd200a1050 con 0x7efd200be3a0 2021-03-25T14:18:06.953 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.924+0000 7efd24ba8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd200a12f0 con 0x7efd20149120 2021-03-25T14:18:06.953 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.924+0000 7efd1e59c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd200b47a0 0x7efd20147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:06.953 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.924+0000 7efd1e59c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd200b47a0 0x7efd20147ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51140/0 (socket says 172.21.15.110:51140) 2021-03-25T14:18:06.953 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.924+0000 7efd1e59c700 1 -- 172.21.15.110:0/224028163 learned_addr learned my addr 172.21.15.110:0/224028163 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:06.953 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.924+0000 7efd1dd9b700 1 --2- 172.21.15.110:0/224028163 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd200be3a0 0x7efd20144fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:06.953 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.924+0000 7efd1ed9d700 1 --2- 172.21.15.110:0/224028163 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efd20149120 0x7efd201454b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:06.953 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.924+0000 7efd1e59c700 1 -- 172.21.15.110:0/224028163 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efd20149120 msgr2=0x7efd201454b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:06.953 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.924+0000 7efd1e59c700 1 --2- 172.21.15.110:0/224028163 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efd20149120 0x7efd201454b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:06.953 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.924+0000 7efd1e59c700 1 -- 172.21.15.110:0/224028163 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd200be3a0 msgr2=0x7efd20144fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:06.953 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.924+0000 7efd1e59c700 1 --2- 172.21.15.110:0/224028163 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd200be3a0 0x7efd20144fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:06.954 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.924+0000 7efd1e59c700 1 -- 172.21.15.110:0/224028163 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd200a1590 con 0x7efd200b47a0 2021-03-25T14:18:06.954 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.924+0000 7efd1e59c700 1 --2- 172.21.15.110:0/224028163 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd200b47a0 0x7efd20147ff0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7efd1400c920 tx=0x7efd14008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:06.954 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.924+0000 7efd0e7fc700 1 -- 172.21.15.110:0/224028163 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1400cec0 con 0x7efd200b47a0 2021-03-25T14:18:06.954 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.924+0000 7efd0e7fc700 1 -- 172.21.15.110:0/224028163 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd140077d0 con 0x7efd200b47a0 2021-03-25T14:18:06.954 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.924+0000 7efd24ba8700 1 -- 172.21.15.110:0/224028163 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd200a1830 con 0x7efd200b47a0 2021-03-25T14:18:06.954 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.924+0000 7efd0e7fc700 1 -- 172.21.15.110:0/224028163 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd14007b50 con 0x7efd200b47a0 2021-03-25T14:18:06.954 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.924+0000 7efd24ba8700 1 -- 172.21.15.110:0/224028163 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd201459a0 con 0x7efd200b47a0 2021-03-25T14:18:06.954 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.925+0000 7efd24ba8700 1 -- 172.21.15.110:0/224028163 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd200650a0 con 0x7efd200b47a0 2021-03-25T14:18:06.954 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.925+0000 7efd0e7fc700 1 -- 172.21.15.110:0/224028163 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7efd1401b460 con 0x7efd200b47a0 2021-03-25T14:18:06.954 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.926+0000 7efd0e7fc700 1 --2- 172.21.15.110:0/224028163 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7efcfc05a0b0 0x7efcfc05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:06.954 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.926+0000 7efd0e7fc700 1 -- 172.21.15.110:0/224028163 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6516+0+0 (secure 0 0 0) 0x7efd14074170 con 0x7efd200b47a0 2021-03-25T14:18:06.954 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.926+0000 7efd1dd9b700 1 --2- 172.21.15.110:0/224028163 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7efcfc05a0b0 0x7efcfc05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:06.955 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.926+0000 7efd1dd9b700 1 --2- 172.21.15.110:0/224028163 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7efcfc05a0b0 0x7efcfc05c570 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7efd10006f20 tx=0x7efd10016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:06.955 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:06.930+0000 7efd0e7fc700 1 -- 172.21.15.110:0/224028163 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7efd140478f0 con 0x7efd200b47a0 2021-03-25T14:18:07.079 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.078+0000 7efd24ba8700 1 -- 172.21.15.110:0/224028163 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7efd2005d7b0 con 0x7efd200b47a0 2021-03-25T14:18:07.079 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.078+0000 7efd0e7fc700 1 -- 172.21.15.110:0/224028163 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v63) v1 ==== 92+0+10 (secure 0 0 0) 0x7efd1404af10 con 0x7efd200b47a0 2021-03-25T14:18:07.079 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:18:07.081 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.079+0000 7efd24ba8700 1 -- 172.21.15.110:0/224028163 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7efcfc05a0b0 msgr2=0x7efcfc05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:07.081 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.079+0000 7efd24ba8700 1 --2- 172.21.15.110:0/224028163 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7efcfc05a0b0 0x7efcfc05c570 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7efd10006f20 tx=0x7efd10016000).stop 2021-03-25T14:18:07.081 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.079+0000 7efd24ba8700 1 -- 172.21.15.110:0/224028163 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd200b47a0 msgr2=0x7efd20147ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:07.081 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.079+0000 7efd24ba8700 1 --2- 172.21.15.110:0/224028163 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd200b47a0 0x7efd20147ff0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7efd1400c920 tx=0x7efd14008040).stop 2021-03-25T14:18:07.081 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.079+0000 7efd24ba8700 1 -- 172.21.15.110:0/224028163 shutdown_connections 2021-03-25T14:18:07.081 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.079+0000 7efd24ba8700 1 --2- 172.21.15.110:0/224028163 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7efcfc05a0b0 0x7efcfc05c570 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:07.081 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.079+0000 7efd24ba8700 1 --2- 172.21.15.110:0/224028163 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efd20149120 0x7efd201454b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:07.081 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.079+0000 7efd24ba8700 1 --2- 172.21.15.110:0/224028163 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd200b47a0 0x7efd20147ff0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:07.081 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.079+0000 7efd24ba8700 1 --2- 172.21.15.110:0/224028163 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd200be3a0 0x7efd20144fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:07.081 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.079+0000 7efd24ba8700 1 -- 172.21.15.110:0/224028163 >> 172.21.15.110:0/224028163 conn(0x7efd200686f0 msgr2=0x7efd20066920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:07.081 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.079+0000 7efd24ba8700 1 -- 172.21.15.110:0/224028163 shutdown_connections 2021-03-25T14:18:07.082 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.080+0000 7efd24ba8700 1 -- 172.21.15.110:0/224028163 wait complete. 2021-03-25T14:18:07.092 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2021-03-25T14:18:07.205 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.203+0000 7f7115ca9700 1 Processor -- start 2021-03-25T14:18:07.205 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.203+0000 7f7115ca9700 1 -- start start 2021-03-25T14:18:07.205 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.204+0000 7f7115ca9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7110060e00 0x7f71100a2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:07.205 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.204+0000 7f7115ca9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f711014da00 0x7f71101434b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:07.205 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.204+0000 7f7115ca9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71100b6c90 con 0x7f7110068440 2021-03-25T14:18:07.205 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.204+0000 7f7115ca9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f711014deb0 con 0x7f7110060e00 2021-03-25T14:18:07.205 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.204+0000 7f7115ca9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711014a080 con 0x7f711014da00 2021-03-25T14:18:07.208 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.204+0000 7f710ffff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f711014da00 0x7f71101434b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:07.208 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.204+0000 7f710f7fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7110060e00 0x7f71100a2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:07.208 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.204+0000 7f710effd700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f7110068440 0x7f7110149970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.110:51750/0 (socket says 172.21.15.110:51750) 2021-03-25T14:18:07.208 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.204+0000 7f710f7fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7110060e00 0x7f71100a2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.110:49796/0 (socket says 172.21.15.110:49796) 2021-03-25T14:18:07.208 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.204+0000 7f710ffff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f711014da00 0x7f71101434b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.110:43550/0 (socket says 172.21.15.110:43550) 2021-03-25T14:18:07.208 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.204+0000 7f710effd700 1 -- 172.21.15.110:0/3557109226 learned_addr learned my addr 172.21.15.110:0/3557109226 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:18:07.208 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.205+0000 7f710f7fe700 1 -- 172.21.15.110:0/3557109226 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f711014da00 msgr2=0x7f71101434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:07.208 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.205+0000 7f710f7fe700 1 --2- 172.21.15.110:0/3557109226 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f711014da00 0x7f71101434b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:07.208 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.205+0000 7f710f7fe700 1 -- 172.21.15.110:0/3557109226 >> v1:172.21.15.174:6789/0 conn(0x7f7110068440 legacy=0x7f7110149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:07.208 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.205+0000 7f710f7fe700 1 -- 172.21.15.110:0/3557109226 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7110068ca0 con 0x7f7110060e00 2021-03-25T14:18:07.208 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.205+0000 7f710ffff700 1 --2- 172.21.15.110:0/3557109226 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f711014da00 0x7f71101434b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:18:07.208 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.205+0000 7f710f7fe700 1 --2- 172.21.15.110:0/3557109226 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7110060e00 0x7f71100a2710 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f710000b9c0 tx=0x7f7100006e20).ready entity=mon.1 client_cookie=d112c95d0c7c32d4 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:07.209 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.205+0000 7f710e7fc700 1 -- 172.21.15.110:0/3557109226 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7100009870 con 0x7f7110060e00 2021-03-25T14:18:07.209 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.205+0000 7f710e7fc700 1 -- 172.21.15.110:0/3557109226 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71000099d0 con 0x7f7110060e00 2021-03-25T14:18:07.209 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.205+0000 7f710e7fc700 1 -- 172.21.15.110:0/3557109226 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7100009d50 con 0x7f7110060e00 2021-03-25T14:18:07.209 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.206+0000 7f7115ca9700 1 -- 172.21.15.110:0/3557109226 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7110060e00 msgr2=0x7f71100a2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:07.209 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.206+0000 7f7115ca9700 1 --2- 172.21.15.110:0/3557109226 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7110060e00 0x7f71100a2710 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f710000b9c0 tx=0x7f7100006e20).stop 2021-03-25T14:18:07.209 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.206+0000 7f7115ca9700 1 -- 172.21.15.110:0/3557109226 shutdown_connections 2021-03-25T14:18:07.209 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.206+0000 7f7115ca9700 1 --2- 172.21.15.110:0/3557109226 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f711014da00 0x7f71101434b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:07.209 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.206+0000 7f7115ca9700 1 --2- 172.21.15.110:0/3557109226 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7110060e00 0x7f71100a2710 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:07.209 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.206+0000 7f7115ca9700 1 -- 172.21.15.110:0/3557109226 >> 172.21.15.110:0/3557109226 conn(0x7f7110061d50 msgr2=0x7f7110062160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:07.209 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.206+0000 7f7115ca9700 1 -- 172.21.15.110:0/3557109226 shutdown_connections 2021-03-25T14:18:07.209 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.206+0000 7f7115ca9700 1 -- 172.21.15.110:0/3557109226 wait complete. 2021-03-25T14:18:07.209 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.207+0000 7f7115ca9700 1 Processor -- start 2021-03-25T14:18:07.209 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.207+0000 7f7115ca9700 1 -- start start 2021-03-25T14:18:07.212 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.208+0000 7f7115ca9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7110060e00 0x7f711014f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:07.212 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.208+0000 7f7115ca9700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7110068440 0x7f711015c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:07.212 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.208+0000 7f7115ca9700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f711014da00 0x7f711015ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:07.212 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.208+0000 7f7115ca9700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71100bcf60 con 0x7f7110068440 2021-03-25T14:18:07.212 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.208+0000 7f7115ca9700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71100a2570 con 0x7f711014da00 2021-03-25T14:18:07.212 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.208+0000 7f7115ca9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71100a2810 con 0x7f7110060e00 2021-03-25T14:18:07.212 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.208+0000 7f710effd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7110068440 0x7f711015c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:07.212 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.208+0000 7f710effd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7110068440 0x7f711015c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51154/0 (socket says 172.21.15.110:51154) 2021-03-25T14:18:07.212 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.208+0000 7f710effd700 1 -- 172.21.15.110:0/3136561860 learned_addr learned my addr 172.21.15.110:0/3136561860 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:07.212 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.208+0000 7f710f7fe700 1 --2- 172.21.15.110:0/3136561860 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7110060e00 0x7f711014f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:07.212 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.208+0000 7f710ffff700 1 --2- 172.21.15.110:0/3136561860 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f711014da00 0x7f711015ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:07.212 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.208+0000 7f710effd700 1 -- 172.21.15.110:0/3136561860 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7110060e00 msgr2=0x7f711014f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:07.213 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.208+0000 7f710effd700 1 --2- 172.21.15.110:0/3136561860 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7110060e00 0x7f711014f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:07.213 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.208+0000 7f710effd700 1 -- 172.21.15.110:0/3136561860 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f711014da00 msgr2=0x7f711015ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:07.213 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.208+0000 7f710effd700 1 --2- 172.21.15.110:0/3136561860 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f711014da00 0x7f711015ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:07.213 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.208+0000 7f710effd700 1 -- 172.21.15.110:0/3136561860 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7110158e20 con 0x7f7110068440 2021-03-25T14:18:07.213 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.208+0000 7f710effd700 1 --2- 172.21.15.110:0/3136561860 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7110068440 0x7f711015c7c0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f710400c710 tx=0x7f7104007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:07.213 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.208+0000 7f70f77fe700 1 -- 172.21.15.110:0/3136561860 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7104007320 con 0x7f7110068440 2021-03-25T14:18:07.213 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.208+0000 7f70f77fe700 1 -- 172.21.15.110:0/3136561860 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7104007480 con 0x7f7110068440 2021-03-25T14:18:07.213 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.208+0000 7f7115ca9700 1 -- 172.21.15.110:0/3136561860 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f711014f850 con 0x7f7110068440 2021-03-25T14:18:07.213 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.208+0000 7f70f77fe700 1 -- 172.21.15.110:0/3136561860 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7104005830 con 0x7f7110068440 2021-03-25T14:18:07.213 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.208+0000 7f7115ca9700 1 -- 172.21.15.110:0/3136561860 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71100bda20 con 0x7f7110068440 2021-03-25T14:18:07.213 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.210+0000 7f7115ca9700 1 -- 172.21.15.110:0/3136561860 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f711015d360 con 0x7f7110068440 2021-03-25T14:18:07.214 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.212+0000 7f70f77fe700 1 -- 172.21.15.110:0/3136561860 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f7104010030 con 0x7f7110068440 2021-03-25T14:18:07.214 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.212+0000 7f70f77fe700 1 --2- 172.21.15.110:0/3136561860 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f70f005a0b0 0x7f70f005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:07.214 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.212+0000 7f70f77fe700 1 -- 172.21.15.110:0/3136561860 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f7104073b50 con 0x7f7110068440 2021-03-25T14:18:07.214 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.212+0000 7f710f7fe700 1 --2- 172.21.15.110:0/3136561860 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f70f005a0b0 0x7f70f005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:07.214 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.212+0000 7f710f7fe700 1 --2- 172.21.15.110:0/3136561860 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f70f005a0b0 0x7f70f005c570 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f7100007fd0 tx=0x7f7100016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:07.216 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.215+0000 7f70f77fe700 1 -- 172.21.15.110:0/3136561860 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f7104047330 con 0x7f7110068440 2021-03-25T14:18:07.367 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.365+0000 7f7115ca9700 1 -- 172.21.15.110:0/3136561860 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f711015d360 con 0x7f7110068440 2021-03-25T14:18:07.368 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.366+0000 7f70f77fe700 1 -- 172.21.15.110:0/3136561860 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v63) v1 ==== 105+0+10 (secure 0 0 0) 0x7f711015d360 con 0x7f7110068440 2021-03-25T14:18:07.368 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:18:07.370 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.367+0000 7f7115ca9700 1 -- 172.21.15.110:0/3136561860 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f70f005a0b0 msgr2=0x7f70f005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:07.371 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.367+0000 7f7115ca9700 1 --2- 172.21.15.110:0/3136561860 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f70f005a0b0 0x7f70f005c570 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f7100007fd0 tx=0x7f7100016000).stop 2021-03-25T14:18:07.371 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.367+0000 7f7115ca9700 1 -- 172.21.15.110:0/3136561860 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7110068440 msgr2=0x7f711015c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:07.371 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.367+0000 7f7115ca9700 1 --2- 172.21.15.110:0/3136561860 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7110068440 0x7f711015c7c0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f710400c710 tx=0x7f7104007c00).stop 2021-03-25T14:18:07.371 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.367+0000 7f7115ca9700 1 -- 172.21.15.110:0/3136561860 shutdown_connections 2021-03-25T14:18:07.371 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.367+0000 7f7115ca9700 1 --2- 172.21.15.110:0/3136561860 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f70f005a0b0 0x7f70f005c570 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:07.371 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.367+0000 7f7115ca9700 1 --2- 172.21.15.110:0/3136561860 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f711014da00 0x7f711015ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:07.372 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.367+0000 7f7115ca9700 1 --2- 172.21.15.110:0/3136561860 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7110060e00 0x7f711014f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:07.372 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.367+0000 7f7115ca9700 1 --2- 172.21.15.110:0/3136561860 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7110068440 0x7f711015c7c0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:07.372 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.367+0000 7f7115ca9700 1 -- 172.21.15.110:0/3136561860 >> 172.21.15.110:0/3136561860 conn(0x7f7110061d50 msgr2=0x7f71101469f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:07.372 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.368+0000 7f7115ca9700 1 -- 172.21.15.110:0/3136561860 shutdown_connections 2021-03-25T14:18:07.372 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.368+0000 7f7115ca9700 1 -- 172.21.15.110:0/3136561860 wait complete. 2021-03-25T14:18:07.381 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2021-03-25T14:18:07.493 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.493+0000 7f18e8781700 1 Processor -- start 2021-03-25T14:18:07.494 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.493+0000 7f18e8781700 1 -- start start 2021-03-25T14:18:07.497 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.494+0000 7f18e8781700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f18e0060e00 0x7f18e00a2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:07.497 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.494+0000 7f18e8781700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f18e014da00 0x7f18e01434b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:07.497 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.494+0000 7f18e8781700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e00b6c90 con 0x7f18e0068440 2021-03-25T14:18:07.497 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.494+0000 7f18e8781700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e014deb0 con 0x7f18e0060e00 2021-03-25T14:18:07.497 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.494+0000 7f18e8781700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e014a080 con 0x7f18e014da00 2021-03-25T14:18:07.497 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.494+0000 7f18e651d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f18e0060e00 0x7f18e00a2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:07.497 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.494+0000 7f18e5d1c700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f18e0068440 0x7f18e0149970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44096/0 (socket says 172.21.15.110:44096) 2021-03-25T14:18:07.497 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.494+0000 7f18e5d1c700 1 -- 172.21.15.110:0/4195197474 learned_addr learned my addr 172.21.15.110:0/4195197474 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:18:07.497 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.494+0000 7f18e651d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f18e0060e00 0x7f18e00a2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51160/0 (socket says 172.21.15.110:51160) 2021-03-25T14:18:07.498 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.494+0000 7f18e651d700 1 -- 172.21.15.110:0/4195197474 >> v2:172.21.15.174:3300/0 conn(0x7f18e014da00 msgr2=0x7f18e01434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:07.498 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.494+0000 7f18e6d1e700 1 --2- 172.21.15.110:0/4195197474 >> v2:172.21.15.174:3300/0 conn(0x7f18e014da00 0x7f18e01434b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:07.498 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.494+0000 7f18e551b700 1 -- 172.21.15.110:0/4195197474 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3673903580 0 0) 0x7f18d0001110 con 0x7f18e0068440 2021-03-25T14:18:07.498 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.494+0000 7f18e651d700 1 --2- 172.21.15.110:0/4195197474 >> v2:172.21.15.174:3300/0 conn(0x7f18e014da00 0x7f18e01434b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:07.498 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.494+0000 7f18e651d700 1 -- 172.21.15.110:0/4195197474 >> v1:172.21.15.110:6789/0 conn(0x7f18e0068440 legacy=0x7f18e0149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:07.498 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.494+0000 7f18e651d700 1 -- 172.21.15.110:0/4195197474 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e0068ca0 con 0x7f18e0060e00 2021-03-25T14:18:07.498 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.494+0000 7f18e651d700 1 --2- 172.21.15.110:0/4195197474 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18e0060e00 0x7f18e00a2710 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f18e00b8060 tx=0x7f18dc006e20).ready entity=mon.0 client_cookie=ac8d7a72c690bac8 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:07.498 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.494+0000 7f18e551b700 1 -- 172.21.15.110:0/4195197474 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18dc009870 con 0x7f18e0060e00 2021-03-25T14:18:07.498 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.494+0000 7f18e551b700 1 -- 172.21.15.110:0/4195197474 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18dc0099d0 con 0x7f18e0060e00 2021-03-25T14:18:07.499 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.494+0000 7f18e551b700 1 -- 172.21.15.110:0/4195197474 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18dc009d50 con 0x7f18e0060e00 2021-03-25T14:18:07.499 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.495+0000 7f18e8781700 1 -- 172.21.15.110:0/4195197474 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18e0060e00 msgr2=0x7f18e00a2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:07.499 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.495+0000 7f18e8781700 1 --2- 172.21.15.110:0/4195197474 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18e0060e00 0x7f18e00a2710 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f18e00b8060 tx=0x7f18dc006e20).stop 2021-03-25T14:18:07.499 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.495+0000 7f18e8781700 1 -- 172.21.15.110:0/4195197474 shutdown_connections 2021-03-25T14:18:07.499 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.495+0000 7f18e8781700 1 --2- 172.21.15.110:0/4195197474 >> v2:172.21.15.174:3300/0 conn(0x7f18e014da00 0x7f18e01434b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:07.499 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.495+0000 7f18e8781700 1 --2- 172.21.15.110:0/4195197474 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18e0060e00 0x7f18e00a2710 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:07.499 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.495+0000 7f18e8781700 1 -- 172.21.15.110:0/4195197474 >> 172.21.15.110:0/4195197474 conn(0x7f18e0061d50 msgr2=0x7f18e0062160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:07.499 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.495+0000 7f18e8781700 1 -- 172.21.15.110:0/4195197474 shutdown_connections 2021-03-25T14:18:07.499 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.495+0000 7f18e8781700 1 -- 172.21.15.110:0/4195197474 wait complete. 2021-03-25T14:18:07.499 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.496+0000 7f18e8781700 1 Processor -- start 2021-03-25T14:18:07.499 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.496+0000 7f18e8781700 1 -- start start 2021-03-25T14:18:07.503 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.497+0000 7f18e8781700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18e0060e00 0x7f18e0145900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:07.503 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.497+0000 7f18e8781700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18e0068440 0x7f18e00a2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:07.503 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.497+0000 7f18e8781700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18e014da00 0x7f18e015c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:07.503 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.497+0000 7f18e8781700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e009ed40 con 0x7f18e014da00 2021-03-25T14:18:07.503 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.497+0000 7f18e8781700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e009e560 con 0x7f18e0060e00 2021-03-25T14:18:07.503 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.497+0000 7f18e8781700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e009e800 con 0x7f18e0068440 2021-03-25T14:18:07.503 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.497+0000 7f18e6d1e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18e014da00 0x7f18e015c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:07.503 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.497+0000 7f18e6d1e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18e014da00 0x7f18e015c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51170/0 (socket says 172.21.15.110:51170) 2021-03-25T14:18:07.503 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.497+0000 7f18e6d1e700 1 -- 172.21.15.110:0/1603619601 learned_addr learned my addr 172.21.15.110:0/1603619601 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:07.504 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.497+0000 7f18e651d700 1 --2- 172.21.15.110:0/1603619601 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18e0060e00 0x7f18e0145900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:07.504 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.497+0000 7f18e5d1c700 1 --2- 172.21.15.110:0/1603619601 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18e0068440 0x7f18e00a2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:07.504 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.497+0000 7f18e6d1e700 1 -- 172.21.15.110:0/1603619601 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18e0068440 msgr2=0x7f18e00a2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:07.504 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.497+0000 7f18e6d1e700 1 --2- 172.21.15.110:0/1603619601 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18e0068440 0x7f18e00a2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:07.504 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.497+0000 7f18e6d1e700 1 -- 172.21.15.110:0/1603619601 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18e0060e00 msgr2=0x7f18e0145900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:07.504 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.497+0000 7f18e6d1e700 1 --2- 172.21.15.110:0/1603619601 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18e0060e00 0x7f18e0145900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:07.504 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.497+0000 7f18e6d1e700 1 -- 172.21.15.110:0/1603619601 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e009eaa0 con 0x7f18e014da00 2021-03-25T14:18:07.504 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.497+0000 7f18e651d700 1 --2- 172.21.15.110:0/1603619601 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18e0060e00 0x7f18e0145900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:18:07.504 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.497+0000 7f18e6d1e700 1 --2- 172.21.15.110:0/1603619601 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18e014da00 0x7f18e015c9c0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f18d800cb20 tx=0x7f18d8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:07.504 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.497+0000 7f18ce7fc700 1 -- 172.21.15.110:0/1603619601 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d80078b0 con 0x7f18e014da00 2021-03-25T14:18:07.504 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.497+0000 7f18ce7fc700 1 -- 172.21.15.110:0/1603619601 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d8007a10 con 0x7f18e014da00 2021-03-25T14:18:07.504 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.497+0000 7f18e8781700 1 -- 172.21.15.110:0/1603619601 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e015c520 con 0x7f18e014da00 2021-03-25T14:18:07.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.497+0000 7f18ce7fc700 1 -- 172.21.15.110:0/1603619601 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d8007db0 con 0x7f18e014da00 2021-03-25T14:18:07.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.497+0000 7f18e8781700 1 -- 172.21.15.110:0/1603619601 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e00a2820 con 0x7f18e014da00 2021-03-25T14:18:07.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.498+0000 7f18e8781700 1 -- 172.21.15.110:0/1603619601 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e005d7b0 con 0x7f18e014da00 2021-03-25T14:18:07.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.499+0000 7f18ce7fc700 1 -- 172.21.15.110:0/1603619601 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f18d8011620 con 0x7f18e014da00 2021-03-25T14:18:07.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.499+0000 7f18ce7fc700 1 --2- 172.21.15.110:0/1603619601 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f18c005a0e0 0x7f18c005c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:07.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.499+0000 7f18ce7fc700 1 -- 172.21.15.110:0/1603619601 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f18d80743c0 con 0x7f18e014da00 2021-03-25T14:18:07.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.499+0000 7f18e651d700 1 --2- 172.21.15.110:0/1603619601 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f18c005a0e0 0x7f18c005c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:07.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.499+0000 7f18e651d700 1 --2- 172.21.15.110:0/1603619601 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f18c005a0e0 0x7f18c005c5a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f18dc006e60 tx=0x7f18dc016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:07.505 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.503+0000 7f18ce7fc700 1 -- 172.21.15.110:0/1603619601 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f18d8047b40 con 0x7f18e014da00 2021-03-25T14:18:07.652 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.651+0000 7f18e8781700 1 -- 172.21.15.110:0/1603619601 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f18e0064f20 con 0x7f18e014da00 2021-03-25T14:18:07.652 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.651+0000 7f18ce7fc700 1 -- 172.21.15.110:0/1603619601 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v63) v1 ==== 101+0+10 (secure 0 0 0) 0x7f18d804b160 con 0x7f18e014da00 2021-03-25T14:18:07.652 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:18:07.654 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.653+0000 7f18e8781700 1 -- 172.21.15.110:0/1603619601 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f18c005a0e0 msgr2=0x7f18c005c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:07.654 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.653+0000 7f18e8781700 1 --2- 172.21.15.110:0/1603619601 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f18c005a0e0 0x7f18c005c5a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f18dc006e60 tx=0x7f18dc016000).stop 2021-03-25T14:18:07.654 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.653+0000 7f18e8781700 1 -- 172.21.15.110:0/1603619601 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18e014da00 msgr2=0x7f18e015c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:07.654 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.653+0000 7f18e8781700 1 --2- 172.21.15.110:0/1603619601 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18e014da00 0x7f18e015c9c0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f18d800cb20 tx=0x7f18d8008040).stop 2021-03-25T14:18:07.654 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.653+0000 7f18e8781700 1 -- 172.21.15.110:0/1603619601 shutdown_connections 2021-03-25T14:18:07.654 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.653+0000 7f18e8781700 1 --2- 172.21.15.110:0/1603619601 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f18c005a0e0 0x7f18c005c5a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:07.654 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.653+0000 7f18e8781700 1 --2- 172.21.15.110:0/1603619601 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18e0060e00 0x7f18e0145900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:07.654 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.653+0000 7f18e8781700 1 --2- 172.21.15.110:0/1603619601 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18e014da00 0x7f18e015c9c0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:07.655 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.653+0000 7f18e8781700 1 --2- 172.21.15.110:0/1603619601 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18e0068440 0x7f18e00a2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:07.655 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.653+0000 7f18e8781700 1 -- 172.21.15.110:0/1603619601 >> 172.21.15.110:0/1603619601 conn(0x7f18e0061d50 msgr2=0x7f18e0149590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:07.655 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.653+0000 7f18e8781700 1 -- 172.21.15.110:0/1603619601 shutdown_connections 2021-03-25T14:18:07.655 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.653+0000 7f18e8781700 1 -- 172.21.15.110:0/1603619601 wait complete. 2021-03-25T14:18:07.665 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-03-25T14:18:07.774 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.773+0000 7f134b1e8700 1 Processor -- start 2021-03-25T14:18:07.775 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.774+0000 7f134b1e8700 1 -- start start 2021-03-25T14:18:07.778 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.774+0000 7f134b1e8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f134412f8c0 0x7f13440b8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:07.778 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.774+0000 7f134b1e8700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f134412fd20 con 0x7f13440bbca0 2021-03-25T14:18:07.778 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.774+0000 7f134b1e8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1344068f50 con 0x7f13440b8500 2021-03-25T14:18:07.778 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.774+0000 7f134b1e8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13440b8e70 con 0x7f134412f8c0 2021-03-25T14:18:07.778 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.774+0000 7f1348f84700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f13440bbca0 0x7f13440684f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44112/0 (socket says 172.21.15.110:44112) 2021-03-25T14:18:07.778 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.774+0000 7f1348f84700 1 -- 172.21.15.110:0/1281394174 learned_addr learned my addr 172.21.15.110:0/1281394174 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:18:07.778 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.775+0000 7f1349785700 1 --2- 172.21.15.110:0/1281394174 >> v2:172.21.15.174:3300/0 conn(0x7f134412f8c0 0x7f13440b8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:07.778 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.775+0000 7f13437fe700 1 -- 172.21.15.110:0/1281394174 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4185406076 0 0) 0x7f134412fd20 con 0x7f13440bbca0 2021-03-25T14:18:07.778 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.775+0000 7f13437fe700 1 -- 172.21.15.110:0/1281394174 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1328003270 con 0x7f13440bbca0 2021-03-25T14:18:07.778 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.775+0000 7f1349785700 1 -- 172.21.15.110:0/1281394174 >> v1:172.21.15.174:6789/0 conn(0x7f13440b8500 legacy=0x7f134412f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:07.779 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.775+0000 7f13437fe700 1 -- 172.21.15.110:0/1281394174 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 812667417 0 0) 0x7f1328003270 con 0x7f13440bbca0 2021-03-25T14:18:07.779 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.775+0000 7f1349785700 1 -- 172.21.15.110:0/1281394174 >> v1:172.21.15.110:6789/0 conn(0x7f13440bbca0 legacy=0x7f13440684f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:07.779 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.775+0000 7f1349785700 1 -- 172.21.15.110:0/1281394174 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1344149940 con 0x7f134412f8c0 2021-03-25T14:18:07.779 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.775+0000 7f1349785700 1 --2- 172.21.15.110:0/1281394174 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f134412f8c0 0x7f13440b8980 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f133c009c40 tx=0x7f133c009220).ready entity=mon.1 client_cookie=ba40cfd2011754f1 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:07.779 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.775+0000 7f13437fe700 1 -- 172.21.15.110:0/1281394174 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1338001520 con 0x7f134412f8c0 2021-03-25T14:18:07.779 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.775+0000 7f13437fe700 1 -- 172.21.15.110:0/1281394174 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133c00b680 con 0x7f134412f8c0 2021-03-25T14:18:07.779 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.775+0000 7f13437fe700 1 -- 172.21.15.110:0/1281394174 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c00ba00 con 0x7f134412f8c0 2021-03-25T14:18:07.779 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.776+0000 7f134b1e8700 1 -- 172.21.15.110:0/1281394174 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f134412f8c0 msgr2=0x7f13440b8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:07.779 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.776+0000 7f134b1e8700 1 --2- 172.21.15.110:0/1281394174 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f134412f8c0 0x7f13440b8980 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f133c009c40 tx=0x7f133c009220).stop 2021-03-25T14:18:07.779 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.776+0000 7f134b1e8700 1 -- 172.21.15.110:0/1281394174 shutdown_connections 2021-03-25T14:18:07.779 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.776+0000 7f134b1e8700 1 --2- 172.21.15.110:0/1281394174 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f134412f8c0 0x7f13440b8980 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:07.780 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.776+0000 7f134b1e8700 1 -- 172.21.15.110:0/1281394174 >> 172.21.15.110:0/1281394174 conn(0x7f1344063850 msgr2=0x7f134405c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:07.780 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.776+0000 7f134b1e8700 1 -- 172.21.15.110:0/1281394174 shutdown_connections 2021-03-25T14:18:07.780 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.776+0000 7f134b1e8700 1 -- 172.21.15.110:0/1281394174 wait complete. 2021-03-25T14:18:07.780 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.777+0000 7f134b1e8700 1 Processor -- start 2021-03-25T14:18:07.780 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.777+0000 7f134b1e8700 1 -- start start 2021-03-25T14:18:07.782 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.778+0000 7f134b1e8700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13440b8500 0x7f13440b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:07.782 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.778+0000 7f134b1e8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f13440bbca0 0x7f134412c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:07.782 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.778+0000 7f134b1e8700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f134412f8c0 0x7f1344155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:07.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.778+0000 7f134b1e8700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1344145d90 con 0x7f134412f8c0 2021-03-25T14:18:07.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.778+0000 7f134b1e8700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13440b6c90 con 0x7f13440b8500 2021-03-25T14:18:07.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.778+0000 7f134b1e8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f134415a0e0 con 0x7f13440bbca0 2021-03-25T14:18:07.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.778+0000 7f1349785700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f134412f8c0 0x7f1344155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:07.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.778+0000 7f1349785700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f134412f8c0 0x7f1344155dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51184/0 (socket says 172.21.15.110:51184) 2021-03-25T14:18:07.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.778+0000 7f1349785700 1 -- 172.21.15.110:0/842779810 learned_addr learned my addr 172.21.15.110:0/842779810 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:07.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.778+0000 7f1349785700 1 -- 172.21.15.110:0/842779810 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f13440bbca0 msgr2=0x7f134412c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:07.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.778+0000 7f1349785700 1 --2- 172.21.15.110:0/842779810 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f13440bbca0 0x7f134412c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:18:07.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.778+0000 7f1349785700 1 -- 172.21.15.110:0/842779810 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13440b8500 msgr2=0x7f13440b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:07.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.778+0000 7f1349785700 1 --2- 172.21.15.110:0/842779810 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13440b8500 0x7f13440b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:18:07.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.778+0000 7f1349785700 1 -- 172.21.15.110:0/842779810 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f134412fca0 con 0x7f134412f8c0 2021-03-25T14:18:07.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.778+0000 7f1349785700 1 --2- 172.21.15.110:0/842779810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f134412f8c0 0x7f1344155dc0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f133c00b3c0 tx=0x7f13440690e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:07.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.778+0000 7f1340ff9700 1 -- 172.21.15.110:0/842779810 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c01b410 con 0x7f134412f8c0 2021-03-25T14:18:07.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.778+0000 7f1340ff9700 1 -- 172.21.15.110:0/842779810 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133c01b570 con 0x7f134412f8c0 2021-03-25T14:18:07.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.778+0000 7f134b1e8700 1 -- 172.21.15.110:0/842779810 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f134412ff40 con 0x7f134412f8c0 2021-03-25T14:18:07.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.778+0000 7f1340ff9700 1 -- 172.21.15.110:0/842779810 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c01b910 con 0x7f134412f8c0 2021-03-25T14:18:07.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.778+0000 7f134b1e8700 1 -- 172.21.15.110:0/842779810 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1344130480 con 0x7f134412f8c0 2021-03-25T14:18:07.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.779+0000 7f134b1e8700 1 -- 172.21.15.110:0/842779810 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f134405d7b0 con 0x7f134412f8c0 2021-03-25T14:18:07.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.779+0000 7f1340ff9700 1 -- 172.21.15.110:0/842779810 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f133c02a070 con 0x7f134412f8c0 2021-03-25T14:18:07.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.780+0000 7f1340ff9700 1 --2- 172.21.15.110:0/842779810 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f132405a0b0 0x7f132405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:07.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.780+0000 7f1340ff9700 1 -- 172.21.15.110:0/842779810 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f133c0753d0 con 0x7f134412f8c0 2021-03-25T14:18:07.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.780+0000 7f1348f84700 1 --2- 172.21.15.110:0/842779810 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f132405a0b0 0x7f132405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:07.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.780+0000 7f1348f84700 1 --2- 172.21.15.110:0/842779810 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f132405a0b0 0x7f132405c570 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f1338001430 tx=0x7f1338001360).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:07.785 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.783+0000 7f1340ff9700 1 -- 172.21.15.110:0/842779810 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f133c048bb0 con 0x7f134412f8c0 2021-03-25T14:18:07.967 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.967+0000 7f134b1e8700 1 -- 172.21.15.110:0/842779810 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1344066f20 con 0x7f134412f8c0 2021-03-25T14:18:07.968 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.967+0000 7f1340ff9700 1 -- 172.21.15.110:0/842779810 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+2854 (secure 0 0 0) 0x7f133c006d30 con 0x7f134412f8c0 2021-03-25T14:18:07.968 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:18:07.968 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":32,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4997,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/3015251726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3015251726},{"type":"v1","addr":"172.21.15.174:6835","nonce":3015251726}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":24},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/1698368640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1698368640},{"type":"v1","addr":"172.21.15.174:6833","nonce":1698368640}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":24},{"gid":5970,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/3337605488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3337605488},{"type":"v1","addr":"172.21.15.110:6836","nonce":3337605488}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":32}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-03-25T14:17:52.495440+0000","modified":"2021-03-25T14:17:53.496776+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5601},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5601":{"gid":5601,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":5,"addr":"172.21.15.110:6837/2143874763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":2143874763},{"type":"v1","addr":"172.21.15.110:6837","nonce":2143874763}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs2","balancer":"","standby_count_wanted":0},"id":5}]} 2021-03-25T14:18:07.970 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.968+0000 7f134b1e8700 1 -- 172.21.15.110:0/842779810 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f132405a0b0 msgr2=0x7f132405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:07.970 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.968+0000 7f134b1e8700 1 --2- 172.21.15.110:0/842779810 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f132405a0b0 0x7f132405c570 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f1338001430 tx=0x7f1338001360).stop 2021-03-25T14:18:07.970 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.968+0000 7f134b1e8700 1 -- 172.21.15.110:0/842779810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f134412f8c0 msgr2=0x7f1344155dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:07.970 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.968+0000 7f134b1e8700 1 --2- 172.21.15.110:0/842779810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f134412f8c0 0x7f1344155dc0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f133c00b3c0 tx=0x7f13440690e0).stop 2021-03-25T14:18:07.970 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.969+0000 7f134b1e8700 1 -- 172.21.15.110:0/842779810 shutdown_connections 2021-03-25T14:18:07.970 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.969+0000 7f134b1e8700 1 --2- 172.21.15.110:0/842779810 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f132405a0b0 0x7f132405c570 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:07.970 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.969+0000 7f134b1e8700 1 --2- 172.21.15.110:0/842779810 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13440b8500 0x7f13440b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:18:07.970 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.969+0000 7f134b1e8700 1 --2- 172.21.15.110:0/842779810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f134412f8c0 0x7f1344155dc0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:07.970 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.969+0000 7f134b1e8700 1 --2- 172.21.15.110:0/842779810 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f13440bbca0 0x7f134412c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:18:07.970 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.969+0000 7f134b1e8700 1 -- 172.21.15.110:0/842779810 >> 172.21.15.110:0/842779810 conn(0x7f1344063850 msgr2=0x7f134412e740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:07.971 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.969+0000 7f134b1e8700 1 -- 172.21.15.110:0/842779810 shutdown_connections 2021-03-25T14:18:07.971 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:07.969+0000 7f134b1e8700 1 -- 172.21.15.110:0/842779810 wait complete. 2021-03-25T14:18:07.971 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 32 2021-03-25T14:18:07.981 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:18:08.090 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.090+0000 7feb5f59e700 1 Processor -- start 2021-03-25T14:18:08.091 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.090+0000 7feb5f59e700 1 -- start start 2021-03-25T14:18:08.094 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.090+0000 7feb5f59e700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7feb600bba10 0x7feb60148cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:08.094 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.090+0000 7feb5f59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb6014d700 0x7feb601491a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:08.094 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.090+0000 7feb5f59e700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb6014dc40 con 0x7feb600b6470 2021-03-25T14:18:08.094 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.091+0000 7feb5f59e700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb600a2a30 con 0x7feb600bba10 2021-03-25T14:18:08.094 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.091+0000 7feb5f59e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb60149930 con 0x7feb6014d700 2021-03-25T14:18:08.094 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.091+0000 7feb5dd9b700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7feb600bba10 0x7feb60148cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:08.094 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.091+0000 7feb5dd9b700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7feb600bba10 0x7feb60148cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51188/0 (socket says 172.21.15.110:51188) 2021-03-25T14:18:08.094 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.091+0000 7feb5dd9b700 1 -- 172.21.15.110:0/2003903046 learned_addr learned my addr 172.21.15.110:0/2003903046 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:08.094 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.091+0000 7feb5e59c700 1 --1- 172.21.15.110:0/2003903046 >> v1:172.21.15.110:6789/0 conn(0x7feb600b6470 0x7feb600bb300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44124/0 (socket says 172.21.15.110:44124) 2021-03-25T14:18:08.095 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.091+0000 7feb5dd9b700 1 -- 172.21.15.110:0/2003903046 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb6014d700 msgr2=0x7feb601491a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:08.095 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.091+0000 7feb5dd9b700 1 --2- 172.21.15.110:0/2003903046 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb6014d700 0x7feb601491a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-03-25T14:18:08.095 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.091+0000 7feb5dd9b700 1 -- 172.21.15.110:0/2003903046 >> v1:172.21.15.110:6789/0 conn(0x7feb600b6470 legacy=0x7feb600bb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:08.095 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.091+0000 7feb5d59a700 1 -- 172.21.15.110:0/2003903046 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2807423030 0 0) 0x7feb6014dc40 con 0x7feb600b6470 2021-03-25T14:18:08.095 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.091+0000 7feb5dd9b700 1 -- 172.21.15.110:0/2003903046 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb60149bd0 con 0x7feb600bba10 2021-03-25T14:18:08.095 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.091+0000 7feb5dd9b700 1 --2- 172.21.15.110:0/2003903046 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb600bba10 0x7feb60148cb0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7feb5000ba20 tx=0x7feb50006ee0).ready entity=mon.0 client_cookie=241e48d270056cb2 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:08.095 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.091+0000 7feb5d59a700 1 -- 172.21.15.110:0/2003903046 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb500098d0 con 0x7feb600bba10 2021-03-25T14:18:08.095 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.091+0000 7feb5d59a700 1 -- 172.21.15.110:0/2003903046 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb50009a30 con 0x7feb600bba10 2021-03-25T14:18:08.095 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.091+0000 7feb5d59a700 1 -- 172.21.15.110:0/2003903046 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb50009db0 con 0x7feb600bba10 2021-03-25T14:18:08.095 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.092+0000 7feb5f59e700 1 -- 172.21.15.110:0/2003903046 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb600bba10 msgr2=0x7feb60148cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:08.095 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.092+0000 7feb5f59e700 1 --2- 172.21.15.110:0/2003903046 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb600bba10 0x7feb60148cb0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7feb5000ba20 tx=0x7feb50006ee0).stop 2021-03-25T14:18:08.095 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.092+0000 7feb5f59e700 1 -- 172.21.15.110:0/2003903046 shutdown_connections 2021-03-25T14:18:08.096 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.092+0000 7feb5f59e700 1 --2- 172.21.15.110:0/2003903046 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb6014d700 0x7feb601491a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-03-25T14:18:08.096 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.092+0000 7feb5f59e700 1 --2- 172.21.15.110:0/2003903046 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb600bba10 0x7feb60148cb0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:08.096 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.092+0000 7feb5f59e700 1 -- 172.21.15.110:0/2003903046 >> 172.21.15.110:0/2003903046 conn(0x7feb60060c40 msgr2=0x7feb60061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:08.096 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.092+0000 7feb5f59e700 1 -- 172.21.15.110:0/2003903046 shutdown_connections 2021-03-25T14:18:08.096 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.092+0000 7feb5f59e700 1 -- 172.21.15.110:0/2003903046 wait complete. 2021-03-25T14:18:08.096 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.093+0000 7feb5f59e700 1 Processor -- start 2021-03-25T14:18:08.096 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.093+0000 7feb5f59e700 1 -- start start 2021-03-25T14:18:08.099 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.093+0000 7feb5f59e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb600b6470 0x7feb6015c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:08.099 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.093+0000 7feb5f59e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb600bba10 0x7feb6014be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:08.099 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.093+0000 7feb5f59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb6014d700 0x7feb600950a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:08.100 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.093+0000 7feb5f59e700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb600a45e0 con 0x7feb600b6470 2021-03-25T14:18:08.100 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.093+0000 7feb5f59e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb600a4880 con 0x7feb600bba10 2021-03-25T14:18:08.100 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.093+0000 7feb5f59e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb600a4b20 con 0x7feb6014d700 2021-03-25T14:18:08.100 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.094+0000 7feb5e59c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb600b6470 0x7feb6015c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:08.100 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.094+0000 7feb5e59c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb600b6470 0x7feb6015c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51192/0 (socket says 172.21.15.110:51192) 2021-03-25T14:18:08.100 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.094+0000 7feb5e59c700 1 -- 172.21.15.110:0/2500498329 learned_addr learned my addr 172.21.15.110:0/2500498329 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:08.100 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.094+0000 7feb5dd9b700 1 --2- 172.21.15.110:0/2500498329 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb600bba10 0x7feb6014be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:08.100 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.094+0000 7feb5e59c700 1 -- 172.21.15.110:0/2500498329 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb6014d700 msgr2=0x7feb600950a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:08.100 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.094+0000 7feb5ed9d700 1 --2- 172.21.15.110:0/2500498329 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb6014d700 0x7feb600950a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:08.101 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.094+0000 7feb5e59c700 1 --2- 172.21.15.110:0/2500498329 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb6014d700 0x7feb600950a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:08.101 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.094+0000 7feb5e59c700 1 -- 172.21.15.110:0/2500498329 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb600bba10 msgr2=0x7feb6014be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:08.101 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.094+0000 7feb5e59c700 1 --2- 172.21.15.110:0/2500498329 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb600bba10 0x7feb6014be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:08.101 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.094+0000 7feb5e59c700 1 -- 172.21.15.110:0/2500498329 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb600a4dc0 con 0x7feb600b6470 2021-03-25T14:18:08.101 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.094+0000 7feb5dd9b700 1 --2- 172.21.15.110:0/2500498329 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb600bba10 0x7feb6014be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:18:08.101 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.094+0000 7feb5ed9d700 1 --2- 172.21.15.110:0/2500498329 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb6014d700 0x7feb600950a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:18:08.101 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.094+0000 7feb5e59c700 1 --2- 172.21.15.110:0/2500498329 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb600b6470 0x7feb6015c610 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7feb5400c740 tx=0x7feb54007b10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:08.101 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.094+0000 7feb4e7fc700 1 -- 172.21.15.110:0/2500498329 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb54007320 con 0x7feb600b6470 2021-03-25T14:18:08.101 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.094+0000 7feb4e7fc700 1 -- 172.21.15.110:0/2500498329 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb54005560 con 0x7feb600b6470 2021-03-25T14:18:08.101 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.094+0000 7feb5f59e700 1 -- 172.21.15.110:0/2500498329 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb60094b90 con 0x7feb600b6470 2021-03-25T14:18:08.101 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.094+0000 7feb4e7fc700 1 -- 172.21.15.110:0/2500498329 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb540058e0 con 0x7feb600b6470 2021-03-25T14:18:08.101 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.094+0000 7feb5f59e700 1 -- 172.21.15.110:0/2500498329 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb60095590 con 0x7feb600b6470 2021-03-25T14:18:08.101 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.095+0000 7feb5f59e700 1 -- 172.21.15.110:0/2500498329 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb60045ae0 con 0x7feb600b6470 2021-03-25T14:18:08.102 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.095+0000 7feb4e7fc700 1 -- 172.21.15.110:0/2500498329 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7feb54010030 con 0x7feb600b6470 2021-03-25T14:18:08.102 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.096+0000 7feb4e7fc700 1 --2- 172.21.15.110:0/2500498329 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7feb3c05a0b0 0x7feb3c05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:08.102 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.096+0000 7feb4e7fc700 1 -- 172.21.15.110:0/2500498329 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6516+0+0 (secure 0 0 0) 0x7feb54073cc0 con 0x7feb600b6470 2021-03-25T14:18:08.102 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.096+0000 7feb5dd9b700 1 --2- 172.21.15.110:0/2500498329 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7feb3c05a0b0 0x7feb3c05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:08.102 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.096+0000 7feb5dd9b700 1 --2- 172.21.15.110:0/2500498329 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7feb3c05a0b0 0x7feb3c05c570 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7feb600a3490 tx=0x7feb50016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:08.102 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.099+0000 7feb4e7fc700 1 -- 172.21.15.110:0/2500498329 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7feb540474a0 con 0x7feb600b6470 2021-03-25T14:18:08.254 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.254+0000 7feb5f59e700 1 -- 172.21.15.110:0/2500498329 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb600bd3d0 con 0x7feb600b6470 2021-03-25T14:18:08.255 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.254+0000 7feb4e7fc700 1 -- 172.21.15.110:0/2500498329 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+17245 (secure 0 0 0) 0x7feb5404aac0 con 0x7feb600b6470 2021-03-25T14:18:08.256 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:18:08.256 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":63,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:18:06.204376+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":12,"pool_name":"cephfs2_metadata","create_time":"2021-03-25T14:17:50.184585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}}},{"pool":13,"pool_name":"cephfs2_data","create_time":"2021-03-25T14:17:51.481411+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs2"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:6836/426511293":"2021-03-26T14:18:02.326774+0000","172.21.15.110:6834/426511293":"2021-03-26T14:18:02.326774+0000"},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:18:08.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.256+0000 7feb5f59e700 1 -- 172.21.15.110:0/2500498329 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7feb3c05a0b0 msgr2=0x7feb3c05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:08.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.256+0000 7feb5f59e700 1 --2- 172.21.15.110:0/2500498329 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7feb3c05a0b0 0x7feb3c05c570 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7feb600a3490 tx=0x7feb50016000).stop 2021-03-25T14:18:08.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.256+0000 7feb5f59e700 1 -- 172.21.15.110:0/2500498329 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb600b6470 msgr2=0x7feb6015c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:08.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.256+0000 7feb5f59e700 1 --2- 172.21.15.110:0/2500498329 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb600b6470 0x7feb6015c610 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7feb5400c740 tx=0x7feb54007b10).stop 2021-03-25T14:18:08.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.256+0000 7feb5f59e700 1 -- 172.21.15.110:0/2500498329 shutdown_connections 2021-03-25T14:18:08.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.256+0000 7feb5f59e700 1 --2- 172.21.15.110:0/2500498329 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7feb3c05a0b0 0x7feb3c05c570 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:08.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.256+0000 7feb5f59e700 1 --2- 172.21.15.110:0/2500498329 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb6014d700 0x7feb600950a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:08.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.256+0000 7feb5f59e700 1 --2- 172.21.15.110:0/2500498329 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb600b6470 0x7feb6015c610 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:08.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.256+0000 7feb5f59e700 1 --2- 172.21.15.110:0/2500498329 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb600bba10 0x7feb6014be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:08.258 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.256+0000 7feb5f59e700 1 -- 172.21.15.110:0/2500498329 >> 172.21.15.110:0/2500498329 conn(0x7feb60060c40 msgr2=0x7feb60069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:08.259 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.256+0000 7feb5f59e700 1 -- 172.21.15.110:0/2500498329 shutdown_connections 2021-03-25T14:18:08.259 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.256+0000 7feb5f59e700 1 -- 172.21.15.110:0/2500498329 wait complete. 2021-03-25T14:18:08.269 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2021-03-25T14:18:08.269 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-03-25T14:18:08.378 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.377+0000 7f47fc416700 1 Processor -- start 2021-03-25T14:18:08.379 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.377+0000 7f47fc416700 1 -- start start 2021-03-25T14:18:08.384 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.378+0000 7f47fc416700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f47f40bbca0 0x7f47f4067840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:08.384 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.378+0000 7f47fc416700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f47f4144960 0x7f47f4144da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:08.384 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.378+0000 7f47fc416700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47f40afee0 con 0x7f47f4068ac0 2021-03-25T14:18:08.384 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.378+0000 7f47fc416700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47f4145d40 con 0x7f47f40bbca0 2021-03-25T14:18:08.385 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.378+0000 7f47fc416700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47f4145fe0 con 0x7f47f4144960 2021-03-25T14:18:08.385 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.378+0000 7f47fa1b2700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f47f40bbca0 0x7f47f4067840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:08.385 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.379+0000 7f47f99b1700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f47f4068ac0 0x7f47f40acf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44140/0 (socket says 172.21.15.110:44140) 2021-03-25T14:18:08.385 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.379+0000 7f47f99b1700 1 -- 172.21.15.110:0/427579493 learned_addr learned my addr 172.21.15.110:0/427579493 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:18:08.385 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.379+0000 7f47fa9b3700 1 --2- 172.21.15.110:0/427579493 >> v2:172.21.15.174:3300/0 conn(0x7f47f4144960 0x7f47f4144da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:08.385 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.379+0000 7f47fa1b2700 1 -- 172.21.15.110:0/427579493 >> v2:172.21.15.174:3300/0 conn(0x7f47f4144960 msgr2=0x7f47f4144da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:08.385 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.379+0000 7f47fa1b2700 1 --2- 172.21.15.110:0/427579493 >> v2:172.21.15.174:3300/0 conn(0x7f47f4144960 0x7f47f4144da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:08.385 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.379+0000 7f47fa1b2700 1 -- 172.21.15.110:0/427579493 >> v1:172.21.15.110:6789/0 conn(0x7f47f4068ac0 legacy=0x7f47f40acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:08.385 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.379+0000 7f47fa1b2700 1 -- 172.21.15.110:0/427579493 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f4145b10 con 0x7f47f40bbca0 2021-03-25T14:18:08.386 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.379+0000 7f47f91b0700 1 -- 172.21.15.110:0/427579493 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 100804753 0 0) 0x7f47f40afee0 con 0x7f47f4068ac0 2021-03-25T14:18:08.386 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.379+0000 7f47fa9b3700 1 --2- 172.21.15.110:0/427579493 >> v2:172.21.15.174:3300/0 conn(0x7f47f4144960 0x7f47f4144da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:18:08.386 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.379+0000 7f47fa1b2700 1 --2- 172.21.15.110:0/427579493 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47f40bbca0 0x7f47f4067840 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7f47f4068f40 tx=0x7f47f0006eb0).ready entity=mon.0 client_cookie=889065cc5dd76a3d server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:08.386 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.379+0000 7f47f91b0700 1 -- 172.21.15.110:0/427579493 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f000bc50 con 0x7f47f40bbca0 2021-03-25T14:18:08.386 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.379+0000 7f47f91b0700 1 -- 172.21.15.110:0/427579493 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f000bdb0 con 0x7f47f40bbca0 2021-03-25T14:18:08.386 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.379+0000 7f47f91b0700 1 -- 172.21.15.110:0/427579493 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f0010680 con 0x7f47f40bbca0 2021-03-25T14:18:08.386 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.379+0000 7f47fc416700 1 -- 172.21.15.110:0/427579493 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47f40bbca0 msgr2=0x7f47f4067840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:08.386 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.379+0000 7f47fc416700 1 --2- 172.21.15.110:0/427579493 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47f40bbca0 0x7f47f4067840 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7f47f4068f40 tx=0x7f47f0006eb0).stop 2021-03-25T14:18:08.386 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.380+0000 7f47fc416700 1 -- 172.21.15.110:0/427579493 shutdown_connections 2021-03-25T14:18:08.386 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.380+0000 7f47fc416700 1 --2- 172.21.15.110:0/427579493 >> v2:172.21.15.174:3300/0 conn(0x7f47f4144960 0x7f47f4144da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:08.386 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.380+0000 7f47fc416700 1 --2- 172.21.15.110:0/427579493 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47f40bbca0 0x7f47f4067840 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:08.386 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.380+0000 7f47fc416700 1 -- 172.21.15.110:0/427579493 >> 172.21.15.110:0/427579493 conn(0x7f47f4063850 msgr2=0x7f47f405c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:08.387 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.380+0000 7f47fc416700 1 -- 172.21.15.110:0/427579493 shutdown_connections 2021-03-25T14:18:08.387 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.380+0000 7f47fc416700 1 -- 172.21.15.110:0/427579493 wait complete. 2021-03-25T14:18:08.387 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.381+0000 7f47fc416700 1 Processor -- start 2021-03-25T14:18:08.387 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.381+0000 7f47fc416700 1 -- start start 2021-03-25T14:18:08.387 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.381+0000 7f47fc416700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47f4068ac0 0x7f47f4155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:08.387 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.381+0000 7f47fc416700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f47f40bbca0 0x7f47f4143960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:08.387 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.381+0000 7f47fc416700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47f4144960 0x7f47f413c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:08.387 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.381+0000 7f47fc416700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f4143e50 con 0x7f47f4068ac0 2021-03-25T14:18:08.387 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.381+0000 7f47fc416700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f4154740 con 0x7f47f4144960 2021-03-25T14:18:08.387 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.381+0000 7f47fc416700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f4144070 con 0x7f47f40bbca0 2021-03-25T14:18:08.387 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.381+0000 7f47fa1b2700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47f4068ac0 0x7f47f4155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:08.387 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.381+0000 7f47fa1b2700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47f4068ac0 0x7f47f4155370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51206/0 (socket says 172.21.15.110:51206) 2021-03-25T14:18:08.388 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.381+0000 7f47fa1b2700 1 -- 172.21.15.110:0/82940160 learned_addr learned my addr 172.21.15.110:0/82940160 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:08.388 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.382+0000 7f47fa9b3700 1 --2- 172.21.15.110:0/82940160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47f4144960 0x7f47f413c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:08.388 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.382+0000 7f47f99b1700 1 --2- 172.21.15.110:0/82940160 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f47f40bbca0 0x7f47f4143960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:08.388 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.382+0000 7f47fa1b2700 1 -- 172.21.15.110:0/82940160 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f47f40bbca0 msgr2=0x7f47f4143960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:08.388 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.382+0000 7f47fa1b2700 1 --2- 172.21.15.110:0/82940160 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f47f40bbca0 0x7f47f4143960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:08.388 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.382+0000 7f47fa1b2700 1 -- 172.21.15.110:0/82940160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47f4144960 msgr2=0x7f47f413c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:08.388 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.382+0000 7f47fa1b2700 1 --2- 172.21.15.110:0/82940160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47f4144960 0x7f47f413c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:08.388 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.382+0000 7f47fa1b2700 1 -- 172.21.15.110:0/82940160 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f4154990 con 0x7f47f4068ac0 2021-03-25T14:18:08.388 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.382+0000 7f47f99b1700 1 --2- 172.21.15.110:0/82940160 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f47f40bbca0 0x7f47f4143960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:18:08.388 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.382+0000 7f47fa1b2700 1 --2- 172.21.15.110:0/82940160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47f4068ac0 0x7f47f4155370 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7f47f4065e30 tx=0x7f47f40aedd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:08.389 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.382+0000 7f47e27fc700 1 -- 172.21.15.110:0/82940160 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f0020070 con 0x7f47f4068ac0 2021-03-25T14:18:08.389 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.382+0000 7f47e27fc700 1 -- 172.21.15.110:0/82940160 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f001b280 con 0x7f47f4068ac0 2021-03-25T14:18:08.389 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.382+0000 7f47fc416700 1 -- 172.21.15.110:0/82940160 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47f4154c30 con 0x7f47f4068ac0 2021-03-25T14:18:08.389 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.382+0000 7f47e27fc700 1 -- 172.21.15.110:0/82940160 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f001b7c0 con 0x7f47f4068ac0 2021-03-25T14:18:08.389 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.382+0000 7f47fc416700 1 -- 172.21.15.110:0/82940160 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47f413cd50 con 0x7f47f4068ac0 2021-03-25T14:18:08.389 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.383+0000 7f47fc416700 1 -- 172.21.15.110:0/82940160 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47f4155090 con 0x7f47f4068ac0 2021-03-25T14:18:08.389 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.383+0000 7f47e27fc700 1 -- 172.21.15.110:0/82940160 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f47f002c070 con 0x7f47f4068ac0 2021-03-25T14:18:08.389 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.383+0000 7f47e27fc700 1 --2- 172.21.15.110:0/82940160 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f47d405a0e0 0x7f47d405c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:08.389 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.384+0000 7f47e27fc700 1 -- 172.21.15.110:0/82940160 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f47f0077b50 con 0x7f47f4068ac0 2021-03-25T14:18:08.389 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.384+0000 7f47f99b1700 1 --2- 172.21.15.110:0/82940160 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f47d405a0e0 0x7f47d405c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:08.390 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.384+0000 7f47f99b1700 1 --2- 172.21.15.110:0/82940160 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f47d405a0e0 0x7f47d405c5a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f47f413efd0 tx=0x7f47e4009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:08.390 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.387+0000 7f47e27fc700 1 -- 172.21.15.110:0/82940160 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f47f004b350 con 0x7f47f4068ac0 2021-03-25T14:18:08.574 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.573+0000 7f47fc416700 1 -- 172.21.15.110:0/82940160 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f47f405d7b0 con 0x7f47f4068ac0 2021-03-25T14:18:08.574 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.573+0000 7f47e27fc700 1 -- 172.21.15.110:0/82940160 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+2854 (secure 0 0 0) 0x7f47f002a020 con 0x7f47f4068ac0 2021-03-25T14:18:08.575 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:18:08.575 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":32,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4997,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/3015251726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3015251726},{"type":"v1","addr":"172.21.15.174:6835","nonce":3015251726}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":24},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/1698368640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1698368640},{"type":"v1","addr":"172.21.15.174:6833","nonce":1698368640}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":24},{"gid":5970,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/3337605488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3337605488},{"type":"v1","addr":"172.21.15.110:6836","nonce":3337605488}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":32}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-03-25T14:17:52.495440+0000","modified":"2021-03-25T14:17:53.496776+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5601},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5601":{"gid":5601,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":5,"addr":"172.21.15.110:6837/2143874763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":2143874763},{"type":"v1","addr":"172.21.15.110:6837","nonce":2143874763}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs2","balancer":"","standby_count_wanted":0},"id":5}]} 2021-03-25T14:18:08.576 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.575+0000 7f47fc416700 1 -- 172.21.15.110:0/82940160 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f47d405a0e0 msgr2=0x7f47d405c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:08.576 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.575+0000 7f47fc416700 1 --2- 172.21.15.110:0/82940160 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f47d405a0e0 0x7f47d405c5a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f47f413efd0 tx=0x7f47e4009040).stop 2021-03-25T14:18:08.577 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.575+0000 7f47fc416700 1 -- 172.21.15.110:0/82940160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47f4068ac0 msgr2=0x7f47f4155370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:08.577 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.575+0000 7f47fc416700 1 --2- 172.21.15.110:0/82940160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47f4068ac0 0x7f47f4155370 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7f47f4065e30 tx=0x7f47f40aedd0).stop 2021-03-25T14:18:08.577 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.575+0000 7f47fc416700 1 -- 172.21.15.110:0/82940160 shutdown_connections 2021-03-25T14:18:08.577 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.575+0000 7f47fc416700 1 --2- 172.21.15.110:0/82940160 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f47d405a0e0 0x7f47d405c5a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:08.577 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.575+0000 7f47fc416700 1 --2- 172.21.15.110:0/82940160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47f4144960 0x7f47f413c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:08.577 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.575+0000 7f47fc416700 1 --2- 172.21.15.110:0/82940160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47f4068ac0 0x7f47f4155370 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:08.577 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.575+0000 7f47fc416700 1 --2- 172.21.15.110:0/82940160 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f47f40bbca0 0x7f47f4143960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:08.577 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.575+0000 7f47fc416700 1 -- 172.21.15.110:0/82940160 >> 172.21.15.110:0/82940160 conn(0x7f47f4063850 msgr2=0x7f47f40b9750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:08.577 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.575+0000 7f47fc416700 1 -- 172.21.15.110:0/82940160 shutdown_connections 2021-03-25T14:18:08.577 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.575+0000 7f47fc416700 1 -- 172.21.15.110:0/82940160 wait complete. 2021-03-25T14:18:08.577 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 32 2021-03-25T14:18:08.587 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-03-25T14:18:08.697 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.696+0000 7f4abeecd700 1 Processor -- start 2021-03-25T14:18:08.697 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.696+0000 7f4abeecd700 1 -- start start 2021-03-25T14:18:08.704 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.697+0000 7f4abeecd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ab80ba9c0 0x7f4ab80b9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:08.704 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.697+0000 7f4abeecd700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab81482d0 con 0x7f4ab80bada0 2021-03-25T14:18:08.704 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.697+0000 7f4abeecd700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab81417d0 con 0x7f4ab80bb330 2021-03-25T14:18:08.704 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.697+0000 7f4abeecd700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab814b050 con 0x7f4ab80ba9c0 2021-03-25T14:18:08.705 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.697+0000 7f4abd46a700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f4ab80bada0 0x7f4ab8147bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44150/0 (socket says 172.21.15.110:44150) 2021-03-25T14:18:08.705 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.697+0000 7f4abd46a700 1 -- 172.21.15.110:0/3841842689 learned_addr learned my addr 172.21.15.110:0/3841842689 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:18:08.705 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.697+0000 7f4abcc69700 1 --2- 172.21.15.110:0/3841842689 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ab80ba9c0 0x7f4ab80b9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:08.705 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.697+0000 7f4ab77fe700 1 -- 172.21.15.110:0/3841842689 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1079860862 0 0) 0x7f4ab81482d0 con 0x7f4ab80bada0 2021-03-25T14:18:08.705 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.697+0000 7f4ab77fe700 1 -- 172.21.15.110:0/3841842689 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a9c003270 con 0x7f4ab80bada0 2021-03-25T14:18:08.705 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.697+0000 7f4ab77fe700 1 -- 172.21.15.110:0/3841842689 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2501252998 0 0) 0x7f4a9c003270 con 0x7f4ab80bada0 2021-03-25T14:18:08.705 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.698+0000 7f4ab77fe700 1 -- 172.21.15.110:0/3841842689 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ab80ba9c0 msgr2=0x7f4ab80b9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:08.705 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.698+0000 7f4ab77fe700 1 --2- 172.21.15.110:0/3841842689 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ab80ba9c0 0x7f4ab80b9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:08.705 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.698+0000 7f4ab77fe700 1 -- 172.21.15.110:0/3841842689 >> v1:172.21.15.174:6789/0 conn(0x7f4ab80bb330 legacy=0x7f4ab814a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:08.705 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.698+0000 7f4ab77fe700 1 -- 172.21.15.110:0/3841842689 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab814b250 con 0x7f4ab80bada0 2021-03-25T14:18:08.705 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.698+0000 7f4ab77fe700 1 -- 172.21.15.110:0/3841842689 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f4ab00018a0 con 0x7f4ab80bada0 2021-03-25T14:18:08.705 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.698+0000 7f4ab77fe700 1 -- 172.21.15.110:0/3841842689 >> v1:172.21.15.110:6789/0 conn(0x7f4ab80bada0 legacy=0x7f4ab8147bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:08.705 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.698+0000 7f4ab77fe700 1 --2- 172.21.15.110:0/3841842689 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ab80ba9c0 0x7f4a9c003790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:08.706 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.698+0000 7f4ab77fe700 1 --2- 172.21.15.110:0/3841842689 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a9c003c80 0x7f4a9c004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:08.706 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.698+0000 7f4ab77fe700 1 --2- 172.21.15.110:0/3841842689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a9c004a00 0x7f4a9c004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:08.706 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.698+0000 7f4ab77fe700 1 -- 172.21.15.110:0/3841842689 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab814b050 con 0x7f4a9c004a00 2021-03-25T14:18:08.706 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.698+0000 7f4ab77fe700 1 -- 172.21.15.110:0/3841842689 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9c0041a0 con 0x7f4a9c003c80 2021-03-25T14:18:08.706 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.698+0000 7f4ab77fe700 1 -- 172.21.15.110:0/3841842689 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9c004360 con 0x7f4ab80ba9c0 2021-03-25T14:18:08.706 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.698+0000 7f4abd46a700 1 --2- 172.21.15.110:0/3841842689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a9c004a00 0x7f4a9c004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:08.706 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.698+0000 7f4abcc69700 1 --2- 172.21.15.110:0/3841842689 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ab80ba9c0 0x7f4a9c003790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:08.706 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.698+0000 7f4ab7fff700 1 --2- 172.21.15.110:0/3841842689 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a9c003c80 0x7f4a9c004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:08.706 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.698+0000 7f4abd46a700 1 -- 172.21.15.110:0/3841842689 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ab80ba9c0 msgr2=0x7f4a9c003790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:08.706 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.698+0000 7f4abd46a700 1 --2- 172.21.15.110:0/3841842689 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ab80ba9c0 0x7f4a9c003790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:08.706 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.698+0000 7f4abd46a700 1 -- 172.21.15.110:0/3841842689 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a9c003c80 msgr2=0x7f4a9c004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:08.707 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.698+0000 7f4abd46a700 1 --2- 172.21.15.110:0/3841842689 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a9c003c80 0x7f4a9c004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:08.707 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.698+0000 7f4abd46a700 1 -- 172.21.15.110:0/3841842689 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a9c003270 con 0x7f4a9c004a00 2021-03-25T14:18:08.707 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.698+0000 7f4ab7fff700 1 --2- 172.21.15.110:0/3841842689 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a9c003c80 0x7f4a9c004510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:18:08.707 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.698+0000 7f4abd46a700 1 --2- 172.21.15.110:0/3841842689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a9c004a00 0x7f4a9c004e80 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f4ab000c810 tx=0x7f4ab8061af0).ready entity=mon.0 client_cookie=e4570e528d8217c server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:08.707 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.698+0000 7f4ab77fe700 1 -- 172.21.15.110:0/3841842689 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0005bb0 con 0x7f4a9c004a00 2021-03-25T14:18:08.707 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.698+0000 7f4ab77fe700 1 -- 172.21.15.110:0/3841842689 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab0005d10 con 0x7f4a9c004a00 2021-03-25T14:18:08.707 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.698+0000 7f4ab77fe700 1 -- 172.21.15.110:0/3841842689 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab00072e0 con 0x7f4a9c004a00 2021-03-25T14:18:08.707 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.699+0000 7f4abeecd700 1 -- 172.21.15.110:0/3841842689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a9c004a00 msgr2=0x7f4a9c004e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:08.707 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.699+0000 7f4abeecd700 1 --2- 172.21.15.110:0/3841842689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a9c004a00 0x7f4a9c004e80 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f4ab000c810 tx=0x7f4ab8061af0).stop 2021-03-25T14:18:08.707 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.699+0000 7f4abd46a700 1 -- 172.21.15.110:0/3841842689 reap_dead start 2021-03-25T14:18:08.707 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.699+0000 7f4abeecd700 1 -- 172.21.15.110:0/3841842689 shutdown_connections 2021-03-25T14:18:08.708 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.699+0000 7f4abeecd700 1 -- 172.21.15.110:0/3841842689 >> 172.21.15.110:0/3841842689 conn(0x7f4ab8060c40 msgr2=0x7f4ab8061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:08.708 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.699+0000 7f4abeecd700 1 -- 172.21.15.110:0/3841842689 shutdown_connections 2021-03-25T14:18:08.708 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.699+0000 7f4abeecd700 1 -- 172.21.15.110:0/3841842689 wait complete. 2021-03-25T14:18:08.708 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.700+0000 7f4abeecd700 1 Processor -- start 2021-03-25T14:18:08.708 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.700+0000 7f4abeecd700 1 -- start start 2021-03-25T14:18:08.708 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.701+0000 7f4abeecd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ab814a840 0x7f4ab8148560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:08.708 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.701+0000 7f4abeecd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ab8141c40 0x7f4ab8156450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:08.708 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.701+0000 7f4abeecd700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ab815a250 0x7f4ab8143ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:08.708 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.701+0000 7f4abeecd700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab8156940 con 0x7f4ab814a840 2021-03-25T14:18:08.708 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.701+0000 7f4abeecd700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab8148b50 con 0x7f4ab815a250 2021-03-25T14:18:08.708 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.701+0000 7f4abeecd700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab8148df0 con 0x7f4ab8141c40 2021-03-25T14:18:08.708 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.701+0000 7f4abcc69700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ab814a840 0x7f4ab8148560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:08.709 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.701+0000 7f4abcc69700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ab814a840 0x7f4ab8148560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51226/0 (socket says 172.21.15.110:51226) 2021-03-25T14:18:08.709 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.701+0000 7f4abcc69700 1 -- 172.21.15.110:0/619387149 learned_addr learned my addr 172.21.15.110:0/619387149 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:08.709 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.701+0000 7f4abd46a700 1 --2- 172.21.15.110:0/619387149 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ab815a250 0x7f4ab8143ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:08.709 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.701+0000 7f4abcc69700 1 -- 172.21.15.110:0/619387149 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ab8141c40 msgr2=0x7f4ab8156450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:08.709 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.701+0000 7f4ab7fff700 1 --2- 172.21.15.110:0/619387149 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ab8141c40 0x7f4ab8156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:08.709 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.701+0000 7f4abcc69700 1 --2- 172.21.15.110:0/619387149 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ab8141c40 0x7f4ab8156450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:08.709 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.701+0000 7f4abcc69700 1 -- 172.21.15.110:0/619387149 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ab815a250 msgr2=0x7f4ab8143ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:08.709 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.701+0000 7f4abcc69700 1 --2- 172.21.15.110:0/619387149 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ab815a250 0x7f4ab8143ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:08.709 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.701+0000 7f4abcc69700 1 -- 172.21.15.110:0/619387149 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab8149090 con 0x7f4ab814a840 2021-03-25T14:18:08.709 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.701+0000 7f4abd46a700 1 --2- 172.21.15.110:0/619387149 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ab815a250 0x7f4ab8143ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:18:08.709 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.701+0000 7f4abcc69700 1 --2- 172.21.15.110:0/619387149 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ab814a840 0x7f4ab8148560 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f4aac00ba00 tx=0x7f4aac008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:08.709 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.701+0000 7f4ab4ff9700 1 -- 172.21.15.110:0/619387149 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac00be70 con 0x7f4ab814a840 2021-03-25T14:18:08.710 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.701+0000 7f4ab4ff9700 1 -- 172.21.15.110:0/619387149 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aac011a50 con 0x7f4ab814a840 2021-03-25T14:18:08.710 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.701+0000 7f4abeecd700 1 -- 172.21.15.110:0/619387149 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ab8159b10 con 0x7f4ab814a840 2021-03-25T14:18:08.710 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.701+0000 7f4ab4ff9700 1 -- 172.21.15.110:0/619387149 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac011dd0 con 0x7f4ab814a840 2021-03-25T14:18:08.710 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.701+0000 7f4abeecd700 1 -- 172.21.15.110:0/619387149 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ab80b7350 con 0x7f4ab814a840 2021-03-25T14:18:08.710 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.702+0000 7f4abeecd700 1 -- 172.21.15.110:0/619387149 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ab8159f70 con 0x7f4ab814a840 2021-03-25T14:18:08.710 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.702+0000 7f4ab4ff9700 1 -- 172.21.15.110:0/619387149 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f4aac024070 con 0x7f4ab814a840 2021-03-25T14:18:08.710 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.703+0000 7f4ab4ff9700 1 --2- 172.21.15.110:0/619387149 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4a9805a0e0 0x7f4a9805c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:08.710 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.703+0000 7f4ab4ff9700 1 -- 172.21.15.110:0/619387149 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f4aac074840 con 0x7f4ab814a840 2021-03-25T14:18:08.710 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.703+0000 7f4ab7fff700 1 --2- 172.21.15.110:0/619387149 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4a9805a0e0 0x7f4a9805c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:08.710 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.703+0000 7f4ab7fff700 1 --2- 172.21.15.110:0/619387149 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4a9805a0e0 0x7f4a9805c5a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f4aa4007980 tx=0x7f4aa400c040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:08.711 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.706+0000 7f4ab4ff9700 1 -- 172.21.15.110:0/619387149 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f4aac048020 con 0x7f4ab814a840 2021-03-25T14:18:08.892 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.891+0000 7f4abeecd700 1 -- 172.21.15.110:0/619387149 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ab805d7b0 con 0x7f4ab814a840 2021-03-25T14:18:08.893 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.892+0000 7f4ab4ff9700 1 -- 172.21.15.110:0/619387149 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+2854 (secure 0 0 0) 0x7f4aac018020 con 0x7f4ab814a840 2021-03-25T14:18:08.893 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:18:08.893 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":32,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4997,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/3015251726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3015251726},{"type":"v1","addr":"172.21.15.174:6835","nonce":3015251726}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":24},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/1698368640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1698368640},{"type":"v1","addr":"172.21.15.174:6833","nonce":1698368640}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":24},{"gid":5970,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/3337605488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3337605488},{"type":"v1","addr":"172.21.15.110:6836","nonce":3337605488}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":32}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-03-25T14:17:52.495440+0000","modified":"2021-03-25T14:17:53.496776+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5601},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5601":{"gid":5601,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":5,"addr":"172.21.15.110:6837/2143874763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":2143874763},{"type":"v1","addr":"172.21.15.110:6837","nonce":2143874763}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs2","balancer":"","standby_count_wanted":0},"id":5}]} 2021-03-25T14:18:08.895 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.893+0000 7f4abeecd700 1 -- 172.21.15.110:0/619387149 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4a9805a0e0 msgr2=0x7f4a9805c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:08.895 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.893+0000 7f4abeecd700 1 --2- 172.21.15.110:0/619387149 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4a9805a0e0 0x7f4a9805c5a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f4aa4007980 tx=0x7f4aa400c040).stop 2021-03-25T14:18:08.895 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.893+0000 7f4abeecd700 1 -- 172.21.15.110:0/619387149 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ab814a840 msgr2=0x7f4ab8148560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:08.895 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.893+0000 7f4abeecd700 1 --2- 172.21.15.110:0/619387149 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ab814a840 0x7f4ab8148560 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f4aac00ba00 tx=0x7f4aac008040).stop 2021-03-25T14:18:08.899 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.893+0000 7f4abeecd700 1 -- 172.21.15.110:0/619387149 shutdown_connections 2021-03-25T14:18:08.899 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.893+0000 7f4abeecd700 1 --2- 172.21.15.110:0/619387149 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4a9805a0e0 0x7f4a9805c5a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:08.900 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.893+0000 7f4abeecd700 1 --2- 172.21.15.110:0/619387149 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ab815a250 0x7f4ab8143ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:08.900 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.893+0000 7f4abeecd700 1 --2- 172.21.15.110:0/619387149 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ab814a840 0x7f4ab8148560 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:08.900 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.893+0000 7f4abeecd700 1 --2- 172.21.15.110:0/619387149 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ab8141c40 0x7f4ab8156450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:08.900 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.893+0000 7f4abeecd700 1 -- 172.21.15.110:0/619387149 >> 172.21.15.110:0/619387149 conn(0x7f4ab8060c40 msgr2=0x7f4ab80652a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:08.900 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.893+0000 7f4abeecd700 1 -- 172.21.15.110:0/619387149 shutdown_connections 2021-03-25T14:18:08.900 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:08.893+0000 7f4abeecd700 1 -- 172.21.15.110:0/619387149 wait complete. 2021-03-25T14:18:08.900 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 32 2021-03-25T14:18:08.906 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:18:09.016 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.015+0000 7f2741cb4700 1 Processor -- start 2021-03-25T14:18:09.017 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.016+0000 7f2741cb4700 1 -- start start 2021-03-25T14:18:09.028 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.016+0000 7f2741cb4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f273c13fff0 0x7f273c1403d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:09.028 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.016+0000 7f2741cb4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f273c0b01b0 0x7f273c14a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:09.028 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.016+0000 7f2741cb4700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f273c14a720 con 0x7f273c0bbab0 2021-03-25T14:18:09.028 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.016+0000 7f2741cb4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f273c146420 con 0x7f273c13fff0 2021-03-25T14:18:09.028 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.016+0000 7f2741cb4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273c1466c0 con 0x7f273c0b01b0 2021-03-25T14:18:09.028 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.016+0000 7f273bfff700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f273c0bbab0 0x7f273c0b83f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44172/0 (socket says 172.21.15.110:44172) 2021-03-25T14:18:09.028 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.016+0000 7f273bfff700 1 -- 172.21.15.110:0/1599325460 learned_addr learned my addr 172.21.15.110:0/1599325460 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:18:09.028 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.017+0000 7f273b7fe700 1 --2- 172.21.15.110:0/1599325460 >> v2:172.21.15.174:3300/0 conn(0x7f273c13fff0 0x7f273c1403d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:09.029 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.017+0000 7f273affd700 1 --2- 172.21.15.110:0/1599325460 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f273c0b01b0 0x7f273c14a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:09.029 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.017+0000 7f273a7fc700 1 -- 172.21.15.110:0/1599325460 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2225053471 0 0) 0x7f273c14a720 con 0x7f273c0bbab0 2021-03-25T14:18:09.029 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.017+0000 7f273a7fc700 1 -- 172.21.15.110:0/1599325460 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2728003270 con 0x7f273c0bbab0 2021-03-25T14:18:09.029 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.017+0000 7f273a7fc700 1 -- 172.21.15.110:0/1599325460 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1769778366 0 0) 0x7f2728003270 con 0x7f273c0bbab0 2021-03-25T14:18:09.029 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.017+0000 7f273a7fc700 1 -- 172.21.15.110:0/1599325460 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f273c0b01b0 msgr2=0x7f273c14a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:09.029 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.017+0000 7f273a7fc700 1 --2- 172.21.15.110:0/1599325460 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f273c0b01b0 0x7f273c14a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:09.029 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.017+0000 7f273a7fc700 1 -- 172.21.15.110:0/1599325460 >> v2:172.21.15.174:3300/0 conn(0x7f273c13fff0 msgr2=0x7f273c1403d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:09.029 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.017+0000 7f273a7fc700 1 --2- 172.21.15.110:0/1599325460 >> v2:172.21.15.174:3300/0 conn(0x7f273c13fff0 0x7f273c1403d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:09.029 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.017+0000 7f273a7fc700 1 -- 172.21.15.110:0/1599325460 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f273c146960 con 0x7f273c0bbab0 2021-03-25T14:18:09.029 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.017+0000 7f273a7fc700 1 -- 172.21.15.110:0/1599325460 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f27340018a0 con 0x7f273c0bbab0 2021-03-25T14:18:09.029 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.017+0000 7f273a7fc700 1 -- 172.21.15.110:0/1599325460 >> v1:172.21.15.110:6789/0 conn(0x7f273c0bbab0 legacy=0x7f273c0b83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:09.030 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.017+0000 7f273a7fc700 1 --2- 172.21.15.110:0/1599325460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2728003760 0x7f2728003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:09.030 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.017+0000 7f273a7fc700 1 --2- 172.21.15.110:0/1599325460 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f273c0b01b0 0x7f2728004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:09.030 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.017+0000 7f273a7fc700 1 --2- 172.21.15.110:0/1599325460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2728004a00 0x7f2728004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:09.030 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.017+0000 7f273a7fc700 1 -- 172.21.15.110:0/1599325460 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273c146420 con 0x7f2728004a00 2021-03-25T14:18:09.030 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.017+0000 7f273a7fc700 1 -- 172.21.15.110:0/1599325460 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273c1466c0 con 0x7f2728003760 2021-03-25T14:18:09.030 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.017+0000 7f273a7fc700 1 -- 172.21.15.110:0/1599325460 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2728004200 con 0x7f273c0b01b0 2021-03-25T14:18:09.030 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.017+0000 7f273b7fe700 1 --2- 172.21.15.110:0/1599325460 >> v2:172.21.15.174:3300/0 conn(0x7f273c13fff0 0x7f273c1403d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:18:09.030 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.017+0000 7f273bfff700 1 --2- 172.21.15.110:0/1599325460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2728004a00 0x7f2728004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:09.030 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.017+0000 7f273b7fe700 1 --2- 172.21.15.110:0/1599325460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2728003760 0x7f2728003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:09.030 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.017+0000 7f273affd700 1 --2- 172.21.15.110:0/1599325460 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f273c0b01b0 0x7f2728004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:09.030 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.017+0000 7f273bfff700 1 -- 172.21.15.110:0/1599325460 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f273c0b01b0 msgr2=0x7f2728004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:09.031 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.017+0000 7f273bfff700 1 --2- 172.21.15.110:0/1599325460 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f273c0b01b0 0x7f2728004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:09.031 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.017+0000 7f273bfff700 1 -- 172.21.15.110:0/1599325460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2728003760 msgr2=0x7f2728003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:09.031 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.017+0000 7f273bfff700 1 --2- 172.21.15.110:0/1599325460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2728003760 0x7f2728003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:09.031 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.017+0000 7f273bfff700 1 -- 172.21.15.110:0/1599325460 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2728003270 con 0x7f2728004a00 2021-03-25T14:18:09.031 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.017+0000 7f273b7fe700 1 --2- 172.21.15.110:0/1599325460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2728003760 0x7f2728003b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:18:09.031 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.018+0000 7f273bfff700 1 --2- 172.21.15.110:0/1599325460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2728004a00 0x7f2728004e80 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7f273400c840 tx=0x7f273c0af630).ready entity=mon.0 client_cookie=5554986374705563 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:09.031 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.018+0000 7f273a7fc700 1 -- 172.21.15.110:0/1599325460 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2734005bb0 con 0x7f2728004a00 2021-03-25T14:18:09.031 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.018+0000 7f273a7fc700 1 -- 172.21.15.110:0/1599325460 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2734005d10 con 0x7f2728004a00 2021-03-25T14:18:09.031 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.018+0000 7f273a7fc700 1 -- 172.21.15.110:0/1599325460 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2734007320 con 0x7f2728004a00 2021-03-25T14:18:09.031 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.018+0000 7f2741cb4700 1 -- 172.21.15.110:0/1599325460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2728004a00 msgr2=0x7f2728004e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:09.031 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.018+0000 7f2741cb4700 1 --2- 172.21.15.110:0/1599325460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2728004a00 0x7f2728004e80 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7f273400c840 tx=0x7f273c0af630).stop 2021-03-25T14:18:09.032 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.018+0000 7f273bfff700 1 -- 172.21.15.110:0/1599325460 reap_dead start 2021-03-25T14:18:09.032 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.018+0000 7f2741cb4700 1 -- 172.21.15.110:0/1599325460 shutdown_connections 2021-03-25T14:18:09.032 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.018+0000 7f2741cb4700 1 -- 172.21.15.110:0/1599325460 >> 172.21.15.110:0/1599325460 conn(0x7f273c063850 msgr2=0x7f273c05c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:09.032 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.018+0000 7f2741cb4700 1 -- 172.21.15.110:0/1599325460 shutdown_connections 2021-03-25T14:18:09.032 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.018+0000 7f2741cb4700 1 -- 172.21.15.110:0/1599325460 wait complete. 2021-03-25T14:18:09.032 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.019+0000 7f2741cb4700 1 Processor -- start 2021-03-25T14:18:09.032 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.019+0000 7f2741cb4700 1 -- start start 2021-03-25T14:18:09.032 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.020+0000 7f2741cb4700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f273c0ad710 0x7f273c157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:09.032 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.020+0000 7f2741cb4700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f273c068b60 0x7f273c147c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:09.032 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.020+0000 7f2741cb4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f273c1480f0 0x7f273c138f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:09.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.020+0000 7f2741cb4700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273c1485c0 con 0x7f273c0ad710 2021-03-25T14:18:09.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.020+0000 7f2741cb4700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273c148860 con 0x7f273c068b60 2021-03-25T14:18:09.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.020+0000 7f2741cb4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273c148b00 con 0x7f273c1480f0 2021-03-25T14:18:09.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.020+0000 7f273b7fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f273c0ad710 0x7f273c157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:09.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.020+0000 7f273b7fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f273c0ad710 0x7f273c157980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51246/0 (socket says 172.21.15.110:51246) 2021-03-25T14:18:09.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.020+0000 7f273b7fe700 1 -- 172.21.15.110:0/2643989951 learned_addr learned my addr 172.21.15.110:0/2643989951 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:09.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.020+0000 7f273affd700 1 --2- 172.21.15.110:0/2643989951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f273c068b60 0x7f273c147c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:09.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.020+0000 7f273bfff700 1 --2- 172.21.15.110:0/2643989951 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f273c1480f0 0x7f273c138f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:09.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.020+0000 7f273b7fe700 1 -- 172.21.15.110:0/2643989951 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f273c1480f0 msgr2=0x7f273c138f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:09.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.020+0000 7f273b7fe700 1 --2- 172.21.15.110:0/2643989951 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f273c1480f0 0x7f273c138f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:09.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.020+0000 7f273b7fe700 1 -- 172.21.15.110:0/2643989951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f273c068b60 msgr2=0x7f273c147c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:09.033 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.020+0000 7f273b7fe700 1 --2- 172.21.15.110:0/2643989951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f273c068b60 0x7f273c147c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:09.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.020+0000 7f273b7fe700 1 -- 172.21.15.110:0/2643989951 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f273c147760 con 0x7f273c0ad710 2021-03-25T14:18:09.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.021+0000 7f273b7fe700 1 --2- 172.21.15.110:0/2643989951 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f273c0ad710 0x7f273c157980 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f272c010d70 tx=0x7f272c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:09.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.021+0000 7f27237fe700 1 -- 172.21.15.110:0/2643989951 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272c010e70 con 0x7f273c0ad710 2021-03-25T14:18:09.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.021+0000 7f27237fe700 1 -- 172.21.15.110:0/2643989951 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272c00ecf0 con 0x7f273c0ad710 2021-03-25T14:18:09.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.021+0000 7f2741cb4700 1 -- 172.21.15.110:0/2643989951 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f273c069040 con 0x7f273c0ad710 2021-03-25T14:18:09.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.021+0000 7f27237fe700 1 -- 172.21.15.110:0/2643989951 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272c014680 con 0x7f273c0ad710 2021-03-25T14:18:09.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.021+0000 7f2741cb4700 1 -- 172.21.15.110:0/2643989951 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f273c0add30 con 0x7f273c0ad710 2021-03-25T14:18:09.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.022+0000 7f2741cb4700 1 -- 172.21.15.110:0/2643989951 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f273c05d0b0 con 0x7f273c0ad710 2021-03-25T14:18:09.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.022+0000 7f27237fe700 1 -- 172.21.15.110:0/2643989951 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f272c0149f0 con 0x7f273c0ad710 2021-03-25T14:18:09.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.022+0000 7f27237fe700 1 --2- 172.21.15.110:0/2643989951 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f271c05a0b0 0x7f271c05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:09.034 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.023+0000 7f27237fe700 1 -- 172.21.15.110:0/2643989951 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f272c0745a0 con 0x7f273c0ad710 2021-03-25T14:18:09.035 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.023+0000 7f273affd700 1 --2- 172.21.15.110:0/2643989951 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f271c05a0b0 0x7f271c05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:09.035 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.023+0000 7f273affd700 1 --2- 172.21.15.110:0/2643989951 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f271c05a0b0 0x7f271c05c570 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f273c1408e0 tx=0x7f2730008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:09.035 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.026+0000 7f27237fe700 1 -- 172.21.15.110:0/2643989951 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f273c05d0b0 con 0x7f273c0ad710 2021-03-25T14:18:09.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.176+0000 7f2741cb4700 1 -- 172.21.15.110:0/2643989951 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f273c05d0b0 con 0x7f273c0ad710 2021-03-25T14:18:09.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.177+0000 7f27237fe700 1 -- 172.21.15.110:0/2643989951 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+17245 (secure 0 0 0) 0x7f273c05d0b0 con 0x7f273c0ad710 2021-03-25T14:18:09.178 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:18:09.178 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":63,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:18:06.204376+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":12,"pool_name":"cephfs2_metadata","create_time":"2021-03-25T14:17:50.184585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}}},{"pool":13,"pool_name":"cephfs2_data","create_time":"2021-03-25T14:17:51.481411+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs2"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:6836/426511293":"2021-03-26T14:18:02.326774+0000","172.21.15.110:6834/426511293":"2021-03-26T14:18:02.326774+0000"},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:18:09.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.178+0000 7f2741cb4700 1 -- 172.21.15.110:0/2643989951 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f271c05a0b0 msgr2=0x7f271c05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:09.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.178+0000 7f2741cb4700 1 --2- 172.21.15.110:0/2643989951 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f271c05a0b0 0x7f271c05c570 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f273c1408e0 tx=0x7f2730008040).stop 2021-03-25T14:18:09.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.178+0000 7f2741cb4700 1 -- 172.21.15.110:0/2643989951 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f273c0ad710 msgr2=0x7f273c157980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:09.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.178+0000 7f2741cb4700 1 --2- 172.21.15.110:0/2643989951 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f273c0ad710 0x7f273c157980 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f272c010d70 tx=0x7f272c008040).stop 2021-03-25T14:18:09.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.178+0000 7f2741cb4700 1 -- 172.21.15.110:0/2643989951 shutdown_connections 2021-03-25T14:18:09.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.178+0000 7f2741cb4700 1 --2- 172.21.15.110:0/2643989951 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f271c05a0b0 0x7f271c05c570 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:09.181 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.178+0000 7f2741cb4700 1 --2- 172.21.15.110:0/2643989951 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f273c1480f0 0x7f273c138f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:09.181 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.178+0000 7f2741cb4700 1 --2- 172.21.15.110:0/2643989951 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f273c0ad710 0x7f273c157980 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:09.181 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.178+0000 7f2741cb4700 1 --2- 172.21.15.110:0/2643989951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f273c068b60 0x7f273c147c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:09.181 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.178+0000 7f2741cb4700 1 -- 172.21.15.110:0/2643989951 >> 172.21.15.110:0/2643989951 conn(0x7f273c063850 msgr2=0x7f273c05c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:09.181 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.178+0000 7f2741cb4700 1 -- 172.21.15.110:0/2643989951 shutdown_connections 2021-03-25T14:18:09.181 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.178+0000 7f2741cb4700 1 -- 172.21.15.110:0/2643989951 wait complete. 2021-03-25T14:18:09.191 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2021-03-25T14:18:09.303 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.302+0000 7fe14759e700 1 Processor -- start 2021-03-25T14:18:09.304 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.302+0000 7fe14759e700 1 -- start start 2021-03-25T14:18:09.311 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.303+0000 7fe14759e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe1480b9600 0x7fe148148bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:09.311 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.303+0000 7fe14759e700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe14814cfd0 con 0x7fe1480684f0 2021-03-25T14:18:09.312 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.303+0000 7fe14759e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe14814d270 con 0x7fe1480690f0 2021-03-25T14:18:09.312 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.303+0000 7fe14759e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14814d510 con 0x7fe1480b9600 2021-03-25T14:18:09.312 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.304+0000 7fe146d9d700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fe1480684f0 0x7fe1481499e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44190/0 (socket says 172.21.15.110:44190) 2021-03-25T14:18:09.312 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.304+0000 7fe146d9d700 1 -- 172.21.15.110:0/3212098019 learned_addr learned my addr 172.21.15.110:0/3212098019 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:18:09.312 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.304+0000 7fe14559a700 1 -- 172.21.15.110:0/3212098019 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 193223070 0 0) 0x7fe14814cfd0 con 0x7fe1480684f0 2021-03-25T14:18:09.312 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.304+0000 7fe14559a700 1 -- 172.21.15.110:0/3212098019 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe12c003270 con 0x7fe1480684f0 2021-03-25T14:18:09.312 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.304+0000 7fe14659c700 1 --2- 172.21.15.110:0/3212098019 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe1480b9600 0x7fe148148bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:09.312 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.304+0000 7fe14559a700 1 -- 172.21.15.110:0/3212098019 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3597687348 0 0) 0x7fe12c003270 con 0x7fe1480684f0 2021-03-25T14:18:09.313 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.304+0000 7fe14559a700 1 -- 172.21.15.110:0/3212098019 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe1480b9600 msgr2=0x7fe148148bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:09.313 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.304+0000 7fe14559a700 1 --2- 172.21.15.110:0/3212098019 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe1480b9600 0x7fe148148bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:09.313 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.304+0000 7fe14559a700 1 -- 172.21.15.110:0/3212098019 >> v1:172.21.15.174:6789/0 conn(0x7fe1480690f0 legacy=0x7fe1481490b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:09.313 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.304+0000 7fe14559a700 1 -- 172.21.15.110:0/3212098019 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14814d7b0 con 0x7fe1480684f0 2021-03-25T14:18:09.313 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.304+0000 7fe14559a700 1 -- 172.21.15.110:0/3212098019 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7fe1400018f0 con 0x7fe1480684f0 2021-03-25T14:18:09.313 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.304+0000 7fe14559a700 1 -- 172.21.15.110:0/3212098019 >> v1:172.21.15.110:6789/0 conn(0x7fe1480684f0 legacy=0x7fe1481499e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:09.313 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.304+0000 7fe14559a700 1 --2- 172.21.15.110:0/3212098019 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe12c003790 0x7fe12c003bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:09.313 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.304+0000 7fe14559a700 1 --2- 172.21.15.110:0/3212098019 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe1480b9600 0x7fe12c004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:09.313 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.304+0000 7fe14559a700 1 --2- 172.21.15.110:0/3212098019 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe12c004a00 0x7fe12c004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:09.313 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.304+0000 7fe14559a700 1 -- 172.21.15.110:0/3212098019 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14814d510 con 0x7fe12c003790 2021-03-25T14:18:09.313 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.304+0000 7fe14559a700 1 -- 172.21.15.110:0/3212098019 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c004230 con 0x7fe12c004a00 2021-03-25T14:18:09.314 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.304+0000 7fe14559a700 1 -- 172.21.15.110:0/3212098019 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c00b760 con 0x7fe1480b9600 2021-03-25T14:18:09.314 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.304+0000 7fe14659c700 1 --2- 172.21.15.110:0/3212098019 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe12c003790 0x7fe12c003bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:09.314 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.304+0000 7fe146d9d700 1 --2- 172.21.15.110:0/3212098019 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe12c004a00 0x7fe12c004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:09.314 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.304+0000 7fe145d9b700 1 --2- 172.21.15.110:0/3212098019 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe1480b9600 0x7fe12c004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:09.314 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.305+0000 7fe14659c700 1 -- 172.21.15.110:0/3212098019 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe1480b9600 msgr2=0x7fe12c004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:09.314 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.305+0000 7fe14659c700 1 --2- 172.21.15.110:0/3212098019 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe1480b9600 0x7fe12c004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:09.314 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.305+0000 7fe14659c700 1 -- 172.21.15.110:0/3212098019 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe12c004a00 msgr2=0x7fe12c004e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:09.314 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.305+0000 7fe14659c700 1 --2- 172.21.15.110:0/3212098019 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe12c004a00 0x7fe12c004e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:09.314 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.305+0000 7fe14659c700 1 -- 172.21.15.110:0/3212098019 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe12c003270 con 0x7fe12c003790 2021-03-25T14:18:09.314 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.305+0000 7fe14659c700 1 --2- 172.21.15.110:0/3212098019 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe12c003790 0x7fe12c003bb0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7fe13800bc30 tx=0x7fe138006e20).ready entity=mon.0 client_cookie=89b8a6624c869723 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:09.314 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.305+0000 7fe14559a700 1 -- 172.21.15.110:0/3212098019 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13800b310 con 0x7fe12c003790 2021-03-25T14:18:09.315 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.305+0000 7fe14559a700 1 -- 172.21.15.110:0/3212098019 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe13800e9a0 con 0x7fe12c003790 2021-03-25T14:18:09.315 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.305+0000 7fe14559a700 1 -- 172.21.15.110:0/3212098019 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13800ed20 con 0x7fe12c003790 2021-03-25T14:18:09.315 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.305+0000 7fe14759e700 1 -- 172.21.15.110:0/3212098019 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe12c003790 msgr2=0x7fe12c003bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:09.315 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.305+0000 7fe14759e700 1 --2- 172.21.15.110:0/3212098019 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe12c003790 0x7fe12c003bb0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7fe13800bc30 tx=0x7fe138006e20).stop 2021-03-25T14:18:09.315 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.305+0000 7fe146d9d700 1 -- 172.21.15.110:0/3212098019 reap_dead start 2021-03-25T14:18:09.315 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.305+0000 7fe14759e700 1 -- 172.21.15.110:0/3212098019 shutdown_connections 2021-03-25T14:18:09.315 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.305+0000 7fe14759e700 1 -- 172.21.15.110:0/3212098019 >> 172.21.15.110:0/3212098019 conn(0x7fe148061d50 msgr2=0x7fe148062160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:09.316 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.305+0000 7fe14759e700 1 -- 172.21.15.110:0/3212098019 shutdown_connections 2021-03-25T14:18:09.316 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.305+0000 7fe14759e700 1 -- 172.21.15.110:0/3212098019 wait complete. 2021-03-25T14:18:09.316 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.306+0000 7fe14759e700 1 Processor -- start 2021-03-25T14:18:09.316 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.306+0000 7fe14759e700 1 -- start start 2021-03-25T14:18:09.316 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.307+0000 7fe14759e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe12c003790 0x7fe148147240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:09.316 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.307+0000 7fe14759e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe14809c2d0 0x7fe14814b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:09.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.307+0000 7fe14759e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe14814b7e0 0x7fe14815c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:09.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.307+0000 7fe14759e700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14814bc20 con 0x7fe14809c2d0 2021-03-25T14:18:09.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.307+0000 7fe14759e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1480a1440 con 0x7fe12c003790 2021-03-25T14:18:09.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.307+0000 7fe14759e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14809ebf0 con 0x7fe14814b7e0 2021-03-25T14:18:09.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.307+0000 7fe145d9b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe14809c2d0 0x7fe14814b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:09.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.307+0000 7fe145d9b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe14809c2d0 0x7fe14814b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51266/0 (socket says 172.21.15.110:51266) 2021-03-25T14:18:09.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.307+0000 7fe145d9b700 1 -- 172.21.15.110:0/123077275 learned_addr learned my addr 172.21.15.110:0/123077275 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:09.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.307+0000 7fe14659c700 1 --2- 172.21.15.110:0/123077275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe12c003790 0x7fe148147240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:09.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.307+0000 7fe146d9d700 1 --2- 172.21.15.110:0/123077275 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe14814b7e0 0x7fe14815c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:09.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.307+0000 7fe145d9b700 1 -- 172.21.15.110:0/123077275 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe14814b7e0 msgr2=0x7fe14815c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:09.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.307+0000 7fe145d9b700 1 --2- 172.21.15.110:0/123077275 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe14814b7e0 0x7fe14815c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:09.318 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.307+0000 7fe145d9b700 1 -- 172.21.15.110:0/123077275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe12c003790 msgr2=0x7fe148147240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:09.318 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.307+0000 7fe145d9b700 1 --2- 172.21.15.110:0/123077275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe12c003790 0x7fe148147240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:09.318 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.308+0000 7fe145d9b700 1 -- 172.21.15.110:0/123077275 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe148146550 con 0x7fe14809c2d0 2021-03-25T14:18:09.318 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.308+0000 7fe145d9b700 1 --2- 172.21.15.110:0/123077275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe14809c2d0 0x7fe14814b2f0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7fe13c002bc0 tx=0x7fe13c007bc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:09.318 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.308+0000 7fe1367fc700 1 -- 172.21.15.110:0/123077275 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13c00f8e0 con 0x7fe14809c2d0 2021-03-25T14:18:09.318 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.308+0000 7fe1367fc700 1 -- 172.21.15.110:0/123077275 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe13c00fa40 con 0x7fe14809c2d0 2021-03-25T14:18:09.318 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.308+0000 7fe1367fc700 1 -- 172.21.15.110:0/123077275 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13c00fdc0 con 0x7fe14809c2d0 2021-03-25T14:18:09.318 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.308+0000 7fe14759e700 1 -- 172.21.15.110:0/123077275 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe14809e6b0 con 0x7fe14809c2d0 2021-03-25T14:18:09.318 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.308+0000 7fe14759e700 1 -- 172.21.15.110:0/123077275 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe14814ae50 con 0x7fe14809c2d0 2021-03-25T14:18:09.318 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.309+0000 7fe14759e700 1 -- 172.21.15.110:0/123077275 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe14814b010 con 0x7fe14809c2d0 2021-03-25T14:18:09.318 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.309+0000 7fe1367fc700 1 -- 172.21.15.110:0/123077275 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fe13c01b030 con 0x7fe14809c2d0 2021-03-25T14:18:09.319 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.309+0000 7fe1367fc700 1 --2- 172.21.15.110:0/123077275 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe12405a0b0 0x7fe12405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:09.319 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.309+0000 7fe1367fc700 1 -- 172.21.15.110:0/123077275 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6516+0+0 (secure 0 0 0) 0x7fe13c073ba0 con 0x7fe14809c2d0 2021-03-25T14:18:09.319 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.310+0000 7fe14659c700 1 --2- 172.21.15.110:0/123077275 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe12405a0b0 0x7fe12405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:09.319 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.310+0000 7fe14659c700 1 --2- 172.21.15.110:0/123077275 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe12405a0b0 0x7fe12405c570 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7fe138007fd0 tx=0x7fe138019000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:09.319 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.313+0000 7fe1367fc700 1 -- 172.21.15.110:0/123077275 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fe13c047430 con 0x7fe14809c2d0 2021-03-25T14:18:09.501 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:09.500+0000 7fe14759e700 1 -- 172.21.15.110:0/123077275 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7fe148045ae0 con 0x7fe14809c2d0 2021-03-25T14:18:10.218 INFO:tasks.ceph.mon.a.smithi110.stderr:2021-03-25T14:18:10.217+0000 7f2dd9594700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-03-25T14:18:10.222 INFO:tasks.ceph.mds.c.smithi110.stderr: -1751> 2021-03-25T14:17:36.949+0000 7f26b3bf3700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2021-03-25T14:18:10.223 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.222+0000 7fe1367fc700 1 -- 172.21.15.110:0/123077275 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v33) v1 ==== 163+0+0 (secure 0 0 0) 0x7fe13c04aa50 con 0x7fe14809c2d0 2021-03-25T14:18:10.224 INFO:tasks.ceph.mds.c.smithi110.stderr: -492> 2021-03-25T14:17:56.134+0000 7f26adbe7700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2021-03-25T14:18:10.226 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.224+0000 7fe14759e700 1 -- 172.21.15.110:0/123077275 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe12405a0b0 msgr2=0x7fe12405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:10.226 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.224+0000 7fe14759e700 1 --2- 172.21.15.110:0/123077275 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe12405a0b0 0x7fe12405c570 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7fe138007fd0 tx=0x7fe138019000).stop 2021-03-25T14:18:10.226 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.224+0000 7fe14759e700 1 -- 172.21.15.110:0/123077275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe14809c2d0 msgr2=0x7fe14814b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:10.226 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.224+0000 7fe14759e700 1 --2- 172.21.15.110:0/123077275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe14809c2d0 0x7fe14814b2f0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7fe13c002bc0 tx=0x7fe13c007bc0).stop 2021-03-25T14:18:10.226 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.225+0000 7fe14759e700 1 -- 172.21.15.110:0/123077275 shutdown_connections 2021-03-25T14:18:10.226 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.225+0000 7fe14759e700 1 --2- 172.21.15.110:0/123077275 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe12405a0b0 0x7fe12405c570 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:10.226 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.225+0000 7fe14759e700 1 --2- 172.21.15.110:0/123077275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe12c003790 0x7fe148147240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:10.226 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.225+0000 7fe14759e700 1 --2- 172.21.15.110:0/123077275 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe14814b7e0 0x7fe14815c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:10.227 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.225+0000 7fe14759e700 1 --2- 172.21.15.110:0/123077275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe14809c2d0 0x7fe14814b2f0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:10.227 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.225+0000 7fe14759e700 1 -- 172.21.15.110:0/123077275 >> 172.21.15.110:0/123077275 conn(0x7fe148061d50 msgr2=0x7fe148148890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:10.227 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.225+0000 7fe14759e700 1 -- 172.21.15.110:0/123077275 shutdown_connections 2021-03-25T14:18:10.227 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.225+0000 7fe14759e700 1 -- 172.21.15.110:0/123077275 wait complete. 2021-03-25T14:18:10.227 INFO:teuthology.orchestra.run.smithi110.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-03-25T14:18:10.239 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2021-03-25T14:18:10.244 INFO:tasks.ceph.mds.c.smithi110.stdout:starting mds.c at 2021-03-25T14:18:10.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.352+0000 7fb57b427700 1 Processor -- start 2021-03-25T14:18:10.354 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.352+0000 7fb57b427700 1 -- start start 2021-03-25T14:18:10.365 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.353+0000 7fb57b427700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb5740b4100 0x7fb574149340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:10.365 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.353+0000 7fb57b427700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb5740b47a0 0x7fb5740b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:10.366 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.353+0000 7fb57b427700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5740b4c10 con 0x7fb5740be3a0 2021-03-25T14:18:10.366 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.353+0000 7fb57b427700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb574149960 con 0x7fb5740b4100 2021-03-25T14:18:10.366 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.353+0000 7fb57b427700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb574149c00 con 0x7fb5740b47a0 2021-03-25T14:18:10.366 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.353+0000 7fb5789c2700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb5740b4100 0x7fb574149340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:10.366 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.353+0000 7fb5791c3700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fb5740be3a0 0x7fb574148c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44220/0 (socket says 172.21.15.110:44220) 2021-03-25T14:18:10.367 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.353+0000 7fb5789c2700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb5740b4100 0x7fb574149340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51286/0 (socket says 172.21.15.110:51286) 2021-03-25T14:18:10.367 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.353+0000 7fb5791c3700 1 -- 172.21.15.110:0/1246033427 learned_addr learned my addr 172.21.15.110:0/1246033427 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:18:10.367 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.353+0000 7fb5799c4700 1 --2- 172.21.15.110:0/1246033427 >> v2:172.21.15.174:3300/0 conn(0x7fb5740b47a0 0x7fb5740b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:10.367 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.353+0000 7fb5789c2700 1 -- 172.21.15.110:0/1246033427 >> v2:172.21.15.174:3300/0 conn(0x7fb5740b47a0 msgr2=0x7fb5740b8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:10.368 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.353+0000 7fb5789c2700 1 --2- 172.21.15.110:0/1246033427 >> v2:172.21.15.174:3300/0 conn(0x7fb5740b47a0 0x7fb5740b8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:10.368 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.353+0000 7fb5789c2700 1 -- 172.21.15.110:0/1246033427 >> v1:172.21.15.110:6789/0 conn(0x7fb5740be3a0 legacy=0x7fb574148c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:10.368 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.353+0000 7fb563fff700 1 -- 172.21.15.110:0/1246033427 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1994681872 0 0) 0x7fb5740b4c10 con 0x7fb5740be3a0 2021-03-25T14:18:10.368 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.353+0000 7fb5789c2700 1 -- 172.21.15.110:0/1246033427 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb574149ea0 con 0x7fb5740b4100 2021-03-25T14:18:10.368 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.354+0000 7fb5789c2700 1 --2- 172.21.15.110:0/1246033427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5740b4100 0x7fb574149340 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7fb5740686a0 tx=0x7fb564006e20).ready entity=mon.0 client_cookie=1ca1e6171f8ae86 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:10.369 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.354+0000 7fb563fff700 1 -- 172.21.15.110:0/1246033427 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5640097e0 con 0x7fb5740b4100 2021-03-25T14:18:10.369 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.354+0000 7fb563fff700 1 -- 172.21.15.110:0/1246033427 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb564009940 con 0x7fb5740b4100 2021-03-25T14:18:10.369 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.354+0000 7fb563fff700 1 -- 172.21.15.110:0/1246033427 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb564009cc0 con 0x7fb5740b4100 2021-03-25T14:18:10.370 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.354+0000 7fb57b427700 1 -- 172.21.15.110:0/1246033427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5740b4100 msgr2=0x7fb574149340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:10.370 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.354+0000 7fb57b427700 1 --2- 172.21.15.110:0/1246033427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5740b4100 0x7fb574149340 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7fb5740686a0 tx=0x7fb564006e20).stop 2021-03-25T14:18:10.370 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.354+0000 7fb57b427700 1 -- 172.21.15.110:0/1246033427 shutdown_connections 2021-03-25T14:18:10.370 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.354+0000 7fb57b427700 1 --2- 172.21.15.110:0/1246033427 >> v2:172.21.15.174:3300/0 conn(0x7fb5740b47a0 0x7fb5740b8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:10.370 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.354+0000 7fb57b427700 1 --2- 172.21.15.110:0/1246033427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5740b4100 0x7fb574149340 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:10.371 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.354+0000 7fb57b427700 1 -- 172.21.15.110:0/1246033427 >> 172.21.15.110:0/1246033427 conn(0x7fb5740686f0 msgr2=0x7fb574068b00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:10.371 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.354+0000 7fb57b427700 1 -- 172.21.15.110:0/1246033427 shutdown_connections 2021-03-25T14:18:10.371 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.354+0000 7fb57b427700 1 -- 172.21.15.110:0/1246033427 wait complete. 2021-03-25T14:18:10.371 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.355+0000 7fb57b427700 1 Processor -- start 2021-03-25T14:18:10.371 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.355+0000 7fb57b427700 1 -- start start 2021-03-25T14:18:10.371 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.356+0000 7fb57b427700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5740b4100 0x7fb574158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:10.371 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.356+0000 7fb57b427700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5740b47a0 0x7fb5740a3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:10.371 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.356+0000 7fb57b427700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5740be3a0 0x7fb574148540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:10.371 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.356+0000 7fb57b427700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57415bdd0 con 0x7fb5740be3a0 2021-03-25T14:18:10.371 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.356+0000 7fb57b427700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57414ab70 con 0x7fb5740b47a0 2021-03-25T14:18:10.372 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.356+0000 7fb57b427700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb57414ae10 con 0x7fb5740b4100 2021-03-25T14:18:10.372 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.356+0000 7fb5799c4700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5740be3a0 0x7fb574148540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:10.372 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.356+0000 7fb5799c4700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5740be3a0 0x7fb574148540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51292/0 (socket says 172.21.15.110:51292) 2021-03-25T14:18:10.372 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.356+0000 7fb5799c4700 1 -- 172.21.15.110:0/3260015885 learned_addr learned my addr 172.21.15.110:0/3260015885 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:10.372 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.356+0000 7fb5791c3700 1 --2- 172.21.15.110:0/3260015885 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5740b4100 0x7fb574158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:10.372 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.356+0000 7fb5789c2700 1 --2- 172.21.15.110:0/3260015885 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5740b47a0 0x7fb5740a3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:10.372 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.357+0000 7fb5799c4700 1 -- 172.21.15.110:0/3260015885 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5740b4100 msgr2=0x7fb574158850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:10.372 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.357+0000 7fb5799c4700 1 --2- 172.21.15.110:0/3260015885 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5740b4100 0x7fb574158850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:10.372 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.357+0000 7fb5799c4700 1 -- 172.21.15.110:0/3260015885 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5740b47a0 msgr2=0x7fb5740a3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:10.373 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.357+0000 7fb5799c4700 1 --2- 172.21.15.110:0/3260015885 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5740b47a0 0x7fb5740a3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:10.373 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.357+0000 7fb5799c4700 1 -- 172.21.15.110:0/3260015885 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57414b0b0 con 0x7fb5740be3a0 2021-03-25T14:18:10.373 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.357+0000 7fb5799c4700 1 --2- 172.21.15.110:0/3260015885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5740be3a0 0x7fb574148540 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7fb56c00cb20 tx=0x7fb56c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:10.373 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.357+0000 7fb5617fa700 1 -- 172.21.15.110:0/3260015885 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56c007780 con 0x7fb5740be3a0 2021-03-25T14:18:10.373 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.357+0000 7fb5617fa700 1 -- 172.21.15.110:0/3260015885 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56c0078e0 con 0x7fb5740be3a0 2021-03-25T14:18:10.373 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.357+0000 7fb57b427700 1 -- 172.21.15.110:0/3260015885 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb57415c030 con 0x7fb5740be3a0 2021-03-25T14:18:10.373 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.357+0000 7fb5617fa700 1 -- 172.21.15.110:0/3260015885 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56c007c80 con 0x7fb5740be3a0 2021-03-25T14:18:10.373 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.357+0000 7fb57b427700 1 -- 172.21.15.110:0/3260015885 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5740a39f0 con 0x7fb5740be3a0 2021-03-25T14:18:10.374 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.358+0000 7fb57b427700 1 -- 172.21.15.110:0/3260015885 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb57405d7b0 con 0x7fb5740be3a0 2021-03-25T14:18:10.374 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.358+0000 7fb5617fa700 1 -- 172.21.15.110:0/3260015885 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fb56c01b460 con 0x7fb5740be3a0 2021-03-25T14:18:10.374 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.358+0000 7fb5617fa700 1 --2- 172.21.15.110:0/3260015885 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb55405a0b0 0x7fb55405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:10.374 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.359+0000 7fb5617fa700 1 -- 172.21.15.110:0/3260015885 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6602+0+0 (secure 0 0 0) 0x7fb56c074400 con 0x7fb5740be3a0 2021-03-25T14:18:10.374 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.359+0000 7fb5791c3700 1 --2- 172.21.15.110:0/3260015885 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb55405a0b0 0x7fb55405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:10.374 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.359+0000 7fb5791c3700 1 --2- 172.21.15.110:0/3260015885 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb55405a0b0 0x7fb55405c570 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7fb570007fd0 tx=0x7fb570007c50).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:10.374 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.362+0000 7fb5617fa700 1 -- 172.21.15.110:0/3260015885 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fb56c047a20 con 0x7fb5740be3a0 2021-03-25T14:18:10.548 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:10.547+0000 7fb57b427700 1 -- 172.21.15.110:0/3260015885 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb574061c50 con 0x7fb5740be3a0 2021-03-25T14:18:11.507 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.506+0000 7fb5617fa700 1 -- 172.21.15.110:0/3260015885 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v34) v1 ==== 105+0+0 (secure 0 0 0) 0x7fb56c04b040 con 0x7fb5740be3a0 2021-03-25T14:18:11.509 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.508+0000 7fb57b427700 1 -- 172.21.15.110:0/3260015885 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb55405a0b0 msgr2=0x7fb55405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:11.509 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.508+0000 7fb57b427700 1 --2- 172.21.15.110:0/3260015885 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb55405a0b0 0x7fb55405c570 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7fb570007fd0 tx=0x7fb570007c50).stop 2021-03-25T14:18:11.510 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.508+0000 7fb57b427700 1 -- 172.21.15.110:0/3260015885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5740be3a0 msgr2=0x7fb574148540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:11.510 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.508+0000 7fb57b427700 1 --2- 172.21.15.110:0/3260015885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5740be3a0 0x7fb574148540 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7fb56c00cb20 tx=0x7fb56c008040).stop 2021-03-25T14:18:11.510 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.508+0000 7fb57b427700 1 -- 172.21.15.110:0/3260015885 shutdown_connections 2021-03-25T14:18:11.510 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.508+0000 7fb57b427700 1 --2- 172.21.15.110:0/3260015885 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb55405a0b0 0x7fb55405c570 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:11.510 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.508+0000 7fb57b427700 1 --2- 172.21.15.110:0/3260015885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5740be3a0 0x7fb574148540 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:11.510 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.508+0000 7fb57b427700 1 --2- 172.21.15.110:0/3260015885 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5740b4100 0x7fb574158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:11.510 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.508+0000 7fb57b427700 1 --2- 172.21.15.110:0/3260015885 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5740b47a0 0x7fb5740a3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:11.510 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.508+0000 7fb57b427700 1 -- 172.21.15.110:0/3260015885 >> 172.21.15.110:0/3260015885 conn(0x7fb5740686f0 msgr2=0x7fb574066930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:11.510 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.508+0000 7fb57b427700 1 -- 172.21.15.110:0/3260015885 shutdown_connections 2021-03-25T14:18:11.510 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.508+0000 7fb57b427700 1 -- 172.21.15.110:0/3260015885 wait complete. 2021-03-25T14:18:11.524 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2021-03-25T14:18:11.684 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.683+0000 7fc6fefcb700 1 Processor -- start 2021-03-25T14:18:11.684 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.683+0000 7fc6fefcb700 1 -- start start 2021-03-25T14:18:11.691 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.684+0000 7fc6fefcb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc6f81493a0 0x7fc6f80b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:11.691 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.684+0000 7fc6fefcb700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6f80b13d0 con 0x7fc6f8063090 2021-03-25T14:18:11.691 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.684+0000 7fc6fefcb700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6f80b7100 con 0x7fc6f8063510 2021-03-25T14:18:11.691 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.684+0000 7fc6fefcb700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6f80b73a0 con 0x7fc6f81493a0 2021-03-25T14:18:11.691 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.684+0000 7fc6f7fff700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fc6f8063090 0x7fc6f8149780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44234/0 (socket says 172.21.15.110:44234) 2021-03-25T14:18:11.691 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.684+0000 7fc6f7fff700 1 -- 172.21.15.110:0/1075005578 learned_addr learned my addr 172.21.15.110:0/1075005578 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:18:11.692 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.684+0000 7fc6f77fe700 1 -- 172.21.15.110:0/1075005578 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 321372398 0 0) 0x7fc6f80b13d0 con 0x7fc6f8063090 2021-03-25T14:18:11.692 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.684+0000 7fc6fcd67700 1 --2- 172.21.15.110:0/1075005578 >> v2:172.21.15.174:3300/0 conn(0x7fc6f81493a0 0x7fc6f80b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:11.692 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.684+0000 7fc6f77fe700 1 -- 172.21.15.110:0/1075005578 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6dc003270 con 0x7fc6f8063090 2021-03-25T14:18:11.692 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.684+0000 7fc6f77fe700 1 -- 172.21.15.110:0/1075005578 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3869981272 0 0) 0x7fc6dc003270 con 0x7fc6f8063090 2021-03-25T14:18:11.692 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.684+0000 7fc6f77fe700 1 -- 172.21.15.110:0/1075005578 >> v2:172.21.15.174:3300/0 conn(0x7fc6f81493a0 msgr2=0x7fc6f80b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:11.692 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.684+0000 7fc6f77fe700 1 --2- 172.21.15.110:0/1075005578 >> v2:172.21.15.174:3300/0 conn(0x7fc6f81493a0 0x7fc6f80b1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:11.692 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.684+0000 7fc6f77fe700 1 -- 172.21.15.110:0/1075005578 >> v1:172.21.15.174:6789/0 conn(0x7fc6f8063510 legacy=0x7fc6f8145c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:11.692 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.684+0000 7fc6f77fe700 1 -- 172.21.15.110:0/1075005578 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f80b1660 con 0x7fc6f8063090 2021-03-25T14:18:11.692 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.684+0000 7fc6f77fe700 1 -- 172.21.15.110:0/1075005578 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7fc6e4001520 con 0x7fc6f8063090 2021-03-25T14:18:11.692 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.685+0000 7fc6f77fe700 1 -- 172.21.15.110:0/1075005578 >> v1:172.21.15.110:6789/0 conn(0x7fc6f8063090 legacy=0x7fc6f8149780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:11.692 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.685+0000 7fc6f77fe700 1 --2- 172.21.15.110:0/1075005578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc6dc003760 0x7fc6dc003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:11.692 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.685+0000 7fc6f77fe700 1 --2- 172.21.15.110:0/1075005578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6dc004510 0x7fc6dc004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:11.693 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.685+0000 7fc6f77fe700 1 --2- 172.21.15.110:0/1075005578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6dc004e80 0x7fc6dc00c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:11.693 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.685+0000 7fc6f77fe700 1 -- 172.21.15.110:0/1075005578 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f80b73a0 con 0x7fc6dc004510 2021-03-25T14:18:11.693 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.685+0000 7fc6f77fe700 1 -- 172.21.15.110:0/1075005578 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6dc004290 con 0x7fc6dc004e80 2021-03-25T14:18:11.693 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.685+0000 7fc6f77fe700 1 -- 172.21.15.110:0/1075005578 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6dc00cd60 con 0x7fc6dc003760 2021-03-25T14:18:11.693 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.685+0000 7fc6f7fff700 1 --2- 172.21.15.110:0/1075005578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6dc004510 0x7fc6dc004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:11.693 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.685+0000 7fc6fd568700 1 --2- 172.21.15.110:0/1075005578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6dc004e80 0x7fc6dc00c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:11.693 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.685+0000 7fc6fcd67700 1 --2- 172.21.15.110:0/1075005578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc6dc003760 0x7fc6dc003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:11.693 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.685+0000 7fc6f7fff700 1 -- 172.21.15.110:0/1075005578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc6dc003760 msgr2=0x7fc6dc003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:11.693 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.685+0000 7fc6f7fff700 1 --2- 172.21.15.110:0/1075005578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc6dc003760 0x7fc6dc003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:11.693 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.685+0000 7fc6f7fff700 1 -- 172.21.15.110:0/1075005578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6dc004e80 msgr2=0x7fc6dc00c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:11.693 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.685+0000 7fc6f7fff700 1 --2- 172.21.15.110:0/1075005578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6dc004e80 0x7fc6dc00c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:11.693 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.685+0000 7fc6f7fff700 1 -- 172.21.15.110:0/1075005578 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6dc003270 con 0x7fc6dc004510 2021-03-25T14:18:11.693 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.685+0000 7fc6fd568700 1 -- 172.21.15.110:0/1075005578 reap_dead start 2021-03-25T14:18:11.694 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.685+0000 7fc6fcd67700 1 --2- 172.21.15.110:0/1075005578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc6dc003760 0x7fc6dc003b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:18:11.694 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.685+0000 7fc6f7fff700 1 --2- 172.21.15.110:0/1075005578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6dc004510 0x7fc6dc004990 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7fc6e4007ee0 tx=0x7fc6f80b7640).ready entity=mon.0 client_cookie=8e3716d6cc9efc92 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:11.694 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.685+0000 7fc6f77fe700 1 -- 172.21.15.110:0/1075005578 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e400ce10 con 0x7fc6dc004510 2021-03-25T14:18:11.694 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.685+0000 7fc6f77fe700 1 -- 172.21.15.110:0/1075005578 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e40072e0 con 0x7fc6dc004510 2021-03-25T14:18:11.694 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.685+0000 7fc6f77fe700 1 -- 172.21.15.110:0/1075005578 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e4005620 con 0x7fc6dc004510 2021-03-25T14:18:11.694 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.686+0000 7fc6fefcb700 1 -- 172.21.15.110:0/1075005578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6dc004510 msgr2=0x7fc6dc004990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:11.694 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.686+0000 7fc6fefcb700 1 --2- 172.21.15.110:0/1075005578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6dc004510 0x7fc6dc004990 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7fc6e4007ee0 tx=0x7fc6f80b7640).stop 2021-03-25T14:18:11.694 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.686+0000 7fc6fefcb700 1 -- 172.21.15.110:0/1075005578 shutdown_connections 2021-03-25T14:18:11.694 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.686+0000 7fc6fefcb700 1 --2- 172.21.15.110:0/1075005578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6dc004510 0x7fc6dc004990 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:11.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.686+0000 7fc6fefcb700 1 -- 172.21.15.110:0/1075005578 >> 172.21.15.110:0/1075005578 conn(0x7fc6f8061710 msgr2=0x7fc6f80bbac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:11.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.686+0000 7fc6fefcb700 1 -- 172.21.15.110:0/1075005578 shutdown_connections 2021-03-25T14:18:11.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.686+0000 7fc6fefcb700 1 -- 172.21.15.110:0/1075005578 wait complete. 2021-03-25T14:18:11.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.687+0000 7fc6fefcb700 1 Processor -- start 2021-03-25T14:18:11.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.687+0000 7fc6fefcb700 1 -- start start 2021-03-25T14:18:11.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.688+0000 7fc6fefcb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc6dc004510 0x7fc6f8144a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:11.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.688+0000 7fc6fefcb700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6f809f630 0x7fc6f8067420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:11.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.688+0000 7fc6fefcb700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6f809ea50 0x7fc6f8067910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:11.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.688+0000 7fc6fefcb700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f8142530 con 0x7fc6f809f630 2021-03-25T14:18:11.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.688+0000 7fc6fefcb700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f80682f0 con 0x7fc6f809ea50 2021-03-25T14:18:11.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.688+0000 7fc6fefcb700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f8068590 con 0x7fc6dc004510 2021-03-25T14:18:11.696 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.688+0000 7fc6f7fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6f809f630 0x7fc6f8067420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:11.696 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.688+0000 7fc6f7fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6f809f630 0x7fc6f8067420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51312/0 (socket says 172.21.15.110:51312) 2021-03-25T14:18:11.696 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.688+0000 7fc6f7fff700 1 -- 172.21.15.110:0/1320567753 learned_addr learned my addr 172.21.15.110:0/1320567753 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:11.696 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.688+0000 7fc6f7fff700 1 -- 172.21.15.110:0/1320567753 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc6dc004510 msgr2=0x7fc6f8144a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:11.696 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.688+0000 7fc6f7fff700 1 --2- 172.21.15.110:0/1320567753 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc6dc004510 0x7fc6f8144a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:18:11.696 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.688+0000 7fc6f7fff700 1 -- 172.21.15.110:0/1320567753 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6f809ea50 msgr2=0x7fc6f8067910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:11.696 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.688+0000 7fc6f7fff700 1 --2- 172.21.15.110:0/1320567753 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6f809ea50 0x7fc6f8067910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:18:11.696 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.688+0000 7fc6f7fff700 1 -- 172.21.15.110:0/1320567753 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f8068830 con 0x7fc6f809f630 2021-03-25T14:18:11.696 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.688+0000 7fc6f7fff700 1 --2- 172.21.15.110:0/1320567753 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6f809f630 0x7fc6f8067420 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7fc6e400cab0 tx=0x7fc6e4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:11.696 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.688+0000 7fc6f4ff9700 1 -- 172.21.15.110:0/1320567753 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e400cd40 con 0x7fc6f809f630 2021-03-25T14:18:11.696 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.688+0000 7fc6f4ff9700 1 -- 172.21.15.110:0/1320567753 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e400cea0 con 0x7fc6f809f630 2021-03-25T14:18:11.696 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.688+0000 7fc6fefcb700 1 -- 172.21.15.110:0/1320567753 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6f8066ce0 con 0x7fc6f809f630 2021-03-25T14:18:11.696 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.688+0000 7fc6f4ff9700 1 -- 172.21.15.110:0/1320567753 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e40116a0 con 0x7fc6f809f630 2021-03-25T14:18:11.697 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.688+0000 7fc6fefcb700 1 -- 172.21.15.110:0/1320567753 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6f8144f50 con 0x7fc6f809f630 2021-03-25T14:18:11.697 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.689+0000 7fc6fefcb700 1 -- 172.21.15.110:0/1320567753 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6f8067140 con 0x7fc6f809f630 2021-03-25T14:18:11.697 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.689+0000 7fc6f4ff9700 1 -- 172.21.15.110:0/1320567753 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fc6e4023020 con 0x7fc6f809f630 2021-03-25T14:18:11.697 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.690+0000 7fc6f4ff9700 1 --2- 172.21.15.110:0/1320567753 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc6d805a0b0 0x7fc6d805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:11.697 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.690+0000 7fc6f4ff9700 1 -- 172.21.15.110:0/1320567753 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6602+0+0 (secure 0 0 0) 0x7fc6e4077be0 con 0x7fc6f809f630 2021-03-25T14:18:11.697 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.690+0000 7fc6fcd67700 1 --2- 172.21.15.110:0/1320567753 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc6d805a0b0 0x7fc6d805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:11.697 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.690+0000 7fc6fcd67700 1 --2- 172.21.15.110:0/1320567753 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc6d805a0b0 0x7fc6d805c570 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7fc6ec006d30 tx=0x7fc6ec008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:11.697 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.693+0000 7fc6f4ff9700 1 -- 172.21.15.110:0/1320567753 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fc6e404b370 con 0x7fc6f809f630 2021-03-25T14:18:11.843 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:11.843+0000 7fc6fefcb700 1 -- 172.21.15.110:0/1320567753 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc6f805d7b0 con 0x7fc6f809f630 2021-03-25T14:18:12.022 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-03-25T14:18:12.024 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-03-25T14:18:12.509 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.508+0000 7fc6f4ff9700 1 -- 172.21.15.110:0/1320567753 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v65) v1 ==== 184+0+0 (secure 0 0 0) 0x7fc6f805d7b0 con 0x7fc6f809f630 2021-03-25T14:18:12.512 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.511+0000 7fc6fefcb700 1 -- 172.21.15.110:0/1320567753 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc6d805a0b0 msgr2=0x7fc6d805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:12.512 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.511+0000 7fc6fefcb700 1 --2- 172.21.15.110:0/1320567753 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc6d805a0b0 0x7fc6d805c570 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7fc6ec006d30 tx=0x7fc6ec008040).stop 2021-03-25T14:18:12.512 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.511+0000 7fc6fefcb700 1 -- 172.21.15.110:0/1320567753 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6f809f630 msgr2=0x7fc6f8067420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:12.512 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.511+0000 7fc6fefcb700 1 --2- 172.21.15.110:0/1320567753 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6f809f630 0x7fc6f8067420 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7fc6e400cab0 tx=0x7fc6e4015000).stop 2021-03-25T14:18:12.513 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.511+0000 7fc6fefcb700 1 -- 172.21.15.110:0/1320567753 shutdown_connections 2021-03-25T14:18:12.513 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.511+0000 7fc6fefcb700 1 --2- 172.21.15.110:0/1320567753 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc6d805a0b0 0x7fc6d805c570 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:12.513 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.511+0000 7fc6fefcb700 1 --2- 172.21.15.110:0/1320567753 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6f809ea50 0x7fc6f8067910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:18:12.513 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.511+0000 7fc6fefcb700 1 --2- 172.21.15.110:0/1320567753 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc6dc004510 0x7fc6f8144a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:18:12.513 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.511+0000 7fc6fefcb700 1 --2- 172.21.15.110:0/1320567753 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6f809f630 0x7fc6f8067420 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:12.513 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.511+0000 7fc6fefcb700 1 -- 172.21.15.110:0/1320567753 >> 172.21.15.110:0/1320567753 conn(0x7fc6f8061710 msgr2=0x7fc6f8146630 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:12.513 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.511+0000 7fc6fefcb700 1 -- 172.21.15.110:0/1320567753 shutdown_connections 2021-03-25T14:18:12.513 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.511+0000 7fc6fefcb700 1 -- 172.21.15.110:0/1320567753 wait complete. 2021-03-25T14:18:12.514 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs2_metadata' removed 2021-03-25T14:18:12.526 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2021-03-25T14:18:12.645 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.644+0000 7fafb9d07700 1 Processor -- start 2021-03-25T14:18:12.645 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.644+0000 7fafb9d07700 1 -- start start 2021-03-25T14:18:12.652 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.645+0000 7fafb9d07700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fafb4147010 0x7fafb40bc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:12.652 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.645+0000 7fafb9d07700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb4067d40 con 0x7fafb4067850 2021-03-25T14:18:12.653 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.645+0000 7fafb9d07700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb4146630 con 0x7fafb4068200 2021-03-25T14:18:12.653 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.645+0000 7fafb9d07700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb41468d0 con 0x7fafb4147010 2021-03-25T14:18:12.653 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.645+0000 7fafb3fff700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fafb4067850 0x7fafb41457c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44256/0 (socket says 172.21.15.110:44256) 2021-03-25T14:18:12.653 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.645+0000 7fafb3fff700 1 -- 172.21.15.110:0/647022220 learned_addr learned my addr 172.21.15.110:0/647022220 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:18:12.653 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.645+0000 7fafb9506700 1 --2- 172.21.15.110:0/647022220 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fafb4147010 0x7fafb40bc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:12.653 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.645+0000 7fafb37fe700 1 -- 172.21.15.110:0/647022220 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 404368142 0 0) 0x7fafb4067d40 con 0x7fafb4067850 2021-03-25T14:18:12.653 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.645+0000 7fafb37fe700 1 -- 172.21.15.110:0/647022220 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafa0003270 con 0x7fafb4067850 2021-03-25T14:18:12.653 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.646+0000 7fafb37fe700 1 -- 172.21.15.110:0/647022220 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 674903311 0 0) 0x7fafb4146630 con 0x7fafb4068200 2021-03-25T14:18:12.653 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.646+0000 7fafb37fe700 1 -- 172.21.15.110:0/647022220 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafb4067d40 con 0x7fafb4068200 2021-03-25T14:18:12.653 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.646+0000 7fafb37fe700 1 -- 172.21.15.110:0/647022220 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3673022381 0 0) 0x7fafa0003270 con 0x7fafb4067850 2021-03-25T14:18:12.653 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.646+0000 7fafb37fe700 1 -- 172.21.15.110:0/647022220 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fafb4147010 msgr2=0x7fafb40bc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:12.653 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.646+0000 7fafb37fe700 1 --2- 172.21.15.110:0/647022220 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fafb4147010 0x7fafb40bc3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:12.653 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.646+0000 7fafb37fe700 1 -- 172.21.15.110:0/647022220 >> v1:172.21.15.174:6789/0 conn(0x7fafb4068200 legacy=0x7fafb40b73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:12.654 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.646+0000 7fafb37fe700 1 -- 172.21.15.110:0/647022220 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb4146b70 con 0x7fafb4067850 2021-03-25T14:18:12.654 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.646+0000 7fafb37fe700 1 -- 172.21.15.110:0/647022220 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7fafa8001520 con 0x7fafb4067850 2021-03-25T14:18:12.654 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.646+0000 7fafb37fe700 1 -- 172.21.15.110:0/647022220 >> v1:172.21.15.110:6789/0 conn(0x7fafb4067850 legacy=0x7fafb41457c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:12.654 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.646+0000 7fafb37fe700 1 --2- 172.21.15.110:0/647022220 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fafb4147010 0x7fafa0003920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:12.654 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.646+0000 7fafb37fe700 1 --2- 172.21.15.110:0/647022220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafa0003e10 0x7fafa0004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:12.654 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.646+0000 7fafb37fe700 1 --2- 172.21.15.110:0/647022220 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafa0004a00 0x7fafa0004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:12.654 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.646+0000 7fafb37fe700 1 -- 172.21.15.110:0/647022220 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb41468d0 con 0x7fafa0003e10 2021-03-25T14:18:12.654 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.646+0000 7fafb37fe700 1 -- 172.21.15.110:0/647022220 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa00053a0 con 0x7fafa0004a00 2021-03-25T14:18:12.654 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.646+0000 7fafb37fe700 1 -- 172.21.15.110:0/647022220 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa000b7b0 con 0x7fafb4147010 2021-03-25T14:18:12.654 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.646+0000 7fafb3fff700 1 --2- 172.21.15.110:0/647022220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafa0003e10 0x7fafa0004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:12.654 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.646+0000 7fafb9506700 1 --2- 172.21.15.110:0/647022220 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafa0004a00 0x7fafa0004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:12.655 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.646+0000 7fafb8d05700 1 --2- 172.21.15.110:0/647022220 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fafb4147010 0x7fafa0003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:12.655 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.646+0000 7fafb3fff700 1 -- 172.21.15.110:0/647022220 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fafb4147010 msgr2=0x7fafa0003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:12.655 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.646+0000 7fafb3fff700 1 --2- 172.21.15.110:0/647022220 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fafb4147010 0x7fafa0003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:12.655 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.646+0000 7fafb3fff700 1 -- 172.21.15.110:0/647022220 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafa0004a00 msgr2=0x7fafa0004e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:12.655 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.646+0000 7fafb3fff700 1 --2- 172.21.15.110:0/647022220 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafa0004a00 0x7fafa0004e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:12.655 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.646+0000 7fafb3fff700 1 -- 172.21.15.110:0/647022220 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa0003270 con 0x7fafa0003e10 2021-03-25T14:18:12.655 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.646+0000 7fafb3fff700 1 --2- 172.21.15.110:0/647022220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafa0003e10 0x7fafa0004510 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7fafa800c420 tx=0x7fafa80077b0).ready entity=mon.0 client_cookie=97f7fdf754a77778 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:12.655 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.646+0000 7fafb37fe700 1 -- 172.21.15.110:0/647022220 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa800ce70 con 0x7fafa0003e10 2021-03-25T14:18:12.655 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.646+0000 7fafb37fe700 1 -- 172.21.15.110:0/647022220 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa80070d0 con 0x7fafa0003e10 2021-03-25T14:18:12.655 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.646+0000 7fafb37fe700 1 -- 172.21.15.110:0/647022220 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa8007470 con 0x7fafa0003e10 2021-03-25T14:18:12.655 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.647+0000 7fafb9d07700 1 -- 172.21.15.110:0/647022220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafa0003e10 msgr2=0x7fafa0004510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:12.655 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.647+0000 7fafb9d07700 1 --2- 172.21.15.110:0/647022220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafa0003e10 0x7fafa0004510 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7fafa800c420 tx=0x7fafa80077b0).stop 2021-03-25T14:18:12.655 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.647+0000 7fafb9506700 1 -- 172.21.15.110:0/647022220 reap_dead start 2021-03-25T14:18:12.656 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.647+0000 7fafb9d07700 1 -- 172.21.15.110:0/647022220 shutdown_connections 2021-03-25T14:18:12.656 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.647+0000 7fafb9d07700 1 -- 172.21.15.110:0/647022220 >> 172.21.15.110:0/647022220 conn(0x7fafb4066370 msgr2=0x7fafb4066780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:12.656 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.647+0000 7fafb9d07700 1 -- 172.21.15.110:0/647022220 shutdown_connections 2021-03-25T14:18:12.656 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.647+0000 7fafb9d07700 1 -- 172.21.15.110:0/647022220 wait complete. 2021-03-25T14:18:12.656 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.648+0000 7fafb9d07700 1 Processor -- start 2021-03-25T14:18:12.656 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.648+0000 7fafb9d07700 1 -- start start 2021-03-25T14:18:12.656 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.649+0000 7fafb9d07700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fafb413ddc0 0x7fafb413e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:12.656 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.649+0000 7fafb9d07700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafb4158c60 0x7fafb40b1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:12.656 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.649+0000 7fafb9d07700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafb40b1830 0x7fafb415c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:12.657 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.649+0000 7fafb9d07700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb41484b0 con 0x7fafb40b1830 2021-03-25T14:18:12.657 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.649+0000 7fafb9d07700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb4147cd0 con 0x7fafb4158c60 2021-03-25T14:18:12.657 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.649+0000 7fafb9d07700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb4147f70 con 0x7fafb413ddc0 2021-03-25T14:18:12.657 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.649+0000 7fafb9506700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafb40b1830 0x7fafb415c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:12.657 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.649+0000 7fafb9506700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafb40b1830 0x7fafb415c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51334/0 (socket says 172.21.15.110:51334) 2021-03-25T14:18:12.657 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.649+0000 7fafb9506700 1 -- 172.21.15.110:0/3219582710 learned_addr learned my addr 172.21.15.110:0/3219582710 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:12.657 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.649+0000 7fafb8d05700 1 --2- 172.21.15.110:0/3219582710 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fafb413ddc0 0x7fafb413e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:12.657 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.649+0000 7fafb3fff700 1 --2- 172.21.15.110:0/3219582710 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafb4158c60 0x7fafb40b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:12.657 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.649+0000 7fafb9506700 1 -- 172.21.15.110:0/3219582710 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fafb413ddc0 msgr2=0x7fafb413e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:12.658 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.649+0000 7fafb9506700 1 --2- 172.21.15.110:0/3219582710 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fafb413ddc0 0x7fafb413e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:12.658 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.649+0000 7fafb9506700 1 -- 172.21.15.110:0/3219582710 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafb4158c60 msgr2=0x7fafb40b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:12.658 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.649+0000 7fafb9506700 1 --2- 172.21.15.110:0/3219582710 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafb4158c60 0x7fafb40b1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:12.658 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.649+0000 7fafb9506700 1 -- 172.21.15.110:0/3219582710 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb4148210 con 0x7fafb40b1830 2021-03-25T14:18:12.658 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.649+0000 7fafb9506700 1 --2- 172.21.15.110:0/3219582710 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafb40b1830 0x7fafb415c7e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7fafb4069a30 tx=0x7fafac009220).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:12.658 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.649+0000 7fafb0ff9700 1 -- 172.21.15.110:0/3219582710 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac00f910 con 0x7fafb40b1830 2021-03-25T14:18:12.658 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.649+0000 7fafb0ff9700 1 -- 172.21.15.110:0/3219582710 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafac00fa70 con 0x7fafb40b1830 2021-03-25T14:18:12.659 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.649+0000 7fafb9d07700 1 -- 172.21.15.110:0/3219582710 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb415c340 con 0x7fafb40b1830 2021-03-25T14:18:12.659 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.649+0000 7fafb0ff9700 1 -- 172.21.15.110:0/3219582710 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac00fe10 con 0x7fafb40b1830 2021-03-25T14:18:12.659 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.649+0000 7fafb9d07700 1 -- 172.21.15.110:0/3219582710 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb40bb770 con 0x7fafb40b1830 2021-03-25T14:18:12.659 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.650+0000 7fafb9d07700 1 -- 172.21.15.110:0/3219582710 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafb415c4d0 con 0x7fafb40b1830 2021-03-25T14:18:12.659 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.651+0000 7fafb0ff9700 1 -- 172.21.15.110:0/3219582710 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fafac014650 con 0x7fafb40b1830 2021-03-25T14:18:12.659 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.651+0000 7fafb0ff9700 1 --2- 172.21.15.110:0/3219582710 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7faf9405a0e0 0x7faf9405c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:12.659 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.651+0000 7fafb0ff9700 1 -- 172.21.15.110:0/3219582710 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6162+0+0 (secure 0 0 0) 0x7fafac074960 con 0x7fafb40b1830 2021-03-25T14:18:12.659 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.651+0000 7fafb8d05700 1 --2- 172.21.15.110:0/3219582710 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7faf9405a0e0 0x7faf9405c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:12.659 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.651+0000 7fafb8d05700 1 --2- 172.21.15.110:0/3219582710 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7faf9405a0e0 0x7faf9405c5a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7fafa4003ae0 tx=0x7fafa4007bc0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:12.660 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.655+0000 7fafb0ff9700 1 -- 172.21.15.110:0/3219582710 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fafac0482a0 con 0x7fafb40b1830 2021-03-25T14:18:12.806 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:12.805+0000 7fafb9d07700 1 -- 172.21.15.110:0/3219582710 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fafb4045ae0 con 0x7fafb40b1830 2021-03-25T14:18:13.513 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.512+0000 7fafb0ff9700 1 -- 172.21.15.110:0/3219582710 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v66) v1 ==== 172+0+0 (secure 0 0 0) 0x7fafac04b8c0 con 0x7fafb40b1830 2021-03-25T14:18:13.517 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.515+0000 7fafb9d07700 1 -- 172.21.15.110:0/3219582710 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7faf9405a0e0 msgr2=0x7faf9405c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:13.517 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.515+0000 7fafb9d07700 1 --2- 172.21.15.110:0/3219582710 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7faf9405a0e0 0x7faf9405c5a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7fafa4003ae0 tx=0x7fafa4007bc0).stop 2021-03-25T14:18:13.517 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.515+0000 7fafb9d07700 1 -- 172.21.15.110:0/3219582710 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafb40b1830 msgr2=0x7fafb415c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:13.517 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.515+0000 7fafb9d07700 1 --2- 172.21.15.110:0/3219582710 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafb40b1830 0x7fafb415c7e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7fafb4069a30 tx=0x7fafac009220).stop 2021-03-25T14:18:13.517 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.515+0000 7fafb9d07700 1 -- 172.21.15.110:0/3219582710 shutdown_connections 2021-03-25T14:18:13.517 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.515+0000 7fafb9d07700 1 --2- 172.21.15.110:0/3219582710 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7faf9405a0e0 0x7faf9405c5a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:13.517 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.515+0000 7fafb9d07700 1 --2- 172.21.15.110:0/3219582710 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafb40b1830 0x7fafb415c7e0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:13.517 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.515+0000 7fafb9d07700 1 --2- 172.21.15.110:0/3219582710 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fafb413ddc0 0x7fafb413e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:13.517 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.515+0000 7fafb9d07700 1 --2- 172.21.15.110:0/3219582710 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafb4158c60 0x7fafb40b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:13.517 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.515+0000 7fafb9d07700 1 -- 172.21.15.110:0/3219582710 >> 172.21.15.110:0/3219582710 conn(0x7fafb4066370 msgr2=0x7fafb4140eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:13.518 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.515+0000 7fafb9d07700 1 -- 172.21.15.110:0/3219582710 shutdown_connections 2021-03-25T14:18:13.518 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.515+0000 7fafb9d07700 1 -- 172.21.15.110:0/3219582710 wait complete. 2021-03-25T14:18:13.518 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs2_data' removed 2021-03-25T14:18:13.530 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-03-25T14:18:13.645 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.644+0000 7f7ff4e97700 1 Processor -- start 2021-03-25T14:18:13.646 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.645+0000 7f7ff4e97700 1 -- start start 2021-03-25T14:18:13.648 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.645+0000 7f7ff4e97700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7ff00bc570 0x7f7ff0149b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:13.648 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.645+0000 7f7ff4e97700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ff00b6630 con 0x7f7ff01433c0 2021-03-25T14:18:13.649 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.645+0000 7f7ff4e97700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ff00b68d0 con 0x7f7ff0142fe0 2021-03-25T14:18:13.649 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.645+0000 7f7ff4e97700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ff00b9320 con 0x7f7ff00bc570 2021-03-25T14:18:13.649 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.645+0000 7f7feffff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7ff00bc570 0x7f7ff0149b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:13.649 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.645+0000 7f7feffff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7ff00bc570 0x7f7ff0149b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51342/0 (socket says 172.21.15.110:51342) 2021-03-25T14:18:13.649 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.645+0000 7f7feffff700 1 -- 172.21.15.110:0/1783132054 learned_addr learned my addr 172.21.15.110:0/1783132054 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:13.649 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.646+0000 7f7feffff700 1 -- 172.21.15.110:0/1783132054 >> v1:172.21.15.174:6789/0 conn(0x7f7ff0142fe0 legacy=0x7f7ff00b7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:13.649 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.646+0000 7f7feffff700 1 -- 172.21.15.110:0/1783132054 >> v1:172.21.15.110:6789/0 conn(0x7f7ff01433c0 legacy=0x7f7ff00673e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:13.650 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.646+0000 7f7feffff700 1 -- 172.21.15.110:0/1783132054 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff00b6b70 con 0x7f7ff00bc570 2021-03-25T14:18:13.650 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.646+0000 7f7fee7fc700 1 -- 172.21.15.110:0/1783132054 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1944431058 0 0) 0x7f7ff00b6630 con 0x7f7ff01433c0 2021-03-25T14:18:13.650 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.646+0000 7f7feffff700 1 --2- 172.21.15.110:0/1783132054 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ff00bc570 0x7f7ff0149b30 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f7fe8009d90 tx=0x7f7fe80092d0).ready entity=mon.0 client_cookie=f942fd2cd4ef07d3 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:13.650 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.646+0000 7f7fee7fc700 1 -- 172.21.15.110:0/1783132054 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe800bbb0 con 0x7f7ff00bc570 2021-03-25T14:18:13.650 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.646+0000 7f7fee7fc700 1 -- 172.21.15.110:0/1783132054 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe800bd10 con 0x7f7ff00bc570 2021-03-25T14:18:13.650 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.646+0000 7f7fee7fc700 1 -- 172.21.15.110:0/1783132054 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe8011610 con 0x7f7ff00bc570 2021-03-25T14:18:13.651 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.646+0000 7f7ff4e97700 1 -- 172.21.15.110:0/1783132054 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ff00bc570 msgr2=0x7f7ff0149b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:13.651 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.646+0000 7f7ff4e97700 1 --2- 172.21.15.110:0/1783132054 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ff00bc570 0x7f7ff0149b30 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f7fe8009d90 tx=0x7f7fe80092d0).stop 2021-03-25T14:18:13.651 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.646+0000 7f7ff4e97700 1 -- 172.21.15.110:0/1783132054 shutdown_connections 2021-03-25T14:18:13.651 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.646+0000 7f7ff4e97700 1 --2- 172.21.15.110:0/1783132054 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ff00bc570 0x7f7ff0149b30 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:13.651 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.646+0000 7f7ff4e97700 1 -- 172.21.15.110:0/1783132054 >> 172.21.15.110:0/1783132054 conn(0x7f7ff005c700 msgr2=0x7f7ff00664d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:13.651 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.647+0000 7f7ff4e97700 1 -- 172.21.15.110:0/1783132054 shutdown_connections 2021-03-25T14:18:13.651 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.647+0000 7f7ff4e97700 1 -- 172.21.15.110:0/1783132054 wait complete. 2021-03-25T14:18:13.651 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.648+0000 7f7ff4e97700 1 Processor -- start 2021-03-25T14:18:13.651 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.648+0000 7f7ff4e97700 1 -- start start 2021-03-25T14:18:13.654 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.648+0000 7f7ff4e97700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ff00bc570 0x7f7ff00a0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:13.654 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.648+0000 7f7ff4e97700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ff0142fe0 0x7f7ff00a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:13.655 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.648+0000 7f7ff4e97700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ff01433c0 0x7f7ff0157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:13.655 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.648+0000 7f7ff4e97700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff00a0470 con 0x7f7ff00bc570 2021-03-25T14:18:13.655 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.648+0000 7f7ff4e97700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff00b0f90 con 0x7f7ff0142fe0 2021-03-25T14:18:13.655 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.648+0000 7f7ff4e97700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff00b1230 con 0x7f7ff01433c0 2021-03-25T14:18:13.655 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.648+0000 7f7fef7fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ff00bc570 0x7f7ff00a0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:13.655 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.648+0000 7f7fef7fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ff00bc570 0x7f7ff00a0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51344/0 (socket says 172.21.15.110:51344) 2021-03-25T14:18:13.655 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.648+0000 7f7fef7fe700 1 -- 172.21.15.110:0/3581467455 learned_addr learned my addr 172.21.15.110:0/3581467455 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:13.655 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.649+0000 7f7feeffd700 1 --2- 172.21.15.110:0/3581467455 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ff0142fe0 0x7f7ff00a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:13.655 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.649+0000 7f7feffff700 1 --2- 172.21.15.110:0/3581467455 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ff01433c0 0x7f7ff0157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:13.656 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.649+0000 7f7fef7fe700 1 -- 172.21.15.110:0/3581467455 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ff01433c0 msgr2=0x7f7ff0157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:13.656 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.649+0000 7f7fef7fe700 1 --2- 172.21.15.110:0/3581467455 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ff01433c0 0x7f7ff0157ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:13.656 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.649+0000 7f7fef7fe700 1 -- 172.21.15.110:0/3581467455 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ff0142fe0 msgr2=0x7f7ff00a1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:13.656 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.649+0000 7f7fef7fe700 1 --2- 172.21.15.110:0/3581467455 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ff0142fe0 0x7f7ff00a1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:13.656 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.649+0000 7f7fef7fe700 1 -- 172.21.15.110:0/3581467455 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff00b14d0 con 0x7f7ff00bc570 2021-03-25T14:18:13.656 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.649+0000 7f7fef7fe700 1 --2- 172.21.15.110:0/3581467455 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ff00bc570 0x7f7ff00a0c40 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f7fe0009760 tx=0x7f7fe0006e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:13.656 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.649+0000 7f7fd77fe700 1 -- 172.21.15.110:0/3581467455 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe000d4a0 con 0x7f7ff00bc570 2021-03-25T14:18:13.656 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.649+0000 7f7fd77fe700 1 -- 172.21.15.110:0/3581467455 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe000d620 con 0x7f7ff00bc570 2021-03-25T14:18:13.657 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.649+0000 7f7ff4e97700 1 -- 172.21.15.110:0/3581467455 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ff00a1130 con 0x7f7ff00bc570 2021-03-25T14:18:13.657 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.649+0000 7f7fd77fe700 1 -- 172.21.15.110:0/3581467455 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe000d9e0 con 0x7f7ff00bc570 2021-03-25T14:18:13.657 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.649+0000 7f7ff4e97700 1 -- 172.21.15.110:0/3581467455 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ff00b1970 con 0x7f7ff00bc570 2021-03-25T14:18:13.657 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.650+0000 7f7ff4e97700 1 -- 172.21.15.110:0/3581467455 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ff00b1660 con 0x7f7ff00bc570 2021-03-25T14:18:13.657 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.650+0000 7f7fd77fe700 1 -- 172.21.15.110:0/3581467455 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f7fe001b030 con 0x7f7ff00bc570 2021-03-25T14:18:13.657 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.650+0000 7f7fd77fe700 1 --2- 172.21.15.110:0/3581467455 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f7fd005a0b0 0x7f7fd005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:13.657 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.651+0000 7f7fd77fe700 1 -- 172.21.15.110:0/3581467455 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5778+0+0 (secure 0 0 0) 0x7f7fe0073970 con 0x7f7ff00bc570 2021-03-25T14:18:13.657 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.651+0000 7f7feeffd700 1 --2- 172.21.15.110:0/3581467455 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f7fd005a0b0 0x7f7fd005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:13.657 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.651+0000 7f7feeffd700 1 --2- 172.21.15.110:0/3581467455 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f7fd005a0b0 0x7f7fd005c570 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f7ff00b7bf0 tx=0x7f7fe4007a30).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:13.658 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.654+0000 7f7fd77fe700 1 -- 172.21.15.110:0/3581467455 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f7fe0047430 con 0x7f7ff00bc570 2021-03-25T14:18:13.811 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.810+0000 7f7ff4e97700 1 -- 172.21.15.110:0/3581467455 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f7ff0146ea0 con 0x7f7ff00bc570 2021-03-25T14:18:13.813 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.813+0000 7f7fd77fe700 1 -- 172.21.15.110:0/3581467455 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7fe004aa50 con 0x7f7ff00bc570 2021-03-25T14:18:13.816 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.815+0000 7f7ff4e97700 1 -- 172.21.15.110:0/3581467455 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f7fd005a0b0 msgr2=0x7f7fd005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:13.817 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.815+0000 7f7ff4e97700 1 --2- 172.21.15.110:0/3581467455 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f7fd005a0b0 0x7f7fd005c570 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f7ff00b7bf0 tx=0x7f7fe4007a30).stop 2021-03-25T14:18:13.817 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.815+0000 7f7ff4e97700 1 -- 172.21.15.110:0/3581467455 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ff00bc570 msgr2=0x7f7ff00a0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:13.817 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.815+0000 7f7ff4e97700 1 --2- 172.21.15.110:0/3581467455 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ff00bc570 0x7f7ff00a0c40 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f7fe0009760 tx=0x7f7fe0006e20).stop 2021-03-25T14:18:13.817 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.815+0000 7f7ff4e97700 1 -- 172.21.15.110:0/3581467455 shutdown_connections 2021-03-25T14:18:13.817 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.815+0000 7f7ff4e97700 1 --2- 172.21.15.110:0/3581467455 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f7fd005a0b0 0x7f7fd005c570 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:13.817 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.815+0000 7f7ff4e97700 1 --2- 172.21.15.110:0/3581467455 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ff01433c0 0x7f7ff0157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:13.817 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.815+0000 7f7ff4e97700 1 --2- 172.21.15.110:0/3581467455 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ff00bc570 0x7f7ff00a0c40 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:13.817 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.815+0000 7f7ff4e97700 1 --2- 172.21.15.110:0/3581467455 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ff0142fe0 0x7f7ff00a1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:13.817 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.815+0000 7f7ff4e97700 1 -- 172.21.15.110:0/3581467455 >> 172.21.15.110:0/3581467455 conn(0x7f7ff005c700 msgr2=0x7f7ff01496a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:13.817 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.815+0000 7f7ff4e97700 1 -- 172.21.15.110:0/3581467455 shutdown_connections 2021-03-25T14:18:13.817 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.815+0000 7f7ff4e97700 1 -- 172.21.15.110:0/3581467455 wait complete. 2021-03-25T14:18:13.828 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent' 2021-03-25T14:18:13.940 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.939+0000 7f7a22991700 1 Processor -- start 2021-03-25T14:18:13.940 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.939+0000 7f7a22991700 1 -- start start 2021-03-25T14:18:13.945 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.939+0000 7f7a22991700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a1c0bc220 0x7f7a1c0b1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:13.945 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.939+0000 7f7a22991700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a1c0bafc0 con 0x7f7a1c148970 2021-03-25T14:18:13.945 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.939+0000 7f7a22991700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a1c0baa80 con 0x7f7a1c0675d0 2021-03-25T14:18:13.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.940+0000 7f7a22991700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c149510 con 0x7f7a1c0bc220 2021-03-25T14:18:13.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.940+0000 7f7a20f2e700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f7a1c148970 0x7f7a1c148e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44290/0 (socket says 172.21.15.110:44290) 2021-03-25T14:18:13.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.940+0000 7f7a20f2e700 1 -- 172.21.15.110:0/2271423408 learned_addr learned my addr 172.21.15.110:0/2271423408 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:18:13.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.940+0000 7f7a1affd700 1 -- 172.21.15.110:0/2271423408 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 802150751 0 0) 0x7f7a1c0bafc0 con 0x7f7a1c148970 2021-03-25T14:18:13.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.940+0000 7f7a1b7fe700 1 --2- 172.21.15.110:0/2271423408 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a1c0bc220 0x7f7a1c0b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:13.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.940+0000 7f7a1affd700 1 -- 172.21.15.110:0/2271423408 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a08003270 con 0x7f7a1c148970 2021-03-25T14:18:13.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.940+0000 7f7a1affd700 1 -- 172.21.15.110:0/2271423408 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1748638089 0 0) 0x7f7a08003270 con 0x7f7a1c148970 2021-03-25T14:18:13.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.940+0000 7f7a1affd700 1 -- 172.21.15.110:0/2271423408 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a1c0bc220 msgr2=0x7f7a1c0b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:13.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.940+0000 7f7a1affd700 1 --2- 172.21.15.110:0/2271423408 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a1c0bc220 0x7f7a1c0b1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:13.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.940+0000 7f7a1affd700 1 -- 172.21.15.110:0/2271423408 >> v1:172.21.15.174:6789/0 conn(0x7f7a1c0675d0 legacy=0x7f7a1c14cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:13.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.940+0000 7f7a1affd700 1 -- 172.21.15.110:0/2271423408 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1c0bad20 con 0x7f7a1c148970 2021-03-25T14:18:13.946 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.940+0000 7f7a1affd700 1 -- 172.21.15.110:0/2271423408 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f7a140018a0 con 0x7f7a1c148970 2021-03-25T14:18:13.947 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.940+0000 7f7a1affd700 1 -- 172.21.15.110:0/2271423408 >> v1:172.21.15.110:6789/0 conn(0x7f7a1c148970 legacy=0x7f7a1c148e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:13.947 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.940+0000 7f7a1affd700 1 --2- 172.21.15.110:0/2271423408 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a1c0bc220 0x7f7a08003790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:13.947 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.940+0000 7f7a1affd700 1 --2- 172.21.15.110:0/2271423408 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a08003ca0 0x7f7a08004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:13.947 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.940+0000 7f7a1affd700 1 --2- 172.21.15.110:0/2271423408 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a08004a00 0x7f7a08004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:13.947 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.940+0000 7f7a1affd700 1 -- 172.21.15.110:0/2271423408 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c149510 con 0x7f7a08004a00 2021-03-25T14:18:13.947 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.940+0000 7f7a1affd700 1 -- 172.21.15.110:0/2271423408 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a08004230 con 0x7f7a08003ca0 2021-03-25T14:18:13.947 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.940+0000 7f7a1affd700 1 -- 172.21.15.110:0/2271423408 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0800b760 con 0x7f7a1c0bc220 2021-03-25T14:18:13.947 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.940+0000 7f7a20f2e700 1 --2- 172.21.15.110:0/2271423408 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a08004a00 0x7f7a08004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:13.947 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.940+0000 7f7a1b7fe700 1 --2- 172.21.15.110:0/2271423408 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a08003ca0 0x7f7a08004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:13.947 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.940+0000 7f7a1bfff700 1 --2- 172.21.15.110:0/2271423408 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a1c0bc220 0x7f7a08003790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:13.947 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.941+0000 7f7a20f2e700 1 -- 172.21.15.110:0/2271423408 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a1c0bc220 msgr2=0x7f7a08003790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:13.947 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.941+0000 7f7a20f2e700 1 --2- 172.21.15.110:0/2271423408 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a1c0bc220 0x7f7a08003790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:13.948 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.941+0000 7f7a20f2e700 1 -- 172.21.15.110:0/2271423408 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a08003ca0 msgr2=0x7f7a08004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:13.948 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.941+0000 7f7a20f2e700 1 --2- 172.21.15.110:0/2271423408 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a08003ca0 0x7f7a08004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:13.948 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.941+0000 7f7a20f2e700 1 -- 172.21.15.110:0/2271423408 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a08003270 con 0x7f7a08004a00 2021-03-25T14:18:13.948 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.941+0000 7f7a20f2e700 1 --2- 172.21.15.110:0/2271423408 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a08004a00 0x7f7a08004e80 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f7a1400c840 tx=0x7f7a1c0690a0).ready entity=mon.0 client_cookie=2530184fdc585eec server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:13.948 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.941+0000 7f7a1affd700 1 -- 172.21.15.110:0/2271423408 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a14005bb0 con 0x7f7a08004a00 2021-03-25T14:18:13.948 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.941+0000 7f7a1affd700 1 -- 172.21.15.110:0/2271423408 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a14005d10 con 0x7f7a08004a00 2021-03-25T14:18:13.948 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.941+0000 7f7a1affd700 1 -- 172.21.15.110:0/2271423408 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a140072e0 con 0x7f7a08004a00 2021-03-25T14:18:13.948 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.941+0000 7f7a22991700 1 -- 172.21.15.110:0/2271423408 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a08004a00 msgr2=0x7f7a08004e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:13.948 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.941+0000 7f7a22991700 1 --2- 172.21.15.110:0/2271423408 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a08004a00 0x7f7a08004e80 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f7a1400c840 tx=0x7f7a1c0690a0).stop 2021-03-25T14:18:13.948 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.941+0000 7f7a20f2e700 1 -- 172.21.15.110:0/2271423408 reap_dead start 2021-03-25T14:18:13.948 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.941+0000 7f7a22991700 1 -- 172.21.15.110:0/2271423408 shutdown_connections 2021-03-25T14:18:13.948 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.941+0000 7f7a22991700 1 -- 172.21.15.110:0/2271423408 >> 172.21.15.110:0/2271423408 conn(0x7f7a1c064a10 msgr2=0x7f7a1c05c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:13.949 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.941+0000 7f7a22991700 1 -- 172.21.15.110:0/2271423408 shutdown_connections 2021-03-25T14:18:13.949 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.941+0000 7f7a22991700 1 -- 172.21.15.110:0/2271423408 wait complete. 2021-03-25T14:18:13.949 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.942+0000 7f7a22991700 1 Processor -- start 2021-03-25T14:18:13.949 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.943+0000 7f7a22991700 1 -- start start 2021-03-25T14:18:13.949 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.943+0000 7f7a22991700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a1c14f100 0x7f7a1c0b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:13.949 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.943+0000 7f7a22991700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a1c0b44a0 0x7f7a1c14f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:13.949 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.943+0000 7f7a22991700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a1c14c420 0x7f7a1c158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:13.949 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.943+0000 7f7a22991700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c0b4a20 con 0x7f7a1c14f100 2021-03-25T14:18:13.949 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.943+0000 7f7a22991700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c0b4cc0 con 0x7f7a1c0b44a0 2021-03-25T14:18:13.949 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.943+0000 7f7a22991700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c0b1b80 con 0x7f7a1c14c420 2021-03-25T14:18:13.949 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.943+0000 7f7a1bfff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a1c14f100 0x7f7a1c0b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:13.949 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.943+0000 7f7a1bfff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a1c14f100 0x7f7a1c0b22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51362/0 (socket says 172.21.15.110:51362) 2021-03-25T14:18:13.949 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.943+0000 7f7a1bfff700 1 -- 172.21.15.110:0/3718414903 learned_addr learned my addr 172.21.15.110:0/3718414903 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:13.950 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.943+0000 7f7a20f2e700 1 --2- 172.21.15.110:0/3718414903 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a1c14c420 0x7f7a1c158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:13.950 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.944+0000 7f7a1b7fe700 1 --2- 172.21.15.110:0/3718414903 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a1c0b44a0 0x7f7a1c14f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:13.950 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.944+0000 7f7a1bfff700 1 -- 172.21.15.110:0/3718414903 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a1c14c420 msgr2=0x7f7a1c158be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:13.950 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.944+0000 7f7a1bfff700 1 --2- 172.21.15.110:0/3718414903 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a1c14c420 0x7f7a1c158be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:13.950 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.944+0000 7f7a1bfff700 1 -- 172.21.15.110:0/3718414903 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a1c0b44a0 msgr2=0x7f7a1c14f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:13.950 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.944+0000 7f7a1bfff700 1 --2- 172.21.15.110:0/3718414903 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a1c0b44a0 0x7f7a1c14f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:13.950 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.944+0000 7f7a1bfff700 1 -- 172.21.15.110:0/3718414903 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1c0b1e20 con 0x7f7a1c14f100 2021-03-25T14:18:13.950 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.944+0000 7f7a1bfff700 1 --2- 172.21.15.110:0/3718414903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a1c14f100 0x7f7a1c0b22c0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f7a10002b90 tx=0x7f7a10007bc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:13.950 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.944+0000 7f7a03fff700 1 -- 172.21.15.110:0/3718414903 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a10003d50 con 0x7f7a1c14f100 2021-03-25T14:18:13.950 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.944+0000 7f7a03fff700 1 -- 172.21.15.110:0/3718414903 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1000f8d0 con 0x7f7a1c14f100 2021-03-25T14:18:13.950 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.944+0000 7f7a22991700 1 -- 172.21.15.110:0/3718414903 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a1c0b4f60 con 0x7f7a1c14f100 2021-03-25T14:18:13.950 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.944+0000 7f7a03fff700 1 -- 172.21.15.110:0/3718414903 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1000fc50 con 0x7f7a1c14f100 2021-03-25T14:18:13.951 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.944+0000 7f7a22991700 1 -- 172.21.15.110:0/3718414903 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a1c1590d0 con 0x7f7a1c14f100 2021-03-25T14:18:13.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.945+0000 7f7a22991700 1 -- 172.21.15.110:0/3718414903 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a1c068850 con 0x7f7a1c14f100 2021-03-25T14:18:13.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.945+0000 7f7a03fff700 1 -- 172.21.15.110:0/3718414903 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f7a1001b030 con 0x7f7a1c14f100 2021-03-25T14:18:13.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.945+0000 7f7a03fff700 1 --2- 172.21.15.110:0/3718414903 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f79fc05a0b0 0x7f79fc05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:13.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.945+0000 7f7a03fff700 1 -- 172.21.15.110:0/3718414903 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5778+0+0 (secure 0 0 0) 0x7f7a100737c0 con 0x7f7a1c14f100 2021-03-25T14:18:13.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.945+0000 7f7a1b7fe700 1 --2- 172.21.15.110:0/3718414903 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f79fc05a0b0 0x7f79fc05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:13.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.946+0000 7f7a1b7fe700 1 --2- 172.21.15.110:0/3718414903 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f79fc05a0b0 0x7f79fc05c570 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f7a0c006ac0 tx=0x7f7a0c006e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:13.952 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:13.949+0000 7f7a03fff700 1 -- 172.21.15.110:0/3718414903 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f7a10047330 con 0x7f7a1c14f100 2021-03-25T14:18:14.156 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.155+0000 7f7a22991700 1 -- 172.21.15.110:0/3718414903 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]} v 0) v1 -- 0x7f7a1c05d7b0 con 0x7f7a1c14f100 2021-03-25T14:18:14.515 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.514+0000 7f7a03fff700 1 -- 172.21.15.110:0/3718414903 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]}]=0 v136) v1 ==== 184+0+0 (secure 0 0 0) 0x7f7a1004a950 con 0x7f7a1c14f100 2021-03-25T14:18:14.518 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.516+0000 7f7a22991700 1 -- 172.21.15.110:0/3718414903 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f79fc05a0b0 msgr2=0x7f79fc05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:14.518 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.516+0000 7f7a22991700 1 --2- 172.21.15.110:0/3718414903 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f79fc05a0b0 0x7f79fc05c570 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f7a0c006ac0 tx=0x7f7a0c006e20).stop 2021-03-25T14:18:14.518 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.516+0000 7f7a22991700 1 -- 172.21.15.110:0/3718414903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a1c14f100 msgr2=0x7f7a1c0b22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:14.518 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.516+0000 7f7a22991700 1 --2- 172.21.15.110:0/3718414903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a1c14f100 0x7f7a1c0b22c0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f7a10002b90 tx=0x7f7a10007bc0).stop 2021-03-25T14:18:14.519 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.516+0000 7f7a22991700 1 -- 172.21.15.110:0/3718414903 shutdown_connections 2021-03-25T14:18:14.519 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.516+0000 7f7a22991700 1 --2- 172.21.15.110:0/3718414903 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f79fc05a0b0 0x7f79fc05c570 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:14.519 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.516+0000 7f7a22991700 1 --2- 172.21.15.110:0/3718414903 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a1c14c420 0x7f7a1c158be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:14.519 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.516+0000 7f7a22991700 1 --2- 172.21.15.110:0/3718414903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a1c14f100 0x7f7a1c0b22c0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:14.520 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.516+0000 7f7a22991700 1 --2- 172.21.15.110:0/3718414903 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a1c0b44a0 0x7f7a1c14f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:14.520 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.516+0000 7f7a22991700 1 -- 172.21.15.110:0/3718414903 >> 172.21.15.110:0/3718414903 conn(0x7f7a1c064a10 msgr2=0x7f7a1c145c80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:14.520 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.516+0000 7f7a22991700 1 -- 172.21.15.110:0/3718414903 shutdown_connections 2021-03-25T14:18:14.520 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.516+0000 7f7a22991700 1 -- 172.21.15.110:0/3718414903 wait complete. 2021-03-25T14:18:14.529 INFO:tasks.cephfs_test_runner:test_mount_mon_and_osd_caps_present_mds_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) ... ok 2021-03-25T14:18:14.529 INFO:tasks.cephfs_test_runner:Starting test: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2021-03-25T14:18:14.529 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap' 2021-03-25T14:18:14.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.638+0000 7f72866a3700 1 Processor -- start 2021-03-25T14:18:14.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.638+0000 7f72866a3700 1 -- start start 2021-03-25T14:18:14.642 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.639+0000 7f72866a3700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f72800b99b0 0x7f72800ba4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:14.643 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.639+0000 7f72866a3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7280148fc0 0x7f72800a3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:14.643 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.639+0000 7f72866a3700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7280149430 con 0x7f728014a050 2021-03-25T14:18:14.643 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.639+0000 7f72866a3700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72800ba9e0 con 0x7f72800b99b0 2021-03-25T14:18:14.643 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.639+0000 7f72866a3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72800babc0 con 0x7f7280148fc0 2021-03-25T14:18:14.643 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.639+0000 7f727ffff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f72800b99b0 0x7f72800ba4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:14.643 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.639+0000 7f727f7fe700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f728014a050 0x7f72801488b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44306/0 (socket says 172.21.15.110:44306) 2021-03-25T14:18:14.643 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.639+0000 7f727f7fe700 1 -- 172.21.15.110:0/1246280758 learned_addr learned my addr 172.21.15.110:0/1246280758 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:18:14.643 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.640+0000 7f7284c40700 1 --2- 172.21.15.110:0/1246280758 >> v2:172.21.15.174:3300/0 conn(0x7f7280148fc0 0x7f72800a3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:14.643 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.640+0000 7f727ffff700 1 -- 172.21.15.110:0/1246280758 >> v2:172.21.15.174:3300/0 conn(0x7f7280148fc0 msgr2=0x7f72800a3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:14.643 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.640+0000 7f727ffff700 1 --2- 172.21.15.110:0/1246280758 >> v2:172.21.15.174:3300/0 conn(0x7f7280148fc0 0x7f72800a3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:14.643 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.640+0000 7f727effd700 1 -- 172.21.15.110:0/1246280758 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4161101558 0 0) 0x7f7280149430 con 0x7f728014a050 2021-03-25T14:18:14.644 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.640+0000 7f727ffff700 1 -- 172.21.15.110:0/1246280758 >> v1:172.21.15.110:6789/0 conn(0x7f728014a050 legacy=0x7f72801488b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:14.644 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.640+0000 7f727ffff700 1 -- 172.21.15.110:0/1246280758 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72800bae60 con 0x7f72800b99b0 2021-03-25T14:18:14.644 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.640+0000 7f727ffff700 1 --2- 172.21.15.110:0/1246280758 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72800b99b0 0x7f72800ba4f0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7f7280068650 tx=0x7f7270006dc0).ready entity=mon.0 client_cookie=e2cfa4275109230f server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:14.644 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.640+0000 7f727effd700 1 -- 172.21.15.110:0/1246280758 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7270006030 con 0x7f72800b99b0 2021-03-25T14:18:14.644 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.640+0000 7f727effd700 1 -- 172.21.15.110:0/1246280758 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7270006190 con 0x7f72800b99b0 2021-03-25T14:18:14.644 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.640+0000 7f727effd700 1 -- 172.21.15.110:0/1246280758 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7270006510 con 0x7f72800b99b0 2021-03-25T14:18:14.644 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.640+0000 7f72866a3700 1 -- 172.21.15.110:0/1246280758 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72800b99b0 msgr2=0x7f72800ba4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:14.644 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.640+0000 7f72866a3700 1 --2- 172.21.15.110:0/1246280758 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72800b99b0 0x7f72800ba4f0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7f7280068650 tx=0x7f7270006dc0).stop 2021-03-25T14:18:14.644 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.640+0000 7f72866a3700 1 -- 172.21.15.110:0/1246280758 shutdown_connections 2021-03-25T14:18:14.644 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.640+0000 7f72866a3700 1 --2- 172.21.15.110:0/1246280758 >> v2:172.21.15.174:3300/0 conn(0x7f7280148fc0 0x7f72800a3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:14.644 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.640+0000 7f72866a3700 1 --2- 172.21.15.110:0/1246280758 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72800b99b0 0x7f72800ba4f0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:14.644 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.640+0000 7f72866a3700 1 -- 172.21.15.110:0/1246280758 >> 172.21.15.110:0/1246280758 conn(0x7f7280060c40 msgr2=0x7f7280061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:14.645 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.640+0000 7f72866a3700 1 -- 172.21.15.110:0/1246280758 shutdown_connections 2021-03-25T14:18:14.645 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.640+0000 7f72866a3700 1 -- 172.21.15.110:0/1246280758 wait complete. 2021-03-25T14:18:14.645 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.641+0000 7f72866a3700 1 Processor -- start 2021-03-25T14:18:14.645 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.642+0000 7f72866a3700 1 -- start start 2021-03-25T14:18:14.648 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.642+0000 7f72866a3700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72800b99b0 0x7f7280063660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:14.648 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.642+0000 7f72866a3700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7280148fc0 0x7f72800be510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:14.648 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.642+0000 7f72866a3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f728014a050 0x7f72800bcdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:14.648 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.642+0000 7f72866a3700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7280063b50 con 0x7f7280148fc0 2021-03-25T14:18:14.648 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.642+0000 7f72866a3700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7280158c80 con 0x7f72800b99b0 2021-03-25T14:18:14.648 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.642+0000 7f72866a3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7280158f20 con 0x7f728014a050 2021-03-25T14:18:14.648 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.642+0000 7f727f7fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7280148fc0 0x7f72800be510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:14.648 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.642+0000 7f727f7fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7280148fc0 0x7f72800be510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51376/0 (socket says 172.21.15.110:51376) 2021-03-25T14:18:14.648 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.642+0000 7f727f7fe700 1 -- 172.21.15.110:0/2540150153 learned_addr learned my addr 172.21.15.110:0/2540150153 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:14.648 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.643+0000 7f727ffff700 1 --2- 172.21.15.110:0/2540150153 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72800b99b0 0x7f7280063660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:14.648 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.643+0000 7f7284c40700 1 --2- 172.21.15.110:0/2540150153 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f728014a050 0x7f72800bcdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:14.649 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.643+0000 7f727f7fe700 1 -- 172.21.15.110:0/2540150153 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f728014a050 msgr2=0x7f72800bcdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:14.649 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.643+0000 7f727f7fe700 1 --2- 172.21.15.110:0/2540150153 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f728014a050 0x7f72800bcdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:14.649 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.643+0000 7f727f7fe700 1 -- 172.21.15.110:0/2540150153 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72800b99b0 msgr2=0x7f7280063660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:14.649 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.643+0000 7f727f7fe700 1 --2- 172.21.15.110:0/2540150153 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72800b99b0 0x7f7280063660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:14.649 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.643+0000 7f727f7fe700 1 -- 172.21.15.110:0/2540150153 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72801591c0 con 0x7f7280148fc0 2021-03-25T14:18:14.649 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.643+0000 7f727f7fe700 1 --2- 172.21.15.110:0/2540150153 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7280148fc0 0x7f72800be510 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f727400c730 tx=0x7f7274007d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:14.649 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.643+0000 7f7267fff700 1 -- 172.21.15.110:0/2540150153 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7274007320 con 0x7f7280148fc0 2021-03-25T14:18:14.649 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.643+0000 7f7267fff700 1 -- 172.21.15.110:0/2540150153 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7274007480 con 0x7f7280148fc0 2021-03-25T14:18:14.649 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.643+0000 7f72866a3700 1 -- 172.21.15.110:0/2540150153 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7280159460 con 0x7f7280148fc0 2021-03-25T14:18:14.649 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.643+0000 7f7267fff700 1 -- 172.21.15.110:0/2540150153 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7274005870 con 0x7f7280148fc0 2021-03-25T14:18:14.649 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.643+0000 7f72866a3700 1 -- 172.21.15.110:0/2540150153 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72800bea00 con 0x7f7280148fc0 2021-03-25T14:18:14.649 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.644+0000 7f72866a3700 1 -- 172.21.15.110:0/2540150153 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72801598c0 con 0x7f7280148fc0 2021-03-25T14:18:14.650 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.644+0000 7f7267fff700 1 -- 172.21.15.110:0/2540150153 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f7274010030 con 0x7f7280148fc0 2021-03-25T14:18:14.650 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.644+0000 7f7267fff700 1 --2- 172.21.15.110:0/2540150153 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f726005a0b0 0x7f726005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:14.650 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.644+0000 7f7267fff700 1 -- 172.21.15.110:0/2540150153 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5778+0+0 (secure 0 0 0) 0x7f72740738a0 con 0x7f7280148fc0 2021-03-25T14:18:14.650 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.645+0000 7f727ffff700 1 --2- 172.21.15.110:0/2540150153 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f726005a0b0 0x7f726005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:14.650 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.645+0000 7f727ffff700 1 --2- 172.21.15.110:0/2540150153 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f726005a0b0 0x7f726005c570 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f7270006e00 tx=0x7f7270015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:14.650 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.648+0000 7f7267fff700 1 -- 172.21.15.110:0/2540150153 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f7274047360 con 0x7f7280148fc0 2021-03-25T14:18:14.858 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:14.857+0000 7f72866a3700 1 -- 172.21.15.110:0/2540150153 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]} v 0) v1 -- 0x7f7280159ac0 con 0x7f7280148fc0 2021-03-25T14:18:15.516 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.515+0000 7f7267fff700 1 -- 172.21.15.110:0/2540150153 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]}]=0 v137) v1 ==== 162+0+0 (secure 0 0 0) 0x7f727404a980 con 0x7f7280148fc0 2021-03-25T14:18:15.518 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.517+0000 7f72866a3700 1 -- 172.21.15.110:0/2540150153 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f726005a0b0 msgr2=0x7f726005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:15.519 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.517+0000 7f72866a3700 1 --2- 172.21.15.110:0/2540150153 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f726005a0b0 0x7f726005c570 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f7270006e00 tx=0x7f7270015000).stop 2021-03-25T14:18:15.519 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.517+0000 7f72866a3700 1 -- 172.21.15.110:0/2540150153 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7280148fc0 msgr2=0x7f72800be510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:15.519 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.517+0000 7f72866a3700 1 --2- 172.21.15.110:0/2540150153 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7280148fc0 0x7f72800be510 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f727400c730 tx=0x7f7274007d10).stop 2021-03-25T14:18:15.519 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.517+0000 7f72866a3700 1 -- 172.21.15.110:0/2540150153 shutdown_connections 2021-03-25T14:18:15.519 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.517+0000 7f72866a3700 1 --2- 172.21.15.110:0/2540150153 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f726005a0b0 0x7f726005c570 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:15.519 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.517+0000 7f72866a3700 1 --2- 172.21.15.110:0/2540150153 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72800b99b0 0x7f7280063660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:15.519 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.517+0000 7f72866a3700 1 --2- 172.21.15.110:0/2540150153 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f728014a050 0x7f72800bcdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:15.519 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.517+0000 7f72866a3700 1 --2- 172.21.15.110:0/2540150153 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7280148fc0 0x7f72800be510 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:15.519 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.517+0000 7f72866a3700 1 -- 172.21.15.110:0/2540150153 >> 172.21.15.110:0/2540150153 conn(0x7f7280060c40 msgr2=0x7f7280145ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:15.519 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.517+0000 7f72866a3700 1 -- 172.21.15.110:0/2540150153 shutdown_connections 2021-03-25T14:18:15.519 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.517+0000 7f72866a3700 1 -- 172.21.15.110:0/2540150153 wait complete. 2021-03-25T14:18:15.531 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-03-25T14:18:15.645 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.644+0000 7efd891fc700 1 Processor -- start 2021-03-25T14:18:15.645 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.644+0000 7efd891fc700 1 -- start start 2021-03-25T14:18:15.647 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.644+0000 7efd891fc700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efd840b5d00 0x7efd84145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:15.647 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.645+0000 7efd891fc700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd84149c50 con 0x7efd840648a0 2021-03-25T14:18:15.647 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.645+0000 7efd891fc700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd841461b0 con 0x7efd840b0cc0 2021-03-25T14:18:15.647 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.645+0000 7efd891fc700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd84067960 con 0x7efd840b5d00 2021-03-25T14:18:15.647 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.645+0000 7efd8259c700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efd840b5d00 0x7efd84145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:15.647 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.645+0000 7efd8259c700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efd840b5d00 0x7efd84145cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51386/0 (socket says 172.21.15.110:51386) 2021-03-25T14:18:15.647 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.645+0000 7efd8359e700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7efd840648a0 0x7efd8409db40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44322/0 (socket says 172.21.15.110:44322) 2021-03-25T14:18:15.648 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.645+0000 7efd8259c700 1 -- 172.21.15.110:0/2523481832 learned_addr learned my addr 172.21.15.110:0/2523481832 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:15.648 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.645+0000 7efd8259c700 1 -- 172.21.15.110:0/2523481832 >> v1:172.21.15.174:6789/0 conn(0x7efd840b0cc0 legacy=0x7efd84067250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:15.648 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.645+0000 7efd8259c700 1 -- 172.21.15.110:0/2523481832 >> v1:172.21.15.110:6789/0 conn(0x7efd840648a0 legacy=0x7efd8409db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:15.648 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.645+0000 7efd8259c700 1 -- 172.21.15.110:0/2523481832 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd84149e80 con 0x7efd840b5d00 2021-03-25T14:18:15.648 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.645+0000 7efd8259c700 1 --2- 172.21.15.110:0/2523481832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd840b5d00 0x7efd84145cc0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7efd7800ba20 tx=0x7efd78006ee0).ready entity=mon.0 client_cookie=6a2eb9c91a954443 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:15.648 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.645+0000 7efd81d9b700 1 -- 172.21.15.110:0/2523481832 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd78009890 con 0x7efd840b5d00 2021-03-25T14:18:15.648 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.645+0000 7efd81d9b700 1 -- 172.21.15.110:0/2523481832 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd780099f0 con 0x7efd840b5d00 2021-03-25T14:18:15.648 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.645+0000 7efd81d9b700 1 -- 172.21.15.110:0/2523481832 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd78009d70 con 0x7efd840b5d00 2021-03-25T14:18:15.648 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.646+0000 7efd891fc700 1 -- 172.21.15.110:0/2523481832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd840b5d00 msgr2=0x7efd84145cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:15.649 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.646+0000 7efd891fc700 1 --2- 172.21.15.110:0/2523481832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd840b5d00 0x7efd84145cc0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7efd7800ba20 tx=0x7efd78006ee0).stop 2021-03-25T14:18:15.649 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.646+0000 7efd891fc700 1 -- 172.21.15.110:0/2523481832 shutdown_connections 2021-03-25T14:18:15.649 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.646+0000 7efd891fc700 1 --2- 172.21.15.110:0/2523481832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd840b5d00 0x7efd84145cc0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:15.649 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.646+0000 7efd891fc700 1 -- 172.21.15.110:0/2523481832 >> 172.21.15.110:0/2523481832 conn(0x7efd840664e0 msgr2=0x7efd840668f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:15.649 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.646+0000 7efd891fc700 1 -- 172.21.15.110:0/2523481832 shutdown_connections 2021-03-25T14:18:15.649 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.646+0000 7efd891fc700 1 -- 172.21.15.110:0/2523481832 wait complete. 2021-03-25T14:18:15.652 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.647+0000 7efd891fc700 1 Processor -- start 2021-03-25T14:18:15.652 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.647+0000 7efd891fc700 1 -- start start 2021-03-25T14:18:15.652 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.648+0000 7efd891fc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efd840648a0 0x7efd840a0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:15.652 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.648+0000 7efd891fc700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd840b0cc0 0x7efd84141f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:15.652 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.648+0000 7efd891fc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd840b5d00 0x7efd841423f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:15.652 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.648+0000 7efd891fc700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd841414b0 con 0x7efd840b5d00 2021-03-25T14:18:15.652 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.648+0000 7efd891fc700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd840b4d90 con 0x7efd840b0cc0 2021-03-25T14:18:15.652 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.648+0000 7efd891fc700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd840b5a40 con 0x7efd840648a0 2021-03-25T14:18:15.652 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.648+0000 7efd8359e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd840b5d00 0x7efd841423f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:15.653 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.648+0000 7efd8359e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd840b5d00 0x7efd841423f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51394/0 (socket says 172.21.15.110:51394) 2021-03-25T14:18:15.653 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.648+0000 7efd8359e700 1 -- 172.21.15.110:0/3642428655 learned_addr learned my addr 172.21.15.110:0/3642428655 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:15.653 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.648+0000 7efd82d9d700 1 --2- 172.21.15.110:0/3642428655 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efd840648a0 0x7efd840a0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:15.653 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.648+0000 7efd8359e700 1 -- 172.21.15.110:0/3642428655 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efd840648a0 msgr2=0x7efd840a0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:15.653 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.648+0000 7efd8359e700 1 --2- 172.21.15.110:0/3642428655 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efd840648a0 0x7efd840a0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:15.653 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.648+0000 7efd8359e700 1 -- 172.21.15.110:0/3642428655 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd840b0cc0 msgr2=0x7efd84141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:15.653 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.648+0000 7efd8259c700 1 --2- 172.21.15.110:0/3642428655 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd840b0cc0 0x7efd84141f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:15.653 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.648+0000 7efd8359e700 1 --2- 172.21.15.110:0/3642428655 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd840b0cc0 0x7efd84141f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:15.653 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.648+0000 7efd8359e700 1 -- 172.21.15.110:0/3642428655 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd840b57e0 con 0x7efd840b5d00 2021-03-25T14:18:15.653 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.648+0000 7efd8359e700 1 --2- 172.21.15.110:0/3642428655 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd840b5d00 0x7efd841423f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7efd7c00ca90 tx=0x7efd7c007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:15.653 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.648+0000 7efd6affd700 1 -- 172.21.15.110:0/3642428655 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7c005af0 con 0x7efd840b5d00 2021-03-25T14:18:15.653 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.648+0000 7efd6affd700 1 -- 172.21.15.110:0/3642428655 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7c005c50 con 0x7efd840b5d00 2021-03-25T14:18:15.654 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.648+0000 7efd891fc700 1 -- 172.21.15.110:0/3642428655 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd840b3f40 con 0x7efd840b5d00 2021-03-25T14:18:15.654 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.648+0000 7efd6affd700 1 -- 172.21.15.110:0/3642428655 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7c007110 con 0x7efd840b5d00 2021-03-25T14:18:15.654 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.648+0000 7efd891fc700 1 -- 172.21.15.110:0/3642428655 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd84149960 con 0x7efd840b5d00 2021-03-25T14:18:15.654 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.649+0000 7efd891fc700 1 -- 172.21.15.110:0/3642428655 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd840b4100 con 0x7efd840b5d00 2021-03-25T14:18:15.654 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.650+0000 7efd6affd700 1 -- 172.21.15.110:0/3642428655 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7efd7c010030 con 0x7efd840b5d00 2021-03-25T14:18:15.654 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.650+0000 7efd6affd700 1 --2- 172.21.15.110:0/3642428655 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7efd6405a0b0 0x7efd6405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:15.654 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.650+0000 7efd6affd700 1 -- 172.21.15.110:0/3642428655 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5778+0+0 (secure 0 0 0) 0x7efd7c073b20 con 0x7efd840b5d00 2021-03-25T14:18:15.654 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.650+0000 7efd82d9d700 1 --2- 172.21.15.110:0/3642428655 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7efd6405a0b0 0x7efd6405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:15.654 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.650+0000 7efd82d9d700 1 --2- 172.21.15.110:0/3642428655 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7efd6405a0b0 0x7efd6405c570 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7efd74007fd0 tx=0x7efd74009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:15.655 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.654+0000 7efd6affd700 1 -- 172.21.15.110:0/3642428655 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7efd840b4100 con 0x7efd840b5d00 2021-03-25T14:18:15.804 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.803+0000 7efd891fc700 1 -- 172.21.15.110:0/3642428655 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7efd840b4a50 con 0x7efd840b5d00 2021-03-25T14:18:15.807 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.807+0000 7efd6affd700 1 -- 172.21.15.110:0/3642428655 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7efd7c0475c0 con 0x7efd840b5d00 2021-03-25T14:18:15.810 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.808+0000 7efd891fc700 1 -- 172.21.15.110:0/3642428655 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7efd6405a0b0 msgr2=0x7efd6405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:15.810 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.808+0000 7efd891fc700 1 --2- 172.21.15.110:0/3642428655 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7efd6405a0b0 0x7efd6405c570 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7efd74007fd0 tx=0x7efd74009040).stop 2021-03-25T14:18:15.810 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.808+0000 7efd891fc700 1 -- 172.21.15.110:0/3642428655 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd840b5d00 msgr2=0x7efd841423f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:15.810 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.808+0000 7efd891fc700 1 --2- 172.21.15.110:0/3642428655 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd840b5d00 0x7efd841423f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7efd7c00ca90 tx=0x7efd7c007f10).stop 2021-03-25T14:18:15.810 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.808+0000 7efd891fc700 1 -- 172.21.15.110:0/3642428655 shutdown_connections 2021-03-25T14:18:15.810 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.808+0000 7efd891fc700 1 --2- 172.21.15.110:0/3642428655 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7efd6405a0b0 0x7efd6405c570 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:15.810 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.808+0000 7efd891fc700 1 --2- 172.21.15.110:0/3642428655 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd840b5d00 0x7efd841423f0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:15.810 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.808+0000 7efd891fc700 1 --2- 172.21.15.110:0/3642428655 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efd840648a0 0x7efd840a0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:15.810 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.808+0000 7efd891fc700 1 --2- 172.21.15.110:0/3642428655 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd840b0cc0 0x7efd84141f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:15.811 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.808+0000 7efd891fc700 1 -- 172.21.15.110:0/3642428655 >> 172.21.15.110:0/3642428655 conn(0x7efd840664e0 msgr2=0x7efd84068740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:15.811 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.809+0000 7efd891fc700 1 -- 172.21.15.110:0/3642428655 shutdown_connections 2021-03-25T14:18:15.811 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.809+0000 7efd891fc700 1 -- 172.21.15.110:0/3642428655 wait complete. 2021-03-25T14:18:15.821 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-03-25T14:18:15.821 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-03-25T14:18:15.847 DEBUG:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-03-25T14:18:15.879 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-03-25T14:18:15.879 INFO:tasks.cephfs.cephfs_test_case:[, ] 2021-03-25T14:18:15.879 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-03-25T14:18:15.997 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.996+0000 7f0243fff700 1 Processor -- start 2021-03-25T14:18:15.997 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.996+0000 7f0243fff700 1 -- start start 2021-03-25T14:18:16.004 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.996+0000 7f0243fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f02440b88b0 0x7f0244068ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:16.005 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.997+0000 7f0243fff700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0244064460 con 0x7f0244067930 2021-03-25T14:18:16.005 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.997+0000 7f0243fff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02440b7be0 con 0x7f02440686f0 2021-03-25T14:18:16.005 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.997+0000 7f0243fff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f024414a760 con 0x7f02440b88b0 2021-03-25T14:18:16.005 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.997+0000 7f02437fe700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f0244067930 0x7f0244148bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44334/0 (socket says 172.21.15.110:44334) 2021-03-25T14:18:16.005 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.997+0000 7f02437fe700 1 -- 172.21.15.110:0/685874417 learned_addr learned my addr 172.21.15.110:0/685874417 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:18:16.005 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.997+0000 7f0241ffb700 1 -- 172.21.15.110:0/685874417 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2973205945 0 0) 0x7f0244064460 con 0x7f0244067930 2021-03-25T14:18:16.005 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.997+0000 7f0241ffb700 1 -- 172.21.15.110:0/685874417 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0230003270 con 0x7f0244067930 2021-03-25T14:18:16.005 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.997+0000 7f02427fc700 1 --2- 172.21.15.110:0/685874417 >> v2:172.21.15.174:3300/0 conn(0x7f02440b88b0 0x7f0244068ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:16.005 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.997+0000 7f0241ffb700 1 -- 172.21.15.110:0/685874417 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2231491415 0 0) 0x7f0230003270 con 0x7f0244067930 2021-03-25T14:18:16.005 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.997+0000 7f0241ffb700 1 -- 172.21.15.110:0/685874417 >> v2:172.21.15.174:3300/0 conn(0x7f02440b88b0 msgr2=0x7f0244068ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:16.005 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.997+0000 7f0241ffb700 1 --2- 172.21.15.110:0/685874417 >> v2:172.21.15.174:3300/0 conn(0x7f02440b88b0 0x7f0244068ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:16.006 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.997+0000 7f0241ffb700 1 -- 172.21.15.110:0/685874417 >> v1:172.21.15.174:6789/0 conn(0x7f02440686f0 legacy=0x7f02440b81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:16.006 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.997+0000 7f0241ffb700 1 -- 172.21.15.110:0/685874417 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0244067e40 con 0x7f0244067930 2021-03-25T14:18:16.006 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.997+0000 7f0241ffb700 1 -- 172.21.15.110:0/685874417 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f023c0018a0 con 0x7f0244067930 2021-03-25T14:18:16.006 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.997+0000 7f0241ffb700 1 -- 172.21.15.110:0/685874417 >> v1:172.21.15.110:6789/0 conn(0x7f0244067930 legacy=0x7f0244148bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:16.006 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.997+0000 7f0241ffb700 1 --2- 172.21.15.110:0/685874417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0230003760 0x7f0230003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:16.006 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.997+0000 7f0241ffb700 1 --2- 172.21.15.110:0/685874417 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0230004510 0x7f0230004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:16.006 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.997+0000 7f0241ffb700 1 --2- 172.21.15.110:0/685874417 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0230004e80 0x7f023000b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:16.006 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.997+0000 7f0241ffb700 1 -- 172.21.15.110:0/685874417 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f024414a760 con 0x7f0230003760 2021-03-25T14:18:16.006 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.997+0000 7f0241ffb700 1 -- 172.21.15.110:0/685874417 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0230004290 con 0x7f0230004510 2021-03-25T14:18:16.006 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.997+0000 7f0241ffb700 1 -- 172.21.15.110:0/685874417 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f023000bc50 con 0x7f0230004e80 2021-03-25T14:18:16.006 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.997+0000 7f0242ffd700 1 --2- 172.21.15.110:0/685874417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0230003760 0x7f0230003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:16.006 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.997+0000 7f02427fc700 1 --2- 172.21.15.110:0/685874417 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0230004510 0x7f0230004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:16.007 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.998+0000 7f02437fe700 1 --2- 172.21.15.110:0/685874417 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0230004e80 0x7f023000b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:16.007 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.998+0000 7f0242ffd700 1 -- 172.21.15.110:0/685874417 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0230004e80 msgr2=0x7f023000b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:16.007 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.998+0000 7f0242ffd700 1 --2- 172.21.15.110:0/685874417 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0230004e80 0x7f023000b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:16.007 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.998+0000 7f0242ffd700 1 -- 172.21.15.110:0/685874417 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0230004510 msgr2=0x7f0230004990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:16.007 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.998+0000 7f0242ffd700 1 --2- 172.21.15.110:0/685874417 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0230004510 0x7f0230004990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:16.007 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.998+0000 7f0242ffd700 1 -- 172.21.15.110:0/685874417 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0230003270 con 0x7f0230003760 2021-03-25T14:18:16.007 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.998+0000 7f02437fe700 1 -- 172.21.15.110:0/685874417 reap_dead start 2021-03-25T14:18:16.007 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.998+0000 7f0242ffd700 1 --2- 172.21.15.110:0/685874417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0230003760 0x7f0230003b80 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f0238001990 tx=0x7f0238007bc0).ready entity=mon.0 client_cookie=130169ad377ca9cd server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:16.007 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.998+0000 7f0241ffb700 1 -- 172.21.15.110:0/685874417 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0238007020 con 0x7f0230003760 2021-03-25T14:18:16.007 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.998+0000 7f0241ffb700 1 -- 172.21.15.110:0/685874417 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0238007180 con 0x7f0230003760 2021-03-25T14:18:16.007 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.998+0000 7f0241ffb700 1 -- 172.21.15.110:0/685874417 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023800c650 con 0x7f0230003760 2021-03-25T14:18:16.007 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.998+0000 7f0243fff700 1 -- 172.21.15.110:0/685874417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0230003760 msgr2=0x7f0230003b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:16.007 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.998+0000 7f0243fff700 1 --2- 172.21.15.110:0/685874417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0230003760 0x7f0230003b80 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f0238001990 tx=0x7f0238007bc0).stop 2021-03-25T14:18:16.008 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.998+0000 7f0243fff700 1 -- 172.21.15.110:0/685874417 shutdown_connections 2021-03-25T14:18:16.008 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.998+0000 7f0243fff700 1 --2- 172.21.15.110:0/685874417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0230003760 0x7f0230003b80 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:16.008 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.998+0000 7f0243fff700 1 -- 172.21.15.110:0/685874417 >> 172.21.15.110:0/685874417 conn(0x7f02440bc2e0 msgr2=0x7f02440bc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:16.008 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.998+0000 7f0243fff700 1 -- 172.21.15.110:0/685874417 shutdown_connections 2021-03-25T14:18:16.008 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:15.998+0000 7f0243fff700 1 -- 172.21.15.110:0/685874417 wait complete. 2021-03-25T14:18:16.008 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.000+0000 7f0243fff700 1 Processor -- start 2021-03-25T14:18:16.008 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.000+0000 7f0243fff700 1 -- start start 2021-03-25T14:18:16.008 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.000+0000 7f0243fff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0230003760 0x7f02441463d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:16.008 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.000+0000 7f0243fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02440b46a0 0x7f0244158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:16.008 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.000+0000 7f0243fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f02440b38a0 0x7f0244158610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:16.008 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.000+0000 7f0243fff700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0244146150 con 0x7f02440b46a0 2021-03-25T14:18:16.008 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.000+0000 7f0243fff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0244159740 con 0x7f0230003760 2021-03-25T14:18:16.009 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.000+0000 7f0243fff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02441599e0 con 0x7f02440b38a0 2021-03-25T14:18:16.009 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.000+0000 7f02427fc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02440b46a0 0x7f0244158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:16.009 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.000+0000 7f02427fc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02440b46a0 0x7f0244158120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51410/0 (socket says 172.21.15.110:51410) 2021-03-25T14:18:16.009 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.000+0000 7f02427fc700 1 -- 172.21.15.110:0/3530646443 learned_addr learned my addr 172.21.15.110:0/3530646443 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:16.009 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.000+0000 7f0242ffd700 1 --2- 172.21.15.110:0/3530646443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0230003760 0x7f02441463d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:16.009 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.000+0000 7f02437fe700 1 --2- 172.21.15.110:0/3530646443 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f02440b38a0 0x7f0244158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:16.009 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.001+0000 7f02427fc700 1 -- 172.21.15.110:0/3530646443 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f02440b38a0 msgr2=0x7f0244158610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:16.009 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.001+0000 7f02427fc700 1 --2- 172.21.15.110:0/3530646443 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f02440b38a0 0x7f0244158610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:16.009 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.001+0000 7f02427fc700 1 -- 172.21.15.110:0/3530646443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0230003760 msgr2=0x7f02441463d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:16.009 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.001+0000 7f02427fc700 1 --2- 172.21.15.110:0/3530646443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0230003760 0x7f02441463d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:16.009 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.001+0000 7f02427fc700 1 -- 172.21.15.110:0/3530646443 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f024414bd50 con 0x7f02440b46a0 2021-03-25T14:18:16.009 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.001+0000 7f02427fc700 1 --2- 172.21.15.110:0/3530646443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02440b46a0 0x7f0244158120 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f0234010c20 tx=0x7f0234008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:16.009 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.001+0000 7f022affd700 1 -- 172.21.15.110:0/3530646443 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023400ea30 con 0x7f02440b46a0 2021-03-25T14:18:16.010 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.001+0000 7f022affd700 1 -- 172.21.15.110:0/3530646443 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f023400eb90 con 0x7f02440b46a0 2021-03-25T14:18:16.010 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.001+0000 7f022affd700 1 -- 172.21.15.110:0/3530646443 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0234014470 con 0x7f02440b46a0 2021-03-25T14:18:16.010 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.001+0000 7f0243fff700 1 -- 172.21.15.110:0/3530646443 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f024414bff0 con 0x7f02440b46a0 2021-03-25T14:18:16.010 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.001+0000 7f0243fff700 1 -- 172.21.15.110:0/3530646443 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f024414c490 con 0x7f02440b46a0 2021-03-25T14:18:16.010 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.002+0000 7f0243fff700 1 -- 172.21.15.110:0/3530646443 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f024414c180 con 0x7f02440b46a0 2021-03-25T14:18:16.010 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.002+0000 7f022affd700 1 -- 172.21.15.110:0/3530646443 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f02340148a0 con 0x7f02440b46a0 2021-03-25T14:18:16.010 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.002+0000 7f022affd700 1 --2- 172.21.15.110:0/3530646443 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f022405a0b0 0x7f022405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:16.010 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.003+0000 7f022affd700 1 -- 172.21.15.110:0/3530646443 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5778+0+0 (secure 0 0 0) 0x7f0234074000 con 0x7f02440b46a0 2021-03-25T14:18:16.010 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.003+0000 7f0242ffd700 1 --2- 172.21.15.110:0/3530646443 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f022405a0b0 0x7f022405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:16.010 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.003+0000 7f0242ffd700 1 --2- 172.21.15.110:0/3530646443 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f022405a0b0 0x7f022405c570 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f02380075a0 tx=0x7f0238015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:16.011 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.006+0000 7f022affd700 1 -- 172.21.15.110:0/3530646443 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f0234047a60 con 0x7f02440b46a0 2021-03-25T14:18:16.192 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.191+0000 7f0243fff700 1 -- 172.21.15.110:0/3530646443 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0244045ae0 con 0x7f02440b46a0 2021-03-25T14:18:16.192 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.191+0000 7f022affd700 1 -- 172.21.15.110:0/3530646443 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+1925 (secure 0 0 0) 0x7f023404b080 con 0x7f02440b46a0 2021-03-25T14:18:16.193 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:18:16.193 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":35,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4997,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/3015251726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3015251726},{"type":"v1","addr":"172.21.15.174:6835","nonce":3015251726}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":24},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/1698368640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1698368640},{"type":"v1","addr":"172.21.15.174:6833","nonce":1698368640}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":24},{"gid":5970,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/3337605488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3337605488},{"type":"v1","addr":"172.21.15.110:6836","nonce":3337605488}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":32},{"gid":6072,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.110:6837/1335968900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1335968900},{"type":"v1","addr":"172.21.15.110:6837","nonce":1335968900}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":35}],"filesystems":[]} 2021-03-25T14:18:16.194 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.193+0000 7f0243fff700 1 -- 172.21.15.110:0/3530646443 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f022405a0b0 msgr2=0x7f022405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:16.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.193+0000 7f0243fff700 1 --2- 172.21.15.110:0/3530646443 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f022405a0b0 0x7f022405c570 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f02380075a0 tx=0x7f0238015000).stop 2021-03-25T14:18:16.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.193+0000 7f0243fff700 1 -- 172.21.15.110:0/3530646443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02440b46a0 msgr2=0x7f0244158120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:16.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.193+0000 7f0243fff700 1 --2- 172.21.15.110:0/3530646443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02440b46a0 0x7f0244158120 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f0234010c20 tx=0x7f0234008040).stop 2021-03-25T14:18:16.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.193+0000 7f0243fff700 1 -- 172.21.15.110:0/3530646443 shutdown_connections 2021-03-25T14:18:16.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.193+0000 7f0243fff700 1 --2- 172.21.15.110:0/3530646443 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f022405a0b0 0x7f022405c570 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:16.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.193+0000 7f0243fff700 1 --2- 172.21.15.110:0/3530646443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0230003760 0x7f02441463d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:16.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.193+0000 7f0243fff700 1 --2- 172.21.15.110:0/3530646443 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f02440b38a0 0x7f0244158610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:16.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.193+0000 7f0243fff700 1 --2- 172.21.15.110:0/3530646443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02440b46a0 0x7f0244158120 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:16.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.193+0000 7f0243fff700 1 -- 172.21.15.110:0/3530646443 >> 172.21.15.110:0/3530646443 conn(0x7f02440bc2e0 msgr2=0x7f02440b80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:16.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.193+0000 7f0243fff700 1 -- 172.21.15.110:0/3530646443 shutdown_connections 2021-03-25T14:18:16.195 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.193+0000 7f0243fff700 1 -- 172.21.15.110:0/3530646443 wait complete. 2021-03-25T14:18:16.195 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 35 2021-03-25T14:18:16.206 INFO:tasks.ceph.mds.a:Restarting daemon 2021-03-25T14:18:16.206 INFO:tasks.ceph.mds.a:Stopping old one... 2021-03-25T14:18:16.207 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-03-25T14:18:16.207 INFO:teuthology.orchestra.run:waiting for 300 2021-03-25T14:18:16.207 INFO:tasks.ceph.mds.c:Restarting daemon 2021-03-25T14:18:16.207 INFO:tasks.ceph.mds.c:Stopping old one... 2021-03-25T14:18:16.207 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-03-25T14:18:16.207 INFO:teuthology.orchestra.run:waiting for 300 2021-03-25T14:18:16.208 INFO:tasks.ceph.mds.b:Restarting daemon 2021-03-25T14:18:16.208 INFO:tasks.ceph.mds.b:Stopping old one... 2021-03-25T14:18:16.208 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-03-25T14:18:16.208 INFO:teuthology.orchestra.run:waiting for 300 2021-03-25T14:18:16.208 INFO:tasks.ceph.mds.d:Restarting daemon 2021-03-25T14:18:16.208 INFO:tasks.ceph.mds.d:Stopping old one... 2021-03-25T14:18:16.209 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2021-03-25T14:18:16.209 INFO:teuthology.orchestra.run:waiting for 300 2021-03-25T14:18:16.216 INFO:tasks.ceph.mds.a:Stopped 2021-03-25T14:18:16.216 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-03-25T14:18:16.217 INFO:tasks.ceph.mds.c:Stopped 2021-03-25T14:18:16.218 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-03-25T14:18:16.220 INFO:tasks.ceph.mds.b:Stopped 2021-03-25T14:18:16.220 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-03-25T14:18:16.222 INFO:tasks.ceph.mds.d:Stopped 2021-03-25T14:18:16.222 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2021-03-25T14:18:16.258 INFO:tasks.ceph.mds.a:Started 2021-03-25T14:18:16.258 DEBUG:teuthology.parallel:result is None 2021-03-25T14:18:16.259 INFO:tasks.ceph.mds.c:Started 2021-03-25T14:18:16.259 DEBUG:teuthology.parallel:result is None 2021-03-25T14:18:16.263 INFO:tasks.ceph.mds.b:Started 2021-03-25T14:18:16.263 DEBUG:teuthology.parallel:result is None 2021-03-25T14:18:16.263 INFO:tasks.ceph.mds.d:Started 2021-03-25T14:18:16.264 DEBUG:teuthology.parallel:result is None 2021-03-25T14:18:16.264 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2021-03-25T14:18:16.329 INFO:tasks.ceph.mds.a.smithi110.stdout:starting mds.a at 2021-03-25T14:18:16.329 INFO:tasks.ceph.mds.c.smithi110.stdout:starting mds.c at 2021-03-25T14:18:16.341 INFO:tasks.ceph.mds.d.smithi174.stdout:starting mds.d at 2021-03-25T14:18:16.341 INFO:tasks.ceph.mds.b.smithi174.stdout:starting mds.b at 2021-03-25T14:18:16.382 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.380+0000 7f09cec6a700 1 Processor -- start 2021-03-25T14:18:16.383 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.380+0000 7f09cec6a700 1 -- start start 2021-03-25T14:18:16.389 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.381+0000 7f09cec6a700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f09c80bc5f0 0x7f09c80671d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:16.389 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.381+0000 7f09cec6a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f09c80bbca0 0x7f09c80bfe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:16.389 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.381+0000 7f09cec6a700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09c80663f0 con 0x7f09c80c0330 2021-03-25T14:18:16.389 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.381+0000 7f09cec6a700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09c80bb180 con 0x7f09c80bc5f0 2021-03-25T14:18:16.389 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.381+0000 7f09cec6a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09c80bb420 con 0x7f09c80bbca0 2021-03-25T14:18:16.389 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.381+0000 7f09cca06700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f09c80bc5f0 0x7f09c80671d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:16.389 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.381+0000 7f09cca06700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f09c80bc5f0 0x7f09c80671d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51442/0 (socket says 172.21.15.110:51442) 2021-03-25T14:18:16.389 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.381+0000 7f09cd207700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f09c80c0330 0x7f09c80b9920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44378/0 (socket says 172.21.15.110:44378) 2021-03-25T14:18:16.389 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.381+0000 7f09cca06700 1 -- 172.21.15.110:0/1403111835 learned_addr learned my addr 172.21.15.110:0/1403111835 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:16.390 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.381+0000 7f09c7fff700 1 --2- 172.21.15.110:0/1403111835 >> v2:172.21.15.174:3300/0 conn(0x7f09c80bbca0 0x7f09c80bfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:16.390 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.382+0000 7f09cca06700 1 -- 172.21.15.110:0/1403111835 >> v2:172.21.15.174:3300/0 conn(0x7f09c80bbca0 msgr2=0x7f09c80bfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:16.390 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.382+0000 7f09cca06700 1 --2- 172.21.15.110:0/1403111835 >> v2:172.21.15.174:3300/0 conn(0x7f09c80bbca0 0x7f09c80bfe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:16.390 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.382+0000 7f09cca06700 1 -- 172.21.15.110:0/1403111835 >> v1:172.21.15.110:6789/0 conn(0x7f09c80c0330 legacy=0x7f09c80b9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:16.390 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.382+0000 7f09cca06700 1 -- 172.21.15.110:0/1403111835 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c80c07a0 con 0x7f09c80bc5f0 2021-03-25T14:18:16.390 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.382+0000 7f09cca06700 1 --2- 172.21.15.110:0/1403111835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09c80bc5f0 0x7f09c80671d0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f09c80654e0 tx=0x7f09bc006ee0).ready entity=mon.0 client_cookie=4b11a8933c5f4717 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:16.390 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.382+0000 7f09c77fe700 1 -- 172.21.15.110:0/1403111835 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09bc0098d0 con 0x7f09c80bc5f0 2021-03-25T14:18:16.390 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.382+0000 7f09c77fe700 1 -- 172.21.15.110:0/1403111835 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09bc009a30 con 0x7f09c80bc5f0 2021-03-25T14:18:16.390 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.382+0000 7f09c77fe700 1 -- 172.21.15.110:0/1403111835 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09bc009db0 con 0x7f09c80bc5f0 2021-03-25T14:18:16.390 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.382+0000 7f09cec6a700 1 -- 172.21.15.110:0/1403111835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09c80bc5f0 msgr2=0x7f09c80671d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:16.390 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.382+0000 7f09cec6a700 1 --2- 172.21.15.110:0/1403111835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09c80bc5f0 0x7f09c80671d0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f09c80654e0 tx=0x7f09bc006ee0).stop 2021-03-25T14:18:16.391 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.382+0000 7f09cec6a700 1 -- 172.21.15.110:0/1403111835 shutdown_connections 2021-03-25T14:18:16.391 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.382+0000 7f09cec6a700 1 --2- 172.21.15.110:0/1403111835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09c80bc5f0 0x7f09c80671d0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:16.391 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.382+0000 7f09cec6a700 1 --2- 172.21.15.110:0/1403111835 >> v2:172.21.15.174:3300/0 conn(0x7f09c80bbca0 0x7f09c80bfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:16.391 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.382+0000 7f09cec6a700 1 -- 172.21.15.110:0/1403111835 >> 172.21.15.110:0/1403111835 conn(0x7f09c8064860 msgr2=0x7f09c80622e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:16.391 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.382+0000 7f09cec6a700 1 -- 172.21.15.110:0/1403111835 shutdown_connections 2021-03-25T14:18:16.391 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.382+0000 7f09cec6a700 1 -- 172.21.15.110:0/1403111835 wait complete. 2021-03-25T14:18:16.391 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.383+0000 7f09cec6a700 1 Processor -- start 2021-03-25T14:18:16.391 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.384+0000 7f09cec6a700 1 -- start start 2021-03-25T14:18:16.391 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.384+0000 7f09cec6a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09c80bbca0 0x7f09c81596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:16.392 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.384+0000 7f09cec6a700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09c80bc5f0 0x7f09c80b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:16.392 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.384+0000 7f09cec6a700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f09c80c0330 0x7f09c814a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:16.392 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.384+0000 7f09cec6a700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c8159be0 con 0x7f09c80bc5f0 2021-03-25T14:18:16.392 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.384+0000 7f09cec6a700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c80be950 con 0x7f09c80c0330 2021-03-25T14:18:16.392 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.384+0000 7f09cec6a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c80b13e0 con 0x7f09c80bbca0 2021-03-25T14:18:16.392 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.384+0000 7f09c7fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09c80bc5f0 0x7f09c80b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:16.392 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.384+0000 7f09c7fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09c80bc5f0 0x7f09c80b3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51450/0 (socket says 172.21.15.110:51450) 2021-03-25T14:18:16.392 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.384+0000 7f09c7fff700 1 -- 172.21.15.110:0/3542550562 learned_addr learned my addr 172.21.15.110:0/3542550562 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:16.392 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.384+0000 7f09cca06700 1 --2- 172.21.15.110:0/3542550562 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09c80bbca0 0x7f09c81596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:16.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.384+0000 7f09cd207700 1 --2- 172.21.15.110:0/3542550562 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f09c80c0330 0x7f09c814a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:16.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.385+0000 7f09c7fff700 1 -- 172.21.15.110:0/3542550562 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09c80bbca0 msgr2=0x7f09c81596f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:16.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.385+0000 7f09c7fff700 1 --2- 172.21.15.110:0/3542550562 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09c80bbca0 0x7f09c81596f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:16.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.385+0000 7f09c7fff700 1 -- 172.21.15.110:0/3542550562 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f09c80c0330 msgr2=0x7f09c814a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:16.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.385+0000 7f09c7fff700 1 --2- 172.21.15.110:0/3542550562 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f09c80c0330 0x7f09c814a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:16.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.385+0000 7f09c7fff700 1 -- 172.21.15.110:0/3542550562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c814b600 con 0x7f09c80bc5f0 2021-03-25T14:18:16.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.385+0000 7f09c7fff700 1 --2- 172.21.15.110:0/3542550562 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09c80bc5f0 0x7f09c80b3fe0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7f09b400dbc0 tx=0x7f09b4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:16.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.385+0000 7f09c4ff9700 1 -- 172.21.15.110:0/3542550562 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b400be50 con 0x7f09c80bc5f0 2021-03-25T14:18:16.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.385+0000 7f09c4ff9700 1 -- 172.21.15.110:0/3542550562 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b40097c0 con 0x7f09c80bc5f0 2021-03-25T14:18:16.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.385+0000 7f09c4ff9700 1 -- 172.21.15.110:0/3542550562 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b4009b40 con 0x7f09c80bc5f0 2021-03-25T14:18:16.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.385+0000 7f09cec6a700 1 -- 172.21.15.110:0/3542550562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09c814b8a0 con 0x7f09c80bc5f0 2021-03-25T14:18:16.393 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.385+0000 7f09cec6a700 1 -- 172.21.15.110:0/3542550562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09c814bb40 con 0x7f09c80bc5f0 2021-03-25T14:18:16.394 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.386+0000 7f09cec6a700 1 -- 172.21.15.110:0/3542550562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09c80b17d0 con 0x7f09c80bc5f0 2021-03-25T14:18:16.394 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.386+0000 7f09c4ff9700 1 -- 172.21.15.110:0/3542550562 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f09b4013480 con 0x7f09c80bc5f0 2021-03-25T14:18:16.394 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.386+0000 7f09c4ff9700 1 --2- 172.21.15.110:0/3542550562 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f09a805a0b0 0x7f09a805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:16.394 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.386+0000 7f09c4ff9700 1 -- 172.21.15.110:0/3542550562 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5778+0+0 (secure 0 0 0) 0x7f09b4073df0 con 0x7f09c80bc5f0 2021-03-25T14:18:16.394 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.386+0000 7f09cca06700 1 --2- 172.21.15.110:0/3542550562 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f09a805a0b0 0x7f09a805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:16.394 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.387+0000 7f09cca06700 1 --2- 172.21.15.110:0/3542550562 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f09a805a0b0 0x7f09a805c570 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f09bc006f20 tx=0x7f09bc016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:16.394 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.390+0000 7f09c4ff9700 1 -- 172.21.15.110:0/3542550562 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f09b4047850 con 0x7f09c80bc5f0 2021-03-25T14:18:16.554 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:16.553+0000 7f09cec6a700 1 -- 172.21.15.110:0/3542550562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f09c805d7b0 con 0x7f09c80bc5f0 2021-03-25T14:18:17.522 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.521+0000 7f09c4ff9700 1 -- 172.21.15.110:0/3542550562 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v68) v1 ==== 97+0+0 (secure 0 0 0) 0x7f09b404ae70 con 0x7f09c80bc5f0 2021-03-25T14:18:17.525 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.523+0000 7f09cec6a700 1 -- 172.21.15.110:0/3542550562 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f09a805a0b0 msgr2=0x7f09a805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:17.525 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.523+0000 7f09cec6a700 1 --2- 172.21.15.110:0/3542550562 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f09a805a0b0 0x7f09a805c570 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f09bc006f20 tx=0x7f09bc016000).stop 2021-03-25T14:18:17.526 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.523+0000 7f09cec6a700 1 -- 172.21.15.110:0/3542550562 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09c80bc5f0 msgr2=0x7f09c80b3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:17.526 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.523+0000 7f09cec6a700 1 --2- 172.21.15.110:0/3542550562 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09c80bc5f0 0x7f09c80b3fe0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7f09b400dbc0 tx=0x7f09b4008040).stop 2021-03-25T14:18:17.526 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.523+0000 7f09cec6a700 1 -- 172.21.15.110:0/3542550562 shutdown_connections 2021-03-25T14:18:17.526 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.523+0000 7f09cec6a700 1 --2- 172.21.15.110:0/3542550562 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f09a805a0b0 0x7f09a805c570 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:17.526 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.523+0000 7f09cec6a700 1 --2- 172.21.15.110:0/3542550562 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f09c80c0330 0x7f09c814a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:17.526 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.523+0000 7f09cec6a700 1 --2- 172.21.15.110:0/3542550562 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09c80bbca0 0x7f09c81596f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:17.526 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.523+0000 7f09cec6a700 1 --2- 172.21.15.110:0/3542550562 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09c80bc5f0 0x7f09c80b3fe0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:17.526 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.523+0000 7f09cec6a700 1 -- 172.21.15.110:0/3542550562 >> 172.21.15.110:0/3542550562 conn(0x7f09c8064860 msgr2=0x7f09c8148ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:17.526 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.523+0000 7f09cec6a700 1 -- 172.21.15.110:0/3542550562 shutdown_connections 2021-03-25T14:18:17.526 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.523+0000 7f09cec6a700 1 -- 172.21.15.110:0/3542550562 wait complete. 2021-03-25T14:18:17.527 INFO:teuthology.orchestra.run.smithi110.stderr: removed all blocklist entries 2021-03-25T14:18:17.539 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-03-25T14:18:17.655 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.653+0000 7f4d37fff700 1 Processor -- start 2021-03-25T14:18:17.655 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.653+0000 7f4d37fff700 1 -- start start 2021-03-25T14:18:17.657 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.654+0000 7f4d37fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4d380ba680 0x7f4d380baa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:17.657 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.654+0000 7f4d37fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4d380b86d0 0x7f4d380bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:17.658 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.654+0000 7f4d37fff700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d380bbcd0 con 0x7f4d3814cdd0 2021-03-25T14:18:17.658 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.654+0000 7f4d37fff700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d380bbf70 con 0x7f4d380ba680 2021-03-25T14:18:17.658 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.654+0000 7f4d37fff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d380bc210 con 0x7f4d380b86d0 2021-03-25T14:18:17.658 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.654+0000 7f4d36ffd700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4d380ba680 0x7f4d380baa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:17.658 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.654+0000 7f4d377fe700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f4d3814cdd0 0x7f4d3814d220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44398/0 (socket says 172.21.15.110:44398) 2021-03-25T14:18:17.658 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.654+0000 7f4d377fe700 1 -- 172.21.15.110:0/3139365873 learned_addr learned my addr 172.21.15.110:0/3139365873 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:18:17.658 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.654+0000 7f4d36ffd700 1 -- 172.21.15.110:0/3139365873 >> v2:172.21.15.174:3300/0 conn(0x7f4d380b86d0 msgr2=0x7f4d380bcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:17.658 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.654+0000 7f4d36ffd700 1 --2- 172.21.15.110:0/3139365873 >> v2:172.21.15.174:3300/0 conn(0x7f4d380b86d0 0x7f4d380bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-03-25T14:18:17.658 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.654+0000 7f4d36ffd700 1 -- 172.21.15.110:0/3139365873 >> v1:172.21.15.110:6789/0 conn(0x7f4d3814cdd0 legacy=0x7f4d3814d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:17.658 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.654+0000 7f4d36ffd700 1 -- 172.21.15.110:0/3139365873 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d380bc4b0 con 0x7f4d380ba680 2021-03-25T14:18:17.658 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.654+0000 7f4d36ffd700 1 --2- 172.21.15.110:0/3139365873 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d380ba680 0x7f4d380baa60 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f4d3814a980 tx=0x7f4d28006e20).ready entity=mon.0 client_cookie=2b61109bb58f0f3e server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:17.659 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.654+0000 7f4d35ffb700 1 -- 172.21.15.110:0/3139365873 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d28009870 con 0x7f4d380ba680 2021-03-25T14:18:17.659 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.654+0000 7f4d35ffb700 1 -- 172.21.15.110:0/3139365873 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d280099d0 con 0x7f4d380ba680 2021-03-25T14:18:17.659 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.654+0000 7f4d35ffb700 1 -- 172.21.15.110:0/3139365873 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d28009d50 con 0x7f4d380ba680 2021-03-25T14:18:17.659 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.655+0000 7f4d37fff700 1 -- 172.21.15.110:0/3139365873 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d380ba680 msgr2=0x7f4d380baa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:17.659 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.655+0000 7f4d37fff700 1 --2- 172.21.15.110:0/3139365873 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d380ba680 0x7f4d380baa60 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f4d3814a980 tx=0x7f4d28006e20).stop 2021-03-25T14:18:17.659 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.655+0000 7f4d37fff700 1 -- 172.21.15.110:0/3139365873 shutdown_connections 2021-03-25T14:18:17.659 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.655+0000 7f4d37fff700 1 --2- 172.21.15.110:0/3139365873 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d380ba680 0x7f4d380baa60 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:17.659 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.655+0000 7f4d37fff700 1 --2- 172.21.15.110:0/3139365873 >> v2:172.21.15.174:3300/0 conn(0x7f4d380b86d0 0x7f4d380bcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-03-25T14:18:17.659 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.655+0000 7f4d37fff700 1 -- 172.21.15.110:0/3139365873 >> 172.21.15.110:0/3139365873 conn(0x7f4d38060c40 msgr2=0x7f4d38061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:17.659 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.655+0000 7f4d37fff700 1 -- 172.21.15.110:0/3139365873 shutdown_connections 2021-03-25T14:18:17.659 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.655+0000 7f4d37fff700 1 -- 172.21.15.110:0/3139365873 wait complete. 2021-03-25T14:18:17.662 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.656+0000 7f4d37fff700 1 Processor -- start 2021-03-25T14:18:17.663 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.656+0000 7f4d37fff700 1 -- start start 2021-03-25T14:18:17.663 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.657+0000 7f4d37fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d380b86d0 0x7f4d38159090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:17.663 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.657+0000 7f4d37fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d380ba680 0x7f4d380b72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:17.663 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.657+0000 7f4d37fff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d3814cdd0 0x7f4d3815ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:17.663 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.657+0000 7f4d37fff700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d38159580 con 0x7f4d380ba680 2021-03-25T14:18:17.663 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.657+0000 7f4d37fff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d38065940 con 0x7f4d3814cdd0 2021-03-25T14:18:17.664 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.657+0000 7f4d37fff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d38065400 con 0x7f4d380b86d0 2021-03-25T14:18:17.664 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.657+0000 7f4d367fc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d380ba680 0x7f4d380b72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:17.664 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.657+0000 7f4d367fc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d380ba680 0x7f4d380b72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51466/0 (socket says 172.21.15.110:51466) 2021-03-25T14:18:17.664 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.657+0000 7f4d367fc700 1 -- 172.21.15.110:0/3483598441 learned_addr learned my addr 172.21.15.110:0/3483598441 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:17.664 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.657+0000 7f4d377fe700 1 --2- 172.21.15.110:0/3483598441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d3814cdd0 0x7f4d3815ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:17.664 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.657+0000 7f4d36ffd700 1 --2- 172.21.15.110:0/3483598441 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d380b86d0 0x7f4d38159090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:17.664 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.657+0000 7f4d367fc700 1 -- 172.21.15.110:0/3483598441 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d380b86d0 msgr2=0x7f4d38159090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:17.664 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.657+0000 7f4d367fc700 1 --2- 172.21.15.110:0/3483598441 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d380b86d0 0x7f4d38159090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:17.664 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.657+0000 7f4d367fc700 1 -- 172.21.15.110:0/3483598441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d3814cdd0 msgr2=0x7f4d3815ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:17.664 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.657+0000 7f4d367fc700 1 --2- 172.21.15.110:0/3483598441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d3814cdd0 0x7f4d3815ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:17.664 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.657+0000 7f4d367fc700 1 -- 172.21.15.110:0/3483598441 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d380656a0 con 0x7f4d380ba680 2021-03-25T14:18:17.664 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.657+0000 7f4d367fc700 1 --2- 172.21.15.110:0/3483598441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d380ba680 0x7f4d380b72b0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f4d2c009730 tx=0x7f4d2c006e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:17.665 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.658+0000 7f4d1effd700 1 -- 172.21.15.110:0/3483598441 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c00d520 con 0x7f4d380ba680 2021-03-25T14:18:17.665 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.658+0000 7f4d1effd700 1 -- 172.21.15.110:0/3483598441 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2c00d680 con 0x7f4d380ba680 2021-03-25T14:18:17.665 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.658+0000 7f4d1effd700 1 -- 172.21.15.110:0/3483598441 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c00da40 con 0x7f4d380ba680 2021-03-25T14:18:17.665 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.658+0000 7f4d37fff700 1 -- 172.21.15.110:0/3483598441 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d3815c6f0 con 0x7f4d380ba680 2021-03-25T14:18:17.665 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.658+0000 7f4d37fff700 1 -- 172.21.15.110:0/3483598441 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d380b77a0 con 0x7f4d380ba680 2021-03-25T14:18:17.665 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.658+0000 7f4d37fff700 1 -- 172.21.15.110:0/3483598441 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d3815cb50 con 0x7f4d380ba680 2021-03-25T14:18:17.665 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.659+0000 7f4d1effd700 1 -- 172.21.15.110:0/3483598441 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f4d2c012440 con 0x7f4d380ba680 2021-03-25T14:18:17.665 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.659+0000 7f4d1effd700 1 --2- 172.21.15.110:0/3483598441 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4d1805a0b0 0x7f4d1805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:17.665 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.659+0000 7f4d1effd700 1 -- 172.21.15.110:0/3483598441 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5606+0+0 (secure 0 0 0) 0x7f4d2c073c70 con 0x7f4d380ba680 2021-03-25T14:18:17.665 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.659+0000 7f4d36ffd700 1 --2- 172.21.15.110:0/3483598441 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4d1805a0b0 0x7f4d1805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:17.665 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.659+0000 7f4d36ffd700 1 --2- 172.21.15.110:0/3483598441 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4d1805a0b0 0x7f4d1805c570 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f4d3814a980 tx=0x7f4d28016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:17.666 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.663+0000 7f4d1effd700 1 -- 172.21.15.110:0/3483598441 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f4d2c04b260 con 0x7f4d380ba680 2021-03-25T14:18:17.871 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.868+0000 7f4d37fff700 1 -- 172.21.15.110:0/3483598441 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4d38045ae0 con 0x7f4d380ba680 2021-03-25T14:18:17.871 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.869+0000 7f4d1effd700 1 -- 172.21.15.110:0/3483598441 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+4915 (secure 0 0 0) 0x7f4d2c00ddb0 con 0x7f4d380ba680 2021-03-25T14:18:17.872 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:18:17.872 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2021-03-25T14:18:17.872 INFO:teuthology.orchestra.run.smithi110.stdout: "auth_dump": [ 2021-03-25T14:18:17.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:18:17.872 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "mds.a", 2021-03-25T14:18:17.872 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDxmlxgu8aCEhAA9Q4e7SWq5aDsLFgylcYasw==", 2021-03-25T14:18:17.872 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:18:17.872 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": "allow", 2021-03-25T14:18:17.872 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2021-03-25T14:18:17.873 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2021-03-25T14:18:17.873 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:18:17.873 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:18:17.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:18:17.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:18:17.873 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "mds.b", 2021-03-25T14:18:17.873 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDxmlxgMKt4HRAA2Zg+dO3gKKuJXsTBqargjg==", 2021-03-25T14:18:17.873 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:18:17.873 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": "allow", 2021-03-25T14:18:17.873 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2021-03-25T14:18:17.873 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2021-03-25T14:18:17.873 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:18:17.873 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:18:17.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:18:17.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:18:17.874 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "mds.c", 2021-03-25T14:18:17.874 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDxmlxgEUUtGRAA88JXgGt3G5BUFrM3XSrcqA==", 2021-03-25T14:18:17.874 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:18:17.874 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": "allow", 2021-03-25T14:18:17.874 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2021-03-25T14:18:17.874 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2021-03-25T14:18:17.874 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:18:17.874 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:18:17.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:18:17.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:18:17.875 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "mds.d", 2021-03-25T14:18:17.875 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDxmlxgW9AxJBAA15D4zF2B1SapEee6SmRcvg==", 2021-03-25T14:18:17.875 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:18:17.875 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": "allow", 2021-03-25T14:18:17.875 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2021-03-25T14:18:17.875 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2021-03-25T14:18:17.875 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:18:17.875 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:18:17.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:18:17.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:18:17.875 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "osd.0", 2021-03-25T14:18:17.875 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDymlxgwZp8OBAAq9v4WdTkWcbGA+npuycbMg==", 2021-03-25T14:18:17.875 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:18:17.876 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2021-03-25T14:18:17.876 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2021-03-25T14:18:17.876 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:18:17.876 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:18:17.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:18:17.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:18:17.876 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "osd.1", 2021-03-25T14:18:17.876 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQD1mlxgGbipOBAA4pnOC/cuKte3/s/OynFO4Q==", 2021-03-25T14:18:17.876 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:18:17.876 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2021-03-25T14:18:17.876 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2021-03-25T14:18:17.876 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:18:17.877 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:18:17.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:18:17.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:18:17.877 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "osd.2", 2021-03-25T14:18:17.877 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQD4mlxgoMlQNhAAX+mGQaqbPBWJ6ML34o+2Ag==", 2021-03-25T14:18:17.877 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:18:17.877 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2021-03-25T14:18:17.877 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2021-03-25T14:18:17.877 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:18:17.877 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:18:17.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:18:17.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:18:17.878 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "osd.3", 2021-03-25T14:18:17.878 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQD7mlxgwMTDMxAASdzfZH/r/hxi4yntbTE44A==", 2021-03-25T14:18:17.878 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:18:17.878 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2021-03-25T14:18:17.878 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2021-03-25T14:18:17.878 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:18:17.878 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:18:17.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:18:17.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:18:17.878 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "osd.4", 2021-03-25T14:18:17.878 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQABm1xgveHKFxAAxxfuXs2iAaCtDS99y84xUA==", 2021-03-25T14:18:17.878 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:18:17.879 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2021-03-25T14:18:17.879 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2021-03-25T14:18:17.879 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:18:17.879 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:18:17.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:18:17.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:18:17.879 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "osd.5", 2021-03-25T14:18:17.879 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQAEm1xgfmgAFhAAS7sBExbnejoEm+RPDBfUbA==", 2021-03-25T14:18:17.879 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:18:17.879 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2021-03-25T14:18:17.879 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2021-03-25T14:18:17.879 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:18:17.879 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:18:17.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:18:17.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:18:17.880 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "osd.6", 2021-03-25T14:18:17.880 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQAHm1xg4ve5ExAA/lvAG/VBB5q20gHi8/t7qg==", 2021-03-25T14:18:17.880 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:18:17.880 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2021-03-25T14:18:17.880 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2021-03-25T14:18:17.880 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:18:17.880 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:18:17.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:18:17.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:18:17.880 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "osd.7", 2021-03-25T14:18:17.881 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQAKm1xgmgHpERAA5e/kkmZ5/bM9r1eLQn+47Q==", 2021-03-25T14:18:17.881 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:18:17.881 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2021-03-25T14:18:17.881 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2021-03-25T14:18:17.881 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:18:17.881 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:18:17.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:18:17.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:18:17.881 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "client.0", 2021-03-25T14:18:17.881 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDxmlxg8erbJxAAJisHYL2sfUoCtEM84zXmTQ==", 2021-03-25T14:18:17.881 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:18:17.881 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": "allow", 2021-03-25T14:18:17.882 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow r", 2021-03-25T14:18:17.882 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow rw pool=cephfs_data" 2021-03-25T14:18:17.882 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:18:17.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:18:17.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:18:17.882 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "client.1", 2021-03-25T14:18:17.882 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDxmlxg7uW1KhAAkf3kOWqyE6uoDsXybdU8CQ==", 2021-03-25T14:18:17.882 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:18:17.882 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": "allow", 2021-03-25T14:18:17.882 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow r", 2021-03-25T14:18:17.882 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow rw pool=cephfs2_data" 2021-03-25T14:18:17.882 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:18:17.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:18:17.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:18:17.883 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "client.admin", 2021-03-25T14:18:17.883 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDwmlxguzAoMxAA3QaeA8eVjVA329iGXhytNg==", 2021-03-25T14:18:17.883 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:18:17.883 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": "allow *", 2021-03-25T14:18:17.883 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2021-03-25T14:18:17.883 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2021-03-25T14:18:17.883 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:18:17.883 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:18:17.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:18:17.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:18:17.884 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "client.testuser", 2021-03-25T14:18:17.884 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQCUm1xgyGE0ABAApeS6A64YWd5WKKCc5/rHFg==", 2021-03-25T14:18:17.884 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:18:17.884 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": "allow rw fsname=cephfs", 2021-03-25T14:18:17.884 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow rw fsname=cephfs, allow rw fsname=cephfs2", 2021-03-25T14:18:17.884 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2021-03-25T14:18:17.884 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:18:17.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:18:17.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:18:17.884 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "mgr.x", 2021-03-25T14:18:17.884 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDxmlxgW4eaDxAAeURkSVsbMqQMPgz6bES0zw==", 2021-03-25T14:18:17.884 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:18:17.885 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": "allow *", 2021-03-25T14:18:17.885 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow profile mgr", 2021-03-25T14:18:17.885 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:18:17.885 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:18:17.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:18:17.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:18:17.885 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "mgr.y", 2021-03-25T14:18:17.885 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDxmlxgil5jCxAAt3504C7TGciH7KF4EIkmhw==", 2021-03-25T14:18:17.885 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2021-03-25T14:18:17.885 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": "allow *", 2021-03-25T14:18:17.885 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow profile mgr", 2021-03-25T14:18:17.885 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2021-03-25T14:18:17.885 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:18:17.886 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:18:17.886 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2021-03-25T14:18:17.886 INFO:teuthology.orchestra.run.smithi110.stdout:} 2021-03-25T14:18:17.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.871+0000 7f4d37fff700 1 -- 172.21.15.110:0/3483598441 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4d1805a0b0 msgr2=0x7f4d1805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:17.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.871+0000 7f4d37fff700 1 --2- 172.21.15.110:0/3483598441 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4d1805a0b0 0x7f4d1805c570 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f4d3814a980 tx=0x7f4d28016000).stop 2021-03-25T14:18:17.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.871+0000 7f4d37fff700 1 -- 172.21.15.110:0/3483598441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d380ba680 msgr2=0x7f4d380b72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:17.888 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.871+0000 7f4d37fff700 1 --2- 172.21.15.110:0/3483598441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d380ba680 0x7f4d380b72b0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f4d2c009730 tx=0x7f4d2c006e50).stop 2021-03-25T14:18:17.888 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.871+0000 7f4d37fff700 1 -- 172.21.15.110:0/3483598441 shutdown_connections 2021-03-25T14:18:17.888 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.871+0000 7f4d37fff700 1 --2- 172.21.15.110:0/3483598441 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f4d1805a0b0 0x7f4d1805c570 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:17.888 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.871+0000 7f4d37fff700 1 --2- 172.21.15.110:0/3483598441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d3814cdd0 0x7f4d3815ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:17.888 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.871+0000 7f4d37fff700 1 --2- 172.21.15.110:0/3483598441 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d380b86d0 0x7f4d38159090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:17.888 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.871+0000 7f4d37fff700 1 --2- 172.21.15.110:0/3483598441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d380ba680 0x7f4d380b72b0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:17.888 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.871+0000 7f4d37fff700 1 -- 172.21.15.110:0/3483598441 >> 172.21.15.110:0/3483598441 conn(0x7f4d38060c40 msgr2=0x7f4d380b9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:17.888 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.871+0000 7f4d37fff700 1 -- 172.21.15.110:0/3483598441 shutdown_connections 2021-03-25T14:18:17.888 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.871+0000 7f4d37fff700 1 -- 172.21.15.110:0/3483598441 wait complete. 2021-03-25T14:18:17.889 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.testuser 2021-03-25T14:18:18.009 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.997+0000 7fb8abc20700 1 Processor -- start 2021-03-25T14:18:18.070 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.997+0000 7fb8abc20700 1 -- start start 2021-03-25T14:18:18.070 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.998+0000 7fb8abc20700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8a40b6460 0x7fb8a4067470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:18.070 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.998+0000 7fb8abc20700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8a40b2940 con 0x7fb8a4069040 2021-03-25T14:18:18.070 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.998+0000 7fb8abc20700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8a40649b0 con 0x7fb8a40b0be0 2021-03-25T14:18:18.070 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.998+0000 7fb8abc20700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a4064c50 con 0x7fb8a40b6460 2021-03-25T14:18:18.070 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.998+0000 7fb8aa1bd700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fb8a4069040 0x7fb8a4144fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44412/0 (socket says 172.21.15.110:44412) 2021-03-25T14:18:18.070 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.998+0000 7fb8aa1bd700 1 -- 172.21.15.110:0/984909949 learned_addr learned my addr 172.21.15.110:0/984909949 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:18:18.070 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.998+0000 7fb8a91bb700 1 --2- 172.21.15.110:0/984909949 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8a40b6460 0x7fb8a4067470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:18.070 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.998+0000 7fb8a89ba700 1 -- 172.21.15.110:0/984909949 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1939748686 0 0) 0x7fb8a40b2940 con 0x7fb8a4069040 2021-03-25T14:18:18.070 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.998+0000 7fb8a89ba700 1 -- 172.21.15.110:0/984909949 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb88c003270 con 0x7fb8a4069040 2021-03-25T14:18:18.071 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.999+0000 7fb8a89ba700 1 -- 172.21.15.110:0/984909949 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1058374738 0 0) 0x7fb8a40649b0 con 0x7fb8a40b0be0 2021-03-25T14:18:18.071 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.999+0000 7fb8a89ba700 1 -- 172.21.15.110:0/984909949 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8a40b2940 con 0x7fb8a40b0be0 2021-03-25T14:18:18.071 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.999+0000 7fb8a91bb700 1 -- 172.21.15.110:0/984909949 >> v1:172.21.15.174:6789/0 conn(0x7fb8a40b0be0 legacy=0x7fb8a40b84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:18.071 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.999+0000 7fb8a91bb700 1 -- 172.21.15.110:0/984909949 >> v1:172.21.15.110:6789/0 conn(0x7fb8a4069040 legacy=0x7fb8a4144fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:18.071 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.999+0000 7fb8a89ba700 1 -- 172.21.15.110:0/984909949 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1474282958 0 0) 0x7fb88c003270 con 0x7fb8a4069040 2021-03-25T14:18:18.071 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.999+0000 7fb8a91bb700 1 -- 172.21.15.110:0/984909949 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a40b72f0 con 0x7fb8a40b6460 2021-03-25T14:18:18.071 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.999+0000 7fb8a91bb700 1 --2- 172.21.15.110:0/984909949 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8a40b6460 0x7fb8a4067470 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fb8a4064d90 tx=0x7fb898006e20).ready entity=mon.2 client_cookie=1cc76b67dd9ba33c server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:18.071 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.999+0000 7fb8a89ba700 1 -- 172.21.15.110:0/984909949 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c0018a0 con 0x7fb8a40b6460 2021-03-25T14:18:18.071 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.999+0000 7fb8a89ba700 1 -- 172.21.15.110:0/984909949 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb898011400 con 0x7fb8a40b6460 2021-03-25T14:18:18.071 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.999+0000 7fb8a89ba700 1 -- 172.21.15.110:0/984909949 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb898011780 con 0x7fb8a40b6460 2021-03-25T14:18:18.071 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.999+0000 7fb8abc20700 1 -- 172.21.15.110:0/984909949 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8a40b6460 msgr2=0x7fb8a4067470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:18.071 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:17.999+0000 7fb8abc20700 1 --2- 172.21.15.110:0/984909949 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8a40b6460 0x7fb8a4067470 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fb8a4064d90 tx=0x7fb898006e20).stop 2021-03-25T14:18:18.072 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.000+0000 7fb8abc20700 1 -- 172.21.15.110:0/984909949 shutdown_connections 2021-03-25T14:18:18.072 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.000+0000 7fb8abc20700 1 --2- 172.21.15.110:0/984909949 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8a40b6460 0x7fb8a4067470 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:18.072 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.000+0000 7fb8abc20700 1 -- 172.21.15.110:0/984909949 >> 172.21.15.110:0/984909949 conn(0x7fb8a40663f0 msgr2=0x7fb8a4066800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:18.072 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.000+0000 7fb8abc20700 1 -- 172.21.15.110:0/984909949 shutdown_connections 2021-03-25T14:18:18.072 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.000+0000 7fb8abc20700 1 -- 172.21.15.110:0/984909949 wait complete. 2021-03-25T14:18:18.072 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.001+0000 7fb8abc20700 1 Processor -- start 2021-03-25T14:18:18.072 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.001+0000 7fb8abc20700 1 -- start start 2021-03-25T14:18:18.072 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.001+0000 7fb8abc20700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8a4069040 0x7fb8a4158cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:18.072 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.001+0000 7fb8abc20700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8a40b0be0 0x7fb8a4148160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:18.072 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.001+0000 7fb8abc20700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8a40b6460 0x7fb8a40b84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:18.072 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.001+0000 7fb8abc20700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a4148a70 con 0x7fb8a40b6460 2021-03-25T14:18:18.072 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.001+0000 7fb8abc20700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a41582e0 con 0x7fb8a4069040 2021-03-25T14:18:18.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.001+0000 7fb8abc20700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a4158580 con 0x7fb8a40b0be0 2021-03-25T14:18:18.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.001+0000 7fb8aa1bd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8a40b6460 0x7fb8a40b84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:18.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.001+0000 7fb8aa1bd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8a40b6460 0x7fb8a40b84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51482/0 (socket says 172.21.15.110:51482) 2021-03-25T14:18:18.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.001+0000 7fb8aa1bd700 1 -- 172.21.15.110:0/2320190252 learned_addr learned my addr 172.21.15.110:0/2320190252 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:18.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.002+0000 7fb8a91bb700 1 --2- 172.21.15.110:0/2320190252 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8a40b0be0 0x7fb8a4148160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:18.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.001+0000 7fb8a99bc700 1 --2- 172.21.15.110:0/2320190252 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8a4069040 0x7fb8a4158cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:18.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.002+0000 7fb8aa1bd700 1 -- 172.21.15.110:0/2320190252 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8a40b0be0 msgr2=0x7fb8a4148160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:18.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.002+0000 7fb8aa1bd700 1 --2- 172.21.15.110:0/2320190252 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8a40b0be0 0x7fb8a4148160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:18.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.002+0000 7fb8aa1bd700 1 -- 172.21.15.110:0/2320190252 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8a4069040 msgr2=0x7fb8a4158cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:18.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.002+0000 7fb8aa1bd700 1 --2- 172.21.15.110:0/2320190252 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8a4069040 0x7fb8a4158cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:18.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.002+0000 7fb8aa1bd700 1 -- 172.21.15.110:0/2320190252 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a4158820 con 0x7fb8a40b6460 2021-03-25T14:18:18.073 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.002+0000 7fb8aa1bd700 1 --2- 172.21.15.110:0/2320190252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8a40b6460 0x7fb8a40b84b0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7fb89c001750 tx=0x7fb89c001990).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:18.074 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.002+0000 7fb895ffb700 1 -- 172.21.15.110:0/2320190252 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c018070 con 0x7fb8a40b6460 2021-03-25T14:18:18.074 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.002+0000 7fb895ffb700 1 -- 172.21.15.110:0/2320190252 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb89c00a900 con 0x7fb8a40b6460 2021-03-25T14:18:18.074 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.002+0000 7fb8abc20700 1 -- 172.21.15.110:0/2320190252 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a4148650 con 0x7fb8a40b6460 2021-03-25T14:18:18.074 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.002+0000 7fb895ffb700 1 -- 172.21.15.110:0/2320190252 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c00aca0 con 0x7fb8a40b6460 2021-03-25T14:18:18.074 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.002+0000 7fb8abc20700 1 -- 172.21.15.110:0/2320190252 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a409ece0 con 0x7fb8a40b6460 2021-03-25T14:18:18.074 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.003+0000 7fb8abc20700 1 -- 172.21.15.110:0/2320190252 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8a4066d50 con 0x7fb8a40b6460 2021-03-25T14:18:18.074 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.003+0000 7fb895ffb700 1 -- 172.21.15.110:0/2320190252 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fb89c004ac0 con 0x7fb8a40b6460 2021-03-25T14:18:18.074 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.004+0000 7fb895ffb700 1 --2- 172.21.15.110:0/2320190252 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb88405a0b0 0x7fb88405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:18.074 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.004+0000 7fb895ffb700 1 -- 172.21.15.110:0/2320190252 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5606+0+0 (secure 0 0 0) 0x7fb89c077990 con 0x7fb8a40b6460 2021-03-25T14:18:18.074 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.004+0000 7fb8a99bc700 1 --2- 172.21.15.110:0/2320190252 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb88405a0b0 0x7fb88405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:18.074 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.004+0000 7fb8a99bc700 1 --2- 172.21.15.110:0/2320190252 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb88405a0b0 0x7fb88405c570 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7fb8a00037a0 tx=0x7fb8a0007a50).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:18.075 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.007+0000 7fb895ffb700 1 -- 172.21.15.110:0/2320190252 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fb89c04b500 con 0x7fb8a40b6460 2021-03-25T14:18:18.216 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.215+0000 7fb8abc20700 1 -- 172.21.15.110:0/2320190252 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.testuser"} v 0) v1 -- 0x7fb8a41589b0 con 0x7fb8a40b6460 2021-03-25T14:18:18.219 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.218+0000 7fb895ffb700 1 -- 172.21.15.110:0/2320190252 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.testuser"}]=0 updated v16) v1 ==== 92+0+0 (secure 0 0 0) 0x7fb89c04eb20 con 0x7fb8a40b6460 2021-03-25T14:18:18.222 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.220+0000 7fb8abc20700 1 -- 172.21.15.110:0/2320190252 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb88405a0b0 msgr2=0x7fb88405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:18.222 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.220+0000 7fb8abc20700 1 --2- 172.21.15.110:0/2320190252 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb88405a0b0 0x7fb88405c570 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7fb8a00037a0 tx=0x7fb8a0007a50).stop 2021-03-25T14:18:18.222 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.220+0000 7fb8abc20700 1 -- 172.21.15.110:0/2320190252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8a40b6460 msgr2=0x7fb8a40b84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:18.222 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.220+0000 7fb8abc20700 1 --2- 172.21.15.110:0/2320190252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8a40b6460 0x7fb8a40b84b0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7fb89c001750 tx=0x7fb89c001990).stop 2021-03-25T14:18:18.222 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.220+0000 7fb8abc20700 1 -- 172.21.15.110:0/2320190252 shutdown_connections 2021-03-25T14:18:18.222 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.220+0000 7fb8abc20700 1 --2- 172.21.15.110:0/2320190252 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb88405a0b0 0x7fb88405c570 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:18.223 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.220+0000 7fb8abc20700 1 --2- 172.21.15.110:0/2320190252 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8a4069040 0x7fb8a4158cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:18.223 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.220+0000 7fb8abc20700 1 --2- 172.21.15.110:0/2320190252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8a40b6460 0x7fb8a40b84b0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:18.223 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.220+0000 7fb8abc20700 1 --2- 172.21.15.110:0/2320190252 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8a40b0be0 0x7fb8a4148160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:18.223 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.220+0000 7fb8abc20700 1 -- 172.21.15.110:0/2320190252 >> 172.21.15.110:0/2320190252 conn(0x7fb8a40663f0 msgr2=0x7fb8a4143810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:18.223 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.220+0000 7fb8abc20700 1 -- 172.21.15.110:0/2320190252 shutdown_connections 2021-03-25T14:18:18.223 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.220+0000 7fb8abc20700 1 -- 172.21.15.110:0/2320190252 wait complete. 2021-03-25T14:18:18.223 INFO:teuthology.orchestra.run.smithi110.stderr:updated 2021-03-25T14:18:18.233 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:18:18.343 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.341+0000 7f832057a700 1 Processor -- start 2021-03-25T14:18:18.343 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.341+0000 7f832057a700 1 -- start start 2021-03-25T14:18:18.346 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.342+0000 7f832057a700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f83180b99b0 0x7f83180ba4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:18.346 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.342+0000 7f832057a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f831814a050 0x7f83181488b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:18.346 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.342+0000 7f832057a700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83180babc0 con 0x7f8318148da0 2021-03-25T14:18:18.346 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.342+0000 7f832057a700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83180ba9e0 con 0x7f83180b99b0 2021-03-25T14:18:18.347 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.342+0000 7f832057a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83180bae60 con 0x7f831814a050 2021-03-25T14:18:18.347 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.342+0000 7f831e316700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f83180b99b0 0x7f83180ba4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:18.347 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.342+0000 7f831eb17700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f8318148da0 0x7f83180a3190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44422/0 (socket says 172.21.15.110:44422) 2021-03-25T14:18:18.347 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.342+0000 7f831eb17700 1 -- 172.21.15.110:0/3817860 learned_addr learned my addr 172.21.15.110:0/3817860 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:18:18.347 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.342+0000 7f831e316700 1 --2- 172.21.15.110:0/3817860 >> v2:172.21.15.110:3300/0 conn(0x7f83180b99b0 0x7f83180ba4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51486/0 (socket says 172.21.15.110:51486) 2021-03-25T14:18:18.347 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.343+0000 7f831db15700 1 --2- 172.21.15.110:0/3817860 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f831814a050 0x7f83181488b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:18.347 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.343+0000 7f831e316700 1 -- 172.21.15.110:0/3817860 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f831814a050 msgr2=0x7f83181488b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:18.347 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.343+0000 7f831e316700 1 --2- 172.21.15.110:0/3817860 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f831814a050 0x7f83181488b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:18.347 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.343+0000 7f831e316700 1 -- 172.21.15.110:0/3817860 >> v1:172.21.15.110:6789/0 conn(0x7f8318148da0 legacy=0x7f83180a3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:18.347 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.343+0000 7f831d314700 1 -- 172.21.15.110:0/3817860 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3863169187 0 0) 0x7f83180babc0 con 0x7f8318148da0 2021-03-25T14:18:18.347 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.343+0000 7f831e316700 1 -- 172.21.15.110:0/3817860 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83180a2a50 con 0x7f83180b99b0 2021-03-25T14:18:18.347 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.343+0000 7f831e316700 1 --2- 172.21.15.110:0/3817860 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83180b99b0 0x7f83180ba4f0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f831400b9b0 tx=0x7f8314006dc0).ready entity=mon.0 client_cookie=1acf2ae742d73a92 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:18.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.343+0000 7f831d314700 1 -- 172.21.15.110:0/3817860 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8314006030 con 0x7f83180b99b0 2021-03-25T14:18:18.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.343+0000 7f831d314700 1 -- 172.21.15.110:0/3817860 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8314006190 con 0x7f83180b99b0 2021-03-25T14:18:18.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.343+0000 7f831d314700 1 -- 172.21.15.110:0/3817860 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8314006510 con 0x7f83180b99b0 2021-03-25T14:18:18.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.343+0000 7f832057a700 1 -- 172.21.15.110:0/3817860 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83180b99b0 msgr2=0x7f83180ba4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:18.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.343+0000 7f832057a700 1 --2- 172.21.15.110:0/3817860 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83180b99b0 0x7f83180ba4f0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f831400b9b0 tx=0x7f8314006dc0).stop 2021-03-25T14:18:18.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.343+0000 7f832057a700 1 -- 172.21.15.110:0/3817860 shutdown_connections 2021-03-25T14:18:18.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.343+0000 7f832057a700 1 --2- 172.21.15.110:0/3817860 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83180b99b0 0x7f83180ba4f0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:18.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.343+0000 7f832057a700 1 --2- 172.21.15.110:0/3817860 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f831814a050 0x7f83181488b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:18.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.343+0000 7f832057a700 1 -- 172.21.15.110:0/3817860 >> 172.21.15.110:0/3817860 conn(0x7f8318060c40 msgr2=0x7f8318061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:18.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.344+0000 7f832057a700 1 -- 172.21.15.110:0/3817860 shutdown_connections 2021-03-25T14:18:18.348 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.344+0000 7f832057a700 1 -- 172.21.15.110:0/3817860 wait complete. 2021-03-25T14:18:18.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.345+0000 7f832057a700 1 Processor -- start 2021-03-25T14:18:18.349 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.345+0000 7f832057a700 1 -- start start 2021-03-25T14:18:18.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.345+0000 7f832057a700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83180b99b0 0x7f831814ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:18.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.345+0000 7f832057a700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8318148da0 0x7f83180bba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:18.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.345+0000 7f832057a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f831814a050 0x7f83180bbf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:18.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.345+0000 7f832057a700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83181402b0 con 0x7f83180b99b0 2021-03-25T14:18:18.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.345+0000 7f832057a700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83181420f0 con 0x7f8318148da0 2021-03-25T14:18:18.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.345+0000 7f832057a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8318141bb0 con 0x7f831814a050 2021-03-25T14:18:18.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.345+0000 7f831e316700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83180b99b0 0x7f831814ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:18.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.345+0000 7f831e316700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83180b99b0 0x7f831814ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51492/0 (socket says 172.21.15.110:51492) 2021-03-25T14:18:18.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.345+0000 7f831e316700 1 -- 172.21.15.110:0/1245090002 learned_addr learned my addr 172.21.15.110:0/1245090002 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:18.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.345+0000 7f831eb17700 1 --2- 172.21.15.110:0/1245090002 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f831814a050 0x7f83180bbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:18.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.345+0000 7f831db15700 1 --2- 172.21.15.110:0/1245090002 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8318148da0 0x7f83180bba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:18.352 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.346+0000 7f831e316700 1 -- 172.21.15.110:0/1245090002 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f831814a050 msgr2=0x7f83180bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:18.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.346+0000 7f831e316700 1 --2- 172.21.15.110:0/1245090002 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f831814a050 0x7f83180bbf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:18.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.346+0000 7f831e316700 1 -- 172.21.15.110:0/1245090002 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8318148da0 msgr2=0x7f83180bba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:18.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.346+0000 7f831e316700 1 --2- 172.21.15.110:0/1245090002 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8318148da0 0x7f83180bba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:18.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.346+0000 7f831e316700 1 -- 172.21.15.110:0/1245090002 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8318141e50 con 0x7f83180b99b0 2021-03-25T14:18:18.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.346+0000 7f831e316700 1 --2- 172.21.15.110:0/1245090002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83180b99b0 0x7f831814ada0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7f8314006e00 tx=0x7f8314015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:18.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.346+0000 7f83067fc700 1 -- 172.21.15.110:0/1245090002 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8314005a60 con 0x7f83180b99b0 2021-03-25T14:18:18.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.346+0000 7f83067fc700 1 -- 172.21.15.110:0/1245090002 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8314005bc0 con 0x7f83180b99b0 2021-03-25T14:18:18.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.346+0000 7f832057a700 1 -- 172.21.15.110:0/1245090002 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83180be360 con 0x7f83180b99b0 2021-03-25T14:18:18.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.346+0000 7f83067fc700 1 -- 172.21.15.110:0/1245090002 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831401d450 con 0x7f83180b99b0 2021-03-25T14:18:18.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.346+0000 7f832057a700 1 -- 172.21.15.110:0/1245090002 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f831814b290 con 0x7f83180b99b0 2021-03-25T14:18:18.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.347+0000 7f832057a700 1 -- 172.21.15.110:0/1245090002 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83180be7c0 con 0x7f83180b99b0 2021-03-25T14:18:18.353 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.347+0000 7f83067fc700 1 -- 172.21.15.110:0/1245090002 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f8314024030 con 0x7f83180b99b0 2021-03-25T14:18:18.354 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.347+0000 7f83067fc700 1 --2- 172.21.15.110:0/1245090002 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f82f805a0b0 0x7f82f805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:18.354 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.348+0000 7f83067fc700 1 -- 172.21.15.110:0/1245090002 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5606+0+0 (secure 0 0 0) 0x7f8314074ee0 con 0x7f83180b99b0 2021-03-25T14:18:18.354 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.348+0000 7f831db15700 1 --2- 172.21.15.110:0/1245090002 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f82f805a0b0 0x7f82f805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:18.354 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.348+0000 7f831db15700 1 --2- 172.21.15.110:0/1245090002 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f82f805a0b0 0x7f82f805c570 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f83180bea10 tx=0x7f8308008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:18.354 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.351+0000 7f83067fc700 1 -- 172.21.15.110:0/1245090002 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f8314048b00 con 0x7f83180b99b0 2021-03-25T14:18:18.504 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.502+0000 7f832057a700 1 -- 172.21.15.110:0/1245090002 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f831805d7b0 con 0x7f83180b99b0 2021-03-25T14:18:18.504 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.503+0000 7f83067fc700 1 -- 172.21.15.110:0/1245090002 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+13959 (secure 0 0 0) 0x7f831402f6a0 con 0x7f83180b99b0 2021-03-25T14:18:18.505 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:18:18.505 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":68,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:18:17.516052+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:18:18.506 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.504+0000 7f832057a700 1 -- 172.21.15.110:0/1245090002 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f82f805a0b0 msgr2=0x7f82f805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:18.506 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.504+0000 7f832057a700 1 --2- 172.21.15.110:0/1245090002 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f82f805a0b0 0x7f82f805c570 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f83180bea10 tx=0x7f8308008040).stop 2021-03-25T14:18:18.506 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.504+0000 7f832057a700 1 -- 172.21.15.110:0/1245090002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83180b99b0 msgr2=0x7f831814ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:18.506 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.504+0000 7f832057a700 1 --2- 172.21.15.110:0/1245090002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83180b99b0 0x7f831814ada0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7f8314006e00 tx=0x7f8314015000).stop 2021-03-25T14:18:18.507 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.504+0000 7f832057a700 1 -- 172.21.15.110:0/1245090002 shutdown_connections 2021-03-25T14:18:18.507 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.504+0000 7f832057a700 1 --2- 172.21.15.110:0/1245090002 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f82f805a0b0 0x7f82f805c570 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:18.507 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.504+0000 7f832057a700 1 --2- 172.21.15.110:0/1245090002 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f831814a050 0x7f83180bbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:18.507 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.504+0000 7f832057a700 1 --2- 172.21.15.110:0/1245090002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83180b99b0 0x7f831814ada0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:18.507 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.504+0000 7f832057a700 1 --2- 172.21.15.110:0/1245090002 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8318148da0 0x7f83180bba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:18.507 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.504+0000 7f832057a700 1 -- 172.21.15.110:0/1245090002 >> 172.21.15.110:0/1245090002 conn(0x7f8318060c40 msgr2=0x7f83180a3480 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:18.507 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.504+0000 7f832057a700 1 -- 172.21.15.110:0/1245090002 shutdown_connections 2021-03-25T14:18:18.507 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.504+0000 7f832057a700 1 -- 172.21.15.110:0/1245090002 wait complete. 2021-03-25T14:18:18.518 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-03-25T14:15:59.047299+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-03-25T14:16:00.537926+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-03-25T14:18:18.518 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-03-25T14:18:18.631 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.629+0000 7fbf700a4700 1 Processor -- start 2021-03-25T14:18:18.631 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.629+0000 7fbf700a4700 1 -- start start 2021-03-25T14:18:18.633 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.629+0000 7fbf700a4700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbf6814a4d0 0x7fbf68065620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:18.633 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.629+0000 7fbf700a4700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf6814cf60 con 0x7fbf68064be0 2021-03-25T14:18:18.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.629+0000 7fbf700a4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf6814d200 con 0x7fbf68064800 2021-03-25T14:18:18.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.629+0000 7fbf700a4700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf6814d4a0 con 0x7fbf6814a4d0 2021-03-25T14:18:18.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.630+0000 7fbf6d63f700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fbf68064be0 0x7fbf68149dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44438/0 (socket says 172.21.15.110:44438) 2021-03-25T14:18:18.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.630+0000 7fbf6e641700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbf6814a4d0 0x7fbf68065620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:18.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.630+0000 7fbf6d63f700 1 -- 172.21.15.110:0/2143265942 learned_addr learned my addr 172.21.15.110:0/2143265942 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:18:18.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.630+0000 7fbf6e641700 1 -- 172.21.15.110:0/2143265942 >> v1:172.21.15.174:6789/0 conn(0x7fbf68064800 legacy=0x7fbf68066c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:18.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.630+0000 7fbf6e641700 1 -- 172.21.15.110:0/2143265942 >> v1:172.21.15.110:6789/0 conn(0x7fbf68064be0 legacy=0x7fbf68149dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:18.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.630+0000 7fbf6ce3e700 1 -- 172.21.15.110:0/2143265942 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 468759491 0 0) 0x7fbf6814cf60 con 0x7fbf68064be0 2021-03-25T14:18:18.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.630+0000 7fbf6e641700 1 -- 172.21.15.110:0/2143265942 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf6814d740 con 0x7fbf6814a4d0 2021-03-25T14:18:18.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.630+0000 7fbf6e641700 1 --2- 172.21.15.110:0/2143265942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf6814a4d0 0x7fbf68065620 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7fbf60009cc0 tx=0x7fbf60009220).ready entity=mon.0 client_cookie=71266fa1e03de723 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:18.634 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.630+0000 7fbf6ce3e700 1 -- 172.21.15.110:0/2143265942 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf6000bbf0 con 0x7fbf6814a4d0 2021-03-25T14:18:18.635 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.630+0000 7fbf6ce3e700 1 -- 172.21.15.110:0/2143265942 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf6000bd50 con 0x7fbf6814a4d0 2021-03-25T14:18:18.635 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.630+0000 7fbf6ce3e700 1 -- 172.21.15.110:0/2143265942 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf60011610 con 0x7fbf6814a4d0 2021-03-25T14:18:18.635 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.631+0000 7fbf700a4700 1 -- 172.21.15.110:0/2143265942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf6814a4d0 msgr2=0x7fbf68065620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:18.635 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.631+0000 7fbf700a4700 1 --2- 172.21.15.110:0/2143265942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf6814a4d0 0x7fbf68065620 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7fbf60009cc0 tx=0x7fbf60009220).stop 2021-03-25T14:18:18.635 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.631+0000 7fbf700a4700 1 -- 172.21.15.110:0/2143265942 shutdown_connections 2021-03-25T14:18:18.635 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.631+0000 7fbf700a4700 1 --2- 172.21.15.110:0/2143265942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf6814a4d0 0x7fbf68065620 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:18.635 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.631+0000 7fbf700a4700 1 -- 172.21.15.110:0/2143265942 >> 172.21.15.110:0/2143265942 conn(0x7fbf68060c40 msgr2=0x7fbf68061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:18.635 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.631+0000 7fbf700a4700 1 -- 172.21.15.110:0/2143265942 shutdown_connections 2021-03-25T14:18:18.635 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.631+0000 7fbf700a4700 1 -- 172.21.15.110:0/2143265942 wait complete. 2021-03-25T14:18:18.635 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.632+0000 7fbf700a4700 1 Processor -- start 2021-03-25T14:18:18.635 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.632+0000 7fbf700a4700 1 -- start start 2021-03-25T14:18:18.638 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.632+0000 7fbf700a4700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf68064800 0x7fbf681589b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:18.638 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.632+0000 7fbf700a4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf68064be0 0x7fbf680bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:18.638 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.633+0000 7fbf700a4700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf6814a4d0 0x7fbf680b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:18.638 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.633+0000 7fbf700a4700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf68158ea0 con 0x7fbf6814a4d0 2021-03-25T14:18:18.638 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.633+0000 7fbf700a4700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf680a1df0 con 0x7fbf68064800 2021-03-25T14:18:18.638 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.633+0000 7fbf700a4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf680a2090 con 0x7fbf68064be0 2021-03-25T14:18:18.638 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.633+0000 7fbf6e641700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf6814a4d0 0x7fbf680b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:18.638 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.633+0000 7fbf6e641700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf6814a4d0 0x7fbf680b5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51510/0 (socket says 172.21.15.110:51510) 2021-03-25T14:18:18.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.633+0000 7fbf6e641700 1 -- 172.21.15.110:0/3420683437 learned_addr learned my addr 172.21.15.110:0/3420683437 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:18.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.633+0000 7fbf6d63f700 1 --2- 172.21.15.110:0/3420683437 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf68064be0 0x7fbf680bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:18.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.633+0000 7fbf6de40700 1 --2- 172.21.15.110:0/3420683437 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf68064800 0x7fbf681589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:18.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.633+0000 7fbf6e641700 1 -- 172.21.15.110:0/3420683437 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf68064be0 msgr2=0x7fbf680bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:18.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.633+0000 7fbf6e641700 1 --2- 172.21.15.110:0/3420683437 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf68064be0 0x7fbf680bbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:18.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.633+0000 7fbf6e641700 1 -- 172.21.15.110:0/3420683437 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf68064800 msgr2=0x7fbf681589b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:18.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.633+0000 7fbf6e641700 1 --2- 172.21.15.110:0/3420683437 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf68064800 0x7fbf681589b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:18.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.633+0000 7fbf6e641700 1 -- 172.21.15.110:0/3420683437 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf680a2330 con 0x7fbf6814a4d0 2021-03-25T14:18:18.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.633+0000 7fbf6e641700 1 --2- 172.21.15.110:0/3420683437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf6814a4d0 0x7fbf680b5cb0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7fbf600090b0 tx=0x7fbf60017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:18.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.633+0000 7fbf55ffb700 1 -- 172.21.15.110:0/3420683437 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf60009e00 con 0x7fbf6814a4d0 2021-03-25T14:18:18.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.633+0000 7fbf55ffb700 1 -- 172.21.15.110:0/3420683437 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf60010b10 con 0x7fbf6814a4d0 2021-03-25T14:18:18.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.633+0000 7fbf700a4700 1 -- 172.21.15.110:0/3420683437 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf680a25d0 con 0x7fbf6814a4d0 2021-03-25T14:18:18.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.633+0000 7fbf55ffb700 1 -- 172.21.15.110:0/3420683437 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf6001b440 con 0x7fbf6814a4d0 2021-03-25T14:18:18.639 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.633+0000 7fbf700a4700 1 -- 172.21.15.110:0/3420683437 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf680bc2b0 con 0x7fbf6814a4d0 2021-03-25T14:18:18.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.634+0000 7fbf700a4700 1 -- 172.21.15.110:0/3420683437 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf680b59d0 con 0x7fbf6814a4d0 2021-03-25T14:18:18.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.635+0000 7fbf55ffb700 1 -- 172.21.15.110:0/3420683437 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fbf6000f070 con 0x7fbf6814a4d0 2021-03-25T14:18:18.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.635+0000 7fbf55ffb700 1 --2- 172.21.15.110:0/3420683437 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fbf4805a0b0 0x7fbf4805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:18.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.635+0000 7fbf55ffb700 1 -- 172.21.15.110:0/3420683437 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5606+0+0 (secure 0 0 0) 0x7fbf60075c00 con 0x7fbf6814a4d0 2021-03-25T14:18:18.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.635+0000 7fbf6de40700 1 --2- 172.21.15.110:0/3420683437 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fbf4805a0b0 0x7fbf4805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:18.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.635+0000 7fbf6de40700 1 --2- 172.21.15.110:0/3420683437 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fbf4805a0b0 0x7fbf4805c570 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7fbf64003590 tx=0x7fbf64009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:18.640 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.639+0000 7fbf55ffb700 1 -- 172.21.15.110:0/3420683437 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fbf60049770 con 0x7fbf6814a4d0 2021-03-25T14:18:18.792 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.790+0000 7fbf700a4700 1 -- 172.21.15.110:0/3420683437 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fbf6805d7b0 con 0x7fbf6814a4d0 2021-03-25T14:18:18.792 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.791+0000 7fbf55ffb700 1 -- 172.21.15.110:0/3420683437 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v68) v1 ==== 110+0+10 (secure 0 0 0) 0x7fbf6004cd90 con 0x7fbf6814a4d0 2021-03-25T14:18:18.793 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 1 2021-03-25T14:18:18.794 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.792+0000 7fbf700a4700 1 -- 172.21.15.110:0/3420683437 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fbf4805a0b0 msgr2=0x7fbf4805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:18.795 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.792+0000 7fbf700a4700 1 --2- 172.21.15.110:0/3420683437 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fbf4805a0b0 0x7fbf4805c570 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7fbf64003590 tx=0x7fbf64009040).stop 2021-03-25T14:18:18.795 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.792+0000 7fbf700a4700 1 -- 172.21.15.110:0/3420683437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf6814a4d0 msgr2=0x7fbf680b5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:18.795 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.792+0000 7fbf700a4700 1 --2- 172.21.15.110:0/3420683437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf6814a4d0 0x7fbf680b5cb0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7fbf600090b0 tx=0x7fbf60017000).stop 2021-03-25T14:18:18.795 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.792+0000 7fbf700a4700 1 -- 172.21.15.110:0/3420683437 shutdown_connections 2021-03-25T14:18:18.795 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.792+0000 7fbf700a4700 1 --2- 172.21.15.110:0/3420683437 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fbf4805a0b0 0x7fbf4805c570 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:18.795 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.792+0000 7fbf700a4700 1 --2- 172.21.15.110:0/3420683437 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf68064800 0x7fbf681589b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:18.795 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.792+0000 7fbf700a4700 1 --2- 172.21.15.110:0/3420683437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf6814a4d0 0x7fbf680b5cb0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:18.795 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.792+0000 7fbf700a4700 1 --2- 172.21.15.110:0/3420683437 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf68064be0 0x7fbf680bbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:18.795 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.792+0000 7fbf700a4700 1 -- 172.21.15.110:0/3420683437 >> 172.21.15.110:0/3420683437 conn(0x7fbf68060c40 msgr2=0x7fbf680b88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:18.795 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.792+0000 7fbf700a4700 1 -- 172.21.15.110:0/3420683437 shutdown_connections 2021-03-25T14:18:18.795 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.792+0000 7fbf700a4700 1 -- 172.21.15.110:0/3420683437 wait complete. 2021-03-25T14:18:18.806 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-03-25T14:18:18.919 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.917+0000 7f79f5909700 1 Processor -- start 2021-03-25T14:18:18.919 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.917+0000 7f79f5909700 1 -- start start 2021-03-25T14:18:18.926 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.917+0000 7f79f5909700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f79f0064be0 0x7f79f0149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:18.926 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.918+0000 7f79f5909700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79f014a6f0 con 0x7f79f0064800 2021-03-25T14:18:18.926 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.918+0000 7f79f5909700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79f014cf60 con 0x7f79f014a2b0 2021-03-25T14:18:18.926 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.918+0000 7f79f5909700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79f014d200 con 0x7f79f0064be0 2021-03-25T14:18:18.926 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.918+0000 7f79eeffd700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f79f0064800 0x7f79f0066c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44450/0 (socket says 172.21.15.110:44450) 2021-03-25T14:18:18.926 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.918+0000 7f79eeffd700 1 -- 172.21.15.110:0/2251026096 learned_addr learned my addr 172.21.15.110:0/2251026096 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:18:18.926 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.918+0000 7f79ee7fc700 1 --2- 172.21.15.110:0/2251026096 >> v2:172.21.15.174:3300/0 conn(0x7f79f0064be0 0x7f79f0149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:18.926 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.918+0000 7f79edffb700 1 -- 172.21.15.110:0/2251026096 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2355502691 0 0) 0x7f79f014a6f0 con 0x7f79f0064800 2021-03-25T14:18:18.926 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.918+0000 7f79edffb700 1 -- 172.21.15.110:0/2251026096 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79dc003270 con 0x7f79f0064800 2021-03-25T14:18:18.926 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.918+0000 7f79edffb700 1 -- 172.21.15.110:0/2251026096 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1202842115 0 0) 0x7f79dc003270 con 0x7f79f0064800 2021-03-25T14:18:18.927 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.918+0000 7f79edffb700 1 -- 172.21.15.110:0/2251026096 >> v2:172.21.15.174:3300/0 conn(0x7f79f0064be0 msgr2=0x7f79f0149dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:18.927 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.918+0000 7f79edffb700 1 --2- 172.21.15.110:0/2251026096 >> v2:172.21.15.174:3300/0 conn(0x7f79f0064be0 0x7f79f0149dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:18.927 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.918+0000 7f79edffb700 1 -- 172.21.15.110:0/2251026096 >> v1:172.21.15.174:6789/0 conn(0x7f79f014a2b0 legacy=0x7f79f0065620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:18.927 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.918+0000 7f79edffb700 1 -- 172.21.15.110:0/2251026096 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f014d4a0 con 0x7f79f0064800 2021-03-25T14:18:18.927 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.918+0000 7f79edffb700 1 -- 172.21.15.110:0/2251026096 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f79e4001520 con 0x7f79f0064800 2021-03-25T14:18:18.927 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.918+0000 7f79edffb700 1 -- 172.21.15.110:0/2251026096 >> v1:172.21.15.110:6789/0 conn(0x7f79f0064800 legacy=0x7f79f0066c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:18.927 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.918+0000 7f79edffb700 1 --2- 172.21.15.110:0/2251026096 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79dc003760 0x7f79dc003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:18.927 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.918+0000 7f79edffb700 1 --2- 172.21.15.110:0/2251026096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79dc004510 0x7f79dc004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:18.927 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.918+0000 7f79edffb700 1 --2- 172.21.15.110:0/2251026096 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79dc004e80 0x7f79dc00b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:18.927 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.918+0000 7f79edffb700 1 -- 172.21.15.110:0/2251026096 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f014d200 con 0x7f79dc003760 2021-03-25T14:18:18.927 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.918+0000 7f79edffb700 1 -- 172.21.15.110:0/2251026096 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc004290 con 0x7f79dc004510 2021-03-25T14:18:18.927 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.918+0000 7f79edffb700 1 -- 172.21.15.110:0/2251026096 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc00bc50 con 0x7f79dc004e80 2021-03-25T14:18:18.927 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.918+0000 7f79eeffd700 1 --2- 172.21.15.110:0/2251026096 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79dc003760 0x7f79dc003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:18.928 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.919+0000 7f79ee7fc700 1 --2- 172.21.15.110:0/2251026096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79dc004510 0x7f79dc004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:18.928 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.919+0000 7f79ef7fe700 1 --2- 172.21.15.110:0/2251026096 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79dc004e80 0x7f79dc00b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:18.928 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.919+0000 7f79eeffd700 1 -- 172.21.15.110:0/2251026096 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79dc004e80 msgr2=0x7f79dc00b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:18.928 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.919+0000 7f79eeffd700 1 --2- 172.21.15.110:0/2251026096 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79dc004e80 0x7f79dc00b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:18.928 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.919+0000 7f79eeffd700 1 -- 172.21.15.110:0/2251026096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79dc004510 msgr2=0x7f79dc004990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:18.928 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.919+0000 7f79eeffd700 1 --2- 172.21.15.110:0/2251026096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79dc004510 0x7f79dc004990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:18.928 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.919+0000 7f79eeffd700 1 -- 172.21.15.110:0/2251026096 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79dc003270 con 0x7f79dc003760 2021-03-25T14:18:18.928 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.919+0000 7f79ef7fe700 1 -- 172.21.15.110:0/2251026096 reap_dead start 2021-03-25T14:18:18.928 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.919+0000 7f79eeffd700 1 --2- 172.21.15.110:0/2251026096 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79dc003760 0x7f79dc003b80 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7f79e400c440 tx=0x7f79f014d0f0).ready entity=mon.0 client_cookie=856f38aafc2836d8 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:18.928 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.919+0000 7f79edffb700 1 -- 172.21.15.110:0/2251026096 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e400ce40 con 0x7f79dc003760 2021-03-25T14:18:18.928 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.919+0000 7f79edffb700 1 -- 172.21.15.110:0/2251026096 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e40072e0 con 0x7f79dc003760 2021-03-25T14:18:18.928 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.919+0000 7f79edffb700 1 -- 172.21.15.110:0/2251026096 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e4005620 con 0x7f79dc003760 2021-03-25T14:18:18.928 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.919+0000 7f79f5909700 1 -- 172.21.15.110:0/2251026096 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79dc003760 msgr2=0x7f79dc003b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:18.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.919+0000 7f79f5909700 1 --2- 172.21.15.110:0/2251026096 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79dc003760 0x7f79dc003b80 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7f79e400c440 tx=0x7f79f014d0f0).stop 2021-03-25T14:18:18.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.919+0000 7f79f5909700 1 -- 172.21.15.110:0/2251026096 shutdown_connections 2021-03-25T14:18:18.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.919+0000 7f79f5909700 1 --2- 172.21.15.110:0/2251026096 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79dc003760 0x7f79dc003b80 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:18.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.919+0000 7f79f5909700 1 -- 172.21.15.110:0/2251026096 >> 172.21.15.110:0/2251026096 conn(0x7f79f0060c40 msgr2=0x7f79f0061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:18.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.919+0000 7f79f5909700 1 -- 172.21.15.110:0/2251026096 shutdown_connections 2021-03-25T14:18:18.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.919+0000 7f79f5909700 1 -- 172.21.15.110:0/2251026096 wait complete. 2021-03-25T14:18:18.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.921+0000 7f79f5909700 1 Processor -- start 2021-03-25T14:18:18.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.921+0000 7f79f5909700 1 -- start start 2021-03-25T14:18:18.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.921+0000 7f79f5909700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79dc003760 0x7f79f00b9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:18.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.921+0000 7f79f5909700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79f014af60 0x7f79f00a1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:18.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.921+0000 7f79f5909700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79f00ba0f0 0x7f79f015c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:18.929 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.921+0000 7f79f5909700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f01420c0 con 0x7f79f00ba0f0 2021-03-25T14:18:18.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.921+0000 7f79f5909700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f014bf50 con 0x7f79f014af60 2021-03-25T14:18:18.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.921+0000 7f79f5909700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f014c1f0 con 0x7f79dc003760 2021-03-25T14:18:18.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.921+0000 7f79ef7fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79f00ba0f0 0x7f79f015c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:18.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.921+0000 7f79ef7fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79f00ba0f0 0x7f79f015c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51530/0 (socket says 172.21.15.110:51530) 2021-03-25T14:18:18.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.921+0000 7f79ef7fe700 1 -- 172.21.15.110:0/107114565 learned_addr learned my addr 172.21.15.110:0/107114565 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:18.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.921+0000 7f79eeffd700 1 --2- 172.21.15.110:0/107114565 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79dc003760 0x7f79f00b9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:18.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.921+0000 7f79ee7fc700 1 --2- 172.21.15.110:0/107114565 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79f014af60 0x7f79f00a1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:18.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.922+0000 7f79ef7fe700 1 -- 172.21.15.110:0/107114565 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79dc003760 msgr2=0x7f79f00b9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:18.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.922+0000 7f79ef7fe700 1 --2- 172.21.15.110:0/107114565 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79dc003760 0x7f79f00b9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:18.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.922+0000 7f79ef7fe700 1 -- 172.21.15.110:0/107114565 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79f014af60 msgr2=0x7f79f00a1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:18.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.922+0000 7f79ef7fe700 1 --2- 172.21.15.110:0/107114565 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79f014af60 0x7f79f00a1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:18.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.922+0000 7f79ef7fe700 1 -- 172.21.15.110:0/107114565 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f014c490 con 0x7f79f00ba0f0 2021-03-25T14:18:18.930 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.922+0000 7f79ef7fe700 1 --2- 172.21.15.110:0/107114565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79f00ba0f0 0x7f79f015c720 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f79f0065200 tx=0x7f79e8009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:18.931 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.922+0000 7f79d6ffd700 1 -- 172.21.15.110:0/107114565 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e8003030 con 0x7f79f00ba0f0 2021-03-25T14:18:18.931 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.922+0000 7f79d6ffd700 1 -- 172.21.15.110:0/107114565 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e8003190 con 0x7f79f00ba0f0 2021-03-25T14:18:18.931 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.922+0000 7f79f5909700 1 -- 172.21.15.110:0/107114565 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f014c730 con 0x7f79f00ba0f0 2021-03-25T14:18:18.931 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.922+0000 7f79d6ffd700 1 -- 172.21.15.110:0/107114565 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e8001790 con 0x7f79f00ba0f0 2021-03-25T14:18:18.931 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.922+0000 7f79f5909700 1 -- 172.21.15.110:0/107114565 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f0146e10 con 0x7f79f00ba0f0 2021-03-25T14:18:18.931 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.923+0000 7f79f5909700 1 -- 172.21.15.110:0/107114565 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79f015c440 con 0x7f79f00ba0f0 2021-03-25T14:18:18.931 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.923+0000 7f79d6ffd700 1 -- 172.21.15.110:0/107114565 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f79e801e070 con 0x7f79f00ba0f0 2021-03-25T14:18:18.931 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.923+0000 7f79d6ffd700 1 --2- 172.21.15.110:0/107114565 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f79d005a0b0 0x7f79d005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:18.931 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.924+0000 7f79d6ffd700 1 -- 172.21.15.110:0/107114565 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5606+0+0 (secure 0 0 0) 0x7f79e8072fa0 con 0x7f79f00ba0f0 2021-03-25T14:18:18.931 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.924+0000 7f79eeffd700 1 --2- 172.21.15.110:0/107114565 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f79d005a0b0 0x7f79d005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:18.931 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.924+0000 7f79eeffd700 1 --2- 172.21.15.110:0/107114565 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f79d005a0b0 0x7f79d005c570 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f79e4008fd0 tx=0x7f79e4013000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:18.932 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:18.927+0000 7f79d6ffd700 1 -- 172.21.15.110:0/107114565 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f79e8046b10 con 0x7f79f00ba0f0 2021-03-25T14:18:19.079 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.077+0000 7f79f5909700 1 -- 172.21.15.110:0/107114565 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f79f005d7b0 con 0x7f79f00ba0f0 2021-03-25T14:18:19.177 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.077+0000 7f79d6ffd700 1 -- 172.21.15.110:0/107114565 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v68) v1 ==== 92+0+10 (secure 0 0 0) 0x7f79e801c030 con 0x7f79f00ba0f0 2021-03-25T14:18:19.178 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:18:19.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.079+0000 7f79f5909700 1 -- 172.21.15.110:0/107114565 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f79d005a0b0 msgr2=0x7f79d005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:19.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.079+0000 7f79f5909700 1 --2- 172.21.15.110:0/107114565 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f79d005a0b0 0x7f79d005c570 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f79e4008fd0 tx=0x7f79e4013000).stop 2021-03-25T14:18:19.180 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.079+0000 7f79f5909700 1 -- 172.21.15.110:0/107114565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79f00ba0f0 msgr2=0x7f79f015c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:19.181 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.079+0000 7f79f5909700 1 --2- 172.21.15.110:0/107114565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79f00ba0f0 0x7f79f015c720 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f79f0065200 tx=0x7f79e8009040).stop 2021-03-25T14:18:19.181 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.079+0000 7f79f5909700 1 -- 172.21.15.110:0/107114565 shutdown_connections 2021-03-25T14:18:19.181 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.079+0000 7f79f5909700 1 --2- 172.21.15.110:0/107114565 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f79d005a0b0 0x7f79d005c570 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:19.181 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.079+0000 7f79f5909700 1 --2- 172.21.15.110:0/107114565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79f00ba0f0 0x7f79f015c720 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:19.181 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.079+0000 7f79f5909700 1 --2- 172.21.15.110:0/107114565 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79dc003760 0x7f79f00b9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:19.181 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.079+0000 7f79f5909700 1 --2- 172.21.15.110:0/107114565 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79f014af60 0x7f79f00a1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:19.181 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.079+0000 7f79f5909700 1 -- 172.21.15.110:0/107114565 >> 172.21.15.110:0/107114565 conn(0x7f79f0060c40 msgr2=0x7f79f0148d90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:19.182 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.079+0000 7f79f5909700 1 -- 172.21.15.110:0/107114565 shutdown_connections 2021-03-25T14:18:19.182 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.079+0000 7f79f5909700 1 -- 172.21.15.110:0/107114565 wait complete. 2021-03-25T14:18:19.182 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-03-25T14:18:19.293 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.291+0000 7f94e0a1b700 1 Processor -- start 2021-03-25T14:18:19.293 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.291+0000 7f94e0a1b700 1 -- start start 2021-03-25T14:18:19.296 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.292+0000 7f94e0a1b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f94dc0667d0 0x7f94dc14d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:19.296 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.292+0000 7f94e0a1b700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f94dc14d840 0x7f94dc149b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:19.296 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.292+0000 7f94e0a1b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94dc064840 con 0x7f94dc0b9730 2021-03-25T14:18:19.296 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.292+0000 7f94e0a1b700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94dc0a1b90 con 0x7f94dc14d840 2021-03-25T14:18:19.296 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.292+0000 7f94e0a1b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94dc064680 con 0x7f94dc0667d0 2021-03-25T14:18:19.296 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.292+0000 7f94dad9d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f94dc14d840 0x7f94dc149b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:19.296 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.292+0000 7f94dad9d700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f94dc14d840 0x7f94dc149b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51538/0 (socket says 172.21.15.110:51538) 2021-03-25T14:18:19.296 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.292+0000 7f94dad9d700 1 -- 172.21.15.110:0/1917628601 learned_addr learned my addr 172.21.15.110:0/1917628601 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:19.297 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.292+0000 7f94d9d9b700 1 --2- 172.21.15.110:0/1917628601 >> v2:172.21.15.174:3300/0 conn(0x7f94dc0667d0 0x7f94dc14d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:19.297 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.292+0000 7f94dad9d700 1 -- 172.21.15.110:0/1917628601 >> v2:172.21.15.174:3300/0 conn(0x7f94dc0667d0 msgr2=0x7f94dc14d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:19.297 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.292+0000 7f94dad9d700 1 --2- 172.21.15.110:0/1917628601 >> v2:172.21.15.174:3300/0 conn(0x7f94dc0667d0 0x7f94dc14d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:19.297 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.292+0000 7f94dad9d700 1 -- 172.21.15.110:0/1917628601 >> v1:172.21.15.174:6789/0 conn(0x7f94dc0b9730 legacy=0x7f94dc14cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:19.297 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.292+0000 7f94dad9d700 1 -- 172.21.15.110:0/1917628601 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94dc064ae0 con 0x7f94dc14d840 2021-03-25T14:18:19.297 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.292+0000 7f94dad9d700 1 --2- 172.21.15.110:0/1917628601 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94dc14d840 0x7f94dc149b20 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f94dc05cd10 tx=0x7f94d40092d0).ready entity=mon.0 client_cookie=ec9a1d6ac19dc51d server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:19.297 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.292+0000 7f94d959a700 1 -- 172.21.15.110:0/1917628601 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d400bbb0 con 0x7f94dc14d840 2021-03-25T14:18:19.297 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.293+0000 7f94d959a700 1 -- 172.21.15.110:0/1917628601 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d400bd10 con 0x7f94dc14d840 2021-03-25T14:18:19.297 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.293+0000 7f94d959a700 1 -- 172.21.15.110:0/1917628601 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d4011610 con 0x7f94dc14d840 2021-03-25T14:18:19.298 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.293+0000 7f94e0a1b700 1 -- 172.21.15.110:0/1917628601 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94dc14d840 msgr2=0x7f94dc149b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:19.298 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.293+0000 7f94e0a1b700 1 --2- 172.21.15.110:0/1917628601 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94dc14d840 0x7f94dc149b20 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f94dc05cd10 tx=0x7f94d40092d0).stop 2021-03-25T14:18:19.298 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.293+0000 7f94e0a1b700 1 -- 172.21.15.110:0/1917628601 shutdown_connections 2021-03-25T14:18:19.298 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.293+0000 7f94e0a1b700 1 --2- 172.21.15.110:0/1917628601 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94dc14d840 0x7f94dc149b20 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:19.298 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.293+0000 7f94e0a1b700 1 --2- 172.21.15.110:0/1917628601 >> v2:172.21.15.174:3300/0 conn(0x7f94dc0667d0 0x7f94dc14d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:19.298 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.293+0000 7f94e0a1b700 1 -- 172.21.15.110:0/1917628601 >> 172.21.15.110:0/1917628601 conn(0x7f94dc0bce50 msgr2=0x7f94dc0b8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:19.298 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.293+0000 7f94e0a1b700 1 -- 172.21.15.110:0/1917628601 shutdown_connections 2021-03-25T14:18:19.298 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.293+0000 7f94e0a1b700 1 -- 172.21.15.110:0/1917628601 wait complete. 2021-03-25T14:18:19.298 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.294+0000 7f94e0a1b700 1 Processor -- start 2021-03-25T14:18:19.298 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.294+0000 7f94e0a1b700 1 -- start start 2021-03-25T14:18:19.302 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.295+0000 7f94e0a1b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94dc0667d0 0x7f94dc14bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:19.302 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.295+0000 7f94e0a1b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94dc0b9730 0x7f94dc1465a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:19.302 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.295+0000 7f94e0a1b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94dc14d840 0x7f94dc158780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:19.302 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.295+0000 7f94e0a1b700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc14ac50 con 0x7f94dc0b9730 2021-03-25T14:18:19.302 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.295+0000 7f94e0a1b700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc14b3c0 con 0x7f94dc0667d0 2021-03-25T14:18:19.302 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.295+0000 7f94e0a1b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc146a90 con 0x7f94dc14d840 2021-03-25T14:18:19.302 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.295+0000 7f94d9d9b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94dc0b9730 0x7f94dc1465a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:19.303 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.295+0000 7f94d9d9b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94dc0b9730 0x7f94dc1465a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51544/0 (socket says 172.21.15.110:51544) 2021-03-25T14:18:19.303 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.295+0000 7f94d9d9b700 1 -- 172.21.15.110:0/709832059 learned_addr learned my addr 172.21.15.110:0/709832059 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:19.303 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.295+0000 7f94da59c700 1 --2- 172.21.15.110:0/709832059 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94dc0667d0 0x7f94dc14bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:19.303 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.295+0000 7f94dad9d700 1 --2- 172.21.15.110:0/709832059 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94dc14d840 0x7f94dc158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:19.303 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.295+0000 7f94d9d9b700 1 -- 172.21.15.110:0/709832059 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94dc14d840 msgr2=0x7f94dc158780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:19.303 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.295+0000 7f94d9d9b700 1 --2- 172.21.15.110:0/709832059 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94dc14d840 0x7f94dc158780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:19.303 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.295+0000 7f94d9d9b700 1 -- 172.21.15.110:0/709832059 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94dc0667d0 msgr2=0x7f94dc14bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:19.303 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.295+0000 7f94d9d9b700 1 --2- 172.21.15.110:0/709832059 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94dc0667d0 0x7f94dc14bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:19.303 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.295+0000 7f94d9d9b700 1 -- 172.21.15.110:0/709832059 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94dc14ae80 con 0x7f94dc0b9730 2021-03-25T14:18:19.303 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.295+0000 7f94dad9d700 1 --2- 172.21.15.110:0/709832059 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94dc14d840 0x7f94dc158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:18:19.303 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.295+0000 7f94d9d9b700 1 --2- 172.21.15.110:0/709832059 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94dc0b9730 0x7f94dc1465a0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f94d000d8e0 tx=0x7f94d0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:19.304 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.295+0000 7f94ca7fc700 1 -- 172.21.15.110:0/709832059 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d0009610 con 0x7f94dc0b9730 2021-03-25T14:18:19.304 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.295+0000 7f94ca7fc700 1 -- 172.21.15.110:0/709832059 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d0009770 con 0x7f94dc0b9730 2021-03-25T14:18:19.304 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.295+0000 7f94e0a1b700 1 -- 172.21.15.110:0/709832059 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94dc14b120 con 0x7f94dc0b9730 2021-03-25T14:18:19.304 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.295+0000 7f94ca7fc700 1 -- 172.21.15.110:0/709832059 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d0009b10 con 0x7f94dc0b9730 2021-03-25T14:18:19.304 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.295+0000 7f94e0a1b700 1 -- 172.21.15.110:0/709832059 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94dc0b8580 con 0x7f94dc0b9730 2021-03-25T14:18:19.304 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.296+0000 7f94e0a1b700 1 -- 172.21.15.110:0/709832059 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94dc1462c0 con 0x7f94dc0b9730 2021-03-25T14:18:19.304 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.296+0000 7f94ca7fc700 1 -- 172.21.15.110:0/709832059 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f94d0013480 con 0x7f94dc0b9730 2021-03-25T14:18:19.304 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.297+0000 7f94ca7fc700 1 --2- 172.21.15.110:0/709832059 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f94b805a0b0 0x7f94b805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:19.304 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.297+0000 7f94ca7fc700 1 -- 172.21.15.110:0/709832059 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5606+0+0 (secure 0 0 0) 0x7f94d0073e50 con 0x7f94dc0b9730 2021-03-25T14:18:19.304 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.297+0000 7f94da59c700 1 --2- 172.21.15.110:0/709832059 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f94b805a0b0 0x7f94b805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:19.304 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.297+0000 7f94da59c700 1 --2- 172.21.15.110:0/709832059 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f94b805a0b0 0x7f94b805c570 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f94dc14d810 tx=0x7f94cc009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:19.305 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.300+0000 7f94ca7fc700 1 -- 172.21.15.110:0/709832059 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f94d0047960 con 0x7f94dc0b9730 2021-03-25T14:18:19.453 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.451+0000 7f94e0a1b700 1 -- 172.21.15.110:0/709832059 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f94dc05d7b0 con 0x7f94dc0b9730 2021-03-25T14:18:19.453 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.451+0000 7f94ca7fc700 1 -- 172.21.15.110:0/709832059 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v68) v1 ==== 84+0+143 (secure 0 0 0) 0x7f94d004af80 con 0x7f94dc0b9730 2021-03-25T14:18:19.453 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:18:19.454 INFO:teuthology.orchestra.run.smithi110.stdout:[ 2021-03-25T14:18:19.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:18:19.454 INFO:teuthology.orchestra.run.smithi110.stdout: "poolnum": 1, 2021-03-25T14:18:19.454 INFO:teuthology.orchestra.run.smithi110.stdout: "poolname": "device_health_metrics" 2021-03-25T14:18:19.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:18:19.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:18:19.454 INFO:teuthology.orchestra.run.smithi110.stdout: "poolnum": 2, 2021-03-25T14:18:19.454 INFO:teuthology.orchestra.run.smithi110.stdout: "poolname": "rbd" 2021-03-25T14:18:19.454 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:18:19.454 INFO:teuthology.orchestra.run.smithi110.stdout:] 2021-03-25T14:18:19.455 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.452+0000 7f94e0a1b700 1 -- 172.21.15.110:0/709832059 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f94b805a0b0 msgr2=0x7f94b805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:19.456 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.453+0000 7f94e0a1b700 1 --2- 172.21.15.110:0/709832059 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f94b805a0b0 0x7f94b805c570 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f94dc14d810 tx=0x7f94cc009040).stop 2021-03-25T14:18:19.456 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.453+0000 7f94e0a1b700 1 -- 172.21.15.110:0/709832059 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94dc0b9730 msgr2=0x7f94dc1465a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:19.456 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.453+0000 7f94e0a1b700 1 --2- 172.21.15.110:0/709832059 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94dc0b9730 0x7f94dc1465a0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f94d000d8e0 tx=0x7f94d0008040).stop 2021-03-25T14:18:19.456 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.453+0000 7f94e0a1b700 1 -- 172.21.15.110:0/709832059 shutdown_connections 2021-03-25T14:18:19.456 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.453+0000 7f94e0a1b700 1 --2- 172.21.15.110:0/709832059 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f94b805a0b0 0x7f94b805c570 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:19.456 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.453+0000 7f94e0a1b700 1 --2- 172.21.15.110:0/709832059 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94dc0667d0 0x7f94dc14bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:19.456 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.453+0000 7f94e0a1b700 1 --2- 172.21.15.110:0/709832059 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94dc14d840 0x7f94dc158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:19.456 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.453+0000 7f94e0a1b700 1 --2- 172.21.15.110:0/709832059 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94dc0b9730 0x7f94dc1465a0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:19.456 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.453+0000 7f94e0a1b700 1 -- 172.21.15.110:0/709832059 >> 172.21.15.110:0/709832059 conn(0x7f94dc0bce50 msgr2=0x7f94dc147440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:19.456 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.453+0000 7f94e0a1b700 1 -- 172.21.15.110:0/709832059 shutdown_connections 2021-03-25T14:18:19.457 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.453+0000 7f94e0a1b700 1 -- 172.21.15.110:0/709832059 wait complete. 2021-03-25T14:18:19.466 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-03-25T14:18:19.466 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-03-25T14:18:19.578 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.577+0000 7f1ed0610700 1 Processor -- start 2021-03-25T14:18:19.579 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.577+0000 7f1ed0610700 1 -- start start 2021-03-25T14:18:19.582 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.578+0000 7f1ed0610700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1ec814d470 0x7f1ec814d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:19.582 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.578+0000 7f1ed0610700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ec814cc90 0x7f1ec81493c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:19.582 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.578+0000 7f1ed0610700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1ec81498b0 0x7f1ec80685d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:19.582 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.578+0000 7f1ed0610700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ec80691b0 con 0x7f1ec81498b0 2021-03-25T14:18:19.582 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.578+0000 7f1ed0610700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ec80bc2b0 con 0x7f1ec814d470 2021-03-25T14:18:19.582 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.578+0000 7f1ed0610700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec8149dd0 con 0x7f1ec814cc90 2021-03-25T14:18:19.582 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.578+0000 7f1ecebad700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1ec81498b0 0x7f1ec80685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:19.583 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.578+0000 7f1ecebad700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1ec81498b0 0x7f1ec80685d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51550/0 (socket says 172.21.15.110:51550) 2021-03-25T14:18:19.583 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.578+0000 7f1ecebad700 1 -- 172.21.15.110:0/3371944031 learned_addr learned my addr 172.21.15.110:0/3371944031 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:19.583 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.578+0000 7f1ece3ac700 1 --2- 172.21.15.110:0/3371944031 >> v2:172.21.15.174:3300/0 conn(0x7f1ec814d470 0x7f1ec814d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:19.583 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.578+0000 7f1ecdbab700 1 --2- 172.21.15.110:0/3371944031 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ec814cc90 0x7f1ec81493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:19.583 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.578+0000 7f1ecebad700 1 -- 172.21.15.110:0/3371944031 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ec814cc90 msgr2=0x7f1ec81493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:19.583 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.578+0000 7f1ecebad700 1 --2- 172.21.15.110:0/3371944031 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ec814cc90 0x7f1ec81493c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:19.583 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.578+0000 7f1ecebad700 1 -- 172.21.15.110:0/3371944031 >> v2:172.21.15.174:3300/0 conn(0x7f1ec814d470 msgr2=0x7f1ec814d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:19.583 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.578+0000 7f1ecebad700 1 --2- 172.21.15.110:0/3371944031 >> v2:172.21.15.174:3300/0 conn(0x7f1ec814d470 0x7f1ec814d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:19.583 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.578+0000 7f1ecebad700 1 -- 172.21.15.110:0/3371944031 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec814a070 con 0x7f1ec81498b0 2021-03-25T14:18:19.583 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.578+0000 7f1ecdbab700 1 --2- 172.21.15.110:0/3371944031 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ec814cc90 0x7f1ec81493c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:18:19.583 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.578+0000 7f1ecebad700 1 --2- 172.21.15.110:0/3371944031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ec81498b0 0x7f1ec80685d0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f1ec8061fa0 tx=0x7f1ec00092d0).ready entity=mon.0 client_cookie=5d18d2229cb60d36 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:19.583 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.578+0000 7f1ecd3aa700 1 -- 172.21.15.110:0/3371944031 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec000bbf0 con 0x7f1ec81498b0 2021-03-25T14:18:19.584 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.578+0000 7f1ecd3aa700 1 -- 172.21.15.110:0/3371944031 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec000bd50 con 0x7f1ec81498b0 2021-03-25T14:18:19.584 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.578+0000 7f1ecd3aa700 1 -- 172.21.15.110:0/3371944031 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec0011610 con 0x7f1ec81498b0 2021-03-25T14:18:19.584 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.579+0000 7f1ed0610700 1 -- 172.21.15.110:0/3371944031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ec81498b0 msgr2=0x7f1ec80685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:19.584 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.579+0000 7f1ed0610700 1 --2- 172.21.15.110:0/3371944031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ec81498b0 0x7f1ec80685d0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f1ec8061fa0 tx=0x7f1ec00092d0).stop 2021-03-25T14:18:19.584 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.579+0000 7f1ed0610700 1 -- 172.21.15.110:0/3371944031 shutdown_connections 2021-03-25T14:18:19.584 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.579+0000 7f1ed0610700 1 --2- 172.21.15.110:0/3371944031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ec81498b0 0x7f1ec80685d0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:19.584 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.579+0000 7f1ed0610700 1 --2- 172.21.15.110:0/3371944031 >> v2:172.21.15.174:3300/0 conn(0x7f1ec814d470 0x7f1ec814d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:19.584 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.579+0000 7f1ed0610700 1 --2- 172.21.15.110:0/3371944031 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ec814cc90 0x7f1ec81493c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:19.584 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.579+0000 7f1ed0610700 1 -- 172.21.15.110:0/3371944031 >> 172.21.15.110:0/3371944031 conn(0x7f1ec8060c40 msgr2=0x7f1ec8061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:19.584 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.579+0000 7f1ed0610700 1 -- 172.21.15.110:0/3371944031 shutdown_connections 2021-03-25T14:18:19.584 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.579+0000 7f1ed0610700 1 -- 172.21.15.110:0/3371944031 wait complete. 2021-03-25T14:18:19.584 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.580+0000 7f1ed0610700 1 Processor -- start 2021-03-25T14:18:19.585 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.580+0000 7f1ed0610700 1 -- start start 2021-03-25T14:18:19.587 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.581+0000 7f1ed0610700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ec81498b0 0x7f1ec8159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:19.587 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.581+0000 7f1ed0610700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ec814cc90 0x7f1ec80b8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:19.587 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.581+0000 7f1ed0610700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ec814d470 0x7f1ec80a4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:19.587 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.581+0000 7f1ed0610700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec80a5db0 con 0x7f1ec814d470 2021-03-25T14:18:19.587 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.581+0000 7f1ed0610700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec80a30c0 con 0x7f1ec814cc90 2021-03-25T14:18:19.587 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.581+0000 7f1ed0610700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec80a3360 con 0x7f1ec81498b0 2021-03-25T14:18:19.588 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.581+0000 7f1ecebad700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ec814d470 0x7f1ec80a4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:19.588 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.581+0000 7f1ecebad700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ec814d470 0x7f1ec80a4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51556/0 (socket says 172.21.15.110:51556) 2021-03-25T14:18:19.588 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.581+0000 7f1ecebad700 1 -- 172.21.15.110:0/3603771453 learned_addr learned my addr 172.21.15.110:0/3603771453 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:19.588 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.581+0000 7f1ece3ac700 1 --2- 172.21.15.110:0/3603771453 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ec81498b0 0x7f1ec8159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:19.588 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.581+0000 7f1ecdbab700 1 --2- 172.21.15.110:0/3603771453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ec814cc90 0x7f1ec80b8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:19.588 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.581+0000 7f1ecebad700 1 -- 172.21.15.110:0/3603771453 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ec81498b0 msgr2=0x7f1ec8159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:19.588 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.581+0000 7f1ecebad700 1 --2- 172.21.15.110:0/3603771453 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ec81498b0 0x7f1ec8159140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:19.588 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.581+0000 7f1ecebad700 1 -- 172.21.15.110:0/3603771453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ec814cc90 msgr2=0x7f1ec80b8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:19.588 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.581+0000 7f1ecebad700 1 --2- 172.21.15.110:0/3603771453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ec814cc90 0x7f1ec80b8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:19.588 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.581+0000 7f1ecebad700 1 -- 172.21.15.110:0/3603771453 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec80a3600 con 0x7f1ec814d470 2021-03-25T14:18:19.588 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.581+0000 7f1ecebad700 1 --2- 172.21.15.110:0/3603771453 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ec814d470 0x7f1ec80a4880 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7f1ec805d650 tx=0x7f1ec0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:19.588 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.581+0000 7f1eb67fc700 1 -- 172.21.15.110:0/3603771453 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec0009ea0 con 0x7f1ec814d470 2021-03-25T14:18:19.589 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.581+0000 7f1ed0610700 1 -- 172.21.15.110:0/3603771453 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ec80a38a0 con 0x7f1ec814d470 2021-03-25T14:18:19.589 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.581+0000 7f1ed0610700 1 -- 172.21.15.110:0/3603771453 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ec80b8760 con 0x7f1ec814d470 2021-03-25T14:18:19.589 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.581+0000 7f1eb67fc700 1 -- 172.21.15.110:0/3603771453 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec000bec0 con 0x7f1ec814d470 2021-03-25T14:18:19.589 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.581+0000 7f1eb67fc700 1 -- 172.21.15.110:0/3603771453 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec0010c30 con 0x7f1ec814d470 2021-03-25T14:18:19.589 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.582+0000 7f1ed0610700 1 -- 172.21.15.110:0/3603771453 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eac004fa0 con 0x7f1ec814d470 2021-03-25T14:18:19.589 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.583+0000 7f1eb67fc700 1 -- 172.21.15.110:0/3603771453 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f1ec002a070 con 0x7f1ec814d470 2021-03-25T14:18:19.589 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.583+0000 7f1eb67fc700 1 --2- 172.21.15.110:0/3603771453 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f1ea805a0e0 0x7f1ea805c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:19.589 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.583+0000 7f1eb67fc700 1 -- 172.21.15.110:0/3603771453 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5606+0+0 (secure 0 0 0) 0x7f1ec0075630 con 0x7f1ec814d470 2021-03-25T14:18:19.589 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.583+0000 7f1ece3ac700 1 --2- 172.21.15.110:0/3603771453 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f1ea805a0e0 0x7f1ea805c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:19.589 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.583+0000 7f1ece3ac700 1 --2- 172.21.15.110:0/3603771453 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f1ea805a0e0 0x7f1ea805c5a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f1ec4006fd0 tx=0x7f1ec4008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:19.590 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.587+0000 7f1eb67fc700 1 -- 172.21.15.110:0/3603771453 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f1ec00491a0 con 0x7f1ec814d470 2021-03-25T14:18:19.737 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.735+0000 7f1ed0610700 1 -- 172.21.15.110:0/3603771453 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f1eac0057d0 con 0x7f1ec814d470 2021-03-25T14:18:19.813 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.811+0000 7f1eb67fc700 1 -- 172.21.15.110:0/3603771453 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v69) v1 ==== 133+0+0 (secure 0 0 0) 0x7f1ec00280a0 con 0x7f1ec814d470 2021-03-25T14:18:19.870 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.813+0000 7f1ed0610700 1 -- 172.21.15.110:0/3603771453 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f1ea805a0e0 msgr2=0x7f1ea805c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:19.871 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.813+0000 7f1ed0610700 1 --2- 172.21.15.110:0/3603771453 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f1ea805a0e0 0x7f1ea805c5a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f1ec4006fd0 tx=0x7f1ec4008040).stop 2021-03-25T14:18:19.871 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.813+0000 7f1ed0610700 1 -- 172.21.15.110:0/3603771453 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ec814d470 msgr2=0x7f1ec80a4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:19.871 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.813+0000 7f1ed0610700 1 --2- 172.21.15.110:0/3603771453 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ec814d470 0x7f1ec80a4880 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7f1ec805d650 tx=0x7f1ec0017000).stop 2021-03-25T14:18:19.871 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.814+0000 7f1ed0610700 1 -- 172.21.15.110:0/3603771453 shutdown_connections 2021-03-25T14:18:19.871 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.814+0000 7f1ed0610700 1 --2- 172.21.15.110:0/3603771453 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f1ea805a0e0 0x7f1ea805c5a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:19.871 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.814+0000 7f1ed0610700 1 --2- 172.21.15.110:0/3603771453 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ec814d470 0x7f1ec80a4880 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:19.871 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.814+0000 7f1ed0610700 1 --2- 172.21.15.110:0/3603771453 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ec81498b0 0x7f1ec8159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:19.871 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.814+0000 7f1ed0610700 1 --2- 172.21.15.110:0/3603771453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ec814cc90 0x7f1ec80b8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:19.871 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.814+0000 7f1ed0610700 1 -- 172.21.15.110:0/3603771453 >> 172.21.15.110:0/3603771453 conn(0x7f1ec8060c40 msgr2=0x7f1ec8146cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:19.871 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.814+0000 7f1ed0610700 1 -- 172.21.15.110:0/3603771453 shutdown_connections 2021-03-25T14:18:19.872 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.814+0000 7f1ed0610700 1 -- 172.21.15.110:0/3603771453 wait complete. 2021-03-25T14:18:19.872 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs_metadata' created 2021-03-25T14:18:19.872 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-03-25T14:18:19.985 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.983+0000 7fed1bfd2700 1 Processor -- start 2021-03-25T14:18:19.985 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.983+0000 7fed1bfd2700 1 -- start start 2021-03-25T14:18:19.993 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.984+0000 7fed1bfd2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fed140b0cc0 0x7fed14145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:19.993 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.984+0000 7fed1bfd2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed140648a0 0x7fed1409db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:19.993 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.984+0000 7fed1bfd2700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed14149c50 con 0x7fed140b5d00 2021-03-25T14:18:19.993 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.984+0000 7fed1bfd2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed14067960 con 0x7fed140b0cc0 2021-03-25T14:18:19.993 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.984+0000 7fed1bfd2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed141461b0 con 0x7fed140648a0 2021-03-25T14:18:19.993 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.984+0000 7fed1956d700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fed140b5d00 0x7fed14067250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44498/0 (socket says 172.21.15.110:44498) 2021-03-25T14:18:19.993 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.984+0000 7fed1956d700 1 -- 172.21.15.110:0/234287185 learned_addr learned my addr 172.21.15.110:0/234287185 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:18:19.994 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.984+0000 7fed19d6e700 1 --2- 172.21.15.110:0/234287185 >> v2:172.21.15.174:3300/0 conn(0x7fed140b0cc0 0x7fed14145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:19.994 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.984+0000 7fed1a56f700 1 --2- 172.21.15.110:0/234287185 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed140648a0 0x7fed1409db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:19.994 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.984+0000 7fed18d6c700 1 -- 172.21.15.110:0/234287185 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2192441310 0 0) 0x7fed14149c50 con 0x7fed140b5d00 2021-03-25T14:18:19.994 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.984+0000 7fed18d6c700 1 -- 172.21.15.110:0/234287185 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecfc005480 con 0x7fed140b5d00 2021-03-25T14:18:19.994 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.984+0000 7fed18d6c700 1 -- 172.21.15.110:0/234287185 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3021665444 0 0) 0x7fecfc005480 con 0x7fed140b5d00 2021-03-25T14:18:19.994 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.984+0000 7fed18d6c700 1 -- 172.21.15.110:0/234287185 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed140648a0 msgr2=0x7fed1409db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:19.994 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.984+0000 7fed18d6c700 1 --2- 172.21.15.110:0/234287185 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed140648a0 0x7fed1409db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:19.994 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.984+0000 7fed18d6c700 1 -- 172.21.15.110:0/234287185 >> v2:172.21.15.174:3300/0 conn(0x7fed140b0cc0 msgr2=0x7fed14145cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:19.994 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.984+0000 7fed18d6c700 1 --2- 172.21.15.110:0/234287185 >> v2:172.21.15.174:3300/0 conn(0x7fed140b0cc0 0x7fed14145cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:19.994 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.984+0000 7fed18d6c700 1 -- 172.21.15.110:0/234287185 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed14149e80 con 0x7fed140b5d00 2021-03-25T14:18:19.995 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.984+0000 7fed18d6c700 1 -- 172.21.15.110:0/234287185 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7fed04001520 con 0x7fed140b5d00 2021-03-25T14:18:19.995 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.984+0000 7fed18d6c700 1 -- 172.21.15.110:0/234287185 >> v1:172.21.15.110:6789/0 conn(0x7fed140b5d00 legacy=0x7fed14067250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:19.995 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.984+0000 7fed18d6c700 1 --2- 172.21.15.110:0/234287185 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fecfc005970 0x7fecfc005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:19.995 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.984+0000 7fed18d6c700 1 --2- 172.21.15.110:0/234287185 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecfc006720 0x7fecfc006ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:19.995 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.984+0000 7fed18d6c700 1 --2- 172.21.15.110:0/234287185 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed140648a0 0x7fecfc007090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:19.995 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.985+0000 7fed18d6c700 1 -- 172.21.15.110:0/234287185 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed14067960 con 0x7fecfc006720 2021-03-25T14:18:19.995 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.985+0000 7fed18d6c700 1 -- 172.21.15.110:0/234287185 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed141461b0 con 0x7fecfc005970 2021-03-25T14:18:19.995 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.985+0000 7fed18d6c700 1 -- 172.21.15.110:0/234287185 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc0064b0 con 0x7fed140648a0 2021-03-25T14:18:19.995 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.985+0000 7fed1956d700 1 --2- 172.21.15.110:0/234287185 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecfc006720 0x7fecfc006ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:19.995 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.985+0000 7fed19d6e700 1 --2- 172.21.15.110:0/234287185 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fecfc005970 0x7fecfc005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:19.996 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.985+0000 7fed1a56f700 1 --2- 172.21.15.110:0/234287185 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed140648a0 0x7fecfc007090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:19.996 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.985+0000 7fed1956d700 1 -- 172.21.15.110:0/234287185 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed140648a0 msgr2=0x7fecfc007090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:19.996 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.985+0000 7fed1956d700 1 --2- 172.21.15.110:0/234287185 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed140648a0 0x7fecfc007090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:19.996 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.985+0000 7fed1956d700 1 -- 172.21.15.110:0/234287185 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fecfc005970 msgr2=0x7fecfc005d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:19.996 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.985+0000 7fed1956d700 1 --2- 172.21.15.110:0/234287185 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fecfc005970 0x7fecfc005d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:19.996 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.985+0000 7fed1956d700 1 -- 172.21.15.110:0/234287185 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecfc005480 con 0x7fecfc006720 2021-03-25T14:18:19.996 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.985+0000 7fed1956d700 1 --2- 172.21.15.110:0/234287185 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecfc006720 0x7fecfc006ba0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7fed0400c440 tx=0x7fed140b2190).ready entity=mon.0 client_cookie=9d888b6268ce1f1b server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:19.996 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.985+0000 7fed18d6c700 1 -- 172.21.15.110:0/234287185 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed040070d0 con 0x7fecfc006720 2021-03-25T14:18:19.996 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.985+0000 7fed18d6c700 1 -- 172.21.15.110:0/234287185 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed04007230 con 0x7fecfc006720 2021-03-25T14:18:19.996 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.985+0000 7fed18d6c700 1 -- 172.21.15.110:0/234287185 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed04005620 con 0x7fecfc006720 2021-03-25T14:18:19.996 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.986+0000 7fed1bfd2700 1 -- 172.21.15.110:0/234287185 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecfc006720 msgr2=0x7fecfc006ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:19.997 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.986+0000 7fed1bfd2700 1 --2- 172.21.15.110:0/234287185 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecfc006720 0x7fecfc006ba0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7fed0400c440 tx=0x7fed140b2190).stop 2021-03-25T14:18:19.997 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.986+0000 7fed1a56f700 1 -- 172.21.15.110:0/234287185 reap_dead start 2021-03-25T14:18:19.997 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.986+0000 7fed1bfd2700 1 -- 172.21.15.110:0/234287185 shutdown_connections 2021-03-25T14:18:19.997 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.986+0000 7fed1bfd2700 1 -- 172.21.15.110:0/234287185 >> 172.21.15.110:0/234287185 conn(0x7fed140664e0 msgr2=0x7fed140668f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:19.997 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.986+0000 7fed1bfd2700 1 -- 172.21.15.110:0/234287185 shutdown_connections 2021-03-25T14:18:19.997 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.986+0000 7fed1bfd2700 1 -- 172.21.15.110:0/234287185 wait complete. 2021-03-25T14:18:19.997 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.987+0000 7fed1bfd2700 1 Processor -- start 2021-03-25T14:18:19.997 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.987+0000 7fed1bfd2700 1 -- start start 2021-03-25T14:18:19.997 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.987+0000 7fed1bfd2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed1409d750 0x7fed1409c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:19.997 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.987+0000 7fed1bfd2700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed140682e0 0x7fed1409ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:19.997 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.987+0000 7fed1bfd2700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed1415c4a0 0x7fed1415c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:19.998 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.987+0000 7fed1bfd2700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed14159800 con 0x7fed1415c4a0 2021-03-25T14:18:19.998 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.987+0000 7fed1bfd2700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed14159a70 con 0x7fed140682e0 2021-03-25T14:18:19.998 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.987+0000 7fed1bfd2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed14063570 con 0x7fed1409d750 2021-03-25T14:18:19.998 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.987+0000 7fed1a56f700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed1415c4a0 0x7fed1415c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:19.998 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.987+0000 7fed1a56f700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed1415c4a0 0x7fed1415c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51576/0 (socket says 172.21.15.110:51576) 2021-03-25T14:18:19.998 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.987+0000 7fed1a56f700 1 -- 172.21.15.110:0/2426797713 learned_addr learned my addr 172.21.15.110:0/2426797713 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:19.998 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.987+0000 7fed19d6e700 1 --2- 172.21.15.110:0/2426797713 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed1409d750 0x7fed1409c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:19.998 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.988+0000 7fed1956d700 1 --2- 172.21.15.110:0/2426797713 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed140682e0 0x7fed1409ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:19.998 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.988+0000 7fed1a56f700 1 -- 172.21.15.110:0/2426797713 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed1409d750 msgr2=0x7fed1409c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:19.999 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.988+0000 7fed1a56f700 1 --2- 172.21.15.110:0/2426797713 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed1409d750 0x7fed1409c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:19.999 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.988+0000 7fed1a56f700 1 -- 172.21.15.110:0/2426797713 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed140682e0 msgr2=0x7fed1409ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:19.999 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.988+0000 7fed1a56f700 1 --2- 172.21.15.110:0/2426797713 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed140682e0 0x7fed1409ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:19.999 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.988+0000 7fed1a56f700 1 -- 172.21.15.110:0/2426797713 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed14063810 con 0x7fed1415c4a0 2021-03-25T14:18:19.999 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.988+0000 7fed1a56f700 1 --2- 172.21.15.110:0/2426797713 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed1415c4a0 0x7fed1415c920 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7fed140b9680 tx=0x7fed0c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:19.999 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.988+0000 7fed01ffb700 1 -- 172.21.15.110:0/2426797713 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c013620 con 0x7fed1415c4a0 2021-03-25T14:18:19.999 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.988+0000 7fed01ffb700 1 -- 172.21.15.110:0/2426797713 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed0c013780 con 0x7fed1415c4a0 2021-03-25T14:18:19.999 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.988+0000 7fed1bfd2700 1 -- 172.21.15.110:0/2426797713 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed14063ab0 con 0x7fed1415c4a0 2021-03-25T14:18:19.999 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.988+0000 7fed01ffb700 1 -- 172.21.15.110:0/2426797713 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c013b20 con 0x7fed1415c4a0 2021-03-25T14:18:19.999 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.988+0000 7fed1bfd2700 1 -- 172.21.15.110:0/2426797713 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed14067ce0 con 0x7fed1415c4a0 2021-03-25T14:18:19.999 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.989+0000 7fed1bfd2700 1 -- 172.21.15.110:0/2426797713 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed1415c310 con 0x7fed1415c4a0 2021-03-25T14:18:19.999 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.990+0000 7fed01ffb700 1 -- 172.21.15.110:0/2426797713 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fed0c012040 con 0x7fed1415c4a0 2021-03-25T14:18:20.000 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.990+0000 7fed01ffb700 1 --2- 172.21.15.110:0/2426797713 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fecf405a0b0 0x7fecf405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:20.000 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.990+0000 7fed01ffb700 1 -- 172.21.15.110:0/2426797713 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5960+0+0 (secure 0 0 0) 0x7fed0c074220 con 0x7fed1415c4a0 2021-03-25T14:18:20.000 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.990+0000 7fed19d6e700 1 --2- 172.21.15.110:0/2426797713 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fecf405a0b0 0x7fecf405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:20.000 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.990+0000 7fed19d6e700 1 --2- 172.21.15.110:0/2426797713 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fecf405a0b0 0x7fecf405c570 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7fed10006fd0 tx=0x7fed10006df0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:20.000 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:19.994+0000 7fed01ffb700 1 -- 172.21.15.110:0/2426797713 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fed0c047bd0 con 0x7fed1415c4a0 2021-03-25T14:18:20.146 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.144+0000 7fed1bfd2700 1 -- 172.21.15.110:0/2426797713 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fed1405d7b0 con 0x7fed1415c4a0 2021-03-25T14:18:20.362 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.360+0000 7fed01ffb700 1 -- 172.21.15.110:0/2426797713 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v70) v1 ==== 125+0+0 (secure 0 0 0) 0x7fed0c04b1f0 con 0x7fed1415c4a0 2021-03-25T14:18:20.365 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.363+0000 7fed1bfd2700 1 -- 172.21.15.110:0/2426797713 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fecf405a0b0 msgr2=0x7fecf405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:20.365 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.363+0000 7fed1bfd2700 1 --2- 172.21.15.110:0/2426797713 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fecf405a0b0 0x7fecf405c570 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7fed10006fd0 tx=0x7fed10006df0).stop 2021-03-25T14:18:20.365 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.363+0000 7fed1bfd2700 1 -- 172.21.15.110:0/2426797713 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed1415c4a0 msgr2=0x7fed1415c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:20.365 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.363+0000 7fed1bfd2700 1 --2- 172.21.15.110:0/2426797713 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed1415c4a0 0x7fed1415c920 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7fed140b9680 tx=0x7fed0c008040).stop 2021-03-25T14:18:20.366 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.364+0000 7fed1bfd2700 1 -- 172.21.15.110:0/2426797713 shutdown_connections 2021-03-25T14:18:20.366 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.364+0000 7fed1bfd2700 1 --2- 172.21.15.110:0/2426797713 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fecf405a0b0 0x7fecf405c570 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:20.366 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.364+0000 7fed1bfd2700 1 --2- 172.21.15.110:0/2426797713 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed1415c4a0 0x7fed1415c920 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:20.366 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.364+0000 7fed1bfd2700 1 --2- 172.21.15.110:0/2426797713 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed1409d750 0x7fed1409c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:20.366 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.364+0000 7fed1bfd2700 1 --2- 172.21.15.110:0/2426797713 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed140682e0 0x7fed1409ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:20.367 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.364+0000 7fed1bfd2700 1 -- 172.21.15.110:0/2426797713 >> 172.21.15.110:0/2426797713 conn(0x7fed140664e0 msgr2=0x7fed14069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:20.367 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.364+0000 7fed1bfd2700 1 -- 172.21.15.110:0/2426797713 shutdown_connections 2021-03-25T14:18:20.367 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.364+0000 7fed1bfd2700 1 -- 172.21.15.110:0/2426797713 wait complete. 2021-03-25T14:18:20.367 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs_data' created 2021-03-25T14:18:20.382 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2021-03-25T14:18:20.498 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.496+0000 7f7036a87700 1 Processor -- start 2021-03-25T14:18:20.498 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.496+0000 7f7036a87700 1 -- start start 2021-03-25T14:18:20.501 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.497+0000 7f7036a87700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f70300671d0 0x7f70300bcef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:20.501 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.497+0000 7f7036a87700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7030068b60 con 0x7f703014a140 2021-03-25T14:18:20.501 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.497+0000 7f7036a87700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f703014a550 con 0x7f70300bcb10 2021-03-25T14:18:20.501 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.497+0000 7f7036a87700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70300a2ad0 con 0x7f70300671d0 2021-03-25T14:18:20.501 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.497+0000 7f7035284700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f70300671d0 0x7f70300bcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:20.502 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.497+0000 7f7036286700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f703014a140 0x7f70300bfeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44516/0 (socket says 172.21.15.110:44516) 2021-03-25T14:18:20.502 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.497+0000 7f7035284700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f70300671d0 0x7f70300bcef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51580/0 (socket says 172.21.15.110:51580) 2021-03-25T14:18:20.502 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.497+0000 7f7036286700 1 -- 172.21.15.110:0/1200980226 learned_addr learned my addr 172.21.15.110:0/1200980226 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:18:20.502 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.498+0000 7f7035284700 1 -- 172.21.15.110:0/1200980226 >> v1:172.21.15.174:6789/0 conn(0x7f70300bcb10 legacy=0x7f70301317c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:20.502 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.498+0000 7f7035284700 1 -- 172.21.15.110:0/1200980226 >> v1:172.21.15.110:6789/0 conn(0x7f703014a140 legacy=0x7f70300bfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:20.502 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.498+0000 7f7034a83700 1 -- 172.21.15.110:0/1200980226 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 950547913 0 0) 0x7f7030068b60 con 0x7f703014a140 2021-03-25T14:18:20.502 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.498+0000 7f7035284700 1 -- 172.21.15.110:0/1200980226 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70300bd4f0 con 0x7f70300671d0 2021-03-25T14:18:20.502 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.498+0000 7f7035284700 1 --2- 172.21.15.110:0/1200980226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70300671d0 0x7f70300bcef0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7f703014a6e0 tx=0x7f7020006dc0).ready entity=mon.0 client_cookie=31591010d6f80dd5 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:20.503 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.498+0000 7f7034a83700 1 -- 172.21.15.110:0/1200980226 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7020006030 con 0x7f70300671d0 2021-03-25T14:18:20.503 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.498+0000 7f7034a83700 1 -- 172.21.15.110:0/1200980226 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7020006190 con 0x7f70300671d0 2021-03-25T14:18:20.503 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.498+0000 7f7034a83700 1 -- 172.21.15.110:0/1200980226 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7020006510 con 0x7f70300671d0 2021-03-25T14:18:20.503 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.498+0000 7f7036a87700 1 -- 172.21.15.110:0/1200980226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70300671d0 msgr2=0x7f70300bcef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:20.503 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.498+0000 7f7036a87700 1 --2- 172.21.15.110:0/1200980226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70300671d0 0x7f70300bcef0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7f703014a6e0 tx=0x7f7020006dc0).stop 2021-03-25T14:18:20.503 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.498+0000 7f7036a87700 1 -- 172.21.15.110:0/1200980226 shutdown_connections 2021-03-25T14:18:20.504 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.498+0000 7f7036a87700 1 --2- 172.21.15.110:0/1200980226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70300671d0 0x7f70300bcef0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:20.504 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.498+0000 7f7036a87700 1 -- 172.21.15.110:0/1200980226 >> 172.21.15.110:0/1200980226 conn(0x7f7030064860 msgr2=0x7f70300664d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:20.504 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.498+0000 7f7036a87700 1 -- 172.21.15.110:0/1200980226 shutdown_connections 2021-03-25T14:18:20.504 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.498+0000 7f7036a87700 1 -- 172.21.15.110:0/1200980226 wait complete. 2021-03-25T14:18:20.504 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.499+0000 7f7036a87700 1 Processor -- start 2021-03-25T14:18:20.504 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.499+0000 7f7036a87700 1 -- start start 2021-03-25T14:18:20.508 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.500+0000 7f7036a87700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70300671d0 0x7f70300a5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:20.508 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.500+0000 7f7036a87700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70300bcb10 0x7f703015c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:20.508 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.500+0000 7f7036a87700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f703014a140 0x7f70300bb120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:20.508 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.500+0000 7f7036a87700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70300a4ae0 con 0x7f703014a140 2021-03-25T14:18:20.508 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.500+0000 7f7036a87700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703014bdf0 con 0x7f70300bcb10 2021-03-25T14:18:20.508 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.500+0000 7f7036a87700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f703014c050 con 0x7f70300671d0 2021-03-25T14:18:20.508 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.500+0000 7f7036286700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f703014a140 0x7f70300bb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:20.508 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.500+0000 7f7036286700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f703014a140 0x7f70300bb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51588/0 (socket says 172.21.15.110:51588) 2021-03-25T14:18:20.508 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.500+0000 7f7036286700 1 -- 172.21.15.110:0/3900143678 learned_addr learned my addr 172.21.15.110:0/3900143678 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:20.509 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.500+0000 7f7035284700 1 --2- 172.21.15.110:0/3900143678 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70300bcb10 0x7f703015c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:20.509 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.500+0000 7f7035a85700 1 --2- 172.21.15.110:0/3900143678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70300671d0 0x7f70300a5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:20.509 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.500+0000 7f7036286700 1 -- 172.21.15.110:0/3900143678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70300671d0 msgr2=0x7f70300a5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:20.509 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.501+0000 7f7036286700 1 --2- 172.21.15.110:0/3900143678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70300671d0 0x7f70300a5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:20.509 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.501+0000 7f7036286700 1 -- 172.21.15.110:0/3900143678 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70300bcb10 msgr2=0x7f703015c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:20.509 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.501+0000 7f7036286700 1 --2- 172.21.15.110:0/3900143678 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70300bcb10 0x7f703015c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:20.509 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.501+0000 7f7036286700 1 -- 172.21.15.110:0/3900143678 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f703014c2f0 con 0x7f703014a140 2021-03-25T14:18:20.509 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.501+0000 7f7035284700 1 --2- 172.21.15.110:0/3900143678 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70300bcb10 0x7f703015c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:18:20.509 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.501+0000 7f7035a85700 1 --2- 172.21.15.110:0/3900143678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70300671d0 0x7f70300a5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:18:20.509 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.501+0000 7f7036286700 1 --2- 172.21.15.110:0/3900143678 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f703014a140 0x7f70300bb120 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7f7028001560 tx=0x7f7028007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:20.509 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.501+0000 7f701dffb700 1 -- 172.21.15.110:0/3900143678 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7028005bb0 con 0x7f703014a140 2021-03-25T14:18:20.509 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.501+0000 7f701dffb700 1 -- 172.21.15.110:0/3900143678 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7028005d10 con 0x7f703014a140 2021-03-25T14:18:20.509 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.501+0000 7f7036a87700 1 -- 172.21.15.110:0/3900143678 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f703012e7f0 con 0x7f703014a140 2021-03-25T14:18:20.510 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.501+0000 7f701dffb700 1 -- 172.21.15.110:0/3900143678 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7028007340 con 0x7f703014a140 2021-03-25T14:18:20.510 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.501+0000 7f7036a87700 1 -- 172.21.15.110:0/3900143678 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70300bb610 con 0x7f703014a140 2021-03-25T14:18:20.510 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.502+0000 7f7036a87700 1 -- 172.21.15.110:0/3900143678 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7030045ae0 con 0x7f703014a140 2021-03-25T14:18:20.510 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.502+0000 7f701dffb700 1 -- 172.21.15.110:0/3900143678 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f7028010030 con 0x7f703014a140 2021-03-25T14:18:20.510 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.503+0000 7f701dffb700 1 --2- 172.21.15.110:0/3900143678 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f701005a0b0 0x7f701005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:20.510 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.503+0000 7f701dffb700 1 -- 172.21.15.110:0/3900143678 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6310+0+0 (secure 0 0 0) 0x7f7028073eb0 con 0x7f703014a140 2021-03-25T14:18:20.510 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.503+0000 7f7035a85700 1 --2- 172.21.15.110:0/3900143678 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f701005a0b0 0x7f701005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:20.510 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.503+0000 7f7035a85700 1 --2- 172.21.15.110:0/3900143678 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f701005a0b0 0x7f701005c570 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f702c001530 tx=0x7f702c009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:20.510 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.507+0000 7f701dffb700 1 -- 172.21.15.110:0/3900143678 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f7028047760 con 0x7f703014a140 2021-03-25T14:18:20.692 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.690+0000 7f7036a87700 1 -- 172.21.15.110:0/3900143678 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f70300a5220 con 0x7f703014a140 2021-03-25T14:18:20.697 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.695+0000 7f701dffb700 1 -- 172.21.15.110:0/3900143678 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v37) v1 ==== 174+0+0 (secure 0 0 0) 0x7f702804ad80 con 0x7f703014a140 2021-03-25T14:18:20.699 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.698+0000 7f7036a87700 1 -- 172.21.15.110:0/3900143678 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f701005a0b0 msgr2=0x7f701005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:20.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.698+0000 7f7036a87700 1 --2- 172.21.15.110:0/3900143678 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f701005a0b0 0x7f701005c570 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f702c001530 tx=0x7f702c009040).stop 2021-03-25T14:18:20.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.698+0000 7f7036a87700 1 -- 172.21.15.110:0/3900143678 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f703014a140 msgr2=0x7f70300bb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:20.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.698+0000 7f7036a87700 1 --2- 172.21.15.110:0/3900143678 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f703014a140 0x7f70300bb120 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7f7028001560 tx=0x7f7028007e10).stop 2021-03-25T14:18:20.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.698+0000 7f7036a87700 1 -- 172.21.15.110:0/3900143678 shutdown_connections 2021-03-25T14:18:20.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.698+0000 7f7036a87700 1 --2- 172.21.15.110:0/3900143678 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f701005a0b0 0x7f701005c570 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:20.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.698+0000 7f7036a87700 1 --2- 172.21.15.110:0/3900143678 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f703014a140 0x7f70300bb120 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:20.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.698+0000 7f7036a87700 1 --2- 172.21.15.110:0/3900143678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70300671d0 0x7f70300a5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:20.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.698+0000 7f7036a87700 1 --2- 172.21.15.110:0/3900143678 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70300bcb10 0x7f703015c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:20.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.698+0000 7f7036a87700 1 -- 172.21.15.110:0/3900143678 >> 172.21.15.110:0/3900143678 conn(0x7f7030064860 msgr2=0x7f70300bdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:20.701 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.699+0000 7f7036a87700 1 -- 172.21.15.110:0/3900143678 shutdown_connections 2021-03-25T14:18:20.707 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.705+0000 7f7036a87700 1 -- 172.21.15.110:0/3900143678 wait complete. 2021-03-25T14:18:20.709 INFO:teuthology.orchestra.run.smithi110.stderr:new fs with metadata pool 14 and data pool 15 2021-03-25T14:18:20.722 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:18:20.834 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.832+0000 7f689c19f700 1 Processor -- start 2021-03-25T14:18:20.834 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.832+0000 7f689c19f700 1 -- start start 2021-03-25T14:18:20.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.833+0000 7f689c19f700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f68940675d0 0x7f68940b1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:20.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.833+0000 7f689c19f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6894148970 0x7f6894148e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:20.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.833+0000 7f689c19f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68940bafc0 con 0x7f68940bc220 2021-03-25T14:18:20.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.833+0000 7f689c19f700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68940b1830 con 0x7f68940675d0 2021-03-25T14:18:20.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.833+0000 7f689c19f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68940baa80 con 0x7f6894148970 2021-03-25T14:18:20.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.833+0000 7f6899f3b700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f68940675d0 0x7f68940b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:20.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.833+0000 7f6899f3b700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f68940675d0 0x7f68940b1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51602/0 (socket says 172.21.15.110:51602) 2021-03-25T14:18:20.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.833+0000 7f6899f3b700 1 -- 172.21.15.110:0/2542265693 learned_addr learned my addr 172.21.15.110:0/2542265693 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:20.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.834+0000 7f6899f3b700 1 -- 172.21.15.110:0/2542265693 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6894148970 msgr2=0x7f6894148e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:20.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.834+0000 7f6899f3b700 1 --2- 172.21.15.110:0/2542265693 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6894148970 0x7f6894148e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-03-25T14:18:20.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.834+0000 7f6899f3b700 1 -- 172.21.15.110:0/2542265693 >> v1:172.21.15.174:6789/0 conn(0x7f68940bc220 legacy=0x7f689414cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:20.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.834+0000 7f6899f3b700 1 -- 172.21.15.110:0/2542265693 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68940bad20 con 0x7f68940675d0 2021-03-25T14:18:20.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.834+0000 7f6899f3b700 1 --2- 172.21.15.110:0/2542265693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68940675d0 0x7f68940b1340 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f689000ba20 tx=0x7f6890006ee0).ready entity=mon.0 client_cookie=eec3664e01d94398 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:20.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.834+0000 7f6898f39700 1 -- 172.21.15.110:0/2542265693 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6890009890 con 0x7f68940675d0 2021-03-25T14:18:20.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.834+0000 7f6898f39700 1 -- 172.21.15.110:0/2542265693 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68900099f0 con 0x7f68940675d0 2021-03-25T14:18:20.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.834+0000 7f6898f39700 1 -- 172.21.15.110:0/2542265693 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6890009d70 con 0x7f68940675d0 2021-03-25T14:18:20.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.834+0000 7f689c19f700 1 -- 172.21.15.110:0/2542265693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68940675d0 msgr2=0x7f68940b1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:20.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.834+0000 7f689c19f700 1 --2- 172.21.15.110:0/2542265693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68940675d0 0x7f68940b1340 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f689000ba20 tx=0x7f6890006ee0).stop 2021-03-25T14:18:20.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.834+0000 7f689c19f700 1 -- 172.21.15.110:0/2542265693 shutdown_connections 2021-03-25T14:18:20.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.834+0000 7f689c19f700 1 --2- 172.21.15.110:0/2542265693 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6894148970 0x7f6894148e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-03-25T14:18:20.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.834+0000 7f689c19f700 1 --2- 172.21.15.110:0/2542265693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68940675d0 0x7f68940b1340 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:20.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.834+0000 7f689c19f700 1 -- 172.21.15.110:0/2542265693 >> 172.21.15.110:0/2542265693 conn(0x7f6894064a10 msgr2=0x7f689405c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:20.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.834+0000 7f689c19f700 1 -- 172.21.15.110:0/2542265693 shutdown_connections 2021-03-25T14:18:20.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.834+0000 7f689c19f700 1 -- 172.21.15.110:0/2542265693 wait complete. 2021-03-25T14:18:20.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.835+0000 7f689c19f700 1 Processor -- start 2021-03-25T14:18:20.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.835+0000 7f689c19f700 1 -- start start 2021-03-25T14:18:20.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.836+0000 7f689c19f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68940675d0 0x7f68940b2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:20.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.836+0000 7f689c19f700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68940bc220 0x7f68940b30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:20.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.836+0000 7f689c19f700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6894148970 0x7f689415c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:20.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.836+0000 7f689c19f700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68940b2a60 con 0x7f68940bc220 2021-03-25T14:18:20.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.836+0000 7f689c19f700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68940b4cf0 con 0x7f6894148970 2021-03-25T14:18:20.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.836+0000 7f689c19f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68940b4f90 con 0x7f68940675d0 2021-03-25T14:18:20.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.836+0000 7f689973a700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68940bc220 0x7f68940b30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:20.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.836+0000 7f689973a700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68940bc220 0x7f68940b30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51608/0 (socket says 172.21.15.110:51608) 2021-03-25T14:18:20.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.836+0000 7f689973a700 1 -- 172.21.15.110:0/1713323578 learned_addr learned my addr 172.21.15.110:0/1713323578 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:20.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.836+0000 7f6899f3b700 1 --2- 172.21.15.110:0/1713323578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68940675d0 0x7f68940b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:20.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.836+0000 7f689a73c700 1 --2- 172.21.15.110:0/1713323578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6894148970 0x7f689415c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:20.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.836+0000 7f689973a700 1 -- 172.21.15.110:0/1713323578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68940675d0 msgr2=0x7f68940b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:20.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.836+0000 7f689973a700 1 --2- 172.21.15.110:0/1713323578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68940675d0 0x7f68940b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:20.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.836+0000 7f689973a700 1 -- 172.21.15.110:0/1713323578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6894148970 msgr2=0x7f689415c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:20.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.836+0000 7f689973a700 1 --2- 172.21.15.110:0/1713323578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6894148970 0x7f689415c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:20.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.837+0000 7f689973a700 1 -- 172.21.15.110:0/1713323578 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68940b5230 con 0x7f68940bc220 2021-03-25T14:18:20.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.837+0000 7f689a73c700 1 --2- 172.21.15.110:0/1713323578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6894148970 0x7f689415c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:18:20.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.837+0000 7f689973a700 1 --2- 172.21.15.110:0/1713323578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68940bc220 0x7f68940b30f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7f68840096b0 tx=0x7f6884006e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:20.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.837+0000 7f6881ffb700 1 -- 172.21.15.110:0/1713323578 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688400d500 con 0x7f68940bc220 2021-03-25T14:18:20.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.837+0000 7f6881ffb700 1 -- 172.21.15.110:0/1713323578 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688400d660 con 0x7f68940bc220 2021-03-25T14:18:20.849 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.837+0000 7f689c19f700 1 -- 172.21.15.110:0/1713323578 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68940b56d0 con 0x7f68940bc220 2021-03-25T14:18:20.849 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.837+0000 7f6881ffb700 1 -- 172.21.15.110:0/1713323578 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688400da20 con 0x7f68940bc220 2021-03-25T14:18:20.849 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.837+0000 7f689c19f700 1 -- 172.21.15.110:0/1713323578 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68940b35e0 con 0x7f68940bc220 2021-03-25T14:18:20.849 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.838+0000 7f689c19f700 1 -- 172.21.15.110:0/1713323578 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68940bc060 con 0x7f68940bc220 2021-03-25T14:18:20.849 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.838+0000 7f6881ffb700 1 -- 172.21.15.110:0/1713323578 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f6884012420 con 0x7f68940bc220 2021-03-25T14:18:20.849 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.838+0000 7f6881ffb700 1 --2- 172.21.15.110:0/1713323578 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f687405a0b0 0x7f687405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:20.849 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.838+0000 7f6881ffb700 1 -- 172.21.15.110:0/1713323578 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6426+0+0 (secure 0 0 0) 0x7f6884073d70 con 0x7f68940bc220 2021-03-25T14:18:20.849 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.838+0000 7f6899f3b700 1 --2- 172.21.15.110:0/1713323578 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f687405a0b0 0x7f687405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:20.849 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.839+0000 7f6899f3b700 1 --2- 172.21.15.110:0/1713323578 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f687405a0b0 0x7f687405c570 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f68940b9a80 tx=0x7f6890016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:20.849 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.842+0000 7f6881ffb700 1 -- 172.21.15.110:0/1713323578 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f6884047550 con 0x7f68940bc220 2021-03-25T14:18:20.995 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.993+0000 7f689c19f700 1 -- 172.21.15.110:0/1713323578 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6894068850 con 0x7f68940bc220 2021-03-25T14:18:20.996 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.994+0000 7f6881ffb700 1 -- 172.21.15.110:0/1713323578 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+17125 (secure 0 0 0) 0x7f688404ab70 con 0x7f68940bc220 2021-03-25T14:18:20.996 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:18:20.996 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":73,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:18:20.692024+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2021-03-25T14:18:19.759815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2021-03-25T14:18:20.168625+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:18:20.999 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.996+0000 7f689c19f700 1 -- 172.21.15.110:0/1713323578 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f687405a0b0 msgr2=0x7f687405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:20.999 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.996+0000 7f689c19f700 1 --2- 172.21.15.110:0/1713323578 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f687405a0b0 0x7f687405c570 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f68940b9a80 tx=0x7f6890016000).stop 2021-03-25T14:18:20.999 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.996+0000 7f689c19f700 1 -- 172.21.15.110:0/1713323578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68940bc220 msgr2=0x7f68940b30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:20.999 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.996+0000 7f689c19f700 1 --2- 172.21.15.110:0/1713323578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68940bc220 0x7f68940b30f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7f68840096b0 tx=0x7f6884006e10).stop 2021-03-25T14:18:20.999 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.996+0000 7f689c19f700 1 -- 172.21.15.110:0/1713323578 shutdown_connections 2021-03-25T14:18:20.999 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.996+0000 7f689c19f700 1 --2- 172.21.15.110:0/1713323578 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f687405a0b0 0x7f687405c570 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:20.999 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.996+0000 7f689c19f700 1 --2- 172.21.15.110:0/1713323578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6894148970 0x7f689415c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:20.999 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.996+0000 7f689c19f700 1 --2- 172.21.15.110:0/1713323578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68940675d0 0x7f68940b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:20.999 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.996+0000 7f689c19f700 1 --2- 172.21.15.110:0/1713323578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68940bc220 0x7f68940b30f0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:20.999 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.996+0000 7f689c19f700 1 -- 172.21.15.110:0/1713323578 >> 172.21.15.110:0/1713323578 conn(0x7f6894064a10 msgr2=0x7f6894145920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:20.999 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.996+0000 7f689c19f700 1 -- 172.21.15.110:0/1713323578 shutdown_connections 2021-03-25T14:18:20.999 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:20.996+0000 7f689c19f700 1 -- 172.21.15.110:0/1713323578 wait complete. 2021-03-25T14:18:21.010 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:18:21.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.117+0000 7f8457c94700 1 Processor -- start 2021-03-25T14:18:21.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.117+0000 7f8457c94700 1 -- start start 2021-03-25T14:18:21.126 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.118+0000 7f8457c94700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f84500ba9c0 0x7f84500b9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:21.126 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.118+0000 7f8457c94700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84500bb330 0x7f845014a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:21.126 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.118+0000 7f8457c94700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84501482d0 con 0x7f84500bada0 2021-03-25T14:18:21.126 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.118+0000 7f8457c94700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84501417d0 con 0x7f84500ba9c0 2021-03-25T14:18:21.126 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.118+0000 7f8457c94700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845014b250 con 0x7f84500bb330 2021-03-25T14:18:21.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.119+0000 7f8455a30700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f84500ba9c0 0x7f84500b9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:21.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.119+0000 7f8456231700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f84500bada0 0x7f8450147bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.110:52218/0 (socket says 172.21.15.110:52218) 2021-03-25T14:18:21.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.119+0000 7f8456231700 1 -- 172.21.15.110:0/1849881358 learned_addr learned my addr 172.21.15.110:0/1849881358 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:18:21.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.119+0000 7f845522f700 1 --2- 172.21.15.110:0/1849881358 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84500bb330 0x7f845014a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:21.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.119+0000 7f8454a2e700 1 -- 172.21.15.110:0/1849881358 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2847528144 0 0) 0x7f84501482d0 con 0x7f84500bada0 2021-03-25T14:18:21.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.119+0000 7f8454a2e700 1 -- 172.21.15.110:0/1849881358 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8438003270 con 0x7f84500bada0 2021-03-25T14:18:21.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.119+0000 7f8455a30700 1 -- 172.21.15.110:0/1849881358 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84500bb330 msgr2=0x7f845014a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:21.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.119+0000 7f8455a30700 1 --2- 172.21.15.110:0/1849881358 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84500bb330 0x7f845014a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:21.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.119+0000 7f8455a30700 1 -- 172.21.15.110:0/1849881358 >> v1:172.21.15.174:6789/0 conn(0x7f84500bada0 legacy=0x7f8450147bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:21.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.119+0000 7f8455a30700 1 -- 172.21.15.110:0/1849881358 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845014b4f0 con 0x7f84500ba9c0 2021-03-25T14:18:21.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.119+0000 7f8455a30700 1 --2- 172.21.15.110:0/1849881358 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84500ba9c0 0x7f84500b9f90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f844c00b9b0 tx=0x7f844c006dc0).ready entity=mon.1 client_cookie=c7753a6da4cc493c server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:21.128 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.119+0000 7f8454a2e700 1 -- 172.21.15.110:0/1849881358 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c006030 con 0x7f84500ba9c0 2021-03-25T14:18:21.128 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.119+0000 7f8454a2e700 1 -- 172.21.15.110:0/1849881358 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844c006190 con 0x7f84500ba9c0 2021-03-25T14:18:21.128 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.119+0000 7f8454a2e700 1 -- 172.21.15.110:0/1849881358 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c006510 con 0x7f84500ba9c0 2021-03-25T14:18:21.128 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.120+0000 7f8457c94700 1 -- 172.21.15.110:0/1849881358 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84500ba9c0 msgr2=0x7f84500b9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:21.128 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.120+0000 7f8457c94700 1 --2- 172.21.15.110:0/1849881358 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84500ba9c0 0x7f84500b9f90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f844c00b9b0 tx=0x7f844c006dc0).stop 2021-03-25T14:18:21.128 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.120+0000 7f8457c94700 1 -- 172.21.15.110:0/1849881358 shutdown_connections 2021-03-25T14:18:21.128 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.120+0000 7f8457c94700 1 --2- 172.21.15.110:0/1849881358 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84500ba9c0 0x7f84500b9f90 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:21.128 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.120+0000 7f8457c94700 1 --2- 172.21.15.110:0/1849881358 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84500bb330 0x7f845014a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:21.128 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.120+0000 7f8457c94700 1 -- 172.21.15.110:0/1849881358 >> 172.21.15.110:0/1849881358 conn(0x7f8450060c40 msgr2=0x7f8450061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:21.128 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.120+0000 7f8457c94700 1 -- 172.21.15.110:0/1849881358 shutdown_connections 2021-03-25T14:18:21.129 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.120+0000 7f8457c94700 1 -- 172.21.15.110:0/1849881358 wait complete. 2021-03-25T14:18:21.129 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.121+0000 7f8457c94700 1 Processor -- start 2021-03-25T14:18:21.129 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.121+0000 7f8457c94700 1 -- start start 2021-03-25T14:18:21.129 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.122+0000 7f8457c94700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84500ba9c0 0x7f845015c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:21.129 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.122+0000 7f8457c94700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84500bada0 0x7f8450063090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:21.129 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.122+0000 7f8457c94700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84500bb330 0x7f84500a28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:21.129 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.122+0000 7f8457c94700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84500b59a0 con 0x7f84500ba9c0 2021-03-25T14:18:21.129 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.122+0000 7f8457c94700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845015c010 con 0x7f84500bb330 2021-03-25T14:18:21.129 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.122+0000 7f8457c94700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84500b5700 con 0x7f84500bada0 2021-03-25T14:18:21.130 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.122+0000 7f8455a30700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84500ba9c0 0x7f845015c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:21.130 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.122+0000 7f8455a30700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84500ba9c0 0x7f845015c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51622/0 (socket says 172.21.15.110:51622) 2021-03-25T14:18:21.130 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.122+0000 7f8455a30700 1 -- 172.21.15.110:0/477851764 learned_addr learned my addr 172.21.15.110:0/477851764 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:21.130 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.122+0000 7f8456231700 1 --2- 172.21.15.110:0/477851764 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84500bb330 0x7f84500a28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:21.130 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.122+0000 7f845522f700 1 --2- 172.21.15.110:0/477851764 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84500bada0 0x7f8450063090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:21.130 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.122+0000 7f8455a30700 1 -- 172.21.15.110:0/477851764 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84500bada0 msgr2=0x7f8450063090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:21.130 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.122+0000 7f8455a30700 1 --2- 172.21.15.110:0/477851764 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84500bada0 0x7f8450063090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:21.130 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.122+0000 7f8455a30700 1 -- 172.21.15.110:0/477851764 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84500bb330 msgr2=0x7f84500a28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:21.130 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.122+0000 7f8455a30700 1 --2- 172.21.15.110:0/477851764 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84500bb330 0x7f84500a28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:21.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.122+0000 7f8455a30700 1 -- 172.21.15.110:0/477851764 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845015c270 con 0x7f84500ba9c0 2021-03-25T14:18:21.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.122+0000 7f8455a30700 1 --2- 172.21.15.110:0/477851764 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84500ba9c0 0x7f845015c9b0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7f844c009450 tx=0x7f844c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:21.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.122+0000 7f843dffb700 1 -- 172.21.15.110:0/477851764 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c009970 con 0x7f84500ba9c0 2021-03-25T14:18:21.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.122+0000 7f843dffb700 1 -- 172.21.15.110:0/477851764 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844c009ad0 con 0x7f84500ba9c0 2021-03-25T14:18:21.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.122+0000 7f8457c94700 1 -- 172.21.15.110:0/477851764 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f845015c510 con 0x7f84500ba9c0 2021-03-25T14:18:21.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.122+0000 7f843dffb700 1 -- 172.21.15.110:0/477851764 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c009e50 con 0x7f84500ba9c0 2021-03-25T14:18:21.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.123+0000 7f8457c94700 1 -- 172.21.15.110:0/477851764 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84500641f0 con 0x7f84500ba9c0 2021-03-25T14:18:21.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.124+0000 7f8457c94700 1 -- 172.21.15.110:0/477851764 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f845005d7b0 con 0x7f84500ba9c0 2021-03-25T14:18:21.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.124+0000 7f843dffb700 1 -- 172.21.15.110:0/477851764 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f844c024030 con 0x7f84500ba9c0 2021-03-25T14:18:21.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.124+0000 7f843dffb700 1 --2- 172.21.15.110:0/477851764 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f843005a0b0 0x7f843005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:21.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.124+0000 7f843dffb700 1 -- 172.21.15.110:0/477851764 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6426+0+0 (secure 0 0 0) 0x7f844c075200 con 0x7f84500ba9c0 2021-03-25T14:18:21.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.124+0000 7f845522f700 1 --2- 172.21.15.110:0/477851764 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f843005a0b0 0x7f843005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:21.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.124+0000 7f845522f700 1 --2- 172.21.15.110:0/477851764 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f843005a0b0 0x7f843005c570 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f8440006c00 tx=0x7f8440008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:21.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.128+0000 7f843dffb700 1 -- 172.21.15.110:0/477851764 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f844c048a40 con 0x7f84500ba9c0 2021-03-25T14:18:21.278 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.276+0000 7f8457c94700 1 -- 172.21.15.110:0/477851764 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8450061c50 con 0x7f84500ba9c0 2021-03-25T14:18:21.286 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.277+0000 7f843dffb700 1 -- 172.21.15.110:0/477851764 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+17125 (secure 0 0 0) 0x7f844c022020 con 0x7f84500ba9c0 2021-03-25T14:18:21.287 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:18:21.287 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":73,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:18:20.692024+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2021-03-25T14:18:19.759815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2021-03-25T14:18:20.168625+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:18:21.289 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.279+0000 7f8457c94700 1 -- 172.21.15.110:0/477851764 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f843005a0b0 msgr2=0x7f843005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:21.289 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.279+0000 7f8457c94700 1 --2- 172.21.15.110:0/477851764 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f843005a0b0 0x7f843005c570 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f8440006c00 tx=0x7f8440008040).stop 2021-03-25T14:18:21.289 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.279+0000 7f8457c94700 1 -- 172.21.15.110:0/477851764 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84500ba9c0 msgr2=0x7f845015c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:21.289 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.279+0000 7f8457c94700 1 --2- 172.21.15.110:0/477851764 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84500ba9c0 0x7f845015c9b0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7f844c009450 tx=0x7f844c015000).stop 2021-03-25T14:18:21.289 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.279+0000 7f8457c94700 1 -- 172.21.15.110:0/477851764 shutdown_connections 2021-03-25T14:18:21.289 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.279+0000 7f8457c94700 1 --2- 172.21.15.110:0/477851764 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f843005a0b0 0x7f843005c570 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:21.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.279+0000 7f8457c94700 1 --2- 172.21.15.110:0/477851764 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84500bb330 0x7f84500a28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:21.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.279+0000 7f8457c94700 1 --2- 172.21.15.110:0/477851764 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84500ba9c0 0x7f845015c9b0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:21.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.279+0000 7f8457c94700 1 --2- 172.21.15.110:0/477851764 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84500bada0 0x7f8450063090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:21.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.279+0000 7f8457c94700 1 -- 172.21.15.110:0/477851764 >> 172.21.15.110:0/477851764 conn(0x7f8450060c40 msgr2=0x7f8450061020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:21.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.279+0000 7f8457c94700 1 -- 172.21.15.110:0/477851764 shutdown_connections 2021-03-25T14:18:21.290 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.279+0000 7f8457c94700 1 -- 172.21.15.110:0/477851764 wait complete. 2021-03-25T14:18:21.293 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-03-25T14:18:21.405 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.403+0000 7fe29926c700 1 Processor -- start 2021-03-25T14:18:21.405 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.403+0000 7fe29926c700 1 -- start start 2021-03-25T14:18:21.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.404+0000 7fe29926c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe294143bc0 0x7fe2940a2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:21.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.404+0000 7fe29926c700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2940b6c90 con 0x7fe294068440 2021-03-25T14:18:21.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.404+0000 7fe29926c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe29414a080 con 0x7fe294060e00 2021-03-25T14:18:21.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.404+0000 7fe29926c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe294068ca0 con 0x7fe294143bc0 2021-03-25T14:18:21.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.404+0000 7fe2927fc700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fe294068440 0x7fe2941434b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44568/0 (socket says 172.21.15.110:44568) 2021-03-25T14:18:21.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.404+0000 7fe2927fc700 1 -- 172.21.15.110:0/3501398749 learned_addr learned my addr 172.21.15.110:0/3501398749 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:18:21.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.404+0000 7fe291ffb700 1 -- 172.21.15.110:0/3501398749 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2706885198 0 0) 0x7fe288001110 con 0x7fe294068440 2021-03-25T14:18:21.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.404+0000 7fe2937fe700 1 --2- 172.21.15.110:0/3501398749 >> v2:172.21.15.174:3300/0 conn(0x7fe294143bc0 0x7fe2940a2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:21.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.404+0000 7fe291ffb700 1 -- 172.21.15.110:0/3501398749 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe280003270 con 0x7fe294068440 2021-03-25T14:18:21.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.404+0000 7fe291ffb700 1 -- 172.21.15.110:0/3501398749 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2539984266 0 0) 0x7fe280003270 con 0x7fe294068440 2021-03-25T14:18:21.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.404+0000 7fe291ffb700 1 -- 172.21.15.110:0/3501398749 >> v2:172.21.15.174:3300/0 conn(0x7fe294143bc0 msgr2=0x7fe2940a2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:21.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.404+0000 7fe291ffb700 1 --2- 172.21.15.110:0/3501398749 >> v2:172.21.15.174:3300/0 conn(0x7fe294143bc0 0x7fe2940a2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:21.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.404+0000 7fe291ffb700 1 -- 172.21.15.110:0/3501398749 >> v1:172.21.15.174:6789/0 conn(0x7fe294060e00 legacy=0x7fe294149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:21.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.404+0000 7fe291ffb700 1 -- 172.21.15.110:0/3501398749 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2940a2d40 con 0x7fe294068440 2021-03-25T14:18:21.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.404+0000 7fe291ffb700 1 -- 172.21.15.110:0/3501398749 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7fe2880016b0 con 0x7fe294068440 2021-03-25T14:18:21.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.405+0000 7fe291ffb700 1 -- 172.21.15.110:0/3501398749 >> v1:172.21.15.110:6789/0 conn(0x7fe294068440 legacy=0x7fe2941434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:21.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.405+0000 7fe291ffb700 1 --2- 172.21.15.110:0/3501398749 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe280003790 0x7fe280003bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:21.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.405+0000 7fe291ffb700 1 --2- 172.21.15.110:0/3501398749 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe280004510 0x7fe280004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:21.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.405+0000 7fe291ffb700 1 --2- 172.21.15.110:0/3501398749 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe280004e80 0x7fe28000b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:21.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.405+0000 7fe291ffb700 1 -- 172.21.15.110:0/3501398749 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe294068ca0 con 0x7fe280004e80 2021-03-25T14:18:21.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.405+0000 7fe291ffb700 1 -- 172.21.15.110:0/3501398749 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2800042c0 con 0x7fe280003790 2021-03-25T14:18:21.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.405+0000 7fe291ffb700 1 -- 172.21.15.110:0/3501398749 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe28000bc50 con 0x7fe280004510 2021-03-25T14:18:21.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.405+0000 7fe2937fe700 1 --2- 172.21.15.110:0/3501398749 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe280004e80 0x7fe28000b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:21.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.405+0000 7fe292ffd700 1 --2- 172.21.15.110:0/3501398749 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe280003790 0x7fe280003bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:21.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.405+0000 7fe2927fc700 1 --2- 172.21.15.110:0/3501398749 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe280004510 0x7fe280004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:21.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.405+0000 7fe2937fe700 1 -- 172.21.15.110:0/3501398749 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe280004510 msgr2=0x7fe280004990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:21.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.405+0000 7fe2937fe700 1 --2- 172.21.15.110:0/3501398749 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe280004510 0x7fe280004990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:21.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.405+0000 7fe2937fe700 1 -- 172.21.15.110:0/3501398749 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe280003790 msgr2=0x7fe280003bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:21.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.405+0000 7fe2937fe700 1 --2- 172.21.15.110:0/3501398749 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe280003790 0x7fe280003bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:21.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.405+0000 7fe2937fe700 1 -- 172.21.15.110:0/3501398749 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe280003270 con 0x7fe280004e80 2021-03-25T14:18:21.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.405+0000 7fe2937fe700 1 -- 172.21.15.110:0/3501398749 reap_dead start 2021-03-25T14:18:21.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.405+0000 7fe2937fe700 1 --2- 172.21.15.110:0/3501398749 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe280004e80 0x7fe28000b760 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7fe28c009ea0 tx=0x7fe28c009220).ready entity=mon.0 client_cookie=5ad05028d93d8a9a server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:21.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.405+0000 7fe291ffb700 1 -- 172.21.15.110:0/3501398749 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c0095f0 con 0x7fe280004e80 2021-03-25T14:18:21.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.405+0000 7fe291ffb700 1 -- 172.21.15.110:0/3501398749 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28c00ebb0 con 0x7fe280004e80 2021-03-25T14:18:21.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.405+0000 7fe291ffb700 1 -- 172.21.15.110:0/3501398749 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c0123f0 con 0x7fe280004e80 2021-03-25T14:18:21.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.406+0000 7fe29926c700 1 -- 172.21.15.110:0/3501398749 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe280004e80 msgr2=0x7fe28000b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:21.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.406+0000 7fe29926c700 1 --2- 172.21.15.110:0/3501398749 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe280004e80 0x7fe28000b760 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7fe28c009ea0 tx=0x7fe28c009220).stop 2021-03-25T14:18:21.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.406+0000 7fe29926c700 1 -- 172.21.15.110:0/3501398749 shutdown_connections 2021-03-25T14:18:21.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.406+0000 7fe29926c700 1 --2- 172.21.15.110:0/3501398749 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe280004e80 0x7fe28000b760 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:21.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.406+0000 7fe29926c700 1 -- 172.21.15.110:0/3501398749 >> 172.21.15.110:0/3501398749 conn(0x7fe294061d50 msgr2=0x7fe294062160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:21.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.406+0000 7fe29926c700 1 -- 172.21.15.110:0/3501398749 shutdown_connections 2021-03-25T14:18:21.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.406+0000 7fe29926c700 1 -- 172.21.15.110:0/3501398749 wait complete. 2021-03-25T14:18:21.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.407+0000 7fe29926c700 1 Processor -- start 2021-03-25T14:18:21.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.407+0000 7fe29926c700 1 -- start start 2021-03-25T14:18:21.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.408+0000 7fe29926c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe280004e80 0x7fe294146660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:21.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.408+0000 7fe29926c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe29409e4c0 0x7fe2941590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:21.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.408+0000 7fe29926c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2941595c0 0x7fe294159a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:21.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.408+0000 7fe29926c700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2940a1de0 con 0x7fe29409e4c0 2021-03-25T14:18:21.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.408+0000 7fe29926c700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2940bdbe0 con 0x7fe280004e80 2021-03-25T14:18:21.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.408+0000 7fe29926c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2940bcb80 con 0x7fe2941595c0 2021-03-25T14:18:21.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.408+0000 7fe2927fc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe29409e4c0 0x7fe2941590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:21.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.408+0000 7fe2927fc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe29409e4c0 0x7fe2941590d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51644/0 (socket says 172.21.15.110:51644) 2021-03-25T14:18:21.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.408+0000 7fe2927fc700 1 -- 172.21.15.110:0/1678787016 learned_addr learned my addr 172.21.15.110:0/1678787016 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:21.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.408+0000 7fe2927fc700 1 -- 172.21.15.110:0/1678787016 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2941595c0 msgr2=0x7fe294159a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:21.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.408+0000 7fe2927fc700 1 --2- 172.21.15.110:0/1678787016 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2941595c0 0x7fe294159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:18:21.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.408+0000 7fe2927fc700 1 -- 172.21.15.110:0/1678787016 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe280004e80 msgr2=0x7fe294146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:21.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.408+0000 7fe2927fc700 1 --2- 172.21.15.110:0/1678787016 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe280004e80 0x7fe294146660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:18:21.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.408+0000 7fe2927fc700 1 -- 172.21.15.110:0/1678787016 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2940bce20 con 0x7fe29409e4c0 2021-03-25T14:18:21.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.408+0000 7fe2927fc700 1 --2- 172.21.15.110:0/1678787016 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe29409e4c0 0x7fe2941590d0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7fe288004b10 tx=0x7fe288007970).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:21.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.408+0000 7fe27affd700 1 -- 172.21.15.110:0/1678787016 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28800f9a0 con 0x7fe29409e4c0 2021-03-25T14:18:21.418 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.408+0000 7fe27affd700 1 -- 172.21.15.110:0/1678787016 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28800fb00 con 0x7fe29409e4c0 2021-03-25T14:18:21.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.408+0000 7fe29926c700 1 -- 172.21.15.110:0/1678787016 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2940bd0c0 con 0x7fe29409e4c0 2021-03-25T14:18:21.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.408+0000 7fe27affd700 1 -- 172.21.15.110:0/1678787016 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28800fe80 con 0x7fe29409e4c0 2021-03-25T14:18:21.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.408+0000 7fe29926c700 1 -- 172.21.15.110:0/1678787016 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe294146b50 con 0x7fe29409e4c0 2021-03-25T14:18:21.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.409+0000 7fe29926c700 1 -- 172.21.15.110:0/1678787016 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2940bd520 con 0x7fe29409e4c0 2021-03-25T14:18:21.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.409+0000 7fe27affd700 1 -- 172.21.15.110:0/1678787016 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fe28801b030 con 0x7fe29409e4c0 2021-03-25T14:18:21.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.410+0000 7fe27affd700 1 --2- 172.21.15.110:0/1678787016 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe27405a0e0 0x7fe27405c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:21.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.410+0000 7fe27affd700 1 -- 172.21.15.110:0/1678787016 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6426+0+0 (secure 0 0 0) 0x7fe288073500 con 0x7fe29409e4c0 2021-03-25T14:18:21.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.410+0000 7fe292ffd700 1 --2- 172.21.15.110:0/1678787016 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe27405a0e0 0x7fe27405c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:21.419 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.410+0000 7fe292ffd700 1 --2- 172.21.15.110:0/1678787016 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe27405a0e0 0x7fe27405c5a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7fe284007b90 tx=0x7fe284007bc0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:21.420 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.413+0000 7fe27affd700 1 -- 172.21.15.110:0/1678787016 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fe288046df0 con 0x7fe29409e4c0 2021-03-25T14:18:21.600 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.598+0000 7fe29926c700 1 -- 172.21.15.110:0/1678787016 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe2940b6c90 con 0x7fe29409e4c0 2021-03-25T14:18:21.700 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.698+0000 7fe27affd700 1 -- 172.21.15.110:0/1678787016 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v38) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe2940b6c90 con 0x7fe29409e4c0 2021-03-25T14:18:21.702 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.700+0000 7fe29926c700 1 -- 172.21.15.110:0/1678787016 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe27405a0e0 msgr2=0x7fe27405c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:21.702 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.700+0000 7fe29926c700 1 --2- 172.21.15.110:0/1678787016 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe27405a0e0 0x7fe27405c5a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7fe284007b90 tx=0x7fe284007bc0).stop 2021-03-25T14:18:21.702 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.700+0000 7fe29926c700 1 -- 172.21.15.110:0/1678787016 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe29409e4c0 msgr2=0x7fe2941590d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:21.702 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.700+0000 7fe29926c700 1 --2- 172.21.15.110:0/1678787016 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe29409e4c0 0x7fe2941590d0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7fe288004b10 tx=0x7fe288007970).stop 2021-03-25T14:18:21.703 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.700+0000 7fe29926c700 1 -- 172.21.15.110:0/1678787016 shutdown_connections 2021-03-25T14:18:21.703 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.700+0000 7fe29926c700 1 --2- 172.21.15.110:0/1678787016 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fe27405a0e0 0x7fe27405c5a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:21.703 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.700+0000 7fe29926c700 1 --2- 172.21.15.110:0/1678787016 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe280004e80 0x7fe294146660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:18:21.703 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.700+0000 7fe29926c700 1 --2- 172.21.15.110:0/1678787016 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2941595c0 0x7fe294159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:18:21.703 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.700+0000 7fe29926c700 1 --2- 172.21.15.110:0/1678787016 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe29409e4c0 0x7fe2941590d0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:21.703 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.700+0000 7fe29926c700 1 -- 172.21.15.110:0/1678787016 >> 172.21.15.110:0/1678787016 conn(0x7fe294061d50 msgr2=0x7fe294063d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:21.703 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.700+0000 7fe29926c700 1 -- 172.21.15.110:0/1678787016 shutdown_connections 2021-03-25T14:18:21.703 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.700+0000 7fe29926c700 1 -- 172.21.15.110:0/1678787016 wait complete. 2021-03-25T14:18:21.713 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-03-25T14:18:21.814 INFO:tasks.ceph.mds.c.smithi110.stderr:2021-03-25T14:18:21.812+0000 7eff0595a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2021-03-25T14:18:21.882 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.823+0000 7f3f139f4700 1 Processor -- start 2021-03-25T14:18:21.882 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.823+0000 7f3f139f4700 1 -- start start 2021-03-25T14:18:21.882 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.824+0000 7f3f139f4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f0c0bdce0 0x7f3f0c0be0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:21.882 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.824+0000 7f3f139f4700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f0c14cd00 con 0x7f3f0c0b7a40 2021-03-25T14:18:21.882 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.824+0000 7f3f139f4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f0c14cfa0 con 0x7f3f0c0b7ec0 2021-03-25T14:18:21.882 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.824+0000 7f3f139f4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c14d240 con 0x7f3f0c0bdce0 2021-03-25T14:18:21.882 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.824+0000 7f3f10f8f700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f3f0c0b7a40 0x7f3f0c143200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44590/0 (socket says 172.21.15.110:44590) 2021-03-25T14:18:21.882 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.824+0000 7f3f10f8f700 1 -- 172.21.15.110:0/2102920926 learned_addr learned my addr 172.21.15.110:0/2102920926 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:18:21.883 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.824+0000 7f3efffff700 1 -- 172.21.15.110:0/2102920926 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 278850735 0 0) 0x7f3f0c14cd00 con 0x7f3f0c0b7a40 2021-03-25T14:18:21.883 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.824+0000 7f3efffff700 1 -- 172.21.15.110:0/2102920926 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ef4003270 con 0x7f3f0c0b7a40 2021-03-25T14:18:21.883 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.824+0000 7f3f11790700 1 --2- 172.21.15.110:0/2102920926 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f0c0bdce0 0x7f3f0c0be0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:21.883 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.824+0000 7f3efffff700 1 -- 172.21.15.110:0/2102920926 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2441108549 0 0) 0x7f3ef4003270 con 0x7f3f0c0b7a40 2021-03-25T14:18:21.883 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.824+0000 7f3efffff700 1 -- 172.21.15.110:0/2102920926 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f0c0bdce0 msgr2=0x7f3f0c0be0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:21.883 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.824+0000 7f3efffff700 1 --2- 172.21.15.110:0/2102920926 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f0c0bdce0 0x7f3f0c0be0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:21.883 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.824+0000 7f3efffff700 1 -- 172.21.15.110:0/2102920926 >> v1:172.21.15.174:6789/0 conn(0x7f3f0c0b7ec0 legacy=0x7f3f0c1495b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:21.883 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.824+0000 7f3efffff700 1 -- 172.21.15.110:0/2102920926 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0c14d4e0 con 0x7f3f0c0b7a40 2021-03-25T14:18:21.883 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.824+0000 7f3efffff700 1 -- 172.21.15.110:0/2102920926 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f3f08001520 con 0x7f3f0c0b7a40 2021-03-25T14:18:21.883 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.824+0000 7f3efffff700 1 -- 172.21.15.110:0/2102920926 >> v1:172.21.15.110:6789/0 conn(0x7f3f0c0b7a40 legacy=0x7f3f0c143200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:21.883 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.825+0000 7f3efffff700 1 --2- 172.21.15.110:0/2102920926 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f0c0bdce0 0x7f3ef4003790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:21.884 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.825+0000 7f3efffff700 1 --2- 172.21.15.110:0/2102920926 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ef4003ca0 0x7f3ef4004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:21.884 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.825+0000 7f3efffff700 1 --2- 172.21.15.110:0/2102920926 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ef4004a00 0x7f3ef4004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:21.884 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.825+0000 7f3efffff700 1 -- 172.21.15.110:0/2102920926 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c14d240 con 0x7f3ef4003ca0 2021-03-25T14:18:21.884 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.825+0000 7f3efffff700 1 -- 172.21.15.110:0/2102920926 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef4004230 con 0x7f3ef4004a00 2021-03-25T14:18:21.884 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.825+0000 7f3efffff700 1 -- 172.21.15.110:0/2102920926 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef400b760 con 0x7f3f0c0bdce0 2021-03-25T14:18:21.884 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.825+0000 7f3f10f8f700 1 --2- 172.21.15.110:0/2102920926 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ef4003ca0 0x7f3ef4004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:21.884 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.825+0000 7f3f11790700 1 --2- 172.21.15.110:0/2102920926 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f0c0bdce0 0x7f3ef4003790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:21.884 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.825+0000 7f3f11f91700 1 --2- 172.21.15.110:0/2102920926 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ef4004a00 0x7f3ef4004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:21.885 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.825+0000 7f3f10f8f700 1 -- 172.21.15.110:0/2102920926 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f0c0bdce0 msgr2=0x7f3ef4003790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:21.885 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.825+0000 7f3f10f8f700 1 --2- 172.21.15.110:0/2102920926 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f0c0bdce0 0x7f3ef4003790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:21.885 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.825+0000 7f3f10f8f700 1 -- 172.21.15.110:0/2102920926 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ef4004a00 msgr2=0x7f3ef4004e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:21.885 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.825+0000 7f3f10f8f700 1 --2- 172.21.15.110:0/2102920926 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ef4004a00 0x7f3ef4004e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:21.885 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.825+0000 7f3f10f8f700 1 -- 172.21.15.110:0/2102920926 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef4003270 con 0x7f3ef4003ca0 2021-03-25T14:18:21.885 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.825+0000 7f3f11f91700 1 --2- 172.21.15.110:0/2102920926 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ef4004a00 0x7f3ef4004e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:18:21.885 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.825+0000 7f3f10f8f700 1 --2- 172.21.15.110:0/2102920926 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ef4003ca0 0x7f3ef4004510 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f3f0800c410 tx=0x7f3f0c14ce90).ready entity=mon.0 client_cookie=45bdc6b04588cd02 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:21.885 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.825+0000 7f3efffff700 1 -- 172.21.15.110:0/2102920926 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f080070d0 con 0x7f3ef4003ca0 2021-03-25T14:18:21.885 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.825+0000 7f3efffff700 1 -- 172.21.15.110:0/2102920926 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f08007230 con 0x7f3ef4003ca0 2021-03-25T14:18:21.885 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.825+0000 7f3efffff700 1 -- 172.21.15.110:0/2102920926 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f08005620 con 0x7f3ef4003ca0 2021-03-25T14:18:21.885 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.826+0000 7f3f139f4700 1 -- 172.21.15.110:0/2102920926 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ef4003ca0 msgr2=0x7f3ef4004510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:21.886 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.826+0000 7f3f139f4700 1 --2- 172.21.15.110:0/2102920926 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ef4003ca0 0x7f3ef4004510 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f3f0800c410 tx=0x7f3f0c14ce90).stop 2021-03-25T14:18:21.886 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.826+0000 7f3f11f91700 1 -- 172.21.15.110:0/2102920926 reap_dead start 2021-03-25T14:18:21.886 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.826+0000 7f3f139f4700 1 -- 172.21.15.110:0/2102920926 shutdown_connections 2021-03-25T14:18:21.886 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.826+0000 7f3f139f4700 1 -- 172.21.15.110:0/2102920926 >> 172.21.15.110:0/2102920926 conn(0x7f3f0c0686a0 msgr2=0x7f3f0c068ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:21.886 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.826+0000 7f3f139f4700 1 -- 172.21.15.110:0/2102920926 shutdown_connections 2021-03-25T14:18:21.886 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.826+0000 7f3f139f4700 1 -- 172.21.15.110:0/2102920926 wait complete. 2021-03-25T14:18:21.886 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.827+0000 7f3f139f4700 1 Processor -- start 2021-03-25T14:18:21.886 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.827+0000 7f3f139f4700 1 -- start start 2021-03-25T14:18:21.886 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.828+0000 7f3f139f4700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ef4003ca0 0x7f3f0c1447d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:21.886 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.828+0000 7f3f139f4700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f0c149cc0 0x7f3f0c15c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:21.886 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.828+0000 7f3f139f4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f0c0ba080 0x7f3f0c15c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:21.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.828+0000 7f3f139f4700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c14a240 con 0x7f3ef4003ca0 2021-03-25T14:18:21.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.828+0000 7f3f139f4700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c0b90c0 con 0x7f3f0c149cc0 2021-03-25T14:18:21.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.828+0000 7f3f139f4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c0b9360 con 0x7f3f0c0ba080 2021-03-25T14:18:21.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.828+0000 7f3f11790700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ef4003ca0 0x7f3f0c1447d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:21.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.828+0000 7f3f11790700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ef4003ca0 0x7f3f0c1447d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51662/0 (socket says 172.21.15.110:51662) 2021-03-25T14:18:21.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.828+0000 7f3f11790700 1 -- 172.21.15.110:0/817807159 learned_addr learned my addr 172.21.15.110:0/817807159 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:21.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.828+0000 7f3f11f91700 1 --2- 172.21.15.110:0/817807159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f0c0ba080 0x7f3f0c15c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:21.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.828+0000 7f3f10f8f700 1 --2- 172.21.15.110:0/817807159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f0c149cc0 0x7f3f0c15c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:21.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.828+0000 7f3f11790700 1 -- 172.21.15.110:0/817807159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f0c0ba080 msgr2=0x7f3f0c15c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:21.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.828+0000 7f3f11790700 1 --2- 172.21.15.110:0/817807159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f0c0ba080 0x7f3f0c15c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:21.887 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.828+0000 7f3f11790700 1 -- 172.21.15.110:0/817807159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f0c149cc0 msgr2=0x7f3f0c15c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:21.888 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.828+0000 7f3f11790700 1 --2- 172.21.15.110:0/817807159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f0c149cc0 0x7f3f0c15c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:21.888 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.828+0000 7f3f11790700 1 -- 172.21.15.110:0/817807159 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0c0b9600 con 0x7f3ef4003ca0 2021-03-25T14:18:21.888 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.828+0000 7f3f10f8f700 1 --2- 172.21.15.110:0/817807159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f0c149cc0 0x7f3f0c15c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:18:21.888 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.828+0000 7f3f11790700 1 --2- 172.21.15.110:0/817807159 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ef4003ca0 0x7f3f0c1447d0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f3f00011cc0 tx=0x7f3f00006e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:21.888 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.828+0000 7f3efd7fa700 1 -- 172.21.15.110:0/817807159 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f00011e70 con 0x7f3ef4003ca0 2021-03-25T14:18:21.888 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.828+0000 7f3efd7fa700 1 -- 172.21.15.110:0/817807159 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0000fc70 con 0x7f3ef4003ca0 2021-03-25T14:18:21.888 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.828+0000 7f3f139f4700 1 -- 172.21.15.110:0/817807159 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f0c144cc0 con 0x7f3ef4003ca0 2021-03-25T14:18:21.888 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.828+0000 7f3efd7fa700 1 -- 172.21.15.110:0/817807159 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f00014440 con 0x7f3ef4003ca0 2021-03-25T14:18:21.888 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.828+0000 7f3f139f4700 1 -- 172.21.15.110:0/817807159 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f0c0b85c0 con 0x7f3ef4003ca0 2021-03-25T14:18:21.888 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.829+0000 7f3f139f4700 1 -- 172.21.15.110:0/817807159 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f0c0b9790 con 0x7f3ef4003ca0 2021-03-25T14:18:21.888 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.830+0000 7f3efd7fa700 1 -- 172.21.15.110:0/817807159 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f3f00024070 con 0x7f3ef4003ca0 2021-03-25T14:18:21.889 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.830+0000 7f3efd7fa700 1 --2- 172.21.15.110:0/817807159 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3eec05a0e0 0x7f3eec05c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:21.889 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.830+0000 7f3efd7fa700 1 -- 172.21.15.110:0/817807159 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6426+0+0 (secure 0 0 0) 0x7f3f00074990 con 0x7f3ef4003ca0 2021-03-25T14:18:21.889 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.830+0000 7f3f10f8f700 1 --2- 172.21.15.110:0/817807159 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3eec05a0e0 0x7f3eec05c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:21.889 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.830+0000 7f3f10f8f700 1 --2- 172.21.15.110:0/817807159 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3eec05a0e0 0x7f3eec05c5a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f3f0c0a36f0 tx=0x7f3f08013000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:21.889 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:21.834+0000 7f3efd7fa700 1 -- 172.21.15.110:0/817807159 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f3f000481d0 con 0x7f3ef4003ca0 2021-03-25T14:18:22.021 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.019+0000 7f3f139f4700 1 -- 172.21.15.110:0/817807159 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3f0c05d7b0 con 0x7f3ef4003ca0 2021-03-25T14:18:22.021 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.019+0000 7f3efd7fa700 1 -- 172.21.15.110:0/817807159 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+2849 (secure 0 0 0) 0x7f3f00014830 con 0x7f3ef4003ca0 2021-03-25T14:18:22.022 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:18:22.022 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":38,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5626,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6834/2882862190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2882862190},{"type":"v1","addr":"172.21.15.174:6834","nonce":2882862190}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":37},{"gid":5629,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2673718386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6833","nonce":2673718386},{"type":"v1","addr":"172.21.15.174:6835","nonce":2673718386}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":37},{"gid":6141,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.110:6836/791689444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":791689444},{"type":"v1","addr":"172.21.15.110:6836","nonce":791689444}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":37}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-03-25T14:18:20.692249+0000","modified":"2021-03-25T14:18:21.694085+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6144},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6144":{"gid":6144,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6837/1764466790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1764466790},{"type":"v1","addr":"172.21.15.110:6837","nonce":1764466790}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-03-25T14:18:22.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.021+0000 7f3f139f4700 1 -- 172.21.15.110:0/817807159 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3eec05a0e0 msgr2=0x7f3eec05c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:22.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.021+0000 7f3f139f4700 1 --2- 172.21.15.110:0/817807159 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3eec05a0e0 0x7f3eec05c5a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f3f0c0a36f0 tx=0x7f3f08013000).stop 2021-03-25T14:18:22.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.021+0000 7f3f139f4700 1 -- 172.21.15.110:0/817807159 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ef4003ca0 msgr2=0x7f3f0c1447d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:22.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.021+0000 7f3f139f4700 1 --2- 172.21.15.110:0/817807159 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ef4003ca0 0x7f3f0c1447d0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f3f00011cc0 tx=0x7f3f00006e20).stop 2021-03-25T14:18:22.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.021+0000 7f3f139f4700 1 -- 172.21.15.110:0/817807159 shutdown_connections 2021-03-25T14:18:22.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.021+0000 7f3f139f4700 1 --2- 172.21.15.110:0/817807159 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f3eec05a0e0 0x7f3eec05c5a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:22.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.021+0000 7f3f139f4700 1 --2- 172.21.15.110:0/817807159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f0c0ba080 0x7f3f0c15c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:22.023 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.021+0000 7f3f139f4700 1 --2- 172.21.15.110:0/817807159 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ef4003ca0 0x7f3f0c1447d0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:22.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.021+0000 7f3f139f4700 1 --2- 172.21.15.110:0/817807159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f0c149cc0 0x7f3f0c15c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:22.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.021+0000 7f3f139f4700 1 -- 172.21.15.110:0/817807159 >> 172.21.15.110:0/817807159 conn(0x7f3f0c0686a0 msgr2=0x7f3f0c0bd360 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:22.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.021+0000 7f3f139f4700 1 -- 172.21.15.110:0/817807159 shutdown_connections 2021-03-25T14:18:22.024 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.021+0000 7f3f139f4700 1 -- 172.21.15.110:0/817807159 wait complete. 2021-03-25T14:18:22.024 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 38 2021-03-25T14:18:22.034 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:18:22.145 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.143+0000 7f7947565700 1 Processor -- start 2021-03-25T14:18:22.178 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.143+0000 7f7947565700 1 -- start start 2021-03-25T14:18:22.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.144+0000 7f7947565700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f79400b1340 0x7f79400b1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:22.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.144+0000 7f7947565700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7940066420 0x7f7940149cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:22.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.144+0000 7f7947565700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7940067510 con 0x7f794014a1e0 2021-03-25T14:18:22.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.144+0000 7f7947565700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79400677b0 con 0x7f79400b1340 2021-03-25T14:18:22.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.144+0000 7f7947565700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7940067a50 con 0x7f7940066420 2021-03-25T14:18:22.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.144+0000 7f7945301700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f79400b1340 0x7f79400b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:22.183 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.144+0000 7f7945301700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f79400b1340 0x7f79400b1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51670/0 (socket says 172.21.15.110:51670) 2021-03-25T14:18:22.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.144+0000 7f7945301700 1 -- 172.21.15.110:0/1878930673 learned_addr learned my addr 172.21.15.110:0/1878930673 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:22.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.145+0000 7f7944b00700 1 --2- 172.21.15.110:0/1878930673 >> v2:172.21.15.174:3300/0 conn(0x7f7940066420 0x7f7940149cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:22.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.145+0000 7f7945301700 1 -- 172.21.15.110:0/1878930673 >> v2:172.21.15.174:3300/0 conn(0x7f7940066420 msgr2=0x7f7940149cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:22.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.145+0000 7f7945301700 1 --2- 172.21.15.110:0/1878930673 >> v2:172.21.15.174:3300/0 conn(0x7f7940066420 0x7f7940149cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:22.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.145+0000 7f7945301700 1 -- 172.21.15.110:0/1878930673 >> v1:172.21.15.174:6789/0 conn(0x7f794014a1e0 legacy=0x7f794014cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:22.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.145+0000 7f7945301700 1 -- 172.21.15.110:0/1878930673 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7940067cf0 con 0x7f79400b1340 2021-03-25T14:18:22.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.145+0000 7f7944b00700 1 --2- 172.21.15.110:0/1878930673 >> v2:172.21.15.174:3300/0 conn(0x7f7940066420 0x7f7940149cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:18:22.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.145+0000 7f7945301700 1 --2- 172.21.15.110:0/1878930673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79400b1340 0x7f79400b1720 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7f79400b2f80 tx=0x7f793c006ee0).ready entity=mon.0 client_cookie=f562416ab5e477c5 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:22.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.145+0000 7f792ffff700 1 -- 172.21.15.110:0/1878930673 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c009890 con 0x7f79400b1340 2021-03-25T14:18:22.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.145+0000 7f792ffff700 1 -- 172.21.15.110:0/1878930673 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793c0099f0 con 0x7f79400b1340 2021-03-25T14:18:22.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.145+0000 7f792ffff700 1 -- 172.21.15.110:0/1878930673 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c009d70 con 0x7f79400b1340 2021-03-25T14:18:22.184 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.145+0000 7f7947565700 1 -- 172.21.15.110:0/1878930673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79400b1340 msgr2=0x7f79400b1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:22.185 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.145+0000 7f7947565700 1 --2- 172.21.15.110:0/1878930673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79400b1340 0x7f79400b1720 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7f79400b2f80 tx=0x7f793c006ee0).stop 2021-03-25T14:18:22.185 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.145+0000 7f7947565700 1 -- 172.21.15.110:0/1878930673 shutdown_connections 2021-03-25T14:18:22.185 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.145+0000 7f7947565700 1 --2- 172.21.15.110:0/1878930673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79400b1340 0x7f79400b1720 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:22.185 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.145+0000 7f7947565700 1 --2- 172.21.15.110:0/1878930673 >> v2:172.21.15.174:3300/0 conn(0x7f7940066420 0x7f7940149cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:22.185 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.145+0000 7f7947565700 1 -- 172.21.15.110:0/1878930673 >> 172.21.15.110:0/1878930673 conn(0x7f79400649a0 msgr2=0x7f794005c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:22.185 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.145+0000 7f7947565700 1 -- 172.21.15.110:0/1878930673 shutdown_connections 2021-03-25T14:18:22.185 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.145+0000 7f7947565700 1 -- 172.21.15.110:0/1878930673 wait complete. 2021-03-25T14:18:22.185 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.146+0000 7f7947565700 1 Processor -- start 2021-03-25T14:18:22.185 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.146+0000 7f7947565700 1 -- start start 2021-03-25T14:18:22.185 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.147+0000 7f7947565700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7940066420 0x7f794015cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:22.185 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.147+0000 7f7947565700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79400b1340 0x7f7940148a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:22.185 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.147+0000 7f7947565700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f794014a1e0 0x7f7940158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:22.185 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.147+0000 7f7947565700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79400bbbc0 con 0x7f794014a1e0 2021-03-25T14:18:22.186 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.147+0000 7f7947565700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79400bb920 con 0x7f7940066420 2021-03-25T14:18:22.186 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.147+0000 7f7947565700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f794015c5d0 con 0x7f79400b1340 2021-03-25T14:18:22.186 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.147+0000 7f7945b02700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f794014a1e0 0x7f7940158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:22.186 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.147+0000 7f7945b02700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f794014a1e0 0x7f7940158e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51680/0 (socket says 172.21.15.110:51680) 2021-03-25T14:18:22.186 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.147+0000 7f7945b02700 1 -- 172.21.15.110:0/44374941 learned_addr learned my addr 172.21.15.110:0/44374941 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:22.186 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.147+0000 7f7944b00700 1 --2- 172.21.15.110:0/44374941 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79400b1340 0x7f7940148a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:22.186 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.147+0000 7f7945301700 1 --2- 172.21.15.110:0/44374941 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7940066420 0x7f794015cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:22.186 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.148+0000 7f7945b02700 1 -- 172.21.15.110:0/44374941 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79400b1340 msgr2=0x7f7940148a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:22.186 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.148+0000 7f7945b02700 1 --2- 172.21.15.110:0/44374941 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79400b1340 0x7f7940148a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:22.186 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.148+0000 7f7945b02700 1 -- 172.21.15.110:0/44374941 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7940066420 msgr2=0x7f794015cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:22.186 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.148+0000 7f7945b02700 1 --2- 172.21.15.110:0/44374941 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7940066420 0x7f794015cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:22.186 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.148+0000 7f7945b02700 1 -- 172.21.15.110:0/44374941 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794015c870 con 0x7f794014a1e0 2021-03-25T14:18:22.187 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.148+0000 7f7945b02700 1 --2- 172.21.15.110:0/44374941 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f794014a1e0 0x7f7940158e90 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f793800bae0 tx=0x7f79380090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:22.187 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.148+0000 7f792d7fa700 1 -- 172.21.15.110:0/44374941 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793800c740 con 0x7f794014a1e0 2021-03-25T14:18:22.187 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.148+0000 7f792d7fa700 1 -- 172.21.15.110:0/44374941 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793800c8c0 con 0x7f794014a1e0 2021-03-25T14:18:22.187 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.148+0000 7f7947565700 1 -- 172.21.15.110:0/44374941 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f794015cb10 con 0x7f794014a1e0 2021-03-25T14:18:22.187 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.148+0000 7f792d7fa700 1 -- 172.21.15.110:0/44374941 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793800ca70 con 0x7f794014a1e0 2021-03-25T14:18:22.187 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.148+0000 7f7947565700 1 -- 172.21.15.110:0/44374941 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79400bb4f0 con 0x7f794014a1e0 2021-03-25T14:18:22.187 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.149+0000 7f7947565700 1 -- 172.21.15.110:0/44374941 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7940068b90 con 0x7f794014a1e0 2021-03-25T14:18:22.187 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.149+0000 7f792d7fa700 1 -- 172.21.15.110:0/44374941 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f793801c070 con 0x7f794014a1e0 2021-03-25T14:18:22.187 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.150+0000 7f792d7fa700 1 --2- 172.21.15.110:0/44374941 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f792005a0b0 0x7f792005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:22.187 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.150+0000 7f792d7fa700 1 -- 172.21.15.110:0/44374941 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6426+0+0 (secure 0 0 0) 0x7f7938073520 con 0x7f794014a1e0 2021-03-25T14:18:22.187 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.150+0000 7f7945301700 1 --2- 172.21.15.110:0/44374941 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f792005a0b0 0x7f792005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:22.187 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.150+0000 7f7945301700 1 --2- 172.21.15.110:0/44374941 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f792005a0b0 0x7f792005c570 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f793c006f20 tx=0x7f793c016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:22.188 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.153+0000 7f792d7fa700 1 -- 172.21.15.110:0/44374941 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f7938046c50 con 0x7f794014a1e0 2021-03-25T14:18:22.304 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.302+0000 7f7947565700 1 -- 172.21.15.110:0/44374941 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f794005d7b0 con 0x7f794014a1e0 2021-03-25T14:18:22.305 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.303+0000 7f792d7fa700 1 -- 172.21.15.110:0/44374941 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+17112 (secure 0 0 0) 0x7f793801a070 con 0x7f794014a1e0 2021-03-25T14:18:22.305 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:18:22.306 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":74,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:18:21.693701+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2021-03-25T14:18:19.759815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2021-03-25T14:18:20.168625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:18:22.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.305+0000 7f7947565700 1 -- 172.21.15.110:0/44374941 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f792005a0b0 msgr2=0x7f792005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:22.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.305+0000 7f7947565700 1 --2- 172.21.15.110:0/44374941 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f792005a0b0 0x7f792005c570 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f793c006f20 tx=0x7f793c016000).stop 2021-03-25T14:18:22.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.305+0000 7f7947565700 1 -- 172.21.15.110:0/44374941 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f794014a1e0 msgr2=0x7f7940158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:22.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.305+0000 7f7947565700 1 --2- 172.21.15.110:0/44374941 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f794014a1e0 0x7f7940158e90 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f793800bae0 tx=0x7f79380090f0).stop 2021-03-25T14:18:22.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.305+0000 7f7947565700 1 -- 172.21.15.110:0/44374941 shutdown_connections 2021-03-25T14:18:22.307 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.305+0000 7f7947565700 1 --2- 172.21.15.110:0/44374941 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f792005a0b0 0x7f792005c570 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:22.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.305+0000 7f7947565700 1 --2- 172.21.15.110:0/44374941 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7940066420 0x7f794015cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:22.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.305+0000 7f7947565700 1 --2- 172.21.15.110:0/44374941 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f794014a1e0 0x7f7940158e90 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:22.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.305+0000 7f7947565700 1 --2- 172.21.15.110:0/44374941 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79400b1340 0x7f7940148a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:22.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.305+0000 7f7947565700 1 -- 172.21.15.110:0/44374941 >> 172.21.15.110:0/44374941 conn(0x7f79400649a0 msgr2=0x7f79400680e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:22.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.305+0000 7f7947565700 1 -- 172.21.15.110:0/44374941 shutdown_connections 2021-03-25T14:18:22.308 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.305+0000 7f7947565700 1 -- 172.21.15.110:0/44374941 wait complete. 2021-03-25T14:18:22.319 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw pool=cephfs_data' mds allow 2021-03-25T14:18:22.436 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.433+0000 7f9f2a5c8700 1 Processor -- start 2021-03-25T14:18:22.436 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.433+0000 7f9f2a5c8700 1 -- start start 2021-03-25T14:18:22.441 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.434+0000 7f9f2a5c8700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9f240be3a0 0x7f9f240b4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:22.441 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.434+0000 7f9f2a5c8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9f24149340 0x7f9f240b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:22.441 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.434+0000 7f9f2a5c8700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f240b4c20 con 0x7f9f240b47a0 2021-03-25T14:18:22.441 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.434+0000 7f9f2a5c8700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f24149960 con 0x7f9f240be3a0 2021-03-25T14:18:22.441 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.434+0000 7f9f2a5c8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f24149c00 con 0x7f9f24149340 2021-03-25T14:18:22.442 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.434+0000 7f9f23fff700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9f240be3a0 0x7f9f240b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:22.442 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.434+0000 7f9f237fe700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f9f240b47a0 0x7f9f24148c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44620/0 (socket says 172.21.15.110:44620) 2021-03-25T14:18:22.442 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.434+0000 7f9f237fe700 1 -- 172.21.15.110:0/1832455912 learned_addr learned my addr 172.21.15.110:0/1832455912 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:18:22.442 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.435+0000 7f9f28b65700 1 --2- 172.21.15.110:0/1832455912 >> v2:172.21.15.174:3300/0 conn(0x7f9f24149340 0x7f9f240b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:22.442 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.435+0000 7f9f23fff700 1 -- 172.21.15.110:0/1832455912 >> v2:172.21.15.174:3300/0 conn(0x7f9f24149340 msgr2=0x7f9f240b8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:22.442 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.435+0000 7f9f23fff700 1 --2- 172.21.15.110:0/1832455912 >> v2:172.21.15.174:3300/0 conn(0x7f9f24149340 0x7f9f240b8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:22.442 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.435+0000 7f9f23fff700 1 -- 172.21.15.110:0/1832455912 >> v1:172.21.15.110:6789/0 conn(0x7f9f240b47a0 legacy=0x7f9f24148c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:22.442 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.435+0000 7f9f22ffd700 1 -- 172.21.15.110:0/1832455912 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1319049972 0 0) 0x7f9f240b4c20 con 0x7f9f240b47a0 2021-03-25T14:18:22.442 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.435+0000 7f9f23fff700 1 -- 172.21.15.110:0/1832455912 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f24149ea0 con 0x7f9f240be3a0 2021-03-25T14:18:22.442 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.435+0000 7f9f23fff700 1 --2- 172.21.15.110:0/1832455912 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f240be3a0 0x7f9f240b4100 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f9f240686a0 tx=0x7f9f14006e20).ready entity=mon.0 client_cookie=8f0333277a1c5e28 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:22.442 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.435+0000 7f9f22ffd700 1 -- 172.21.15.110:0/1832455912 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f140097e0 con 0x7f9f240be3a0 2021-03-25T14:18:22.443 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.435+0000 7f9f22ffd700 1 -- 172.21.15.110:0/1832455912 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f14009940 con 0x7f9f240be3a0 2021-03-25T14:18:22.443 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.435+0000 7f9f22ffd700 1 -- 172.21.15.110:0/1832455912 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f14009cc0 con 0x7f9f240be3a0 2021-03-25T14:18:22.443 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.435+0000 7f9f2a5c8700 1 -- 172.21.15.110:0/1832455912 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f240be3a0 msgr2=0x7f9f240b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:22.443 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.435+0000 7f9f2a5c8700 1 --2- 172.21.15.110:0/1832455912 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f240be3a0 0x7f9f240b4100 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f9f240686a0 tx=0x7f9f14006e20).stop 2021-03-25T14:18:22.443 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.435+0000 7f9f2a5c8700 1 -- 172.21.15.110:0/1832455912 shutdown_connections 2021-03-25T14:18:22.443 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.435+0000 7f9f2a5c8700 1 --2- 172.21.15.110:0/1832455912 >> v2:172.21.15.174:3300/0 conn(0x7f9f24149340 0x7f9f240b8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:22.443 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.435+0000 7f9f2a5c8700 1 --2- 172.21.15.110:0/1832455912 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f240be3a0 0x7f9f240b4100 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:22.443 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.435+0000 7f9f2a5c8700 1 -- 172.21.15.110:0/1832455912 >> 172.21.15.110:0/1832455912 conn(0x7f9f240686f0 msgr2=0x7f9f24068b00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:22.443 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.435+0000 7f9f2a5c8700 1 -- 172.21.15.110:0/1832455912 shutdown_connections 2021-03-25T14:18:22.443 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.435+0000 7f9f2a5c8700 1 -- 172.21.15.110:0/1832455912 wait complete. 2021-03-25T14:18:22.443 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.436+0000 7f9f2a5c8700 1 Processor -- start 2021-03-25T14:18:22.443 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.437+0000 7f9f2a5c8700 1 -- start start 2021-03-25T14:18:22.444 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.437+0000 7f9f2a5c8700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f240b47a0 0x7f9f241588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:22.444 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.437+0000 7f9f2a5c8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f240be3a0 0x7f9f2415c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:22.444 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.437+0000 7f9f2a5c8700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f24149340 0x7f9f2414f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:22.444 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.437+0000 7f9f2a5c8700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f240a20f0 con 0x7f9f240b47a0 2021-03-25T14:18:22.444 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.437+0000 7f9f2a5c8700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f240a1bb0 con 0x7f9f24149340 2021-03-25T14:18:22.444 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.437+0000 7f9f2a5c8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f240a1e50 con 0x7f9f240be3a0 2021-03-25T14:18:22.444 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.437+0000 7f9f23fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f240b47a0 0x7f9f241588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:22.444 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.437+0000 7f9f23fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f240b47a0 0x7f9f241588c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51690/0 (socket says 172.21.15.110:51690) 2021-03-25T14:18:22.444 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.437+0000 7f9f23fff700 1 -- 172.21.15.110:0/1263074071 learned_addr learned my addr 172.21.15.110:0/1263074071 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:22.444 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.438+0000 7f9f23fff700 1 -- 172.21.15.110:0/1263074071 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f240be3a0 msgr2=0x7f9f2415c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:22.444 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.438+0000 7f9f23fff700 1 --2- 172.21.15.110:0/1263074071 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f240be3a0 0x7f9f2415c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:18:22.444 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.438+0000 7f9f23fff700 1 -- 172.21.15.110:0/1263074071 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f24149340 msgr2=0x7f9f2414f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:22.444 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.438+0000 7f9f23fff700 1 --2- 172.21.15.110:0/1263074071 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f24149340 0x7f9f2414f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:18:22.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.438+0000 7f9f23fff700 1 -- 172.21.15.110:0/1263074071 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2415c010 con 0x7f9f240b47a0 2021-03-25T14:18:22.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.438+0000 7f9f23fff700 1 --2- 172.21.15.110:0/1263074071 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f240b47a0 0x7f9f241588c0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f9f240683f0 tx=0x7f9f14016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:22.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.438+0000 7f9f0bfff700 1 -- 172.21.15.110:0/1263074071 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f14006b50 con 0x7f9f240b47a0 2021-03-25T14:18:22.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.438+0000 7f9f0bfff700 1 -- 172.21.15.110:0/1263074071 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f1401c5a0 con 0x7f9f240b47a0 2021-03-25T14:18:22.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.438+0000 7f9f2a5c8700 1 -- 172.21.15.110:0/1263074071 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f2415c2b0 con 0x7f9f240b47a0 2021-03-25T14:18:22.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.438+0000 7f9f0bfff700 1 -- 172.21.15.110:0/1263074071 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1401c960 con 0x7f9f240b47a0 2021-03-25T14:18:22.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.438+0000 7f9f2a5c8700 1 -- 172.21.15.110:0/1263074071 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f2415cc40 con 0x7f9f240b47a0 2021-03-25T14:18:22.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.439+0000 7f9f2a5c8700 1 -- 172.21.15.110:0/1263074071 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f2415c440 con 0x7f9f240b47a0 2021-03-25T14:18:22.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.439+0000 7f9f0bfff700 1 -- 172.21.15.110:0/1263074071 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f9f14024030 con 0x7f9f240b47a0 2021-03-25T14:18:22.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.439+0000 7f9f0bfff700 1 --2- 172.21.15.110:0/1263074071 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f9f0405a0b0 0x7f9f0405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:22.445 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.439+0000 7f9f0bfff700 1 -- 172.21.15.110:0/1263074071 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6426+0+0 (secure 0 0 0) 0x7f9f14075330 con 0x7f9f240b47a0 2021-03-25T14:18:22.446 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.439+0000 7f9f237fe700 1 --2- 172.21.15.110:0/1263074071 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f9f0405a0b0 0x7f9f0405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:22.446 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.440+0000 7f9f237fe700 1 --2- 172.21.15.110:0/1263074071 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f9f0405a0b0 0x7f9f0405c570 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f9f180011e0 tx=0x7f9f180076d0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:22.446 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.443+0000 7f9f0bfff700 1 -- 172.21.15.110:0/1263074071 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f9f14048b70 con 0x7f9f240b47a0 2021-03-25T14:18:22.649 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.647+0000 7f9f2a5c8700 1 -- 172.21.15.110:0/1263074071 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]} v 0) v1 -- 0x7f9f2405d7b0 con 0x7f9f240b47a0 2021-03-25T14:18:22.652 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.650+0000 7f9f0bfff700 1 -- 172.21.15.110:0/1263074071 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 184+0+0 (secure 0 0 0) 0x7f9f14022020 con 0x7f9f240b47a0 2021-03-25T14:18:22.654 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.652+0000 7f9f2a5c8700 1 -- 172.21.15.110:0/1263074071 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f9f0405a0b0 msgr2=0x7f9f0405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:22.654 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.652+0000 7f9f2a5c8700 1 --2- 172.21.15.110:0/1263074071 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f9f0405a0b0 0x7f9f0405c570 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f9f180011e0 tx=0x7f9f180076d0).stop 2021-03-25T14:18:22.655 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.652+0000 7f9f2a5c8700 1 -- 172.21.15.110:0/1263074071 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f240b47a0 msgr2=0x7f9f241588c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:22.655 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.652+0000 7f9f2a5c8700 1 --2- 172.21.15.110:0/1263074071 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f240b47a0 0x7f9f241588c0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f9f240683f0 tx=0x7f9f14016000).stop 2021-03-25T14:18:22.655 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.652+0000 7f9f2a5c8700 1 -- 172.21.15.110:0/1263074071 shutdown_connections 2021-03-25T14:18:22.655 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.652+0000 7f9f2a5c8700 1 --2- 172.21.15.110:0/1263074071 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f9f0405a0b0 0x7f9f0405c570 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:22.655 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.652+0000 7f9f2a5c8700 1 --2- 172.21.15.110:0/1263074071 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f24149340 0x7f9f2414f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:18:22.655 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.652+0000 7f9f2a5c8700 1 --2- 172.21.15.110:0/1263074071 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f240b47a0 0x7f9f241588c0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:22.655 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.652+0000 7f9f2a5c8700 1 --2- 172.21.15.110:0/1263074071 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f240be3a0 0x7f9f2415c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-03-25T14:18:22.655 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.652+0000 7f9f2a5c8700 1 -- 172.21.15.110:0/1263074071 >> 172.21.15.110:0/1263074071 conn(0x7f9f240686f0 msgr2=0x7f9f240b9600 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:22.655 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.652+0000 7f9f2a5c8700 1 -- 172.21.15.110:0/1263074071 shutdown_connections 2021-03-25T14:18:22.655 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.652+0000 7f9f2a5c8700 1 -- 172.21.15.110:0/1263074071 wait complete. 2021-03-25T14:18:22.655 INFO:teuthology.orchestra.run.smithi110.stderr:updated caps for client.0 2021-03-25T14:18:22.665 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-03-25T14:18:22.775 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.773+0000 7f604333f700 1 Processor -- start 2021-03-25T14:18:22.775 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.774+0000 7f604333f700 1 -- start start 2021-03-25T14:18:22.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.774+0000 7f604333f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f603c13fff0 0x7f603c1403d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:22.783 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.774+0000 7f604333f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f603c0b01b0 0x7f603c14a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:22.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.774+0000 7f604333f700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f603c14a720 con 0x7f603c0bbab0 2021-03-25T14:18:22.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.774+0000 7f604333f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f603c146420 con 0x7f603c0b01b0 2021-03-25T14:18:22.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.774+0000 7f604333f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603c1466c0 con 0x7f603c13fff0 2021-03-25T14:18:22.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.774+0000 7f60418dc700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f603c0bbab0 0x7f603c0b83f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44638/0 (socket says 172.21.15.110:44638) 2021-03-25T14:18:22.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.774+0000 7f60418dc700 1 -- 172.21.15.110:0/3282652705 learned_addr learned my addr 172.21.15.110:0/3282652705 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:18:22.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.775+0000 7f60408da700 1 --2- 172.21.15.110:0/3282652705 >> v2:172.21.15.174:3300/0 conn(0x7f603c0b01b0 0x7f603c14a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:22.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.775+0000 7f60410db700 1 --2- 172.21.15.110:0/3282652705 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f603c13fff0 0x7f603c1403d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:22.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.775+0000 7f602bfff700 1 -- 172.21.15.110:0/3282652705 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1783249264 0 0) 0x7f603c14a720 con 0x7f603c0bbab0 2021-03-25T14:18:22.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.775+0000 7f602bfff700 1 -- 172.21.15.110:0/3282652705 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6024003270 con 0x7f603c0bbab0 2021-03-25T14:18:22.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.775+0000 7f602bfff700 1 -- 172.21.15.110:0/3282652705 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3992647219 0 0) 0x7f6024003270 con 0x7f603c0bbab0 2021-03-25T14:18:22.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.775+0000 7f602bfff700 1 -- 172.21.15.110:0/3282652705 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f603c13fff0 msgr2=0x7f603c1403d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:22.784 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.775+0000 7f602bfff700 1 --2- 172.21.15.110:0/3282652705 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f603c13fff0 0x7f603c1403d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:22.785 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.775+0000 7f602bfff700 1 -- 172.21.15.110:0/3282652705 >> v2:172.21.15.174:3300/0 conn(0x7f603c0b01b0 msgr2=0x7f603c14a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:22.785 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.775+0000 7f602bfff700 1 --2- 172.21.15.110:0/3282652705 >> v2:172.21.15.174:3300/0 conn(0x7f603c0b01b0 0x7f603c14a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:22.785 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.775+0000 7f602bfff700 1 -- 172.21.15.110:0/3282652705 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603c146960 con 0x7f603c0bbab0 2021-03-25T14:18:22.785 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.775+0000 7f602bfff700 1 -- 172.21.15.110:0/3282652705 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f60340018a0 con 0x7f603c0bbab0 2021-03-25T14:18:22.785 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.775+0000 7f602bfff700 1 -- 172.21.15.110:0/3282652705 >> v1:172.21.15.110:6789/0 conn(0x7f603c0bbab0 legacy=0x7f603c0b83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:22.785 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.775+0000 7f602bfff700 1 --2- 172.21.15.110:0/3282652705 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f603c13fff0 0x7f6024003760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:22.785 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.775+0000 7f602bfff700 1 --2- 172.21.15.110:0/3282652705 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6024003c70 0x7f6024004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:22.785 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.775+0000 7f602bfff700 1 --2- 172.21.15.110:0/3282652705 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6024004a00 0x7f6024004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:22.785 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.775+0000 7f602bfff700 1 -- 172.21.15.110:0/3282652705 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603c146420 con 0x7f6024004a00 2021-03-25T14:18:22.785 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.775+0000 7f602bfff700 1 -- 172.21.15.110:0/3282652705 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603c1466c0 con 0x7f6024003c70 2021-03-25T14:18:22.785 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.775+0000 7f602bfff700 1 -- 172.21.15.110:0/3282652705 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6024004230 con 0x7f603c13fff0 2021-03-25T14:18:22.785 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.775+0000 7f60418dc700 1 --2- 172.21.15.110:0/3282652705 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6024004a00 0x7f6024004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:22.785 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.775+0000 7f60410db700 1 --2- 172.21.15.110:0/3282652705 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f603c13fff0 0x7f6024003760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:22.786 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.775+0000 7f60408da700 1 --2- 172.21.15.110:0/3282652705 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6024003c70 0x7f6024004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:22.786 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.775+0000 7f60418dc700 1 -- 172.21.15.110:0/3282652705 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f603c13fff0 msgr2=0x7f6024003760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:22.786 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.775+0000 7f60418dc700 1 --2- 172.21.15.110:0/3282652705 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f603c13fff0 0x7f6024003760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:22.786 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.775+0000 7f60418dc700 1 -- 172.21.15.110:0/3282652705 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6024003c70 msgr2=0x7f6024004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:22.786 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.775+0000 7f60418dc700 1 --2- 172.21.15.110:0/3282652705 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6024003c70 0x7f6024004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:22.786 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.775+0000 7f60418dc700 1 -- 172.21.15.110:0/3282652705 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6024003270 con 0x7f6024004a00 2021-03-25T14:18:22.786 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.776+0000 7f60418dc700 1 --2- 172.21.15.110:0/3282652705 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6024004a00 0x7f6024004e80 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7f603400c840 tx=0x7f603c0af630).ready entity=mon.0 client_cookie=738159a69445dc5a server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:22.786 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.776+0000 7f602bfff700 1 -- 172.21.15.110:0/3282652705 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6034005bb0 con 0x7f6024004a00 2021-03-25T14:18:22.786 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.776+0000 7f602bfff700 1 -- 172.21.15.110:0/3282652705 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6034005d10 con 0x7f6024004a00 2021-03-25T14:18:22.786 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.776+0000 7f602bfff700 1 -- 172.21.15.110:0/3282652705 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60340072e0 con 0x7f6024004a00 2021-03-25T14:18:22.786 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.776+0000 7f604333f700 1 -- 172.21.15.110:0/3282652705 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6024004a00 msgr2=0x7f6024004e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:22.787 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.776+0000 7f604333f700 1 --2- 172.21.15.110:0/3282652705 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6024004a00 0x7f6024004e80 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7f603400c840 tx=0x7f603c0af630).stop 2021-03-25T14:18:22.787 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.776+0000 7f60418dc700 1 -- 172.21.15.110:0/3282652705 reap_dead start 2021-03-25T14:18:22.787 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.776+0000 7f604333f700 1 -- 172.21.15.110:0/3282652705 shutdown_connections 2021-03-25T14:18:22.787 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.776+0000 7f604333f700 1 -- 172.21.15.110:0/3282652705 >> 172.21.15.110:0/3282652705 conn(0x7f603c063850 msgr2=0x7f603c05c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:22.787 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.776+0000 7f604333f700 1 -- 172.21.15.110:0/3282652705 shutdown_connections 2021-03-25T14:18:22.787 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.776+0000 7f604333f700 1 -- 172.21.15.110:0/3282652705 wait complete. 2021-03-25T14:18:22.787 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.777+0000 7f604333f700 1 Processor -- start 2021-03-25T14:18:22.787 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.777+0000 7f604333f700 1 -- start start 2021-03-25T14:18:22.787 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.778+0000 7f604333f700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f603c0ad0f0 0x7f603c13e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:22.787 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.778+0000 7f604333f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f603c155660 0x7f603c13e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:22.787 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.778+0000 7f604333f700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f603c1427d0 0x7f603c158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:22.788 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.778+0000 7f604333f700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603c156640 con 0x7f603c1427d0 2021-03-25T14:18:22.788 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.778+0000 7f604333f700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603c155bc0 con 0x7f603c0ad0f0 2021-03-25T14:18:22.788 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.778+0000 7f604333f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603c155e60 con 0x7f603c155660 2021-03-25T14:18:22.788 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.778+0000 7f60418dc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f603c1427d0 0x7f603c158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:22.788 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.778+0000 7f60418dc700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f603c1427d0 0x7f603c158f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51714/0 (socket says 172.21.15.110:51714) 2021-03-25T14:18:22.788 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.778+0000 7f60418dc700 1 -- 172.21.15.110:0/3182232598 learned_addr learned my addr 172.21.15.110:0/3182232598 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:22.788 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.779+0000 7f60408da700 1 --2- 172.21.15.110:0/3182232598 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f603c155660 0x7f603c13e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:22.788 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.779+0000 7f60410db700 1 --2- 172.21.15.110:0/3182232598 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f603c0ad0f0 0x7f603c13e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:22.788 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.779+0000 7f60418dc700 1 -- 172.21.15.110:0/3182232598 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f603c155660 msgr2=0x7f603c13e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:22.788 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.779+0000 7f60418dc700 1 --2- 172.21.15.110:0/3182232598 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f603c155660 0x7f603c13e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:22.788 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.779+0000 7f60418dc700 1 -- 172.21.15.110:0/3182232598 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f603c0ad0f0 msgr2=0x7f603c13e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:22.788 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.779+0000 7f60418dc700 1 --2- 172.21.15.110:0/3182232598 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f603c0ad0f0 0x7f603c13e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:22.789 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.779+0000 7f60418dc700 1 -- 172.21.15.110:0/3182232598 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603c156100 con 0x7f603c1427d0 2021-03-25T14:18:22.789 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.779+0000 7f60418dc700 1 --2- 172.21.15.110:0/3182232598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f603c1427d0 0x7f603c158f60 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f6034001d70 tx=0x7f6034013000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:22.789 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.779+0000 7f60297fa700 1 -- 172.21.15.110:0/3182232598 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603401a070 con 0x7f603c1427d0 2021-03-25T14:18:22.789 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.779+0000 7f60297fa700 1 -- 172.21.15.110:0/3182232598 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60340010c0 con 0x7f603c1427d0 2021-03-25T14:18:22.789 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.779+0000 7f604333f700 1 -- 172.21.15.110:0/3182232598 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f603c1563a0 con 0x7f603c1427d0 2021-03-25T14:18:22.789 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.779+0000 7f60297fa700 1 -- 172.21.15.110:0/3182232598 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60340072e0 con 0x7f603c1427d0 2021-03-25T14:18:22.789 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.779+0000 7f604333f700 1 -- 172.21.15.110:0/3182232598 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f603c141710 con 0x7f603c1427d0 2021-03-25T14:18:22.789 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.780+0000 7f604333f700 1 -- 172.21.15.110:0/3182232598 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f603c05d7b0 con 0x7f603c1427d0 2021-03-25T14:18:22.790 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.780+0000 7f60297fa700 1 -- 172.21.15.110:0/3182232598 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f6034010070 con 0x7f603c1427d0 2021-03-25T14:18:22.790 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.780+0000 7f60297fa700 1 --2- 172.21.15.110:0/3182232598 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f601c05a0b0 0x7f601c05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:22.790 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.780+0000 7f60297fa700 1 -- 172.21.15.110:0/3182232598 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6426+0+0 (secure 0 0 0) 0x7f6034074340 con 0x7f603c1427d0 2021-03-25T14:18:22.790 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.780+0000 7f60410db700 1 --2- 172.21.15.110:0/3182232598 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f601c05a0b0 0x7f601c05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:22.790 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.781+0000 7f60410db700 1 --2- 172.21.15.110:0/3182232598 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f601c05a0b0 0x7f601c05c570 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f602c006890 tx=0x7f602c008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:22.790 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.784+0000 7f60297fa700 1 -- 172.21.15.110:0/3182232598 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f6034047c00 con 0x7f603c1427d0 2021-03-25T14:18:22.972 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.970+0000 7f604333f700 1 -- 172.21.15.110:0/3182232598 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f603c061c50 con 0x7f603c1427d0 2021-03-25T14:18:22.972 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.970+0000 7f60297fa700 1 -- 172.21.15.110:0/3182232598 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+2849 (secure 0 0 0) 0x7f6034001ea0 con 0x7f603c1427d0 2021-03-25T14:18:22.972 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:18:22.973 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":38,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5626,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6834/2882862190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2882862190},{"type":"v1","addr":"172.21.15.174:6834","nonce":2882862190}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":37},{"gid":5629,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2673718386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6833","nonce":2673718386},{"type":"v1","addr":"172.21.15.174:6835","nonce":2673718386}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":37},{"gid":6141,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.110:6836/791689444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":791689444},{"type":"v1","addr":"172.21.15.110:6836","nonce":791689444}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":37}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-03-25T14:18:20.692249+0000","modified":"2021-03-25T14:18:21.694085+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6144},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6144":{"gid":6144,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6837/1764466790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1764466790},{"type":"v1","addr":"172.21.15.110:6837","nonce":1764466790}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-03-25T14:18:22.974 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.971+0000 7f604333f700 1 -- 172.21.15.110:0/3182232598 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f601c05a0b0 msgr2=0x7f601c05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:22.974 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.971+0000 7f604333f700 1 --2- 172.21.15.110:0/3182232598 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f601c05a0b0 0x7f601c05c570 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f602c006890 tx=0x7f602c008040).stop 2021-03-25T14:18:22.974 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.971+0000 7f604333f700 1 -- 172.21.15.110:0/3182232598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f603c1427d0 msgr2=0x7f603c158f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:22.974 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.971+0000 7f604333f700 1 --2- 172.21.15.110:0/3182232598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f603c1427d0 0x7f603c158f60 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f6034001d70 tx=0x7f6034013000).stop 2021-03-25T14:18:22.974 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.972+0000 7f604333f700 1 -- 172.21.15.110:0/3182232598 shutdown_connections 2021-03-25T14:18:22.974 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.972+0000 7f604333f700 1 --2- 172.21.15.110:0/3182232598 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f601c05a0b0 0x7f601c05c570 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:22.974 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.972+0000 7f604333f700 1 --2- 172.21.15.110:0/3182232598 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f603c0ad0f0 0x7f603c13e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:22.974 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.972+0000 7f604333f700 1 --2- 172.21.15.110:0/3182232598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f603c1427d0 0x7f603c158f60 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:22.974 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.972+0000 7f604333f700 1 --2- 172.21.15.110:0/3182232598 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f603c155660 0x7f603c13e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:22.974 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.972+0000 7f604333f700 1 -- 172.21.15.110:0/3182232598 >> 172.21.15.110:0/3182232598 conn(0x7f603c063850 msgr2=0x7f603c0ae150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:22.975 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.972+0000 7f604333f700 1 -- 172.21.15.110:0/3182232598 shutdown_connections 2021-03-25T14:18:22.975 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:22.972+0000 7f604333f700 1 -- 172.21.15.110:0/3182232598 wait complete. 2021-03-25T14:18:22.975 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 38 2021-03-25T14:18:23.387 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 38, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-03-25T14:18:20.692249+0000', 'modified': '2021-03-25T14:18:21.694085+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6144}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6144': {'gid': 6144, 'name': 'c', 'rank': 0, 'incarnation': 37, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.110:6837/1764466790', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6835', 'nonce': 1764466790}, {'type': 'v1', 'addr': '172.21.15.110:6837', 'nonce': 1764466790}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138303579357183, 'flags': 0}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-03-25T14:18:23.388 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-03-25T14:18:23.388 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-03-25T14:18:23.518 INFO:teuthology.orchestra.run.smithi110.stdout:{"cluster_fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","whoami":0,"id":6144,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":2.814463843,"mdsmap_epoch":38,"osdmap_epoch":74,"osdmap_epoch_barrier":74,"uptime":7.1761567480000004} 2021-03-25T14:18:23.519 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5524cbad-8383-4081-a708-5d9e9f7cc15c", "fs_name": "cephfs", "id": 6144, "mdsmap_epoch": 38, "osdmap_epoch": 74, "osdmap_epoch_barrier": 74, "rank_uptime": 2.814463843, "state": "up:active", "uptime": 7.176156748, "want_state": "up:active", "whoami": 0 } 2021-03-25T14:18:23.519 DEBUG:teuthology.orchestra.run.smithi110:> ceph fs ls 2021-03-25T14:18:23.617 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.615+0000 7f13fb9bd700 1 Processor -- start 2021-03-25T14:18:23.618 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.616+0000 7f13fb9bd700 1 -- start start 2021-03-25T14:18:23.620 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.616+0000 7f13fb9bd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f13f41468e0 0x7f13f4068ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:23.620 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.616+0000 7f13fb9bd700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f13f40bc4c0 0x7f13f413f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:23.620 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.616+0000 7f13fb9bd700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13f40b00c0 con 0x7f13f40b8820 2021-03-25T14:18:23.620 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.616+0000 7f13fb9bd700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13f40690f0 con 0x7f13f40bc4c0 2021-03-25T14:18:23.620 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.616+0000 7f13fb9bd700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13f4145f00 con 0x7f13f41468e0 2021-03-25T14:18:23.620 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.616+0000 7f13f9f5a700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f13f40bc4c0 0x7f13f413f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:23.620 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.616+0000 7f13f9f5a700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f13f40bc4c0 0x7f13f413f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51722/0 (socket says 172.21.15.110:51722) 2021-03-25T14:18:23.621 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.616+0000 7f13f9f5a700 1 -- 172.21.15.110:0/2266285316 learned_addr learned my addr 172.21.15.110:0/2266285316 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:23.621 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.616+0000 7f13f9759700 1 --1- 172.21.15.110:0/2266285316 >> v1:172.21.15.110:6789/0 conn(0x7f13f40b8820 0x7f13f40ad220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44656/0 (socket says 172.21.15.110:44656) 2021-03-25T14:18:23.621 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.617+0000 7f13f9f5a700 1 -- 172.21.15.110:0/2266285316 >> v2:172.21.15.174:3300/0 conn(0x7f13f41468e0 msgr2=0x7f13f4068ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:23.621 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.617+0000 7f13f9f5a700 1 --2- 172.21.15.110:0/2266285316 >> v2:172.21.15.174:3300/0 conn(0x7f13f41468e0 0x7f13f4068ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-03-25T14:18:23.621 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.617+0000 7f13f9f5a700 1 -- 172.21.15.110:0/2266285316 >> v1:172.21.15.110:6789/0 conn(0x7f13f40b8820 legacy=0x7f13f40ad220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:23.621 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.617+0000 7f13e3fff700 1 -- 172.21.15.110:0/2266285316 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2270848911 0 0) 0x7f13f40b00c0 con 0x7f13f40b8820 2021-03-25T14:18:23.621 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.617+0000 7f13f9f5a700 1 -- 172.21.15.110:0/2266285316 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f41461a0 con 0x7f13f40bc4c0 2021-03-25T14:18:23.621 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.617+0000 7f13f9f5a700 1 --2- 172.21.15.110:0/2266285316 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13f40bc4c0 0x7f13f413f1c0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7f13f4064e70 tx=0x7f13ec0092d0).ready entity=mon.0 client_cookie=fb962a1490f47ba0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:23.621 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.617+0000 7f13e3fff700 1 -- 172.21.15.110:0/2266285316 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ec00bc80 con 0x7f13f40bc4c0 2021-03-25T14:18:23.621 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.617+0000 7f13e3fff700 1 -- 172.21.15.110:0/2266285316 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13ec00bde0 con 0x7f13f40bc4c0 2021-03-25T14:18:23.621 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.617+0000 7f13e3fff700 1 -- 172.21.15.110:0/2266285316 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ec011610 con 0x7f13f40bc4c0 2021-03-25T14:18:23.622 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.618+0000 7f13fb9bd700 1 -- 172.21.15.110:0/2266285316 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13f40bc4c0 msgr2=0x7f13f413f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:23.622 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.618+0000 7f13fb9bd700 1 --2- 172.21.15.110:0/2266285316 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13f40bc4c0 0x7f13f413f1c0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7f13f4064e70 tx=0x7f13ec0092d0).stop 2021-03-25T14:18:23.622 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.618+0000 7f13fb9bd700 1 -- 172.21.15.110:0/2266285316 shutdown_connections 2021-03-25T14:18:23.622 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.618+0000 7f13fb9bd700 1 --2- 172.21.15.110:0/2266285316 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13f40bc4c0 0x7f13f413f1c0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:23.622 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.618+0000 7f13fb9bd700 1 --2- 172.21.15.110:0/2266285316 >> v2:172.21.15.174:3300/0 conn(0x7f13f41468e0 0x7f13f4068ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-03-25T14:18:23.622 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.618+0000 7f13fb9bd700 1 -- 172.21.15.110:0/2266285316 >> 172.21.15.110:0/2266285316 conn(0x7f13f4062580 msgr2=0x7f13f4062990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:23.622 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.618+0000 7f13fb9bd700 1 -- 172.21.15.110:0/2266285316 shutdown_connections 2021-03-25T14:18:23.622 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.618+0000 7f13fb9bd700 1 -- 172.21.15.110:0/2266285316 wait complete. 2021-03-25T14:18:23.626 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.619+0000 7f13fb9bd700 1 Processor -- start 2021-03-25T14:18:23.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.619+0000 7f13fb9bd700 1 -- start start 2021-03-25T14:18:23.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.619+0000 7f13fb9bd700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13f40b8820 0x7f13f4151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:23.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.619+0000 7f13fb9bd700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13f40bc4c0 0x7f13f414ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:23.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.619+0000 7f13fb9bd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f13f41468e0 0x7f13f4157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:23.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.620+0000 7f13fb9bd700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f4150e80 con 0x7f13f40b8820 2021-03-25T14:18:23.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.620+0000 7f13fb9bd700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f41506a0 con 0x7f13f40bc4c0 2021-03-25T14:18:23.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.620+0000 7f13fb9bd700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13f4150940 con 0x7f13f41468e0 2021-03-25T14:18:23.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.620+0000 7f13f9759700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13f40b8820 0x7f13f4151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:23.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.620+0000 7f13f9759700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13f40b8820 0x7f13f4151070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51724/0 (socket says 172.21.15.110:51724) 2021-03-25T14:18:23.627 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.620+0000 7f13f9759700 1 -- 172.21.15.110:0/247468986 learned_addr learned my addr 172.21.15.110:0/247468986 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:23.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.620+0000 7f13f8f58700 1 --2- 172.21.15.110:0/247468986 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13f40bc4c0 0x7f13f414ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:23.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.620+0000 7f13f9759700 1 -- 172.21.15.110:0/247468986 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f13f41468e0 msgr2=0x7f13f4157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:23.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.620+0000 7f13f9f5a700 1 --2- 172.21.15.110:0/247468986 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f13f41468e0 0x7f13f4157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:23.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.620+0000 7f13f9759700 1 --2- 172.21.15.110:0/247468986 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f13f41468e0 0x7f13f4157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:23.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.620+0000 7f13f9759700 1 -- 172.21.15.110:0/247468986 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13f40bc4c0 msgr2=0x7f13f414ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:23.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.620+0000 7f13f9759700 1 --2- 172.21.15.110:0/247468986 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13f40bc4c0 0x7f13f414ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:23.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.620+0000 7f13f9759700 1 -- 172.21.15.110:0/247468986 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f4150be0 con 0x7f13f40b8820 2021-03-25T14:18:23.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.620+0000 7f13f8f58700 1 --2- 172.21.15.110:0/247468986 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13f40bc4c0 0x7f13f414ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:18:23.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.620+0000 7f13f9f5a700 1 --2- 172.21.15.110:0/247468986 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f13f41468e0 0x7f13f4157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:18:23.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.620+0000 7f13f9759700 1 --2- 172.21.15.110:0/247468986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13f40b8820 0x7f13f4151070 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7f13f000c740 tx=0x7f13f0007b10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:23.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.620+0000 7f13e17fa700 1 -- 172.21.15.110:0/247468986 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f0007320 con 0x7f13f40b8820 2021-03-25T14:18:23.628 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.620+0000 7f13e17fa700 1 -- 172.21.15.110:0/247468986 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f0005560 con 0x7f13f40b8820 2021-03-25T14:18:23.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.620+0000 7f13fb9bd700 1 -- 172.21.15.110:0/247468986 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13f4156ed0 con 0x7f13f40b8820 2021-03-25T14:18:23.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.620+0000 7f13e17fa700 1 -- 172.21.15.110:0/247468986 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f00058e0 con 0x7f13f40b8820 2021-03-25T14:18:23.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.620+0000 7f13fb9bd700 1 -- 172.21.15.110:0/247468986 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13f4150320 con 0x7f13f40b8820 2021-03-25T14:18:23.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.621+0000 7f13fb9bd700 1 -- 172.21.15.110:0/247468986 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13f40afee0 con 0x7f13f40b8820 2021-03-25T14:18:23.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.621+0000 7f13e17fa700 1 -- 172.21.15.110:0/247468986 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f13f0010030 con 0x7f13f40b8820 2021-03-25T14:18:23.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.622+0000 7f13e17fa700 1 --2- 172.21.15.110:0/247468986 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f13d405a0b0 0x7f13d405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:23.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.622+0000 7f13e17fa700 1 -- 172.21.15.110:0/247468986 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6426+0+0 (secure 0 0 0) 0x7f13f0073c00 con 0x7f13f40b8820 2021-03-25T14:18:23.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.622+0000 7f13f8f58700 1 --2- 172.21.15.110:0/247468986 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f13d405a0b0 0x7f13d405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:23.629 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.622+0000 7f13f8f58700 1 --2- 172.21.15.110:0/247468986 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f13d405a0b0 0x7f13d405c570 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f13f40adcb0 tx=0x7f13e4008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:23.630 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.626+0000 7f13e17fa700 1 -- 172.21.15.110:0/247468986 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f13f0079020 con 0x7f13f40b8820 2021-03-25T14:18:23.811 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.809+0000 7f13fb9bd700 1 -- 172.21.15.110:0/247468986 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f13f4146380 con 0x7f13f40b8820 2021-03-25T14:18:23.812 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.810+0000 7f13e17fa700 1 -- 172.21.15.110:0/247468986 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v38) v1 ==== 53+0+73 (secure 0 0 0) 0x7f13f0047440 con 0x7f13f40b8820 2021-03-25T14:18:23.812 INFO:teuthology.orchestra.run.smithi110.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2021-03-25T14:18:23.813 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.811+0000 7f13fb9bd700 1 -- 172.21.15.110:0/247468986 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f13d405a0b0 msgr2=0x7f13d405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:23.814 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.811+0000 7f13fb9bd700 1 --2- 172.21.15.110:0/247468986 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f13d405a0b0 0x7f13d405c570 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f13f40adcb0 tx=0x7f13e4008040).stop 2021-03-25T14:18:23.814 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.811+0000 7f13fb9bd700 1 -- 172.21.15.110:0/247468986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13f40b8820 msgr2=0x7f13f4151070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:23.814 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.811+0000 7f13fb9bd700 1 --2- 172.21.15.110:0/247468986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13f40b8820 0x7f13f4151070 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7f13f000c740 tx=0x7f13f0007b10).stop 2021-03-25T14:18:23.814 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.811+0000 7f13fb9bd700 1 -- 172.21.15.110:0/247468986 shutdown_connections 2021-03-25T14:18:23.814 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.811+0000 7f13fb9bd700 1 --2- 172.21.15.110:0/247468986 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f13d405a0b0 0x7f13d405c570 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:23.814 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.811+0000 7f13fb9bd700 1 --2- 172.21.15.110:0/247468986 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f13f41468e0 0x7f13f4157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:23.814 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.811+0000 7f13fb9bd700 1 --2- 172.21.15.110:0/247468986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13f40b8820 0x7f13f4151070 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:23.814 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.811+0000 7f13fb9bd700 1 --2- 172.21.15.110:0/247468986 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13f40bc4c0 0x7f13f414ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:23.814 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.811+0000 7f13fb9bd700 1 -- 172.21.15.110:0/247468986 >> 172.21.15.110:0/247468986 conn(0x7f13f4062580 msgr2=0x7f13f40bbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:23.814 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.811+0000 7f13fb9bd700 1 -- 172.21.15.110:0/247468986 shutdown_connections 2021-03-25T14:18:23.814 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:23.811+0000 7f13fb9bd700 1 -- 172.21.15.110:0/247468986 wait complete. 2021-03-25T14:18:23.823 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2021-03-25T14:18:23.824 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2021-03-25T14:18:23.824 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi110.front.sepia.ceph.com 2021-03-25T14:18:23.824 INFO:tasks.cephfs.mount:self.client.name = client.0 2021-03-25T14:18:23.824 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2021-03-25T14:18:23.824 INFO:tasks.cephfs.mount:self.cephfs_name = None 2021-03-25T14:18:23.824 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2021-03-25T14:18:23.824 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2021-03-25T14:18:23.824 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2021-03-25T14:18:23.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:18:23.824 DEBUG:teuthology.orchestra.run.smithi110:> ip addr 2021-03-25T14:18:23.839 INFO:teuthology.orchestra.run.smithi110.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2021-03-25T14:18:23.839 INFO:teuthology.orchestra.run.smithi110.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2021-03-25T14:18:23.839 INFO:teuthology.orchestra.run.smithi110.stdout: inet 127.0.0.1/8 scope host lo 2021-03-25T14:18:23.839 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:18:23.839 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 ::1/128 scope host 2021-03-25T14:18:23.839 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:18:23.839 INFO:teuthology.orchestra.run.smithi110.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-03-25T14:18:23.839 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:14 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:18:23.839 INFO:teuthology.orchestra.run.smithi110.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-03-25T14:18:23.840 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:15 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:18:23.840 INFO:teuthology.orchestra.run.smithi110.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-03-25T14:18:23.840 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:34 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:18:23.840 INFO:teuthology.orchestra.run.smithi110.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2021-03-25T14:18:23.840 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:35 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:18:23.840 INFO:teuthology.orchestra.run.smithi110.stdout: inet 172.21.15.110/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2021-03-25T14:18:23.840 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft 42498sec preferred_lft 42498sec 2021-03-25T14:18:23.840 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::ec4:7aff:fe8f:cc35/64 scope link 2021-03-25T14:18:23.840 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:18:23.840 INFO:teuthology.orchestra.run.smithi110.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2021-03-25T14:18:23.840 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 1a:d9:4b:2f:6c:02 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:18:23.840 INFO:teuthology.orchestra.run.smithi110.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2021-03-25T14:18:23.841 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:18:23.841 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::1835:66ff:feca:f994/64 scope link 2021-03-25T14:18:23.841 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:18:23.841 INFO:teuthology.orchestra.run.smithi110.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2021-03-25T14:18:23.841 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 1a:d9:4b:2f:6c:02 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2021-03-25T14:18:23.841 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::18d9:4bff:fe2f:6c02/64 scope link 2021-03-25T14:18:23.841 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:18:23.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:18:23.842 DEBUG:teuthology.orchestra.run.smithi110:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2021-03-25T14:18:23.902 INFO:teuthology.orchestra.run.smithi110.stdout:1 2021-03-25T14:18:23.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:18:23.909 DEBUG:teuthology.orchestra.run.smithi110:> route 2021-03-25T14:18:23.967 INFO:teuthology.orchestra.run.smithi110.stdout:Kernel IP routing table 2021-03-25T14:18:23.967 INFO:teuthology.orchestra.run.smithi110.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2021-03-25T14:18:23.967 INFO:teuthology.orchestra.run.smithi110.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2021-03-25T14:18:23.967 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2021-03-25T14:18:23.967 INFO:teuthology.orchestra.run.smithi110.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2021-03-25T14:18:23.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:18:23.967 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec sudo bash -c ' 2021-03-25T14:18:23.968 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2021-03-25T14:18:23.968 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2021-03-25T14:18:23.968 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2021-03-25T14:18:23.968 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2021-03-25T14:18:23.968 DEBUG:teuthology.orchestra.run.smithi110:> ') 2021-03-25T14:18:24.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:18:24.063 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2021-03-25T14:18:24.077 INFO:teuthology.orchestra.run.smithi110.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2021-03-25T14:18:24.078 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2021-03-25T14:18:24.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:18:24.078 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set brx.0 up 2021-03-25T14:18:24.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:18:24.141 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p /home/ubuntu/cephtest/mnt.0 2021-03-25T14:18:24.195 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-03-25T14:18:24.196 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2021-03-25T14:18:24.273 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2021-03-25T14:18:24.273 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2021-03-25T14:18:24.314 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2021-03-25T14:18:24.314 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2021-03-25T14:18:24.316 INFO:tasks.cephfs.kernel_mount:mount command passed 2021-03-25T14:18:24.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:18:24.317 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2021-03-25T14:18:24.381 DEBUG:teuthology.orchestra.run.smithi174:> ceph fs ls 2021-03-25T14:18:24.492 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.490+0000 7f22eee43700 1 Processor -- start 2021-03-25T14:18:24.492 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.490+0000 7f22eee43700 1 -- start start 2021-03-25T14:18:24.494 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.491+0000 7f22eee43700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f22e8068da0 0x7f22e81498b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:24.494 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.491+0000 7f22eee43700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22e80611e0 con 0x7f22e81433c0 2021-03-25T14:18:24.494 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.491+0000 7f22eee43700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22e8149da0 con 0x7f22e80bcda0 2021-03-25T14:18:24.494 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.491+0000 7f22eee43700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22e8061410 con 0x7f22e8068da0 2021-03-25T14:18:24.494 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.491+0000 7f22e7fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f22e8068da0 0x7f22e81498b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:24.494 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.491+0000 7f22ecbdf700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f22e80bcda0 0x7f22e80643b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:49504/0 (socket says 172.21.15.174:49504) 2021-03-25T14:18:24.494 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.491+0000 7f22ecbdf700 1 -- 172.21.15.174:0/440410829 learned_addr learned my addr 172.21.15.174:0/440410829 (peer_addr_for_me v1:172.21.15.174:0/0) 2021-03-25T14:18:24.494 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.491+0000 7f22e7fff700 1 -- 172.21.15.174:0/440410829 >> v1:172.21.15.174:6789/0 conn(0x7f22e80bcda0 legacy=0x7f22e80643b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:24.495 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.491+0000 7f22e7fff700 1 -- 172.21.15.174:0/440410829 >> v1:172.21.15.110:6789/0 conn(0x7f22e81433c0 legacy=0x7f22e81437f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:24.495 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.491+0000 7f22e77fe700 1 -- 172.21.15.174:0/440410829 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 648296681 0 0) 0x7f22e8149da0 con 0x7f22e80bcda0 2021-03-25T14:18:24.495 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.491+0000 7f22e7fff700 1 -- 172.21.15.174:0/440410829 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e80616b0 con 0x7f22e8068da0 2021-03-25T14:18:24.495 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.491+0000 7f22e7fff700 1 --2- 172.21.15.174:0/440410829 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22e8068da0 0x7f22e81498b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f22d400b9c0 tx=0x7f22d4006e20).ready entity=mon.1 client_cookie=20f9f05a6e3e2d23 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:24.495 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.492+0000 7f22e77fe700 1 -- 172.21.15.174:0/440410829 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d40097e0 con 0x7f22e8068da0 2021-03-25T14:18:24.495 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.492+0000 7f22e77fe700 1 -- 172.21.15.174:0/440410829 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d4009940 con 0x7f22e8068da0 2021-03-25T14:18:24.495 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.492+0000 7f22e77fe700 1 -- 172.21.15.174:0/440410829 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d4009cc0 con 0x7f22e8068da0 2021-03-25T14:18:24.495 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.492+0000 7f22eee43700 1 -- 172.21.15.174:0/440410829 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22e8068da0 msgr2=0x7f22e81498b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:24.495 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.492+0000 7f22eee43700 1 --2- 172.21.15.174:0/440410829 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22e8068da0 0x7f22e81498b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f22d400b9c0 tx=0x7f22d4006e20).stop 2021-03-25T14:18:24.495 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.492+0000 7f22eee43700 1 -- 172.21.15.174:0/440410829 shutdown_connections 2021-03-25T14:18:24.495 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.492+0000 7f22eee43700 1 --2- 172.21.15.174:0/440410829 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22e8068da0 0x7f22e81498b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:24.495 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.492+0000 7f22eee43700 1 -- 172.21.15.174:0/440410829 >> 172.21.15.174:0/440410829 conn(0x7f22e80675f0 msgr2=0x7f22e8067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:24.495 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.492+0000 7f22eee43700 1 -- 172.21.15.174:0/440410829 shutdown_connections 2021-03-25T14:18:24.496 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.492+0000 7f22eee43700 1 -- 172.21.15.174:0/440410829 wait complete. 2021-03-25T14:18:24.498 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.494+0000 7f22eee43700 1 Processor -- start 2021-03-25T14:18:24.499 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.494+0000 7f22eee43700 1 -- start start 2021-03-25T14:18:24.499 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.495+0000 7f22eee43700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22e8068da0 0x7f22e80ba220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:24.499 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.495+0000 7f22eee43700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22e80bcda0 0x7f22e814be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:24.499 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.495+0000 7f22eee43700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22e81433c0 0x7f22e8141900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:24.499 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.495+0000 7f22eee43700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e814cd30 con 0x7f22e81433c0 2021-03-25T14:18:24.499 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.495+0000 7f22eee43700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e80b9770 con 0x7f22e8068da0 2021-03-25T14:18:24.499 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.495+0000 7f22eee43700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e80b8f10 con 0x7f22e80bcda0 2021-03-25T14:18:24.499 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.495+0000 7f22ecbdf700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22e8068da0 0x7f22e80ba220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:24.499 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.495+0000 7f22e7fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22e80bcda0 0x7f22e814be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:24.499 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.495+0000 7f22ecbdf700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22e8068da0 0x7f22e80ba220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:47262/0 (socket says 172.21.15.174:47262) 2021-03-25T14:18:24.499 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.495+0000 7f22ecbdf700 1 -- 172.21.15.174:0/1789962077 learned_addr learned my addr 172.21.15.174:0/1789962077 (peer_addr_for_me v2:172.21.15.174:0/0) 2021-03-25T14:18:24.499 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.495+0000 7f22ed3e0700 1 --2- 172.21.15.174:0/1789962077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22e81433c0 0x7f22e8141900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:24.499 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.495+0000 7f22e7fff700 1 -- 172.21.15.174:0/1789962077 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22e8068da0 msgr2=0x7f22e80ba220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:24.500 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.495+0000 7f22e7fff700 1 --2- 172.21.15.174:0/1789962077 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22e8068da0 0x7f22e80ba220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:24.500 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.495+0000 7f22e7fff700 1 -- 172.21.15.174:0/1789962077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22e81433c0 msgr2=0x7f22e8141900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:24.500 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.495+0000 7f22e7fff700 1 --2- 172.21.15.174:0/1789962077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22e81433c0 0x7f22e8141900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:24.500 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.495+0000 7f22e7fff700 1 -- 172.21.15.174:0/1789962077 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e80b89d0 con 0x7f22e80bcda0 2021-03-25T14:18:24.500 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.495+0000 7f22ecbdf700 1 --2- 172.21.15.174:0/1789962077 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22e8068da0 0x7f22e80ba220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:18:24.500 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.495+0000 7f22e7fff700 1 --2- 172.21.15.174:0/1789962077 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22e80bcda0 0x7f22e814be90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f22d4013000 tx=0x7f22d4016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:24.500 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.495+0000 7f22e4ff9700 1 -- 172.21.15.174:0/1789962077 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d4021070 con 0x7f22e80bcda0 2021-03-25T14:18:24.500 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.495+0000 7f22e4ff9700 1 -- 172.21.15.174:0/1789962077 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d4011de0 con 0x7f22e80bcda0 2021-03-25T14:18:24.500 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.495+0000 7f22eee43700 1 -- 172.21.15.174:0/1789962077 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22e80b8c70 con 0x7f22e80bcda0 2021-03-25T14:18:24.500 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.495+0000 7f22e4ff9700 1 -- 172.21.15.174:0/1789962077 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d401d640 con 0x7f22e80bcda0 2021-03-25T14:18:24.500 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.496+0000 7f22eee43700 1 -- 172.21.15.174:0/1789962077 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22e80b94d0 con 0x7f22e80bcda0 2021-03-25T14:18:24.500 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.496+0000 7f22eee43700 1 -- 172.21.15.174:0/1789962077 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22e80b2050 con 0x7f22e80bcda0 2021-03-25T14:18:24.500 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.497+0000 7f22e4ff9700 1 -- 172.21.15.174:0/1789962077 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f22d400f070 con 0x7f22e80bcda0 2021-03-25T14:18:24.501 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.497+0000 7f22e4ff9700 1 --2- 172.21.15.174:0/1789962077 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f22c805a0e0 0x7f22c805c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:24.501 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.497+0000 7f22e4ff9700 1 -- 172.21.15.174:0/1789962077 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6426+0+0 (secure 0 0 0) 0x7f22d40752e0 con 0x7f22e80bcda0 2021-03-25T14:18:24.501 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.497+0000 7f22ecbdf700 1 --2- 172.21.15.174:0/1789962077 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f22c805a0e0 0x7f22c805c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:24.501 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.498+0000 7f22ecbdf700 1 --2- 172.21.15.174:0/1789962077 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f22c805a0e0 0x7f22c805c5a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f22dc007fd0 tx=0x7f22dc009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:24.502 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.501+0000 7f22e4ff9700 1 -- 172.21.15.174:0/1789962077 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f22d4048b20 con 0x7f22e80bcda0 2021-03-25T14:18:24.687 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.685+0000 7f22eee43700 1 -- 172.21.15.174:0/1789962077 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f22e806aaa0 con 0x7f22e80bcda0 2021-03-25T14:18:24.687 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.685+0000 7f22e4ff9700 1 -- 172.21.15.174:0/1789962077 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v38) v1 ==== 53+0+73 (secure 0 0 0) 0x7f22d404c140 con 0x7f22e80bcda0 2021-03-25T14:18:24.687 INFO:teuthology.orchestra.run.smithi174.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2021-03-25T14:18:24.689 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.687+0000 7f22eee43700 1 -- 172.21.15.174:0/1789962077 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f22c805a0e0 msgr2=0x7f22c805c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:24.689 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.687+0000 7f22eee43700 1 --2- 172.21.15.174:0/1789962077 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f22c805a0e0 0x7f22c805c5a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f22dc007fd0 tx=0x7f22dc009040).stop 2021-03-25T14:18:24.689 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.687+0000 7f22eee43700 1 -- 172.21.15.174:0/1789962077 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22e80bcda0 msgr2=0x7f22e814be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:24.689 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.687+0000 7f22eee43700 1 --2- 172.21.15.174:0/1789962077 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22e80bcda0 0x7f22e814be90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f22d4013000 tx=0x7f22d4016000).stop 2021-03-25T14:18:24.689 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.687+0000 7f22eee43700 1 -- 172.21.15.174:0/1789962077 shutdown_connections 2021-03-25T14:18:24.689 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.687+0000 7f22eee43700 1 --2- 172.21.15.174:0/1789962077 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f22c805a0e0 0x7f22c805c5a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:24.689 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.687+0000 7f22eee43700 1 --2- 172.21.15.174:0/1789962077 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22e8068da0 0x7f22e80ba220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:24.689 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.687+0000 7f22eee43700 1 --2- 172.21.15.174:0/1789962077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22e81433c0 0x7f22e8141900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:24.689 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.687+0000 7f22eee43700 1 --2- 172.21.15.174:0/1789962077 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22e80bcda0 0x7f22e814be90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:24.689 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.687+0000 7f22eee43700 1 -- 172.21.15.174:0/1789962077 >> 172.21.15.174:0/1789962077 conn(0x7f22e80675f0 msgr2=0x7f22e80bc060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:24.689 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.687+0000 7f22eee43700 1 -- 172.21.15.174:0/1789962077 shutdown_connections 2021-03-25T14:18:24.690 INFO:teuthology.orchestra.run.smithi174.stderr:2021-03-25T14:18:24.687+0000 7f22eee43700 1 -- 172.21.15.174:0/1789962077 wait complete. 2021-03-25T14:18:24.699 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2021-03-25T14:18:24.699 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2021-03-25T14:18:24.699 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi174.front.sepia.ceph.com 2021-03-25T14:18:24.699 INFO:tasks.cephfs.mount:self.client.name = client.1 2021-03-25T14:18:24.699 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2021-03-25T14:18:24.699 INFO:tasks.cephfs.mount:self.cephfs_name = None 2021-03-25T14:18:24.699 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2021-03-25T14:18:24.699 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2021-03-25T14:18:24.699 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2021-03-25T14:18:24.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:18:24.700 DEBUG:teuthology.orchestra.run.smithi174:> ip addr 2021-03-25T14:18:24.715 INFO:teuthology.orchestra.run.smithi174.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2021-03-25T14:18:24.715 INFO:teuthology.orchestra.run.smithi174.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2021-03-25T14:18:24.715 INFO:teuthology.orchestra.run.smithi174.stdout: inet 127.0.0.1/8 scope host lo 2021-03-25T14:18:24.715 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:18:24.715 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 ::1/128 scope host 2021-03-25T14:18:24.715 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:18:24.715 INFO:teuthology.orchestra.run.smithi174.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-03-25T14:18:24.715 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:d9:36:e0 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:18:24.715 INFO:teuthology.orchestra.run.smithi174.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-03-25T14:18:24.715 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:d9:36:e1 brd ff:ff:ff:ff:ff:ff 2021-03-25T14:18:24.716 INFO:teuthology.orchestra.run.smithi174.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-03-25T14:18:24.716 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:88:77:1a brd ff:ff:ff:ff:ff:ff 2021-03-25T14:18:24.716 INFO:teuthology.orchestra.run.smithi174.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2021-03-25T14:18:24.716 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:88:77:1b brd ff:ff:ff:ff:ff:ff 2021-03-25T14:18:24.716 INFO:teuthology.orchestra.run.smithi174.stdout: inet 172.21.15.174/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2021-03-25T14:18:24.716 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft 42497sec preferred_lft 42497sec 2021-03-25T14:18:24.716 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::ec4:7aff:fe88:771b/64 scope link 2021-03-25T14:18:24.716 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:18:24.716 INFO:teuthology.orchestra.run.smithi174.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2021-03-25T14:18:24.717 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 32:28:39:9e:9c:fe brd ff:ff:ff:ff:ff:ff 2021-03-25T14:18:24.717 INFO:teuthology.orchestra.run.smithi174.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2021-03-25T14:18:24.717 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:18:24.717 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::2843:d3ff:fe04:eed1/64 scope link 2021-03-25T14:18:24.717 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:18:24.717 INFO:teuthology.orchestra.run.smithi174.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2021-03-25T14:18:24.717 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 32:28:39:9e:9c:fe brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2021-03-25T14:18:24.717 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::3028:39ff:fe9e:9cfe/64 scope link 2021-03-25T14:18:24.717 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2021-03-25T14:18:24.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:18:24.718 DEBUG:teuthology.orchestra.run.smithi174:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2021-03-25T14:18:24.778 INFO:teuthology.orchestra.run.smithi174.stdout:1 2021-03-25T14:18:24.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:18:24.780 DEBUG:teuthology.orchestra.run.smithi174:> route 2021-03-25T14:18:24.836 INFO:teuthology.orchestra.run.smithi174.stdout:Kernel IP routing table 2021-03-25T14:18:24.836 INFO:teuthology.orchestra.run.smithi174.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2021-03-25T14:18:24.836 INFO:teuthology.orchestra.run.smithi174.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2021-03-25T14:18:24.836 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2021-03-25T14:18:24.836 INFO:teuthology.orchestra.run.smithi174.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2021-03-25T14:18:24.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:18:24.837 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec sudo bash -c ' 2021-03-25T14:18:24.837 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2021-03-25T14:18:24.837 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2021-03-25T14:18:24.837 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2021-03-25T14:18:24.837 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2021-03-25T14:18:24.837 DEBUG:teuthology.orchestra.run.smithi174:> ') 2021-03-25T14:18:24.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:18:24.933 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list 2021-03-25T14:18:24.947 INFO:teuthology.orchestra.run.smithi174.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2021-03-25T14:18:24.947 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2021-03-25T14:18:24.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:18:24.947 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set brx.0 up 2021-03-25T14:18:25.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:18:25.011 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p /home/ubuntu/cephtest/mnt.1 2021-03-25T14:18:25.065 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-03-25T14:18:25.065 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,norbytes 2021-03-25T14:18:25.143 INFO:teuthology.orchestra.run.smithi174.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,norbytes 2021-03-25T14:18:25.143 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,name=1,norbytes" will pass to kernel. 2021-03-25T14:18:25.172 INFO:teuthology.orchestra.run.smithi174.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,norbytes 2021-03-25T14:18:25.172 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,name=1,norbytes" will pass to kernel. 2021-03-25T14:18:25.175 INFO:tasks.cephfs.kernel_mount:mount command passed 2021-03-25T14:18:25.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-03-25T14:18:25.175 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2021-03-25T14:18:25.240 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2021-03-25T14:18:25.364 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.362+0000 7f564f927700 1 Processor -- start 2021-03-25T14:18:25.364 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.362+0000 7f564f927700 1 -- start start 2021-03-25T14:18:25.371 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.363+0000 7f564f927700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f56480b7570 0x7f56480b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:25.372 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.363+0000 7f564f927700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56480b8e20 con 0x7f56480b97c0 2021-03-25T14:18:25.372 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.363+0000 7f564f927700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56480b9050 con 0x7f56480b8750 2021-03-25T14:18:25.372 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.363+0000 7f564f927700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56480b92f0 con 0x7f56480b7570 2021-03-25T14:18:25.372 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.363+0000 7f564d6c3700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f56480b97c0 0x7f564809c8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44672/0 (socket says 172.21.15.110:44672) 2021-03-25T14:18:25.372 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.363+0000 7f564d6c3700 1 -- 172.21.15.110:0/2707095734 learned_addr learned my addr 172.21.15.110:0/2707095734 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:18:25.372 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.363+0000 7f564cec2700 1 --2- 172.21.15.110:0/2707095734 >> v2:172.21.15.174:3300/0 conn(0x7f56480b7570 0x7f56480b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:25.372 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.363+0000 7f5637fff700 1 -- 172.21.15.110:0/2707095734 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1958825165 0 0) 0x7f56480b8e20 con 0x7f56480b97c0 2021-03-25T14:18:25.372 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.363+0000 7f5637fff700 1 -- 172.21.15.110:0/2707095734 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5630003270 con 0x7f56480b97c0 2021-03-25T14:18:25.372 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.363+0000 7f5637fff700 1 -- 172.21.15.110:0/2707095734 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3587757952 0 0) 0x7f56480b9050 con 0x7f56480b8750 2021-03-25T14:18:25.373 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.363+0000 7f5637fff700 1 -- 172.21.15.110:0/2707095734 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56480b8e20 con 0x7f56480b8750 2021-03-25T14:18:25.373 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.363+0000 7f5637fff700 1 -- 172.21.15.110:0/2707095734 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1587628852 0 0) 0x7f5630003270 con 0x7f56480b97c0 2021-03-25T14:18:25.373 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.363+0000 7f564cec2700 1 -- 172.21.15.110:0/2707095734 >> v1:172.21.15.174:6789/0 conn(0x7f56480b8750 legacy=0x7f5648147db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:25.373 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.363+0000 7f564cec2700 1 -- 172.21.15.110:0/2707095734 >> v1:172.21.15.110:6789/0 conn(0x7f56480b97c0 legacy=0x7f564809c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:25.373 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.363+0000 7f564cec2700 1 -- 172.21.15.110:0/2707095734 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56480b3210 con 0x7f56480b7570 2021-03-25T14:18:25.373 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.363+0000 7f564cec2700 1 --2- 172.21.15.110:0/2707095734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56480b7570 0x7f56480b36b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f563800b9c0 tx=0x7f5638006e20).ready entity=mon.1 client_cookie=705a37a9a4918efc server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:25.373 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.364+0000 7f5637fff700 1 -- 172.21.15.110:0/2707095734 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5644001520 con 0x7f56480b7570 2021-03-25T14:18:25.373 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.364+0000 7f5637fff700 1 -- 172.21.15.110:0/2707095734 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5638011400 con 0x7f56480b7570 2021-03-25T14:18:25.373 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.364+0000 7f5637fff700 1 -- 172.21.15.110:0/2707095734 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5638011780 con 0x7f56480b7570 2021-03-25T14:18:25.373 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.364+0000 7f564f927700 1 -- 172.21.15.110:0/2707095734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56480b7570 msgr2=0x7f56480b36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:25.373 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.364+0000 7f564f927700 1 --2- 172.21.15.110:0/2707095734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56480b7570 0x7f56480b36b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f563800b9c0 tx=0x7f5638006e20).stop 2021-03-25T14:18:25.374 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.364+0000 7f564f927700 1 -- 172.21.15.110:0/2707095734 shutdown_connections 2021-03-25T14:18:25.374 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.364+0000 7f564f927700 1 --2- 172.21.15.110:0/2707095734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56480b7570 0x7f56480b36b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:25.374 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.364+0000 7f564f927700 1 -- 172.21.15.110:0/2707095734 >> 172.21.15.110:0/2707095734 conn(0x7f5648061d50 msgr2=0x7f5648062160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:25.374 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.364+0000 7f564f927700 1 -- 172.21.15.110:0/2707095734 shutdown_connections 2021-03-25T14:18:25.374 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.364+0000 7f564f927700 1 -- 172.21.15.110:0/2707095734 wait complete. 2021-03-25T14:18:25.374 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.365+0000 7f564f927700 1 Processor -- start 2021-03-25T14:18:25.374 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.365+0000 7f564f927700 1 -- start start 2021-03-25T14:18:25.374 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.366+0000 7f564f927700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56480b7570 0x7f56480b9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:25.374 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.366+0000 7f564f927700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56480b8750 0x7f5648159480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:25.374 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.366+0000 7f564f927700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56480b97c0 0x7f5648159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:25.374 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.366+0000 7f564f927700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564809dd10 con 0x7f56480b7570 2021-03-25T14:18:25.375 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.366+0000 7f564f927700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5648158d50 con 0x7f56480b97c0 2021-03-25T14:18:25.375 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.366+0000 7f564f927700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f564814c8e0 con 0x7f56480b8750 2021-03-25T14:18:25.375 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.366+0000 7f564d6c3700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56480b7570 0x7f56480b9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:25.375 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.366+0000 7f564d6c3700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56480b7570 0x7f56480b9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51742/0 (socket says 172.21.15.110:51742) 2021-03-25T14:18:25.375 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.366+0000 7f564d6c3700 1 -- 172.21.15.110:0/1553479916 learned_addr learned my addr 172.21.15.110:0/1553479916 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:25.375 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.366+0000 7f564dec4700 1 --2- 172.21.15.110:0/1553479916 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56480b97c0 0x7f5648159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:25.375 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.367+0000 7f564cec2700 1 --2- 172.21.15.110:0/1553479916 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56480b8750 0x7f5648159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:25.375 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.367+0000 7f564d6c3700 1 -- 172.21.15.110:0/1553479916 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56480b8750 msgr2=0x7f5648159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:25.375 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.367+0000 7f564d6c3700 1 --2- 172.21.15.110:0/1553479916 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56480b8750 0x7f5648159480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:25.375 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.367+0000 7f564d6c3700 1 -- 172.21.15.110:0/1553479916 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56480b97c0 msgr2=0x7f5648159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:25.375 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.367+0000 7f564d6c3700 1 --2- 172.21.15.110:0/1553479916 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56480b97c0 0x7f5648159970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:25.375 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.367+0000 7f564d6c3700 1 -- 172.21.15.110:0/1553479916 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f564814cb80 con 0x7f56480b7570 2021-03-25T14:18:25.376 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.367+0000 7f564cec2700 1 --2- 172.21.15.110:0/1553479916 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56480b8750 0x7f5648159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:18:25.376 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.367+0000 7f564d6c3700 1 --2- 172.21.15.110:0/1553479916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56480b7570 0x7f56480b9d60 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7f564400cae0 tx=0x7f5644001a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:25.376 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.367+0000 7f56357fa700 1 -- 172.21.15.110:0/1553479916 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5644007170 con 0x7f56480b7570 2021-03-25T14:18:25.376 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.367+0000 7f56357fa700 1 -- 172.21.15.110:0/1553479916 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56440072d0 con 0x7f56480b7570 2021-03-25T14:18:25.376 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.367+0000 7f564f927700 1 -- 172.21.15.110:0/1553479916 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f564814ce20 con 0x7f56480b7570 2021-03-25T14:18:25.376 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.367+0000 7f56357fa700 1 -- 172.21.15.110:0/1553479916 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564400a970 con 0x7f56480b7570 2021-03-25T14:18:25.376 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.367+0000 7f564f927700 1 -- 172.21.15.110:0/1553479916 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f564809e0d0 con 0x7f56480b7570 2021-03-25T14:18:25.376 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.368+0000 7f564f927700 1 -- 172.21.15.110:0/1553479916 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f564814d280 con 0x7f56480b7570 2021-03-25T14:18:25.376 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.368+0000 7f56357fa700 1 -- 172.21.15.110:0/1553479916 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f564401b060 con 0x7f56480b7570 2021-03-25T14:18:25.376 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.368+0000 7f56357fa700 1 --2- 172.21.15.110:0/1553479916 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f562805a0b0 0x7f562805c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:25.376 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.368+0000 7f56357fa700 1 -- 172.21.15.110:0/1553479916 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6426+0+0 (secure 0 0 0) 0x7f5644073ae0 con 0x7f56480b7570 2021-03-25T14:18:25.376 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.369+0000 7f564cec2700 1 --2- 172.21.15.110:0/1553479916 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f562805a0b0 0x7f562805c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:25.377 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.369+0000 7f564cec2700 1 --2- 172.21.15.110:0/1553479916 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f562805a0b0 0x7f562805c570 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f56480627e0 tx=0x7f5638016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:25.377 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.372+0000 7f56357fa700 1 -- 172.21.15.110:0/1553479916 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f56440472c0 con 0x7f56480b7570 2021-03-25T14:18:25.582 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.580+0000 7f564f927700 1 -- 172.21.15.110:0/1553479916 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7f564805d7b0 con 0x7f56480b7570 2021-03-25T14:18:25.583 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.580+0000 7f56357fa700 1 -- 172.21.15.110:0/1553479916 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 entity client.testuser does not exist v17) v1 ==== 121+0+0 (secure 0 0 0) 0x7f5644019070 con 0x7f56480b7570 2021-03-25T14:18:25.585 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.582+0000 7f564f927700 1 -- 172.21.15.110:0/1553479916 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f562805a0b0 msgr2=0x7f562805c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:25.585 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.582+0000 7f564f927700 1 --2- 172.21.15.110:0/1553479916 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f562805a0b0 0x7f562805c570 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f56480627e0 tx=0x7f5638016000).stop 2021-03-25T14:18:25.586 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.582+0000 7f564f927700 1 -- 172.21.15.110:0/1553479916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56480b7570 msgr2=0x7f56480b9d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:25.586 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.582+0000 7f564f927700 1 --2- 172.21.15.110:0/1553479916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56480b7570 0x7f56480b9d60 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7f564400cae0 tx=0x7f5644001a60).stop 2021-03-25T14:18:25.586 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.582+0000 7f564f927700 1 -- 172.21.15.110:0/1553479916 shutdown_connections 2021-03-25T14:18:25.586 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.582+0000 7f564f927700 1 --2- 172.21.15.110:0/1553479916 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f562805a0b0 0x7f562805c570 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:25.587 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.582+0000 7f564f927700 1 --2- 172.21.15.110:0/1553479916 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56480b97c0 0x7f5648159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:25.587 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.582+0000 7f564f927700 1 --2- 172.21.15.110:0/1553479916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56480b7570 0x7f56480b9d60 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:25.587 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.582+0000 7f564f927700 1 --2- 172.21.15.110:0/1553479916 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56480b8750 0x7f5648159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:25.587 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.582+0000 7f564f927700 1 -- 172.21.15.110:0/1553479916 >> 172.21.15.110:0/1553479916 conn(0x7f5648061d50 msgr2=0x7f564809bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:25.587 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.582+0000 7f564f927700 1 -- 172.21.15.110:0/1553479916 shutdown_connections 2021-03-25T14:18:25.588 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.582+0000 7f564f927700 1 -- 172.21.15.110:0/1553479916 wait complete. 2021-03-25T14:18:25.588 INFO:teuthology.orchestra.run.smithi110.stderr:entity client.testuser does not exist 2021-03-25T14:18:25.595 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true 2021-03-25T14:18:25.708 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.706+0000 7fb301a35700 1 Processor -- start 2021-03-25T14:18:25.708 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.706+0000 7fb301a35700 1 -- start start 2021-03-25T14:18:25.711 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.707+0000 7fb301a35700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb2fc064800 0x7fb2fc064be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:25.711 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.707+0000 7fb301a35700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2fc14cf60 con 0x7fb2fc065d30 2021-03-25T14:18:25.711 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.707+0000 7fb301a35700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2fc14d200 con 0x7fb2fc066c30 2021-03-25T14:18:25.711 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.707+0000 7fb301a35700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2fc14d4a0 con 0x7fb2fc064800 2021-03-25T14:18:25.711 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.707+0000 7fb2fb7fe700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fb2fc065d30 0x7fb2fc149dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44688/0 (socket says 172.21.15.110:44688) 2021-03-25T14:18:25.711 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.707+0000 7fb2fb7fe700 1 -- 172.21.15.110:0/7042660 learned_addr learned my addr 172.21.15.110:0/7042660 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:18:25.711 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.707+0000 7fb2faffd700 1 --2- 172.21.15.110:0/7042660 >> v2:172.21.15.174:3300/0 conn(0x7fb2fc064800 0x7fb2fc064be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:25.711 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.708+0000 7fb2f9ffb700 1 -- 172.21.15.110:0/7042660 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1938828896 0 0) 0x7fb2fc14cf60 con 0x7fb2fc065d30 2021-03-25T14:18:25.711 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.708+0000 7fb2f9ffb700 1 -- 172.21.15.110:0/7042660 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2e8003270 con 0x7fb2fc065d30 2021-03-25T14:18:25.712 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.708+0000 7fb2faffd700 1 -- 172.21.15.110:0/7042660 >> v1:172.21.15.174:6789/0 conn(0x7fb2fc066c30 legacy=0x7fb2fc065620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:25.712 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.708+0000 7fb2faffd700 1 -- 172.21.15.110:0/7042660 >> v1:172.21.15.110:6789/0 conn(0x7fb2fc065d30 legacy=0x7fb2fc149dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:25.712 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.708+0000 7fb2faffd700 1 -- 172.21.15.110:0/7042660 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2fc14d740 con 0x7fb2fc064800 2021-03-25T14:18:25.712 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.708+0000 7fb2faffd700 1 --2- 172.21.15.110:0/7042660 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2fc064800 0x7fb2fc064be0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fb2ec00b9c0 tx=0x7fb2ec006e20).ready entity=mon.1 client_cookie=993d372d9ef0e607 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:25.712 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.708+0000 7fb2f9ffb700 1 -- 172.21.15.110:0/7042660 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec0097e0 con 0x7fb2fc064800 2021-03-25T14:18:25.712 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.708+0000 7fb2f9ffb700 1 -- 172.21.15.110:0/7042660 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2ec009940 con 0x7fb2fc064800 2021-03-25T14:18:25.712 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.708+0000 7fb2f9ffb700 1 -- 172.21.15.110:0/7042660 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec009cc0 con 0x7fb2fc064800 2021-03-25T14:18:25.712 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.708+0000 7fb301a35700 1 -- 172.21.15.110:0/7042660 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2fc064800 msgr2=0x7fb2fc064be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:25.712 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.708+0000 7fb301a35700 1 --2- 172.21.15.110:0/7042660 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2fc064800 0x7fb2fc064be0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fb2ec00b9c0 tx=0x7fb2ec006e20).stop 2021-03-25T14:18:25.713 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.708+0000 7fb301a35700 1 -- 172.21.15.110:0/7042660 shutdown_connections 2021-03-25T14:18:25.713 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.708+0000 7fb301a35700 1 --2- 172.21.15.110:0/7042660 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2fc064800 0x7fb2fc064be0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:25.713 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.708+0000 7fb301a35700 1 -- 172.21.15.110:0/7042660 >> 172.21.15.110:0/7042660 conn(0x7fb2fc060c40 msgr2=0x7fb2fc061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:25.713 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.708+0000 7fb301a35700 1 -- 172.21.15.110:0/7042660 shutdown_connections 2021-03-25T14:18:25.713 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.709+0000 7fb301a35700 1 -- 172.21.15.110:0/7042660 wait complete. 2021-03-25T14:18:25.717 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.710+0000 7fb301a35700 1 Processor -- start 2021-03-25T14:18:25.717 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.710+0000 7fb301a35700 1 -- start start 2021-03-25T14:18:25.717 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.710+0000 7fb301a35700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2fc064800 0x7fb2fc0b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:25.717 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.710+0000 7fb301a35700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2fc065d30 0x7fb2fc159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:25.717 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.710+0000 7fb301a35700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2fc066c30 0x7fb2fc0b9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:25.717 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.710+0000 7fb301a35700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc159b40 con 0x7fb2fc066c30 2021-03-25T14:18:25.717 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.710+0000 7fb301a35700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc0b7850 con 0x7fb2fc064800 2021-03-25T14:18:25.717 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.710+0000 7fb301a35700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc0b7af0 con 0x7fb2fc065d30 2021-03-25T14:18:25.718 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.710+0000 7fb2fb7fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2fc066c30 0x7fb2fc0b9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:25.718 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.710+0000 7fb2fb7fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2fc066c30 0x7fb2fc0b9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51760/0 (socket says 172.21.15.110:51760) 2021-03-25T14:18:25.718 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.710+0000 7fb2fb7fe700 1 -- 172.21.15.110:0/3865332196 learned_addr learned my addr 172.21.15.110:0/3865332196 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:25.718 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.711+0000 7fb2faffd700 1 --2- 172.21.15.110:0/3865332196 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2fc064800 0x7fb2fc0b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:25.718 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.711+0000 7fb2fa7fc700 1 --2- 172.21.15.110:0/3865332196 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2fc065d30 0x7fb2fc159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:25.718 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.711+0000 7fb2fb7fe700 1 -- 172.21.15.110:0/3865332196 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2fc065d30 msgr2=0x7fb2fc159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:25.718 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.711+0000 7fb2fb7fe700 1 --2- 172.21.15.110:0/3865332196 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2fc065d30 0x7fb2fc159650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:25.718 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.711+0000 7fb2fb7fe700 1 -- 172.21.15.110:0/3865332196 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2fc064800 msgr2=0x7fb2fc0b7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:25.718 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.711+0000 7fb2fb7fe700 1 --2- 172.21.15.110:0/3865332196 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2fc064800 0x7fb2fc0b7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:25.718 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.711+0000 7fb2fb7fe700 1 -- 172.21.15.110:0/3865332196 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2fc0b7d90 con 0x7fb2fc066c30 2021-03-25T14:18:25.718 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.711+0000 7fb2fb7fe700 1 --2- 172.21.15.110:0/3865332196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2fc066c30 0x7fb2fc0b9a60 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7fb2f4005950 tx=0x7fb2f4007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:25.718 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.711+0000 7fb2e2ffd700 1 -- 172.21.15.110:0/3865332196 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f4005bb0 con 0x7fb2fc066c30 2021-03-25T14:18:25.718 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.711+0000 7fb301a35700 1 -- 172.21.15.110:0/3865332196 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2fc14de40 con 0x7fb2fc066c30 2021-03-25T14:18:25.719 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.711+0000 7fb2e2ffd700 1 -- 172.21.15.110:0/3865332196 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f4005d10 con 0x7fb2fc066c30 2021-03-25T14:18:25.719 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.711+0000 7fb2e2ffd700 1 -- 172.21.15.110:0/3865332196 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f4007320 con 0x7fb2fc066c30 2021-03-25T14:18:25.719 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.711+0000 7fb301a35700 1 -- 172.21.15.110:0/3865332196 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2fc0b9f50 con 0x7fb2fc066c30 2021-03-25T14:18:25.719 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.712+0000 7fb301a35700 1 -- 172.21.15.110:0/3865332196 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2fc0663b0 con 0x7fb2fc066c30 2021-03-25T14:18:25.719 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.712+0000 7fb2e2ffd700 1 -- 172.21.15.110:0/3865332196 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fb2f4010030 con 0x7fb2fc066c30 2021-03-25T14:18:25.719 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.713+0000 7fb2e2ffd700 1 --2- 172.21.15.110:0/3865332196 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb2dc05a0b0 0x7fb2dc05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:25.719 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.713+0000 7fb2e2ffd700 1 -- 172.21.15.110:0/3865332196 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6426+0+0 (secure 0 0 0) 0x7fb2f4073d10 con 0x7fb2fc066c30 2021-03-25T14:18:25.719 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.713+0000 7fb2faffd700 1 --2- 172.21.15.110:0/3865332196 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb2dc05a0b0 0x7fb2dc05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:25.719 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.713+0000 7fb2faffd700 1 --2- 172.21.15.110:0/3865332196 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb2dc05a0b0 0x7fb2dc05c570 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7fb2ec006e60 tx=0x7fb2ec016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:25.720 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.716+0000 7fb2e2ffd700 1 -- 172.21.15.110:0/3865332196 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fb2f4047550 con 0x7fb2fc066c30 2021-03-25T14:18:25.912 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:25.910+0000 7fb301a35700 1 -- 172.21.15.110:0/3865332196 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true"} v 0) v1 -- 0x7fb2fc05d7b0 con 0x7fb2fc066c30 2021-03-25T14:18:26.833 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.831+0000 7fb2e2ffd700 1 -- 172.21.15.110:0/3865332196 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true"}]=0 v39) v1 ==== 106+0+0 (secure 0 0 0) 0x7fb2f404ab70 con 0x7fb2fc066c30 2021-03-25T14:18:26.836 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.834+0000 7fb301a35700 1 -- 172.21.15.110:0/3865332196 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb2dc05a0b0 msgr2=0x7fb2dc05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:26.836 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.834+0000 7fb301a35700 1 --2- 172.21.15.110:0/3865332196 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb2dc05a0b0 0x7fb2dc05c570 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7fb2ec006e60 tx=0x7fb2ec016000).stop 2021-03-25T14:18:26.836 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.834+0000 7fb301a35700 1 -- 172.21.15.110:0/3865332196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2fc066c30 msgr2=0x7fb2fc0b9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:26.836 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.834+0000 7fb301a35700 1 --2- 172.21.15.110:0/3865332196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2fc066c30 0x7fb2fc0b9a60 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7fb2f4005950 tx=0x7fb2f4007e50).stop 2021-03-25T14:18:26.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.834+0000 7fb301a35700 1 -- 172.21.15.110:0/3865332196 shutdown_connections 2021-03-25T14:18:26.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.834+0000 7fb301a35700 1 --2- 172.21.15.110:0/3865332196 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fb2dc05a0b0 0x7fb2dc05c570 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:26.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.834+0000 7fb301a35700 1 --2- 172.21.15.110:0/3865332196 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2fc064800 0x7fb2fc0b7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:26.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.834+0000 7fb301a35700 1 --2- 172.21.15.110:0/3865332196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2fc066c30 0x7fb2fc0b9a60 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:26.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.834+0000 7fb301a35700 1 --2- 172.21.15.110:0/3865332196 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2fc065d30 0x7fb2fc159650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:26.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.834+0000 7fb301a35700 1 -- 172.21.15.110:0/3865332196 >> 172.21.15.110:0/3865332196 conn(0x7fb2fc060c40 msgr2=0x7fb2fc14a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:26.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.834+0000 7fb301a35700 1 -- 172.21.15.110:0/3865332196 shutdown_connections 2021-03-25T14:18:26.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.834+0000 7fb301a35700 1 -- 172.21.15.110:0/3865332196 wait complete. 2021-03-25T14:18:26.850 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-03-25T14:18:26.969 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.964+0000 7f5db318a700 1 Processor -- start 2021-03-25T14:18:26.969 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.964+0000 7f5db318a700 1 -- start start 2021-03-25T14:18:26.969 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.965+0000 7f5db318a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5dac068ac0 0x7f5dac067840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:26.970 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.965+0000 7f5db318a700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5dac144960 0x7f5dac144dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:26.970 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.965+0000 7f5db318a700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dac0afee0 con 0x7f5dac0bbca0 2021-03-25T14:18:26.970 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.965+0000 7f5db318a700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dac145d40 con 0x7f5dac144960 2021-03-25T14:18:26.970 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.965+0000 7f5db318a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac145fe0 con 0x7f5dac068ac0 2021-03-25T14:18:26.970 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.965+0000 7f5db1727700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5dac144960 0x7f5dac144dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:26.970 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.965+0000 7f5db1727700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5dac144960 0x7f5dac144dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51768/0 (socket says 172.21.15.110:51768) 2021-03-25T14:18:26.970 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.965+0000 7f5db1727700 1 -- 172.21.15.110:0/1666868085 learned_addr learned my addr 172.21.15.110:0/1666868085 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:26.970 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.965+0000 7f5db0f26700 1 --1- 172.21.15.110:0/1666868085 >> v1:172.21.15.110:6789/0 conn(0x7f5dac0bbca0 0x7f5dac0acf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44700/0 (socket says 172.21.15.110:44700) 2021-03-25T14:18:26.970 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.966+0000 7f5dabfff700 1 --2- 172.21.15.110:0/1666868085 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5dac068ac0 0x7f5dac067840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:26.970 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.966+0000 7f5db1727700 1 -- 172.21.15.110:0/1666868085 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5dac068ac0 msgr2=0x7f5dac067840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:26.971 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.966+0000 7f5db1727700 1 --2- 172.21.15.110:0/1666868085 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5dac068ac0 0x7f5dac067840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:26.971 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.966+0000 7f5db1727700 1 -- 172.21.15.110:0/1666868085 >> v1:172.21.15.110:6789/0 conn(0x7f5dac0bbca0 legacy=0x7f5dac0acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:26.971 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.966+0000 7f5db1727700 1 -- 172.21.15.110:0/1666868085 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dac145b10 con 0x7f5dac144960 2021-03-25T14:18:26.971 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.966+0000 7f5dab7fe700 1 -- 172.21.15.110:0/1666868085 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4078456102 0 0) 0x7f5dac0afee0 con 0x7f5dac0bbca0 2021-03-25T14:18:26.971 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.966+0000 7f5db1727700 1 --2- 172.21.15.110:0/1666868085 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5dac144960 0x7f5dac144dd0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7f5da4009d90 tx=0x7f5da40092d0).ready entity=mon.0 client_cookie=3037e6cd8b4494a9 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:26.971 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.966+0000 7f5dab7fe700 1 -- 172.21.15.110:0/1666868085 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da400bc80 con 0x7f5dac144960 2021-03-25T14:18:26.971 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.966+0000 7f5dab7fe700 1 -- 172.21.15.110:0/1666868085 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da400bde0 con 0x7f5dac144960 2021-03-25T14:18:26.971 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.966+0000 7f5dab7fe700 1 -- 172.21.15.110:0/1666868085 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da4011610 con 0x7f5dac144960 2021-03-25T14:18:26.971 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.966+0000 7f5db318a700 1 -- 172.21.15.110:0/1666868085 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5dac144960 msgr2=0x7f5dac144dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:26.971 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.966+0000 7f5db318a700 1 --2- 172.21.15.110:0/1666868085 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5dac144960 0x7f5dac144dd0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7f5da4009d90 tx=0x7f5da40092d0).stop 2021-03-25T14:18:26.971 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.966+0000 7f5db318a700 1 -- 172.21.15.110:0/1666868085 shutdown_connections 2021-03-25T14:18:26.971 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.966+0000 7f5db318a700 1 --2- 172.21.15.110:0/1666868085 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5dac144960 0x7f5dac144dd0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:26.972 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.966+0000 7f5db318a700 1 --2- 172.21.15.110:0/1666868085 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5dac068ac0 0x7f5dac067840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:26.972 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.966+0000 7f5db318a700 1 -- 172.21.15.110:0/1666868085 >> 172.21.15.110:0/1666868085 conn(0x7f5dac063850 msgr2=0x7f5dac05c700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:26.972 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.966+0000 7f5db318a700 1 -- 172.21.15.110:0/1666868085 shutdown_connections 2021-03-25T14:18:26.972 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.966+0000 7f5db318a700 1 -- 172.21.15.110:0/1666868085 wait complete. 2021-03-25T14:18:26.972 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.967+0000 7f5db318a700 1 Processor -- start 2021-03-25T14:18:26.972 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.968+0000 7f5db318a700 1 -- start start 2021-03-25T14:18:26.975 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.968+0000 7f5db318a700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5dac068ac0 0x7f5dac133680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:26.975 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.968+0000 7f5db318a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5dac0bbca0 0x7f5dac148640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:26.976 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.968+0000 7f5db318a700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5dac144960 0x7f5dac148b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:26.976 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.968+0000 7f5db318a700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac149cc0 con 0x7f5dac068ac0 2021-03-25T14:18:26.976 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.968+0000 7f5db318a700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac136360 con 0x7f5dac144960 2021-03-25T14:18:26.976 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.968+0000 7f5db318a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac135950 con 0x7f5dac0bbca0 2021-03-25T14:18:26.976 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.968+0000 7f5db0f26700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5dac068ac0 0x7f5dac133680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:26.976 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.968+0000 7f5db0f26700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5dac068ac0 0x7f5dac133680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51770/0 (socket says 172.21.15.110:51770) 2021-03-25T14:18:26.976 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.968+0000 7f5db0f26700 1 -- 172.21.15.110:0/3961180746 learned_addr learned my addr 172.21.15.110:0/3961180746 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:26.976 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.969+0000 7f5dabfff700 1 --2- 172.21.15.110:0/3961180746 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5dac0bbca0 0x7f5dac148640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:26.976 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.969+0000 7f5db1727700 1 --2- 172.21.15.110:0/3961180746 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5dac144960 0x7f5dac148b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:26.976 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.969+0000 7f5db0f26700 1 -- 172.21.15.110:0/3961180746 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5dac0bbca0 msgr2=0x7f5dac148640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:26.976 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.969+0000 7f5db0f26700 1 --2- 172.21.15.110:0/3961180746 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5dac0bbca0 0x7f5dac148640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:26.976 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.969+0000 7f5db0f26700 1 -- 172.21.15.110:0/3961180746 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5dac144960 msgr2=0x7f5dac148b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:26.977 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.969+0000 7f5db0f26700 1 --2- 172.21.15.110:0/3961180746 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5dac144960 0x7f5dac148b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:26.977 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.969+0000 7f5db0f26700 1 -- 172.21.15.110:0/3961180746 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dac133b70 con 0x7f5dac068ac0 2021-03-25T14:18:26.977 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.969+0000 7f5db1727700 1 --2- 172.21.15.110:0/3961180746 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5dac144960 0x7f5dac148b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-03-25T14:18:26.977 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.969+0000 7f5db0f26700 1 --2- 172.21.15.110:0/3961180746 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5dac068ac0 0x7f5dac133680 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7f5da0001ea0 tx=0x7f5da0007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:26.977 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.969+0000 7f5da8ff9700 1 -- 172.21.15.110:0/3961180746 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da0007320 con 0x7f5dac068ac0 2021-03-25T14:18:26.977 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.969+0000 7f5da8ff9700 1 -- 172.21.15.110:0/3961180746 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da0005560 con 0x7f5dac068ac0 2021-03-25T14:18:26.977 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.969+0000 7f5db318a700 1 -- 172.21.15.110:0/3961180746 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dac138970 con 0x7f5dac068ac0 2021-03-25T14:18:26.977 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.969+0000 7f5da8ff9700 1 -- 172.21.15.110:0/3961180746 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da0005920 con 0x7f5dac068ac0 2021-03-25T14:18:26.977 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.969+0000 7f5db318a700 1 -- 172.21.15.110:0/3961180746 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dac135fb0 con 0x7f5dac068ac0 2021-03-25T14:18:26.977 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.970+0000 7f5db318a700 1 -- 172.21.15.110:0/3961180746 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dac05d7b0 con 0x7f5dac068ac0 2021-03-25T14:18:26.977 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.970+0000 7f5da8ff9700 1 -- 172.21.15.110:0/3961180746 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f5da0005c90 con 0x7f5dac068ac0 2021-03-25T14:18:26.977 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.971+0000 7f5da8ff9700 1 --2- 172.21.15.110:0/3961180746 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5d8c05a0b0 0x7f5d8c05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:26.977 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.971+0000 7f5da8ff9700 1 -- 172.21.15.110:0/3961180746 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6426+0+0 (secure 0 0 0) 0x7f5da0075d50 con 0x7f5dac068ac0 2021-03-25T14:18:26.978 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.971+0000 7f5dabfff700 1 --2- 172.21.15.110:0/3961180746 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5d8c05a0b0 0x7f5d8c05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:26.978 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.971+0000 7f5dabfff700 1 --2- 172.21.15.110:0/3961180746 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5d8c05a0b0 0x7f5d8c05c570 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f5dac0bc410 tx=0x7f5d98008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:26.978 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:26.974+0000 7f5da8ff9700 1 -- 172.21.15.110:0/3961180746 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f5da0049590 con 0x7f5dac068ac0 2021-03-25T14:18:27.128 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.126+0000 7f5db318a700 1 -- 172.21.15.110:0/3961180746 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5dac138d60 con 0x7f5dac068ac0 2021-03-25T14:18:27.128 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.127+0000 7f5da8ff9700 1 -- 172.21.15.110:0/3961180746 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+17112 (secure 0 0 0) 0x7f5da004cbb0 con 0x7f5dac068ac0 2021-03-25T14:18:27.129 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:18:27.129 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":74,"fsid":"5524cbad-8383-4081-a708-5d9e9f7cc15c","created":"2021-03-25T14:15:48.974114+0000","modified":"2021-03-25T14:18:21.693701+0000","last_up_change":"2021-03-25T14:15:59.006572+0000","last_in_change":"2021-03-25T14:15:52.116422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-25T14:15:59.047299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-25T14:16:00.537926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2021-03-25T14:18:19.759815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2021-03-25T14:18:20.168625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e307a1d3-b0e0-4ee4-b163-a060d9b0df2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":36956},{"type":"v1","addr":"172.21.15.110:6801","nonce":36956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":36956},{"type":"v1","addr":"172.21.15.110:6803","nonce":36956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":36956},{"type":"v1","addr":"172.21.15.110:6807","nonce":36956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":36956},{"type":"v1","addr":"172.21.15.110:6805","nonce":36956}]},"public_addr":"172.21.15.110:6801/36956","cluster_addr":"172.21.15.110:6803/36956","heartbeat_back_addr":"172.21.15.110:6807/36956","heartbeat_front_addr":"172.21.15.110:6805/36956","state":["exists","up"]},{"osd":1,"uuid":"4da77e5e-0b28-4b7d-abd6-21a2769adb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":36957},{"type":"v1","addr":"172.21.15.110:6809","nonce":36957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":36957},{"type":"v1","addr":"172.21.15.110:6811","nonce":36957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":36957},{"type":"v1","addr":"172.21.15.110:6815","nonce":36957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":36957},{"type":"v1","addr":"172.21.15.110:6813","nonce":36957}]},"public_addr":"172.21.15.110:6809/36957","cluster_addr":"172.21.15.110:6811/36957","heartbeat_back_addr":"172.21.15.110:6815/36957","heartbeat_front_addr":"172.21.15.110:6813/36957","state":["exists","up"]},{"osd":2,"uuid":"99589dc9-e1d0-461a-aa93-fa6b4bca4411","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":36986},{"type":"v1","addr":"172.21.15.110:6817","nonce":36986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":36986},{"type":"v1","addr":"172.21.15.110:6819","nonce":36986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":36986},{"type":"v1","addr":"172.21.15.110:6823","nonce":36986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":36986},{"type":"v1","addr":"172.21.15.110:6821","nonce":36986}]},"public_addr":"172.21.15.110:6817/36986","cluster_addr":"172.21.15.110:6819/36986","heartbeat_back_addr":"172.21.15.110:6823/36986","heartbeat_front_addr":"172.21.15.110:6821/36986","state":["exists","up"]},{"osd":3,"uuid":"0dd70ec1-946c-451f-b4db-731f2183b73a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":36988},{"type":"v1","addr":"172.21.15.110:6825","nonce":36988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":36988},{"type":"v1","addr":"172.21.15.110:6827","nonce":36988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":36988},{"type":"v1","addr":"172.21.15.110:6831","nonce":36988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":36988},{"type":"v1","addr":"172.21.15.110:6829","nonce":36988}]},"public_addr":"172.21.15.110:6825/36988","cluster_addr":"172.21.15.110:6827/36988","heartbeat_back_addr":"172.21.15.110:6831/36988","heartbeat_front_addr":"172.21.15.110:6829/36988","state":["exists","up"]},{"osd":4,"uuid":"e89c627c-3c0b-4696-b76a-267ac80f4280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6801","nonce":37282},{"type":"v1","addr":"172.21.15.174:6803","nonce":37282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6805","nonce":37282},{"type":"v1","addr":"172.21.15.174:6807","nonce":37282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":37282},{"type":"v1","addr":"172.21.15.174:6815","nonce":37282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":37282},{"type":"v1","addr":"172.21.15.174:6811","nonce":37282}]},"public_addr":"172.21.15.174:6803/37282","cluster_addr":"172.21.15.174:6807/37282","heartbeat_back_addr":"172.21.15.174:6815/37282","heartbeat_front_addr":"172.21.15.174:6811/37282","state":["exists","up"]},{"osd":5,"uuid":"c4c6a6e5-98df-4239-9dba-53ed311acd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":37283},{"type":"v1","addr":"172.21.15.174:6802","nonce":37283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":37283},{"type":"v1","addr":"172.21.15.174:6806","nonce":37283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":37283},{"type":"v1","addr":"172.21.15.174:6814","nonce":37283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":37283},{"type":"v1","addr":"172.21.15.174:6810","nonce":37283}]},"public_addr":"172.21.15.174:6802/37283","cluster_addr":"172.21.15.174:6806/37283","heartbeat_back_addr":"172.21.15.174:6814/37283","heartbeat_front_addr":"172.21.15.174:6810/37283","state":["exists","up"]},{"osd":6,"uuid":"6912beba-0704-442b-af14-b804dea8d7ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":37327},{"type":"v1","addr":"172.21.15.174:6825","nonce":37327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":37327},{"type":"v1","addr":"172.21.15.174:6827","nonce":37327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":37327},{"type":"v1","addr":"172.21.15.174:6831","nonce":37327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":37327},{"type":"v1","addr":"172.21.15.174:6829","nonce":37327}]},"public_addr":"172.21.15.174:6825/37327","cluster_addr":"172.21.15.174:6827/37327","heartbeat_back_addr":"172.21.15.174:6831/37327","heartbeat_front_addr":"172.21.15.174:6829/37327","state":["exists","up"]},{"osd":7,"uuid":"aa93635b-7039-4052-a0a5-1242f674e068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":37284},{"type":"v1","addr":"172.21.15.174:6817","nonce":37284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":37284},{"type":"v1","addr":"172.21.15.174:6819","nonce":37284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":37284},{"type":"v1","addr":"172.21.15.174:6823","nonce":37284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":37284},{"type":"v1","addr":"172.21.15.174:6821","nonce":37284}]},"public_addr":"172.21.15.174:6817/37284","cluster_addr":"172.21.15.174:6819/37284","heartbeat_back_addr":"172.21.15.174:6823/37284","heartbeat_front_addr":"172.21.15.174:6821/37284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.234226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.229937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.246100+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.214923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.170639+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.205831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.230130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-03-25T14:15:57.227173+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-25T14:18:27.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.128+0000 7f5db318a700 1 -- 172.21.15.110:0/3961180746 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5d8c05a0b0 msgr2=0x7f5d8c05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:27.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.128+0000 7f5db318a700 1 --2- 172.21.15.110:0/3961180746 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5d8c05a0b0 0x7f5d8c05c570 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f5dac0bc410 tx=0x7f5d98008040).stop 2021-03-25T14:18:27.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.128+0000 7f5db318a700 1 -- 172.21.15.110:0/3961180746 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5dac068ac0 msgr2=0x7f5dac133680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:27.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.128+0000 7f5db318a700 1 --2- 172.21.15.110:0/3961180746 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5dac068ac0 0x7f5dac133680 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7f5da0001ea0 tx=0x7f5da0007a90).stop 2021-03-25T14:18:27.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.128+0000 7f5db318a700 1 -- 172.21.15.110:0/3961180746 shutdown_connections 2021-03-25T14:18:27.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.128+0000 7f5db318a700 1 --2- 172.21.15.110:0/3961180746 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f5d8c05a0b0 0x7f5d8c05c570 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:27.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.128+0000 7f5db318a700 1 --2- 172.21.15.110:0/3961180746 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5dac144960 0x7f5dac148b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:27.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.128+0000 7f5db318a700 1 --2- 172.21.15.110:0/3961180746 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5dac068ac0 0x7f5dac133680 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:27.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.128+0000 7f5db318a700 1 --2- 172.21.15.110:0/3961180746 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5dac0bbca0 0x7f5dac148640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:27.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.129+0000 7f5db318a700 1 -- 172.21.15.110:0/3961180746 >> 172.21.15.110:0/3961180746 conn(0x7f5dac063850 msgr2=0x7f5dac0acfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:27.131 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.129+0000 7f5db318a700 1 -- 172.21.15.110:0/3961180746 shutdown_connections 2021-03-25T14:18:27.132 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.129+0000 7f5db318a700 1 -- 172.21.15.110:0/3961180746 wait complete. 2021-03-25T14:18:27.142 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-03-25T14:15:59.047299+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-03-25T14:16:00.537926+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2021-03-25T14:18:19.759815+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2021-03-25T14:18:20.168625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-03-25T14:18:27.142 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-03-25T14:18:27.255 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.253+0000 7f47d4385700 1 Processor -- start 2021-03-25T14:18:27.310 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.253+0000 7f47d4385700 1 -- start start 2021-03-25T14:18:27.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.254+0000 7f47d4385700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f47cc0b5d00 0x7f47cc145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:27.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.254+0000 7f47d4385700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f47cc0648a0 0x7f47cc09db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:27.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.254+0000 7f47d4385700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47cc149c50 con 0x7f47cc0b0cc0 2021-03-25T14:18:27.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.254+0000 7f47d4385700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47cc067960 con 0x7f47cc0648a0 2021-03-25T14:18:27.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.254+0000 7f47d4385700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47cc1461b0 con 0x7f47cc0b5d00 2021-03-25T14:18:27.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.254+0000 7f47d2922700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f47cc0648a0 0x7f47cc09db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:27.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.254+0000 7f47d2922700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f47cc0648a0 0x7f47cc09db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51780/0 (socket says 172.21.15.110:51780) 2021-03-25T14:18:27.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.254+0000 7f47d2922700 1 -- 172.21.15.110:0/781144143 learned_addr learned my addr 172.21.15.110:0/781144143 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:27.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.254+0000 7f47d1920700 1 --2- 172.21.15.110:0/781144143 >> v2:172.21.15.174:3300/0 conn(0x7f47cc0b5d00 0x7f47cc145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:27.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.254+0000 7f47d2922700 1 -- 172.21.15.110:0/781144143 >> v2:172.21.15.174:3300/0 conn(0x7f47cc0b5d00 msgr2=0x7f47cc145cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:27.317 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.254+0000 7f47d2922700 1 --2- 172.21.15.110:0/781144143 >> v2:172.21.15.174:3300/0 conn(0x7f47cc0b5d00 0x7f47cc145cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:27.318 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.254+0000 7f47d2922700 1 -- 172.21.15.110:0/781144143 >> v1:172.21.15.174:6789/0 conn(0x7f47cc0b0cc0 legacy=0x7f47cc067250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:27.318 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.254+0000 7f47d2922700 1 -- 172.21.15.110:0/781144143 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47cc149e80 con 0x7f47cc0648a0 2021-03-25T14:18:27.318 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.254+0000 7f47d2922700 1 --2- 172.21.15.110:0/781144143 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47cc0648a0 0x7f47cc09db40 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x7f47cc0a1db0 tx=0x7f47c40092d0).ready entity=mon.0 client_cookie=bb9d5067bba143b3 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:27.318 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.255+0000 7f47d111f700 1 -- 172.21.15.110:0/781144143 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c400bc40 con 0x7f47cc0648a0 2021-03-25T14:18:27.318 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.255+0000 7f47d111f700 1 -- 172.21.15.110:0/781144143 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c400bda0 con 0x7f47cc0648a0 2021-03-25T14:18:27.318 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.255+0000 7f47d111f700 1 -- 172.21.15.110:0/781144143 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c4011610 con 0x7f47cc0648a0 2021-03-25T14:18:27.318 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.255+0000 7f47d4385700 1 -- 172.21.15.110:0/781144143 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47cc0648a0 msgr2=0x7f47cc09db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:27.318 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.255+0000 7f47d4385700 1 --2- 172.21.15.110:0/781144143 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47cc0648a0 0x7f47cc09db40 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x7f47cc0a1db0 tx=0x7f47c40092d0).stop 2021-03-25T14:18:27.318 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.255+0000 7f47d4385700 1 -- 172.21.15.110:0/781144143 shutdown_connections 2021-03-25T14:18:27.318 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.255+0000 7f47d4385700 1 --2- 172.21.15.110:0/781144143 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47cc0648a0 0x7f47cc09db40 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:27.318 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.255+0000 7f47d4385700 1 --2- 172.21.15.110:0/781144143 >> v2:172.21.15.174:3300/0 conn(0x7f47cc0b5d00 0x7f47cc145cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:27.318 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.255+0000 7f47d4385700 1 -- 172.21.15.110:0/781144143 >> 172.21.15.110:0/781144143 conn(0x7f47cc0664e0 msgr2=0x7f47cc0668f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:27.319 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.255+0000 7f47d4385700 1 -- 172.21.15.110:0/781144143 shutdown_connections 2021-03-25T14:18:27.319 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.255+0000 7f47d4385700 1 -- 172.21.15.110:0/781144143 wait complete. 2021-03-25T14:18:27.319 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.256+0000 7f47d4385700 1 Processor -- start 2021-03-25T14:18:27.319 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.256+0000 7f47d4385700 1 -- start start 2021-03-25T14:18:27.319 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.257+0000 7f47d4385700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47cc0648a0 0x7f47cc08fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:27.319 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.257+0000 7f47d4385700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47cc0b0cc0 0x7f47cc09fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:27.319 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.257+0000 7f47d4385700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f47cc0b5d00 0x7f47cc09fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:27.319 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.257+0000 7f47d4385700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc0a04e0 con 0x7f47cc0648a0 2021-03-25T14:18:27.319 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.257+0000 7f47d4385700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc0a1540 con 0x7f47cc0b0cc0 2021-03-25T14:18:27.319 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.257+0000 7f47d4385700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc0b6ff0 con 0x7f47cc0b5d00 2021-03-25T14:18:27.319 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.257+0000 7f47d2121700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47cc0648a0 0x7f47cc08fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:27.319 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.257+0000 7f47d2121700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47cc0648a0 0x7f47cc08fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51784/0 (socket says 172.21.15.110:51784) 2021-03-25T14:18:27.319 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.257+0000 7f47d2121700 1 -- 172.21.15.110:0/2633602763 learned_addr learned my addr 172.21.15.110:0/2633602763 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:27.320 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.257+0000 7f47d1920700 1 --2- 172.21.15.110:0/2633602763 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47cc0b0cc0 0x7f47cc09fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:27.320 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.257+0000 7f47d2922700 1 --2- 172.21.15.110:0/2633602763 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f47cc0b5d00 0x7f47cc09fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:27.320 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.257+0000 7f47d2121700 1 -- 172.21.15.110:0/2633602763 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f47cc0b5d00 msgr2=0x7f47cc09fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:27.320 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.257+0000 7f47d2121700 1 --2- 172.21.15.110:0/2633602763 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f47cc0b5d00 0x7f47cc09fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:27.320 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.257+0000 7f47d2121700 1 -- 172.21.15.110:0/2633602763 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47cc0b0cc0 msgr2=0x7f47cc09fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:27.320 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.257+0000 7f47d2121700 1 --2- 172.21.15.110:0/2633602763 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47cc0b0cc0 0x7f47cc09fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:27.320 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.257+0000 7f47d2121700 1 -- 172.21.15.110:0/2633602763 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47cc159450 con 0x7f47cc0648a0 2021-03-25T14:18:27.320 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.257+0000 7f47d2121700 1 --2- 172.21.15.110:0/2633602763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47cc0648a0 0x7f47cc08fc20 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7f47c800c760 tx=0x7f47c8007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:27.320 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.258+0000 7f47be7fc700 1 -- 172.21.15.110:0/2633602763 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c8010510 con 0x7f47cc0648a0 2021-03-25T14:18:27.320 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.258+0000 7f47be7fc700 1 -- 172.21.15.110:0/2633602763 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c8010690 con 0x7f47cc0648a0 2021-03-25T14:18:27.320 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.258+0000 7f47d4385700 1 -- 172.21.15.110:0/2633602763 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47cc1596f0 con 0x7f47cc0648a0 2021-03-25T14:18:27.320 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.258+0000 7f47be7fc700 1 -- 172.21.15.110:0/2633602763 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c8010a50 con 0x7f47cc0648a0 2021-03-25T14:18:27.321 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.258+0000 7f47d4385700 1 -- 172.21.15.110:0/2633602763 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47cc159c30 con 0x7f47cc0648a0 2021-03-25T14:18:27.321 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.258+0000 7f47d4385700 1 -- 172.21.15.110:0/2633602763 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47cc067b40 con 0x7f47cc0648a0 2021-03-25T14:18:27.321 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.259+0000 7f47be7fc700 1 -- 172.21.15.110:0/2633602763 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f47c8010070 con 0x7f47cc0648a0 2021-03-25T14:18:27.321 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.259+0000 7f47be7fc700 1 --2- 172.21.15.110:0/2633602763 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f47ac05a0b0 0x7f47ac05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:27.321 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.259+0000 7f47be7fc700 1 -- 172.21.15.110:0/2633602763 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6426+0+0 (secure 0 0 0) 0x7f47c8073a30 con 0x7f47cc0648a0 2021-03-25T14:18:27.321 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.259+0000 7f47d1920700 1 --2- 172.21.15.110:0/2633602763 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f47ac05a0b0 0x7f47ac05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:27.321 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.259+0000 7f47d1920700 1 --2- 172.21.15.110:0/2633602763 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f47ac05a0b0 0x7f47ac05c570 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f47c0006fd0 tx=0x7f47c0008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:27.321 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.263+0000 7f47be7fc700 1 -- 172.21.15.110:0/2633602763 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f47c8047270 con 0x7f47cc0648a0 2021-03-25T14:18:27.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.412+0000 7f47d4385700 1 -- 172.21.15.110:0/2633602763 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f47cc159dc0 con 0x7f47cc0648a0 2021-03-25T14:18:27.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.412+0000 7f47be7fc700 1 -- 172.21.15.110:0/2633602763 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v74) v1 ==== 110+0+10 (secure 0 0 0) 0x7f47c8007d80 con 0x7f47cc0648a0 2021-03-25T14:18:27.414 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 1 2021-03-25T14:18:27.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.414+0000 7f47d4385700 1 -- 172.21.15.110:0/2633602763 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f47ac05a0b0 msgr2=0x7f47ac05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:27.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.414+0000 7f47d4385700 1 --2- 172.21.15.110:0/2633602763 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f47ac05a0b0 0x7f47ac05c570 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f47c0006fd0 tx=0x7f47c0008040).stop 2021-03-25T14:18:27.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.414+0000 7f47d4385700 1 -- 172.21.15.110:0/2633602763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47cc0648a0 msgr2=0x7f47cc08fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:27.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.414+0000 7f47d4385700 1 --2- 172.21.15.110:0/2633602763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47cc0648a0 0x7f47cc08fc20 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7f47c800c760 tx=0x7f47c8007c60).stop 2021-03-25T14:18:27.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.414+0000 7f47d4385700 1 -- 172.21.15.110:0/2633602763 shutdown_connections 2021-03-25T14:18:27.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.414+0000 7f47d4385700 1 --2- 172.21.15.110:0/2633602763 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f47ac05a0b0 0x7f47ac05c570 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:27.416 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.414+0000 7f47d4385700 1 --2- 172.21.15.110:0/2633602763 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f47cc0b5d00 0x7f47cc09fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:27.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.414+0000 7f47d4385700 1 --2- 172.21.15.110:0/2633602763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47cc0648a0 0x7f47cc08fc20 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:27.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.414+0000 7f47d4385700 1 --2- 172.21.15.110:0/2633602763 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47cc0b0cc0 0x7f47cc09fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:27.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.414+0000 7f47d4385700 1 -- 172.21.15.110:0/2633602763 >> 172.21.15.110:0/2633602763 conn(0x7f47cc0664e0 msgr2=0x7f47cc0b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:27.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.414+0000 7f47d4385700 1 -- 172.21.15.110:0/2633602763 shutdown_connections 2021-03-25T14:18:27.417 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.414+0000 7f47d4385700 1 -- 172.21.15.110:0/2633602763 wait complete. 2021-03-25T14:18:27.428 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-03-25T14:18:27.540 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.538+0000 7f4367df5700 1 Processor -- start 2021-03-25T14:18:27.540 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.538+0000 7f4367df5700 1 -- start start 2021-03-25T14:18:27.543 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.539+0000 7f4367df5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f43600b4100 0x7f4360149340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:27.543 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.539+0000 7f4367df5700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f43600b47a0 0x7f43600b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:27.543 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.539+0000 7f4367df5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43600b4c10 con 0x7f43600be3a0 2021-03-25T14:18:27.543 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.539+0000 7f4367df5700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4360149960 con 0x7f43600b47a0 2021-03-25T14:18:27.543 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.539+0000 7f4367df5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4360149c00 con 0x7f43600b4100 2021-03-25T14:18:27.543 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.539+0000 7f4366392700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f43600b47a0 0x7f43600b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:27.544 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.539+0000 7f4366392700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f43600b47a0 0x7f43600b8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51796/0 (socket says 172.21.15.110:51796) 2021-03-25T14:18:27.544 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.539+0000 7f4366392700 1 -- 172.21.15.110:0/4006691250 learned_addr learned my addr 172.21.15.110:0/4006691250 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:27.544 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.539+0000 7f4365390700 1 --2- 172.21.15.110:0/4006691250 >> v2:172.21.15.174:3300/0 conn(0x7f43600b4100 0x7f4360149340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:27.544 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.539+0000 7f4366392700 1 -- 172.21.15.110:0/4006691250 >> v2:172.21.15.174:3300/0 conn(0x7f43600b4100 msgr2=0x7f4360149340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:27.544 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.539+0000 7f4366392700 1 --2- 172.21.15.110:0/4006691250 >> v2:172.21.15.174:3300/0 conn(0x7f43600b4100 0x7f4360149340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:27.544 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.539+0000 7f4366392700 1 -- 172.21.15.110:0/4006691250 >> v1:172.21.15.174:6789/0 conn(0x7f43600be3a0 legacy=0x7f4360148c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:27.544 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.539+0000 7f4366392700 1 -- 172.21.15.110:0/4006691250 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4360149ea0 con 0x7f43600b47a0 2021-03-25T14:18:27.544 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.539+0000 7f4366392700 1 --2- 172.21.15.110:0/4006691250 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43600b47a0 0x7f43600b8cc0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7f43600b8230 tx=0x7f43580092d0).ready entity=mon.0 client_cookie=f87615793f23329e server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:27.544 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.540+0000 7f4364b8f700 1 -- 172.21.15.110:0/4006691250 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435800bbf0 con 0x7f43600b47a0 2021-03-25T14:18:27.544 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.540+0000 7f4364b8f700 1 -- 172.21.15.110:0/4006691250 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f435800bd50 con 0x7f43600b47a0 2021-03-25T14:18:27.544 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.540+0000 7f4364b8f700 1 -- 172.21.15.110:0/4006691250 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4358011610 con 0x7f43600b47a0 2021-03-25T14:18:27.545 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.540+0000 7f4367df5700 1 -- 172.21.15.110:0/4006691250 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43600b47a0 msgr2=0x7f43600b8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:27.545 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.540+0000 7f4367df5700 1 --2- 172.21.15.110:0/4006691250 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43600b47a0 0x7f43600b8cc0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7f43600b8230 tx=0x7f43580092d0).stop 2021-03-25T14:18:27.545 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.540+0000 7f4367df5700 1 -- 172.21.15.110:0/4006691250 shutdown_connections 2021-03-25T14:18:27.545 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.540+0000 7f4367df5700 1 --2- 172.21.15.110:0/4006691250 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43600b47a0 0x7f43600b8cc0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:27.545 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.540+0000 7f4367df5700 1 --2- 172.21.15.110:0/4006691250 >> v2:172.21.15.174:3300/0 conn(0x7f43600b4100 0x7f4360149340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:27.545 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.540+0000 7f4367df5700 1 -- 172.21.15.110:0/4006691250 >> 172.21.15.110:0/4006691250 conn(0x7f43600686f0 msgr2=0x7f4360068b00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:27.545 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.540+0000 7f4367df5700 1 -- 172.21.15.110:0/4006691250 shutdown_connections 2021-03-25T14:18:27.545 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.540+0000 7f4367df5700 1 -- 172.21.15.110:0/4006691250 wait complete. 2021-03-25T14:18:27.545 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.541+0000 7f4367df5700 1 Processor -- start 2021-03-25T14:18:27.545 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.541+0000 7f4367df5700 1 -- start start 2021-03-25T14:18:27.549 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.542+0000 7f4367df5700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43600b4100 0x7f436014bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:27.550 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.542+0000 7f4367df5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43600b47a0 0x7f43600ba0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:27.550 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.542+0000 7f4367df5700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43600be3a0 0x7f4360147000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:27.550 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.542+0000 7f4367df5700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436014c3e0 con 0x7f43600be3a0 2021-03-25T14:18:27.550 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.542+0000 7f4367df5700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436014dba0 con 0x7f43600b4100 2021-03-25T14:18:27.550 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.542+0000 7f4367df5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f436014de40 con 0x7f43600b47a0 2021-03-25T14:18:27.550 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.542+0000 7f4366392700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43600be3a0 0x7f4360147000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:27.550 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.542+0000 7f4366392700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43600be3a0 0x7f4360147000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51802/0 (socket says 172.21.15.110:51802) 2021-03-25T14:18:27.550 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.542+0000 7f4366392700 1 -- 172.21.15.110:0/3871022393 learned_addr learned my addr 172.21.15.110:0/3871022393 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:27.550 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.542+0000 7f4365b91700 1 --2- 172.21.15.110:0/3871022393 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43600b4100 0x7f436014bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:27.550 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.542+0000 7f4365390700 1 --2- 172.21.15.110:0/3871022393 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43600b47a0 0x7f43600ba0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:27.550 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.542+0000 7f4366392700 1 -- 172.21.15.110:0/3871022393 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43600b47a0 msgr2=0x7f43600ba0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:27.550 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.542+0000 7f4366392700 1 --2- 172.21.15.110:0/3871022393 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43600b47a0 0x7f43600ba0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:27.551 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.542+0000 7f4366392700 1 -- 172.21.15.110:0/3871022393 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43600b4100 msgr2=0x7f436014bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:27.551 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.542+0000 7f4366392700 1 --2- 172.21.15.110:0/3871022393 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43600b4100 0x7f436014bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:27.551 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.542+0000 7f4366392700 1 -- 172.21.15.110:0/3871022393 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f436014e0e0 con 0x7f43600be3a0 2021-03-25T14:18:27.551 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.542+0000 7f4366392700 1 --2- 172.21.15.110:0/3871022393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43600be3a0 0x7f4360147000 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7f4358009310 tx=0x7f4358017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:27.551 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.542+0000 7f434dffb700 1 -- 172.21.15.110:0/3871022393 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4358009ea0 con 0x7f43600be3a0 2021-03-25T14:18:27.551 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.543+0000 7f434dffb700 1 -- 172.21.15.110:0/3871022393 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f435800bec0 con 0x7f43600be3a0 2021-03-25T14:18:27.551 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.543+0000 7f4367df5700 1 -- 172.21.15.110:0/3871022393 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f436014c0e0 con 0x7f43600be3a0 2021-03-25T14:18:27.551 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.543+0000 7f434dffb700 1 -- 172.21.15.110:0/3871022393 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4358010c90 con 0x7f43600be3a0 2021-03-25T14:18:27.551 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.543+0000 7f4367df5700 1 -- 172.21.15.110:0/3871022393 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43600ba5e0 con 0x7f43600be3a0 2021-03-25T14:18:27.551 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.544+0000 7f4367df5700 1 -- 172.21.15.110:0/3871022393 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43600bd3b0 con 0x7f43600be3a0 2021-03-25T14:18:27.551 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.544+0000 7f434dffb700 1 -- 172.21.15.110:0/3871022393 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f435800f070 con 0x7f43600be3a0 2021-03-25T14:18:27.551 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.544+0000 7f434dffb700 1 --2- 172.21.15.110:0/3871022393 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f434005a0b0 0x7f434005c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:27.552 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.544+0000 7f434dffb700 1 -- 172.21.15.110:0/3871022393 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6426+0+0 (secure 0 0 0) 0x7f4358075880 con 0x7f43600be3a0 2021-03-25T14:18:27.552 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.544+0000 7f4365b91700 1 --2- 172.21.15.110:0/3871022393 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f434005a0b0 0x7f434005c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:27.552 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.545+0000 7f4365b91700 1 --2- 172.21.15.110:0/3871022393 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f434005a0b0 0x7f434005c570 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f43500036e0 tx=0x7f4350007bc0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:27.552 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.548+0000 7f434dffb700 1 -- 172.21.15.110:0/3871022393 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f4358048fb0 con 0x7f43600be3a0 2021-03-25T14:18:27.703 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.700+0000 7f4367df5700 1 -- 172.21.15.110:0/3871022393 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f436014e270 con 0x7f43600be3a0 2021-03-25T14:18:27.703 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.701+0000 7f434dffb700 1 -- 172.21.15.110:0/3871022393 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v74) v1 ==== 92+0+10 (secure 0 0 0) 0x7f435804c5d0 con 0x7f43600be3a0 2021-03-25T14:18:27.703 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:18:27.705 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.702+0000 7f4367df5700 1 -- 172.21.15.110:0/3871022393 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f434005a0b0 msgr2=0x7f434005c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:27.705 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.702+0000 7f4367df5700 1 --2- 172.21.15.110:0/3871022393 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f434005a0b0 0x7f434005c570 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f43500036e0 tx=0x7f4350007bc0).stop 2021-03-25T14:18:27.705 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.702+0000 7f4367df5700 1 -- 172.21.15.110:0/3871022393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43600be3a0 msgr2=0x7f4360147000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:27.705 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.702+0000 7f4367df5700 1 --2- 172.21.15.110:0/3871022393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43600be3a0 0x7f4360147000 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7f4358009310 tx=0x7f4358017000).stop 2021-03-25T14:18:27.705 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.702+0000 7f4367df5700 1 -- 172.21.15.110:0/3871022393 shutdown_connections 2021-03-25T14:18:27.705 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.702+0000 7f4367df5700 1 --2- 172.21.15.110:0/3871022393 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f434005a0b0 0x7f434005c570 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:27.705 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.702+0000 7f4367df5700 1 --2- 172.21.15.110:0/3871022393 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43600b4100 0x7f436014bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:27.705 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.702+0000 7f4367df5700 1 --2- 172.21.15.110:0/3871022393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43600be3a0 0x7f4360147000 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:27.705 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.702+0000 7f4367df5700 1 --2- 172.21.15.110:0/3871022393 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43600b47a0 0x7f43600ba0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:27.706 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.702+0000 7f4367df5700 1 -- 172.21.15.110:0/3871022393 >> 172.21.15.110:0/3871022393 conn(0x7f43600686f0 msgr2=0x7f4360068ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:27.706 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.703+0000 7f4367df5700 1 -- 172.21.15.110:0/3871022393 shutdown_connections 2021-03-25T14:18:27.706 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.703+0000 7f4367df5700 1 -- 172.21.15.110:0/3871022393 wait complete. 2021-03-25T14:18:27.716 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-03-25T14:18:27.835 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.829+0000 7f0b61ef3700 1 Processor -- start 2021-03-25T14:18:27.836 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.829+0000 7f0b61ef3700 1 -- start start 2021-03-25T14:18:27.836 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.830+0000 7f0b61ef3700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0b5c0bbfd0 0x7f0b5c0bc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:27.836 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.830+0000 7f0b61ef3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b5c147130 0x7f0b5c0b0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:27.836 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.830+0000 7f0b61ef3700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b5c14a790 con 0x7f0b5c0b6780 2021-03-25T14:18:27.836 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.830+0000 7f0b61ef3700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b5c146750 con 0x7f0b5c0bbfd0 2021-03-25T14:18:27.836 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.830+0000 7f0b61ef3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c1469f0 con 0x7f0b5c147130 2021-03-25T14:18:27.836 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.830+0000 7f0b5b7fe700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0b5c0bbfd0 0x7f0b5c0bc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:27.836 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.830+0000 7f0b5bfff700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f0b5c0b6780 0x7f0b5c145a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44746/0 (socket says 172.21.15.110:44746) 2021-03-25T14:18:27.836 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.830+0000 7f0b5bfff700 1 -- 172.21.15.110:0/1747154784 learned_addr learned my addr 172.21.15.110:0/1747154784 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:18:27.836 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.830+0000 7f0b5b7fe700 1 --2- 172.21.15.110:0/1747154784 >> v2:172.21.15.110:3300/0 conn(0x7f0b5c0bbfd0 0x7f0b5c0bc3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51806/0 (socket says 172.21.15.110:51806) 2021-03-25T14:18:27.836 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.830+0000 7f0b5affd700 1 --2- 172.21.15.110:0/1747154784 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b5c147130 0x7f0b5c0b0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:27.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.830+0000 7f0b5b7fe700 1 -- 172.21.15.110:0/1747154784 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b5c147130 msgr2=0x7f0b5c0b0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:27.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.830+0000 7f0b5b7fe700 1 --2- 172.21.15.110:0/1747154784 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b5c147130 0x7f0b5c0b0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:27.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.830+0000 7f0b5b7fe700 1 -- 172.21.15.110:0/1747154784 >> v1:172.21.15.110:6789/0 conn(0x7f0b5c0b6780 legacy=0x7f0b5c145a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:27.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.830+0000 7f0b5b7fe700 1 -- 172.21.15.110:0/1747154784 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b5c146c90 con 0x7f0b5c0bbfd0 2021-03-25T14:18:27.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.830+0000 7f0b5a7fc700 1 -- 172.21.15.110:0/1747154784 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4210292695 0 0) 0x7f0b5c14a790 con 0x7f0b5c0b6780 2021-03-25T14:18:27.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.831+0000 7f0b5b7fe700 1 --2- 172.21.15.110:0/1747154784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b5c0bbfd0 0x7f0b5c0bc3b0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7f0b4c00b9c0 tx=0x7f0b4c006e20).ready entity=mon.0 client_cookie=9cc9a94483eb67ab server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:27.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.831+0000 7f0b5a7fc700 1 -- 172.21.15.110:0/1747154784 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c009870 con 0x7f0b5c0bbfd0 2021-03-25T14:18:27.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.831+0000 7f0b5a7fc700 1 -- 172.21.15.110:0/1747154784 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4c0099d0 con 0x7f0b5c0bbfd0 2021-03-25T14:18:27.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.831+0000 7f0b5a7fc700 1 -- 172.21.15.110:0/1747154784 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c009d50 con 0x7f0b5c0bbfd0 2021-03-25T14:18:27.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.831+0000 7f0b61ef3700 1 -- 172.21.15.110:0/1747154784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b5c0bbfd0 msgr2=0x7f0b5c0bc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:27.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.831+0000 7f0b61ef3700 1 --2- 172.21.15.110:0/1747154784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b5c0bbfd0 0x7f0b5c0bc3b0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7f0b4c00b9c0 tx=0x7f0b4c006e20).stop 2021-03-25T14:18:27.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.831+0000 7f0b61ef3700 1 -- 172.21.15.110:0/1747154784 shutdown_connections 2021-03-25T14:18:27.837 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.831+0000 7f0b61ef3700 1 --2- 172.21.15.110:0/1747154784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b5c0bbfd0 0x7f0b5c0bc3b0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:27.838 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.831+0000 7f0b61ef3700 1 --2- 172.21.15.110:0/1747154784 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b5c147130 0x7f0b5c0b0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:27.838 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.831+0000 7f0b61ef3700 1 -- 172.21.15.110:0/1747154784 >> 172.21.15.110:0/1747154784 conn(0x7f0b5c0664e0 msgr2=0x7f0b5c0668f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:27.838 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.833+0000 7f0b61ef3700 1 -- 172.21.15.110:0/1747154784 shutdown_connections 2021-03-25T14:18:27.838 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.833+0000 7f0b61ef3700 1 -- 172.21.15.110:0/1747154784 wait complete. 2021-03-25T14:18:27.838 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.834+0000 7f0b61ef3700 1 Processor -- start 2021-03-25T14:18:27.838 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.834+0000 7f0b61ef3700 1 -- start start 2021-03-25T14:18:27.844 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.834+0000 7f0b61ef3700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b5c0b6780 0x7f0b5c09da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:27.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.834+0000 7f0b61ef3700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b5c0bbfd0 0x7f0b5c159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:27.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.834+0000 7f0b61ef3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b5c147130 0x7f0b5c15a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:27.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.834+0000 7f0b61ef3700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c148f30 con 0x7f0b5c0b6780 2021-03-25T14:18:27.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.834+0000 7f0b61ef3700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c156cf0 con 0x7f0b5c0bbfd0 2021-03-25T14:18:27.845 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.834+0000 7f0b61ef3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c156f90 con 0x7f0b5c147130 2021-03-25T14:18:27.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.835+0000 7f0b5b7fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b5c0b6780 0x7f0b5c09da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:27.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.835+0000 7f0b5b7fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b5c0b6780 0x7f0b5c09da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51812/0 (socket says 172.21.15.110:51812) 2021-03-25T14:18:27.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.835+0000 7f0b5b7fe700 1 -- 172.21.15.110:0/332503174 learned_addr learned my addr 172.21.15.110:0/332503174 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:27.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.835+0000 7f0b5affd700 1 --2- 172.21.15.110:0/332503174 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b5c0bbfd0 0x7f0b5c159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:27.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.835+0000 7f0b5bfff700 1 --2- 172.21.15.110:0/332503174 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b5c147130 0x7f0b5c15a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:27.846 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.835+0000 7f0b5b7fe700 1 -- 172.21.15.110:0/332503174 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b5c147130 msgr2=0x7f0b5c15a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:27.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.835+0000 7f0b5b7fe700 1 --2- 172.21.15.110:0/332503174 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b5c147130 0x7f0b5c15a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:27.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.835+0000 7f0b5b7fe700 1 -- 172.21.15.110:0/332503174 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b5c0bbfd0 msgr2=0x7f0b5c159fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:27.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.835+0000 7f0b5b7fe700 1 --2- 172.21.15.110:0/332503174 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b5c0bbfd0 0x7f0b5c159fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:27.847 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.835+0000 7f0b5b7fe700 1 -- 172.21.15.110:0/332503174 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b5c157230 con 0x7f0b5c0b6780 2021-03-25T14:18:27.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.835+0000 7f0b5b7fe700 1 --2- 172.21.15.110:0/332503174 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b5c0b6780 0x7f0b5c09da50 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f0b4c007fd0 tx=0x7f0b4c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:27.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.835+0000 7f0b437fe700 1 -- 172.21.15.110:0/332503174 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c011b70 con 0x7f0b5c0b6780 2021-03-25T14:18:27.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.835+0000 7f0b437fe700 1 -- 172.21.15.110:0/332503174 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4c011cd0 con 0x7f0b5c0b6780 2021-03-25T14:18:27.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.835+0000 7f0b61ef3700 1 -- 172.21.15.110:0/332503174 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b5c1569f0 con 0x7f0b5c0b6780 2021-03-25T14:18:27.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.835+0000 7f0b437fe700 1 -- 172.21.15.110:0/332503174 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c01c630 con 0x7f0b5c0b6780 2021-03-25T14:18:27.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.835+0000 7f0b61ef3700 1 -- 172.21.15.110:0/332503174 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b5c09df40 con 0x7f0b5c0b6780 2021-03-25T14:18:27.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.836+0000 7f0b437fe700 1 -- 172.21.15.110:0/332503174 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f0b4c00f070 con 0x7f0b5c0b6780 2021-03-25T14:18:27.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.836+0000 7f0b61ef3700 1 -- 172.21.15.110:0/332503174 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b5c05d7b0 con 0x7f0b5c0b6780 2021-03-25T14:18:27.849 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.837+0000 7f0b437fe700 1 --2- 172.21.15.110:0/332503174 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f0b3c05a0b0 0x7f0b3c05c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:27.849 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.837+0000 7f0b437fe700 1 -- 172.21.15.110:0/332503174 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6426+0+0 (secure 0 0 0) 0x7f0b4c0753e0 con 0x7f0b5c0b6780 2021-03-25T14:18:27.849 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.837+0000 7f0b5affd700 1 --2- 172.21.15.110:0/332503174 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f0b3c05a0b0 0x7f0b3c05c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:27.849 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.837+0000 7f0b5affd700 1 --2- 172.21.15.110:0/332503174 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f0b3c05a0b0 0x7f0b3c05c570 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f0b5c147590 tx=0x7f0b50006e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:27.849 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.840+0000 7f0b437fe700 1 -- 172.21.15.110:0/332503174 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f0b4c048c20 con 0x7f0b5c0b6780 2021-03-25T14:18:27.991 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.989+0000 7f0b61ef3700 1 -- 172.21.15.110:0/332503174 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0b5c149bf0 con 0x7f0b5c0b6780 2021-03-25T14:18:27.991 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.989+0000 7f0b437fe700 1 -- 172.21.15.110:0/332503174 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v74) v1 ==== 104+0+10 (secure 0 0 0) 0x7f0b4c04c240 con 0x7f0b5c0b6780 2021-03-25T14:18:27.991 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:18:27.993 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.991+0000 7f0b61ef3700 1 -- 172.21.15.110:0/332503174 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f0b3c05a0b0 msgr2=0x7f0b3c05c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:27.993 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.991+0000 7f0b61ef3700 1 --2- 172.21.15.110:0/332503174 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f0b3c05a0b0 0x7f0b3c05c570 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f0b5c147590 tx=0x7f0b50006e20).stop 2021-03-25T14:18:27.993 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.991+0000 7f0b61ef3700 1 -- 172.21.15.110:0/332503174 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b5c0b6780 msgr2=0x7f0b5c09da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:27.993 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.991+0000 7f0b61ef3700 1 --2- 172.21.15.110:0/332503174 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b5c0b6780 0x7f0b5c09da50 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f0b4c007fd0 tx=0x7f0b4c016000).stop 2021-03-25T14:18:27.993 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.991+0000 7f0b61ef3700 1 -- 172.21.15.110:0/332503174 shutdown_connections 2021-03-25T14:18:27.993 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.991+0000 7f0b61ef3700 1 --2- 172.21.15.110:0/332503174 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f0b3c05a0b0 0x7f0b3c05c570 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:27.993 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.991+0000 7f0b61ef3700 1 --2- 172.21.15.110:0/332503174 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b5c147130 0x7f0b5c15a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:27.993 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.991+0000 7f0b61ef3700 1 --2- 172.21.15.110:0/332503174 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b5c0b6780 0x7f0b5c09da50 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:27.993 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.991+0000 7f0b61ef3700 1 --2- 172.21.15.110:0/332503174 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b5c0bbfd0 0x7f0b5c159fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:27.994 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.991+0000 7f0b61ef3700 1 -- 172.21.15.110:0/332503174 >> 172.21.15.110:0/332503174 conn(0x7f0b5c0664e0 msgr2=0x7f0b5c067f50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:27.994 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.991+0000 7f0b61ef3700 1 -- 172.21.15.110:0/332503174 shutdown_connections 2021-03-25T14:18:27.994 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:27.991+0000 7f0b61ef3700 1 -- 172.21.15.110:0/332503174 wait complete. 2021-03-25T14:18:28.004 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-03-25T14:18:28.116 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.114+0000 7fc36b0ed700 1 Processor -- start 2021-03-25T14:18:28.116 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.114+0000 7fc36b0ed700 1 -- start start 2021-03-25T14:18:28.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.115+0000 7fc36b0ed700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3640b2c60 0x7fc3640655b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:28.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.115+0000 7fc36b0ed700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc364066d20 0x7fc364146b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:28.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.115+0000 7fc36b0ed700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3640671b0 con 0x7fc3640ba8f0 2021-03-25T14:18:28.119 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.115+0000 7fc36b0ed700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc36409d070 con 0x7fc364066d20 2021-03-25T14:18:28.120 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.115+0000 7fc36b0ed700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc36409d310 con 0x7fc3640b2c60 2021-03-25T14:18:28.120 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.115+0000 7fc36968a700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc364066d20 0x7fc364146b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:28.120 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.115+0000 7fc36968a700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc364066d20 0x7fc364146b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51822/0 (socket says 172.21.15.110:51822) 2021-03-25T14:18:28.120 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.115+0000 7fc36968a700 1 -- 172.21.15.110:0/1547424361 learned_addr learned my addr 172.21.15.110:0/1547424361 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:28.120 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.115+0000 7fc368e89700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fc3640ba8f0 0x7fc364147f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44758/0 (socket says 172.21.15.110:44758) 2021-03-25T14:18:28.120 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.115+0000 7fc363fff700 1 --2- 172.21.15.110:0/1547424361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3640b2c60 0x7fc3640655b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:28.120 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.115+0000 7fc36968a700 1 -- 172.21.15.110:0/1547424361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3640b2c60 msgr2=0x7fc3640655b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:28.120 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.115+0000 7fc36968a700 1 --2- 172.21.15.110:0/1547424361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3640b2c60 0x7fc3640655b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:28.120 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.115+0000 7fc36968a700 1 -- 172.21.15.110:0/1547424361 >> v1:172.21.15.110:6789/0 conn(0x7fc3640ba8f0 legacy=0x7fc364147f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:28.120 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.115+0000 7fc36968a700 1 -- 172.21.15.110:0/1547424361 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc36409d5b0 con 0x7fc364066d20 2021-03-25T14:18:28.120 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.115+0000 7fc3637fe700 1 -- 172.21.15.110:0/1547424361 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3259244113 0 0) 0x7fc3640671b0 con 0x7fc3640ba8f0 2021-03-25T14:18:28.120 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.115+0000 7fc36968a700 1 --2- 172.21.15.110:0/1547424361 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc364066d20 0x7fc364146b60 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7fc35c009d90 tx=0x7fc35c0092d0).ready entity=mon.0 client_cookie=a6ff4846e7c9f203 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:28.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.115+0000 7fc3637fe700 1 -- 172.21.15.110:0/1547424361 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35c00bc80 con 0x7fc364066d20 2021-03-25T14:18:28.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.116+0000 7fc3637fe700 1 -- 172.21.15.110:0/1547424361 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc35c00bde0 con 0x7fc364066d20 2021-03-25T14:18:28.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.116+0000 7fc3637fe700 1 -- 172.21.15.110:0/1547424361 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35c011610 con 0x7fc364066d20 2021-03-25T14:18:28.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.116+0000 7fc36b0ed700 1 -- 172.21.15.110:0/1547424361 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc364066d20 msgr2=0x7fc364146b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:28.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.116+0000 7fc36b0ed700 1 --2- 172.21.15.110:0/1547424361 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc364066d20 0x7fc364146b60 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7fc35c009d90 tx=0x7fc35c0092d0).stop 2021-03-25T14:18:28.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.116+0000 7fc36b0ed700 1 -- 172.21.15.110:0/1547424361 shutdown_connections 2021-03-25T14:18:28.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.116+0000 7fc36b0ed700 1 --2- 172.21.15.110:0/1547424361 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc364066d20 0x7fc364146b60 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:28.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.116+0000 7fc36b0ed700 1 --2- 172.21.15.110:0/1547424361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3640b2c60 0x7fc3640655b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:28.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.116+0000 7fc36b0ed700 1 -- 172.21.15.110:0/1547424361 >> 172.21.15.110:0/1547424361 conn(0x7fc364060c40 msgr2=0x7fc364061050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:28.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.116+0000 7fc36b0ed700 1 -- 172.21.15.110:0/1547424361 shutdown_connections 2021-03-25T14:18:28.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.116+0000 7fc36b0ed700 1 -- 172.21.15.110:0/1547424361 wait complete. 2021-03-25T14:18:28.121 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.117+0000 7fc36b0ed700 1 Processor -- start 2021-03-25T14:18:28.122 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.117+0000 7fc36b0ed700 1 -- start start 2021-03-25T14:18:28.125 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.118+0000 7fc36b0ed700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc364066d20 0x7fc36409d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:28.125 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.118+0000 7fc36b0ed700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3640b2c60 0x7fc3640655b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:28.125 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.118+0000 7fc36b0ed700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3640ba8f0 0x7fc36414b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:28.125 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.118+0000 7fc36b0ed700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc364156b80 con 0x7fc364066d20 2021-03-25T14:18:28.125 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.118+0000 7fc36b0ed700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc364156e20 con 0x7fc3640ba8f0 2021-03-25T14:18:28.125 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.118+0000 7fc36b0ed700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3641570c0 con 0x7fc3640b2c60 2021-03-25T14:18:28.125 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.118+0000 7fc368e89700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc364066d20 0x7fc36409d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:28.125 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.118+0000 7fc368e89700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc364066d20 0x7fc36409d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51826/0 (socket says 172.21.15.110:51826) 2021-03-25T14:18:28.126 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.118+0000 7fc368e89700 1 -- 172.21.15.110:0/761578805 learned_addr learned my addr 172.21.15.110:0/761578805 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:28.126 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.118+0000 7fc363fff700 1 --2- 172.21.15.110:0/761578805 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3640b2c60 0x7fc3640655b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:28.126 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.118+0000 7fc36968a700 1 --2- 172.21.15.110:0/761578805 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3640ba8f0 0x7fc36414b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:28.126 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.118+0000 7fc368e89700 1 -- 172.21.15.110:0/761578805 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3640b2c60 msgr2=0x7fc3640655b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:28.126 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.118+0000 7fc368e89700 1 --2- 172.21.15.110:0/761578805 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3640b2c60 0x7fc3640655b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:28.126 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.118+0000 7fc368e89700 1 -- 172.21.15.110:0/761578805 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3640ba8f0 msgr2=0x7fc36414b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:28.126 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.118+0000 7fc368e89700 1 --2- 172.21.15.110:0/761578805 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3640ba8f0 0x7fc36414b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:28.126 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.118+0000 7fc368e89700 1 -- 172.21.15.110:0/761578805 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc364157360 con 0x7fc364066d20 2021-03-25T14:18:28.126 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.118+0000 7fc368e89700 1 --2- 172.21.15.110:0/761578805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc364066d20 0x7fc36409d8e0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7fc35800c760 tx=0x7fc358007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:28.126 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.119+0000 7fc360ff9700 1 -- 172.21.15.110:0/761578805 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3580072e0 con 0x7fc364066d20 2021-03-25T14:18:28.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.119+0000 7fc360ff9700 1 -- 172.21.15.110:0/761578805 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc358007440 con 0x7fc364066d20 2021-03-25T14:18:28.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.119+0000 7fc36b0ed700 1 -- 172.21.15.110:0/761578805 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc364157800 con 0x7fc364066d20 2021-03-25T14:18:28.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.119+0000 7fc360ff9700 1 -- 172.21.15.110:0/761578805 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3580057b0 con 0x7fc364066d20 2021-03-25T14:18:28.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.119+0000 7fc36b0ed700 1 -- 172.21.15.110:0/761578805 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc364141270 con 0x7fc364066d20 2021-03-25T14:18:28.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.120+0000 7fc36b0ed700 1 -- 172.21.15.110:0/761578805 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc36405d7b0 con 0x7fc364066d20 2021-03-25T14:18:28.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.120+0000 7fc360ff9700 1 -- 172.21.15.110:0/761578805 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7fc35801a060 con 0x7fc364066d20 2021-03-25T14:18:28.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.120+0000 7fc360ff9700 1 --2- 172.21.15.110:0/761578805 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc34405a0b0 0x7fc34405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:28.127 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.120+0000 7fc360ff9700 1 -- 172.21.15.110:0/761578805 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6426+0+0 (secure 0 0 0) 0x7fc358073430 con 0x7fc364066d20 2021-03-25T14:18:28.128 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.120+0000 7fc363fff700 1 --2- 172.21.15.110:0/761578805 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc34405a0b0 0x7fc34405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:28.128 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.121+0000 7fc363fff700 1 --2- 172.21.15.110:0/761578805 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc34405a0b0 0x7fc34405c570 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7fc364066400 tx=0x7fc350008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:28.128 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.124+0000 7fc360ff9700 1 -- 172.21.15.110:0/761578805 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7fc358046c70 con 0x7fc364066d20 2021-03-25T14:18:28.276 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.274+0000 7fc36b0ed700 1 -- 172.21.15.110:0/761578805 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc364141270 con 0x7fc364066d20 2021-03-25T14:18:28.276 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.274+0000 7fc360ff9700 1 -- 172.21.15.110:0/761578805 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v74) v1 ==== 100+0+10 (secure 0 0 0) 0x7fc364141270 con 0x7fc364066d20 2021-03-25T14:18:28.277 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 8 2021-03-25T14:18:28.278 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.276+0000 7fc36b0ed700 1 -- 172.21.15.110:0/761578805 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc34405a0b0 msgr2=0x7fc34405c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:28.278 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.276+0000 7fc36b0ed700 1 --2- 172.21.15.110:0/761578805 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc34405a0b0 0x7fc34405c570 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7fc364066400 tx=0x7fc350008040).stop 2021-03-25T14:18:28.278 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.276+0000 7fc36b0ed700 1 -- 172.21.15.110:0/761578805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc364066d20 msgr2=0x7fc36409d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:28.278 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.276+0000 7fc36b0ed700 1 --2- 172.21.15.110:0/761578805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc364066d20 0x7fc36409d8e0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7fc35800c760 tx=0x7fc358007c60).stop 2021-03-25T14:18:28.278 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.276+0000 7fc36b0ed700 1 -- 172.21.15.110:0/761578805 shutdown_connections 2021-03-25T14:18:28.278 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.276+0000 7fc36b0ed700 1 --2- 172.21.15.110:0/761578805 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7fc34405a0b0 0x7fc34405c570 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:28.279 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.276+0000 7fc36b0ed700 1 --2- 172.21.15.110:0/761578805 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3640ba8f0 0x7fc36414b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:28.279 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.276+0000 7fc36b0ed700 1 --2- 172.21.15.110:0/761578805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc364066d20 0x7fc36409d8e0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:28.279 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.276+0000 7fc36b0ed700 1 --2- 172.21.15.110:0/761578805 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3640b2c60 0x7fc3640655b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:28.279 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.276+0000 7fc36b0ed700 1 -- 172.21.15.110:0/761578805 >> 172.21.15.110:0/761578805 conn(0x7fc364060c40 msgr2=0x7fc3640bd490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:28.279 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.276+0000 7fc36b0ed700 1 -- 172.21.15.110:0/761578805 shutdown_connections 2021-03-25T14:18:28.279 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.276+0000 7fc36b0ed700 1 -- 172.21.15.110:0/761578805 wait complete. 2021-03-25T14:18:28.289 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-03-25T14:18:28.401 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.399+0000 7f01fc770700 1 Processor -- start 2021-03-25T14:18:28.401 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.399+0000 7f01fc770700 1 -- start start 2021-03-25T14:18:28.408 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.400+0000 7f01fc770700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f01f40bcd90 0x7f01f414d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:28.408 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.400+0000 7f01fc770700 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01f40b9140 con 0x7f01f40b1340 2021-03-25T14:18:28.408 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.400+0000 7f01fc770700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01f40b93e0 con 0x7f01f40b7620 2021-03-25T14:18:28.408 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.400+0000 7f01fc770700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01f40692a0 con 0x7f01f40bcd90 2021-03-25T14:18:28.408 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.400+0000 7f01f9d0b700 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f01f40b1340 0x7f01f4060c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44770/0 (socket says 172.21.15.110:44770) 2021-03-25T14:18:28.408 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.400+0000 7f01f9d0b700 1 -- 172.21.15.110:0/3056816585 learned_addr learned my addr 172.21.15.110:0/3056816585 (peer_addr_for_me v1:172.21.15.110:0/0) 2021-03-25T14:18:28.408 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.400+0000 7f01fa50c700 1 --2- 172.21.15.110:0/3056816585 >> v2:172.21.15.174:3300/0 conn(0x7f01f40bcd90 0x7f01f414d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:28.408 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.400+0000 7f01f950a700 1 -- 172.21.15.110:0/3056816585 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1235616711 0 0) 0x7f01f40b9140 con 0x7f01f40b1340 2021-03-25T14:18:28.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.400+0000 7f01f950a700 1 -- 172.21.15.110:0/3056816585 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01dc003270 con 0x7f01f40b1340 2021-03-25T14:18:28.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.400+0000 7f01f950a700 1 -- 172.21.15.110:0/3056816585 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 146599046 0 0) 0x7f01dc003270 con 0x7f01f40b1340 2021-03-25T14:18:28.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.401+0000 7f01f950a700 1 -- 172.21.15.110:0/3056816585 >> v2:172.21.15.174:3300/0 conn(0x7f01f40bcd90 msgr2=0x7f01f414d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:28.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.401+0000 7f01f950a700 1 --2- 172.21.15.110:0/3056816585 >> v2:172.21.15.174:3300/0 conn(0x7f01f40bcd90 0x7f01f414d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:28.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.401+0000 7f01f950a700 1 -- 172.21.15.110:0/3056816585 >> v1:172.21.15.174:6789/0 conn(0x7f01f40b7620 legacy=0x7f01f4148ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:28.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.401+0000 7f01f950a700 1 -- 172.21.15.110:0/3056816585 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f414cda0 con 0x7f01f40b1340 2021-03-25T14:18:28.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.401+0000 7f01f950a700 1 -- 172.21.15.110:0/3056816585 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 703828717 0 0) 0x7f01e8001520 con 0x7f01f40b1340 2021-03-25T14:18:28.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.401+0000 7f01f950a700 1 -- 172.21.15.110:0/3056816585 >> v1:172.21.15.110:6789/0 conn(0x7f01f40b1340 legacy=0x7f01f4060c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:28.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.401+0000 7f01f950a700 1 --2- 172.21.15.110:0/3056816585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01dc003760 0x7f01dc003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:28.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.401+0000 7f01f950a700 1 --2- 172.21.15.110:0/3056816585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01dc004510 0x7f01dc004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:28.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.401+0000 7f01f950a700 1 --2- 172.21.15.110:0/3056816585 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01dc004e80 0x7f01dc00b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:28.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.401+0000 7f01f950a700 1 -- 172.21.15.110:0/3056816585 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f40692a0 con 0x7f01dc004e80 2021-03-25T14:18:28.409 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.401+0000 7f01f950a700 1 -- 172.21.15.110:0/3056816585 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc004200 con 0x7f01dc003760 2021-03-25T14:18:28.410 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.401+0000 7f01f950a700 1 -- 172.21.15.110:0/3056816585 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc00bc50 con 0x7f01dc004510 2021-03-25T14:18:28.410 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.401+0000 7f01fa50c700 1 --2- 172.21.15.110:0/3056816585 >> v2:172.21.15.174:3300/0 conn(0x7f01f40bcd90 0x7f01f414d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:18:28.410 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.401+0000 7f01fad0d700 1 --2- 172.21.15.110:0/3056816585 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01dc004e80 0x7f01dc00b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:28.410 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.401+0000 7f01f9d0b700 1 --2- 172.21.15.110:0/3056816585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01dc004510 0x7f01dc004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:28.410 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.401+0000 7f01fa50c700 1 --2- 172.21.15.110:0/3056816585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01dc003760 0x7f01dc003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:28.410 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.401+0000 7f01fad0d700 1 -- 172.21.15.110:0/3056816585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01dc004510 msgr2=0x7f01dc004990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:28.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.401+0000 7f01fad0d700 1 --2- 172.21.15.110:0/3056816585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01dc004510 0x7f01dc004990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:28.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.401+0000 7f01fad0d700 1 -- 172.21.15.110:0/3056816585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01dc003760 msgr2=0x7f01dc003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:28.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.401+0000 7f01fad0d700 1 --2- 172.21.15.110:0/3056816585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01dc003760 0x7f01dc003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:28.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.401+0000 7f01fad0d700 1 -- 172.21.15.110:0/3056816585 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01dc003270 con 0x7f01dc004e80 2021-03-25T14:18:28.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.401+0000 7f01fad0d700 1 -- 172.21.15.110:0/3056816585 reap_dead start 2021-03-25T14:18:28.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.401+0000 7f01fad0d700 1 --2- 172.21.15.110:0/3056816585 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01dc004e80 0x7f01dc00b760 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7f01ec001fd0 tx=0x7f01ec007f20).ready entity=mon.0 client_cookie=3376232d54272bbd server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:28.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.401+0000 7f01f950a700 1 -- 172.21.15.110:0/3056816585 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ec003030 con 0x7f01dc004e80 2021-03-25T14:18:28.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.401+0000 7f01f950a700 1 -- 172.21.15.110:0/3056816585 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01ec00cb40 con 0x7f01dc004e80 2021-03-25T14:18:28.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.401+0000 7f01f950a700 1 -- 172.21.15.110:0/3056816585 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ec013410 con 0x7f01dc004e80 2021-03-25T14:18:28.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.402+0000 7f01fc770700 1 -- 172.21.15.110:0/3056816585 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01dc004e80 msgr2=0x7f01dc00b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:28.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.402+0000 7f01fc770700 1 --2- 172.21.15.110:0/3056816585 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01dc004e80 0x7f01dc00b760 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7f01ec001fd0 tx=0x7f01ec007f20).stop 2021-03-25T14:18:28.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.402+0000 7f01fc770700 1 -- 172.21.15.110:0/3056816585 shutdown_connections 2021-03-25T14:18:28.411 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.402+0000 7f01fc770700 1 --2- 172.21.15.110:0/3056816585 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01dc004e80 0x7f01dc00b760 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:28.412 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.402+0000 7f01fc770700 1 -- 172.21.15.110:0/3056816585 >> 172.21.15.110:0/3056816585 conn(0x7f01f4063720 msgr2=0x7f01f4063b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:28.412 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.402+0000 7f01fc770700 1 -- 172.21.15.110:0/3056816585 shutdown_connections 2021-03-25T14:18:28.412 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.402+0000 7f01fc770700 1 -- 172.21.15.110:0/3056816585 wait complete. 2021-03-25T14:18:28.412 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.403+0000 7f01fc770700 1 Processor -- start 2021-03-25T14:18:28.412 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.403+0000 7f01fc770700 1 -- start start 2021-03-25T14:18:28.412 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.404+0000 7f01fc770700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01dc004e80 0x7f01f4159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:28.412 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.404+0000 7f01fc770700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01f4118b10 0x7f01f4118f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:28.412 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.404+0000 7f01fc770700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01f4149950 0x7f01f4149db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:28.412 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.404+0000 7f01fc770700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f4159f50 con 0x7f01f4149950 2021-03-25T14:18:28.412 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.404+0000 7f01fc770700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f4115e70 con 0x7f01dc004e80 2021-03-25T14:18:28.412 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.404+0000 7f01fc770700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f4119480 con 0x7f01f4118b10 2021-03-25T14:18:28.412 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.404+0000 7f01fad0d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01f4149950 0x7f01f4149db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:28.412 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.404+0000 7f01fad0d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01f4149950 0x7f01f4149db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51850/0 (socket says 172.21.15.110:51850) 2021-03-25T14:18:28.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.404+0000 7f01fad0d700 1 -- 172.21.15.110:0/2863090079 learned_addr learned my addr 172.21.15.110:0/2863090079 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:28.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.404+0000 7f01f9d0b700 1 --2- 172.21.15.110:0/2863090079 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01f4118b10 0x7f01f4118f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:28.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.404+0000 7f01fa50c700 1 --2- 172.21.15.110:0/2863090079 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01dc004e80 0x7f01f4159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:28.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.404+0000 7f01fad0d700 1 -- 172.21.15.110:0/2863090079 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01f4118b10 msgr2=0x7f01f4118f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:28.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.404+0000 7f01fad0d700 1 --2- 172.21.15.110:0/2863090079 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01f4118b10 0x7f01f4118f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:28.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.404+0000 7f01fad0d700 1 -- 172.21.15.110:0/2863090079 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01dc004e80 msgr2=0x7f01f4159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:28.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.404+0000 7f01fad0d700 1 --2- 172.21.15.110:0/2863090079 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01dc004e80 0x7f01f4159a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:28.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.404+0000 7f01fad0d700 1 -- 172.21.15.110:0/2863090079 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f40b5a60 con 0x7f01f4149950 2021-03-25T14:18:28.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.404+0000 7f01fa50c700 1 --2- 172.21.15.110:0/2863090079 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01dc004e80 0x7f01f4159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-03-25T14:18:28.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.404+0000 7f01fad0d700 1 --2- 172.21.15.110:0/2863090079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01f4149950 0x7f01f4149db0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f01ec0016c0 tx=0x7f01ec016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:28.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.404+0000 7f01e67fc700 1 -- 172.21.15.110:0/2863090079 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ec0068a0 con 0x7f01f4149950 2021-03-25T14:18:28.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.404+0000 7f01e67fc700 1 -- 172.21.15.110:0/2863090079 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01ec006a00 con 0x7f01f4149950 2021-03-25T14:18:28.413 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.404+0000 7f01fc770700 1 -- 172.21.15.110:0/2863090079 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01f40b5d00 con 0x7f01f4149950 2021-03-25T14:18:28.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.404+0000 7f01e67fc700 1 -- 172.21.15.110:0/2863090079 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ec006d80 con 0x7f01f4149950 2021-03-25T14:18:28.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.404+0000 7f01fc770700 1 -- 172.21.15.110:0/2863090079 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01f41160a0 con 0x7f01f4149950 2021-03-25T14:18:28.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.405+0000 7f01fc770700 1 -- 172.21.15.110:0/2863090079 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01f4116230 con 0x7f01f4149950 2021-03-25T14:18:28.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.405+0000 7f01e67fc700 1 -- 172.21.15.110:0/2863090079 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f01ec004030 con 0x7f01f4149950 2021-03-25T14:18:28.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.406+0000 7f01e67fc700 1 --2- 172.21.15.110:0/2863090079 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f01d405a0e0 0x7f01d405c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:28.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.406+0000 7f01e67fc700 1 -- 172.21.15.110:0/2863090079 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6426+0+0 (secure 0 0 0) 0x7f01ec075c60 con 0x7f01f4149950 2021-03-25T14:18:28.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.406+0000 7f01fa50c700 1 --2- 172.21.15.110:0/2863090079 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f01d405a0e0 0x7f01d405c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:28.414 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.406+0000 7f01fa50c700 1 --2- 172.21.15.110:0/2863090079 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f01d405a0e0 0x7f01d405c5a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f01f0006ac0 tx=0x7f01f0008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:28.415 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.410+0000 7f01e67fc700 1 -- 172.21.15.110:0/2863090079 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f01ec049440 con 0x7f01f4149950 2021-03-25T14:18:28.562 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.560+0000 7f01fc770700 1 -- 172.21.15.110:0/2863090079 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f01f405d7b0 con 0x7f01f4149950 2021-03-25T14:18:28.562 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.560+0000 7f01e67fc700 1 -- 172.21.15.110:0/2863090079 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v74) v1 ==== 84+0+287 (secure 0 0 0) 0x7f01ec04ca60 con 0x7f01f4149950 2021-03-25T14:18:28.562 INFO:teuthology.orchestra.run.smithi110.stdout: 2021-03-25T14:18:28.562 INFO:teuthology.orchestra.run.smithi110.stdout:[ 2021-03-25T14:18:28.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:18:28.563 INFO:teuthology.orchestra.run.smithi110.stdout: "poolnum": 1, 2021-03-25T14:18:28.563 INFO:teuthology.orchestra.run.smithi110.stdout: "poolname": "device_health_metrics" 2021-03-25T14:18:28.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:18:28.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:18:28.563 INFO:teuthology.orchestra.run.smithi110.stdout: "poolnum": 2, 2021-03-25T14:18:28.563 INFO:teuthology.orchestra.run.smithi110.stdout: "poolname": "rbd" 2021-03-25T14:18:28.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:18:28.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:18:28.563 INFO:teuthology.orchestra.run.smithi110.stdout: "poolnum": 14, 2021-03-25T14:18:28.563 INFO:teuthology.orchestra.run.smithi110.stdout: "poolname": "cephfs_metadata" 2021-03-25T14:18:28.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2021-03-25T14:18:28.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2021-03-25T14:18:28.563 INFO:teuthology.orchestra.run.smithi110.stdout: "poolnum": 15, 2021-03-25T14:18:28.564 INFO:teuthology.orchestra.run.smithi110.stdout: "poolname": "cephfs_data" 2021-03-25T14:18:28.564 INFO:teuthology.orchestra.run.smithi110.stdout: } 2021-03-25T14:18:28.564 INFO:teuthology.orchestra.run.smithi110.stdout:] 2021-03-25T14:18:28.565 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.562+0000 7f01fc770700 1 -- 172.21.15.110:0/2863090079 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f01d405a0e0 msgr2=0x7f01d405c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:28.565 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.562+0000 7f01fc770700 1 --2- 172.21.15.110:0/2863090079 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f01d405a0e0 0x7f01d405c5a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f01f0006ac0 tx=0x7f01f0008040).stop 2021-03-25T14:18:28.565 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.562+0000 7f01fc770700 1 -- 172.21.15.110:0/2863090079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01f4149950 msgr2=0x7f01f4149db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:28.565 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.562+0000 7f01fc770700 1 --2- 172.21.15.110:0/2863090079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01f4149950 0x7f01f4149db0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f01ec0016c0 tx=0x7f01ec016000).stop 2021-03-25T14:18:28.565 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.562+0000 7f01fc770700 1 -- 172.21.15.110:0/2863090079 shutdown_connections 2021-03-25T14:18:28.565 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.562+0000 7f01fc770700 1 --2- 172.21.15.110:0/2863090079 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f01d405a0e0 0x7f01d405c5a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:28.565 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.562+0000 7f01fc770700 1 --2- 172.21.15.110:0/2863090079 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01dc004e80 0x7f01f4159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:28.565 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.562+0000 7f01fc770700 1 --2- 172.21.15.110:0/2863090079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01f4149950 0x7f01f4149db0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:28.565 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.562+0000 7f01fc770700 1 --2- 172.21.15.110:0/2863090079 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01f4118b10 0x7f01f4118f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:28.566 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.562+0000 7f01fc770700 1 -- 172.21.15.110:0/2863090079 >> 172.21.15.110:0/2863090079 conn(0x7f01f4063720 msgr2=0x7f01f40b96b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:28.566 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.562+0000 7f01fc770700 1 -- 172.21.15.110:0/2863090079 shutdown_connections 2021-03-25T14:18:28.566 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.562+0000 7f01fc770700 1 -- 172.21.15.110:0/2863090079 wait complete. 2021-03-25T14:18:28.575 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2021-03-25T14:18:28.575 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata 8 2021-03-25T14:18:28.687 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.685+0000 7f54833de700 1 Processor -- start 2021-03-25T14:18:28.687 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.685+0000 7f54833de700 1 -- start start 2021-03-25T14:18:28.689 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.686+0000 7f54833de700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f547c0b0cc0 0x7f547c145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:28.689 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.686+0000 7f54833de700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f547c0b5d00 0x7f547c067250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:28.690 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.686+0000 7f54833de700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f547c149c50 con 0x7f547c0648a0 2021-03-25T14:18:28.690 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.686+0000 7f54833de700 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f547c1461b0 con 0x7f547c0b5d00 2021-03-25T14:18:28.690 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.686+0000 7f54833de700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f547c149e80 con 0x7f547c0b0cc0 2021-03-25T14:18:28.690 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.686+0000 7f5480979700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f547c0b5d00 0x7f547c067250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:28.690 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.686+0000 7f5480979700 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f547c0b5d00 0x7f547c067250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51854/0 (socket says 172.21.15.110:51854) 2021-03-25T14:18:28.690 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.686+0000 7f5480979700 1 -- 172.21.15.110:0/4210502475 learned_addr learned my addr 172.21.15.110:0/4210502475 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:28.690 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.686+0000 7f548117a700 1 --2- 172.21.15.110:0/4210502475 >> v2:172.21.15.174:3300/0 conn(0x7f547c0b0cc0 0x7f547c145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:28.690 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.686+0000 7f5480979700 1 -- 172.21.15.110:0/4210502475 >> v2:172.21.15.174:3300/0 conn(0x7f547c0b0cc0 msgr2=0x7f547c145cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:28.690 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.686+0000 7f5480979700 1 --2- 172.21.15.110:0/4210502475 >> v2:172.21.15.174:3300/0 conn(0x7f547c0b0cc0 0x7f547c145cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:28.690 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.686+0000 7f5480979700 1 -- 172.21.15.110:0/4210502475 >> v1:172.21.15.174:6789/0 conn(0x7f547c0648a0 legacy=0x7f547c09db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:28.690 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.686+0000 7f5480979700 1 -- 172.21.15.110:0/4210502475 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f547c0b6650 con 0x7f547c0b5d00 2021-03-25T14:18:28.690 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.687+0000 7f5480979700 1 --2- 172.21.15.110:0/4210502475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f547c0b5d00 0x7f547c067250 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7f547c066100 tx=0x7f546c006ee0).ready entity=mon.0 client_cookie=6b1092faee02a39f server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:28.691 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.687+0000 7f546bfff700 1 -- 172.21.15.110:0/4210502475 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546c0098d0 con 0x7f547c0b5d00 2021-03-25T14:18:28.691 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.687+0000 7f546bfff700 1 -- 172.21.15.110:0/4210502475 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546c009a30 con 0x7f547c0b5d00 2021-03-25T14:18:28.691 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.687+0000 7f546bfff700 1 -- 172.21.15.110:0/4210502475 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546c009db0 con 0x7f547c0b5d00 2021-03-25T14:18:28.691 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.687+0000 7f54833de700 1 -- 172.21.15.110:0/4210502475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f547c0b5d00 msgr2=0x7f547c067250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:28.691 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.687+0000 7f54833de700 1 --2- 172.21.15.110:0/4210502475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f547c0b5d00 0x7f547c067250 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7f547c066100 tx=0x7f546c006ee0).stop 2021-03-25T14:18:28.691 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.687+0000 7f54833de700 1 -- 172.21.15.110:0/4210502475 shutdown_connections 2021-03-25T14:18:28.691 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.687+0000 7f54833de700 1 --2- 172.21.15.110:0/4210502475 >> v2:172.21.15.174:3300/0 conn(0x7f547c0b0cc0 0x7f547c145cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:28.691 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.687+0000 7f54833de700 1 --2- 172.21.15.110:0/4210502475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f547c0b5d00 0x7f547c067250 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:28.691 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.687+0000 7f54833de700 1 -- 172.21.15.110:0/4210502475 >> 172.21.15.110:0/4210502475 conn(0x7f547c0664e0 msgr2=0x7f547c0668f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:28.691 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.687+0000 7f54833de700 1 -- 172.21.15.110:0/4210502475 shutdown_connections 2021-03-25T14:18:28.691 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.687+0000 7f54833de700 1 -- 172.21.15.110:0/4210502475 wait complete. 2021-03-25T14:18:28.694 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.688+0000 7f54833de700 1 Processor -- start 2021-03-25T14:18:28.694 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.688+0000 7f54833de700 1 -- start start 2021-03-25T14:18:28.694 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.689+0000 7f54833de700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f547c0648a0 0x7f547c147f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:28.694 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.689+0000 7f54833de700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f547c0b0cc0 0x7f547c140920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:28.694 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.689+0000 7f54833de700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f547c0b5d00 0x7f547c0b3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:28.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.689+0000 7f54833de700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c0a1220 con 0x7f547c0b5d00 2021-03-25T14:18:28.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.689+0000 7f54833de700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c147910 con 0x7f547c0b0cc0 2021-03-25T14:18:28.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.689+0000 7f54833de700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f547c1475f0 con 0x7f547c0648a0 2021-03-25T14:18:28.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.689+0000 7f548197b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f547c0b5d00 0x7f547c0b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:28.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.689+0000 7f548197b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f547c0b5d00 0x7f547c0b3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51864/0 (socket says 172.21.15.110:51864) 2021-03-25T14:18:28.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.689+0000 7f548197b700 1 -- 172.21.15.110:0/339508519 learned_addr learned my addr 172.21.15.110:0/339508519 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:28.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.689+0000 7f548117a700 1 --2- 172.21.15.110:0/339508519 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f547c0648a0 0x7f547c147f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:28.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.689+0000 7f5480979700 1 --2- 172.21.15.110:0/339508519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f547c0b0cc0 0x7f547c140920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:28.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.690+0000 7f548197b700 1 -- 172.21.15.110:0/339508519 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f547c0648a0 msgr2=0x7f547c147f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:28.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.690+0000 7f548197b700 1 --2- 172.21.15.110:0/339508519 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f547c0648a0 0x7f547c147f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:28.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.690+0000 7f548197b700 1 -- 172.21.15.110:0/339508519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f547c0b0cc0 msgr2=0x7f547c140920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:28.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.690+0000 7f548197b700 1 --2- 172.21.15.110:0/339508519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f547c0b0cc0 0x7f547c140920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:28.695 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.690+0000 7f548197b700 1 -- 172.21.15.110:0/339508519 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f547c149080 con 0x7f547c0b5d00 2021-03-25T14:18:28.696 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.690+0000 7f548197b700 1 --2- 172.21.15.110:0/339508519 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f547c0b5d00 0x7f547c0b3180 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f547400ca90 tx=0x7f5474007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:28.696 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.690+0000 7f54697fa700 1 -- 172.21.15.110:0/339508519 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547400ce70 con 0x7f547c0b5d00 2021-03-25T14:18:28.696 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.690+0000 7f54697fa700 1 -- 172.21.15.110:0/339508519 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547400a7f0 con 0x7f547c0b5d00 2021-03-25T14:18:28.696 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.690+0000 7f54833de700 1 -- 172.21.15.110:0/339508519 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f547c0a1410 con 0x7f547c0b5d00 2021-03-25T14:18:28.696 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.690+0000 7f54697fa700 1 -- 172.21.15.110:0/339508519 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547400ab70 con 0x7f547c0b5d00 2021-03-25T14:18:28.696 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.690+0000 7f54833de700 1 -- 172.21.15.110:0/339508519 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f547c0a1950 con 0x7f547c0b5d00 2021-03-25T14:18:28.696 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.691+0000 7f54833de700 1 -- 172.21.15.110:0/339508519 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f547c147c60 con 0x7f547c0b5d00 2021-03-25T14:18:28.696 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.691+0000 7f54697fa700 1 -- 172.21.15.110:0/339508519 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f5474019030 con 0x7f547c0b5d00 2021-03-25T14:18:28.696 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.691+0000 7f54697fa700 1 --2- 172.21.15.110:0/339508519 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f545c05a0e0 0x7f545c05c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:28.696 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.691+0000 7f54697fa700 1 -- 172.21.15.110:0/339508519 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6426+0+0 (secure 0 0 0) 0x7f54740735e0 con 0x7f547c0b5d00 2021-03-25T14:18:28.696 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.691+0000 7f548117a700 1 --2- 172.21.15.110:0/339508519 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f545c05a0e0 0x7f545c05c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:28.696 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.692+0000 7f548117a700 1 --2- 172.21.15.110:0/339508519 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f545c05a0e0 0x7f545c05c5a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f5478006fd0 tx=0x7f5478008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:28.697 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.695+0000 7f54697fa700 1 -- 172.21.15.110:0/339508519 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f5474045620 con 0x7f547c0b5d00 2021-03-25T14:18:28.851 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:28.849+0000 7f54833de700 1 -- 172.21.15.110:0/339508519 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num": 8} v 0) v1 -- 0x7f547c05d7b0 con 0x7f547c0b5d00 2021-03-25T14:18:29.848 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.846+0000 7f54697fa700 1 -- 172.21.15.110:0/339508519 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num": 8}]=0 pool 'cephfs2_metadata' created v75) v1 ==== 135+0+0 (secure 0 0 0) 0x7f547c147c60 con 0x7f547c0b5d00 2021-03-25T14:18:29.852 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.850+0000 7f54833de700 1 -- 172.21.15.110:0/339508519 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f545c05a0e0 msgr2=0x7f545c05c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:29.852 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.850+0000 7f54833de700 1 --2- 172.21.15.110:0/339508519 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f545c05a0e0 0x7f545c05c5a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f5478006fd0 tx=0x7f5478008040).stop 2021-03-25T14:18:29.852 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.850+0000 7f54833de700 1 -- 172.21.15.110:0/339508519 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f547c0b5d00 msgr2=0x7f547c0b3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:29.852 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.850+0000 7f54833de700 1 --2- 172.21.15.110:0/339508519 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f547c0b5d00 0x7f547c0b3180 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f547400ca90 tx=0x7f5474007f10).stop 2021-03-25T14:18:29.853 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.850+0000 7f54833de700 1 -- 172.21.15.110:0/339508519 shutdown_connections 2021-03-25T14:18:29.853 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.850+0000 7f54833de700 1 --2- 172.21.15.110:0/339508519 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f545c05a0e0 0x7f545c05c5a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:29.853 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.850+0000 7f54833de700 1 --2- 172.21.15.110:0/339508519 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f547c0b5d00 0x7f547c0b3180 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:29.853 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.850+0000 7f54833de700 1 --2- 172.21.15.110:0/339508519 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f547c0648a0 0x7f547c147f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:29.853 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.850+0000 7f54833de700 1 --2- 172.21.15.110:0/339508519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f547c0b0cc0 0x7f547c140920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:29.853 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.850+0000 7f54833de700 1 -- 172.21.15.110:0/339508519 >> 172.21.15.110:0/339508519 conn(0x7f547c0664e0 msgr2=0x7f547c0668c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:29.853 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.850+0000 7f54833de700 1 -- 172.21.15.110:0/339508519 shutdown_connections 2021-03-25T14:18:29.853 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.850+0000 7f54833de700 1 -- 172.21.15.110:0/339508519 wait complete. 2021-03-25T14:18:29.854 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs2_metadata' created 2021-03-25T14:18:29.866 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 8 2021-03-25T14:18:29.984 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.982+0000 7f43cb27e700 1 Processor -- start 2021-03-25T14:18:29.984 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.982+0000 7f43cb27e700 1 -- start start 2021-03-25T14:18:29.986 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.983+0000 7f43cb27e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43c41471c0 0x7f43c40be2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:29.986 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.983+0000 7f43cb27e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f43c414ab30 0x7f43c4148e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:29.987 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.983+0000 7f43cb27e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c4148a30 con 0x7f43c40be7c0 2021-03-25T14:18:29.987 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.983+0000 7f43cb27e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c40b3ba0 con 0x7f43c414ab30 2021-03-25T14:18:29.987 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.983+0000 7f43cb27e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c414b0b0 con 0x7f43c41471c0 2021-03-25T14:18:29.987 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.983+0000 7f43c981b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f43c414ab30 0x7f43c4148e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:29.987 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.983+0000 7f43c901a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43c41471c0 0x7f43c40be2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:29.987 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.983+0000 7f43c981b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f43c414ab30 0x7f43c4148e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.110:50520/0 (socket says 172.21.15.110:50520) 2021-03-25T14:18:29.987 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.983+0000 7f43c981b700 1 -- 172.21.15.110:0/3163666281 learned_addr learned my addr 172.21.15.110:0/3163666281 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:29.987 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.983+0000 7f43c8819700 1 --1- 172.21.15.110:0/3163666281 >> v1:172.21.15.174:6789/0 conn(0x7f43c40be7c0 0x7f43c40b4430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.110:52474/0 (socket says 172.21.15.110:52474) 2021-03-25T14:18:29.987 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.983+0000 7f43c981b700 1 -- 172.21.15.110:0/3163666281 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43c41471c0 msgr2=0x7f43c40be2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-03-25T14:18:29.987 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.983+0000 7f43c981b700 1 --2- 172.21.15.110:0/3163666281 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43c41471c0 0x7f43c40be2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:29.987 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.983+0000 7f43c981b700 1 -- 172.21.15.110:0/3163666281 >> v1:172.21.15.174:6789/0 conn(0x7f43c40be7c0 legacy=0x7f43c40b4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:29.988 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.983+0000 7f43c981b700 1 -- 172.21.15.110:0/3163666281 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c414b350 con 0x7f43c414ab30 2021-03-25T14:18:29.988 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.983+0000 7f43b3fff700 1 -- 172.21.15.110:0/3163666281 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 794288904 0 0) 0x7f43c4148a30 con 0x7f43c40be7c0 2021-03-25T14:18:29.988 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.983+0000 7f43c901a700 1 --2- 172.21.15.110:0/3163666281 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43c41471c0 0x7f43c40be2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-03-25T14:18:29.988 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.984+0000 7f43c981b700 1 --2- 172.21.15.110:0/3163666281 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43c414ab30 0x7f43c4148e60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f43bc009d90 tx=0x7f43bc0092d0).ready entity=mon.1 client_cookie=4dabed956e47c5b server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:29.988 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.984+0000 7f43b3fff700 1 -- 172.21.15.110:0/3163666281 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc00bbf0 con 0x7f43c414ab30 2021-03-25T14:18:29.988 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.984+0000 7f43b3fff700 1 -- 172.21.15.110:0/3163666281 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43bc00bd50 con 0x7f43c414ab30 2021-03-25T14:18:29.988 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.984+0000 7f43b3fff700 1 -- 172.21.15.110:0/3163666281 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc011610 con 0x7f43c414ab30 2021-03-25T14:18:29.988 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.984+0000 7f43cb27e700 1 -- 172.21.15.110:0/3163666281 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43c414ab30 msgr2=0x7f43c4148e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:29.988 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.984+0000 7f43cb27e700 1 --2- 172.21.15.110:0/3163666281 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43c414ab30 0x7f43c4148e60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f43bc009d90 tx=0x7f43bc0092d0).stop 2021-03-25T14:18:29.988 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.984+0000 7f43cb27e700 1 -- 172.21.15.110:0/3163666281 shutdown_connections 2021-03-25T14:18:29.988 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.984+0000 7f43cb27e700 1 --2- 172.21.15.110:0/3163666281 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43c414ab30 0x7f43c4148e60 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:29.988 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.984+0000 7f43cb27e700 1 --2- 172.21.15.110:0/3163666281 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43c41471c0 0x7f43c40be2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:29.989 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.984+0000 7f43cb27e700 1 -- 172.21.15.110:0/3163666281 >> 172.21.15.110:0/3163666281 conn(0x7f43c40686f0 msgr2=0x7f43c4068b00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-25T14:18:29.989 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.984+0000 7f43cb27e700 1 -- 172.21.15.110:0/3163666281 shutdown_connections 2021-03-25T14:18:29.989 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.984+0000 7f43cb27e700 1 -- 172.21.15.110:0/3163666281 wait complete. 2021-03-25T14:18:29.991 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.985+0000 7f43cb27e700 1 Processor -- start 2021-03-25T14:18:29.991 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.985+0000 7f43cb27e700 1 -- start start 2021-03-25T14:18:29.992 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.986+0000 7f43cb27e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43c40be7c0 0x7f43c414e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:29.992 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.986+0000 7f43cb27e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43c41471c0 0x7f43c40b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:29.992 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.986+0000 7f43cb27e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43c414ab30 0x7f43c409f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:29.992 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.986+0000 7f43cb27e700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c40b73a0 con 0x7f43c414ab30 2021-03-25T14:18:29.992 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.986+0000 7f43cb27e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c41596e0 con 0x7f43c40be7c0 2021-03-25T14:18:29.992 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.986+0000 7f43cb27e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c40b41a0 con 0x7f43c41471c0 2021-03-25T14:18:29.992 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.986+0000 7f43c981b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43c414ab30 0x7f43c409f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:29.992 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.986+0000 7f43c981b700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43c414ab30 0x7f43c409f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51878/0 (socket says 172.21.15.110:51878) 2021-03-25T14:18:29.992 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.986+0000 7f43c981b700 1 -- 172.21.15.110:0/1036982009 learned_addr learned my addr 172.21.15.110:0/1036982009 (peer_addr_for_me v2:172.21.15.110:0/0) 2021-03-25T14:18:29.992 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.986+0000 7f43c901a700 1 --2- 172.21.15.110:0/1036982009 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43c40be7c0 0x7f43c414e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:29.992 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.986+0000 7f43c8819700 1 --2- 172.21.15.110:0/1036982009 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43c41471c0 0x7f43c40b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:29.992 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.987+0000 7f43c981b700 1 -- 172.21.15.110:0/1036982009 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43c41471c0 msgr2=0x7f43c40b7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:29.993 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.987+0000 7f43c981b700 1 --2- 172.21.15.110:0/1036982009 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43c41471c0 0x7f43c40b7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:29.993 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.987+0000 7f43c981b700 1 -- 172.21.15.110:0/1036982009 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43c40be7c0 msgr2=0x7f43c414e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-25T14:18:29.993 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.987+0000 7f43c981b700 1 --2- 172.21.15.110:0/1036982009 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43c40be7c0 0x7f43c414e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-03-25T14:18:29.993 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.987+0000 7f43c981b700 1 -- 172.21.15.110:0/1036982009 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c4158c60 con 0x7f43c414ab30 2021-03-25T14:18:29.993 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.987+0000 7f43c981b700 1 --2- 172.21.15.110:0/1036982009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43c414ab30 0x7f43c409f150 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7f43c40bb8c0 tx=0x7f43bc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:29.993 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.987+0000 7f43b17fa700 1 -- 172.21.15.110:0/1036982009 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc00bec0 con 0x7f43c414ab30 2021-03-25T14:18:29.993 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.987+0000 7f43b17fa700 1 -- 172.21.15.110:0/1036982009 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43bc011e30 con 0x7f43c414ab30 2021-03-25T14:18:29.993 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.987+0000 7f43b17fa700 1 -- 172.21.15.110:0/1036982009 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc010c70 con 0x7f43c414ab30 2021-03-25T14:18:29.993 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.987+0000 7f43cb27e700 1 -- 172.21.15.110:0/1036982009 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c4158f00 con 0x7f43c414ab30 2021-03-25T14:18:29.993 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.987+0000 7f43cb27e700 1 -- 172.21.15.110:0/1036982009 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c414e9f0 con 0x7f43c414ab30 2021-03-25T14:18:29.993 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.988+0000 7f43cb27e700 1 -- 172.21.15.110:0/1036982009 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c414b530 con 0x7f43c414ab30 2021-03-25T14:18:29.993 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.988+0000 7f43b17fa700 1 -- 172.21.15.110:0/1036982009 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 70293+0+0 (secure 0 0 0) 0x7f43bc00f070 con 0x7f43c414ab30 2021-03-25T14:18:29.993 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.989+0000 7f43b17fa700 1 --2- 172.21.15.110:0/1036982009 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f43a405a0b0 0x7f43a405c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-03-25T14:18:29.994 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.989+0000 7f43b17fa700 1 -- 172.21.15.110:0/1036982009 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f43bc075c00 con 0x7f43c414ab30 2021-03-25T14:18:29.994 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.989+0000 7f43c901a700 1 --2- 172.21.15.110:0/1036982009 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f43a405a0b0 0x7f43a405c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-03-25T14:18:29.994 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.989+0000 7f43c901a700 1 --2- 172.21.15.110:0/1036982009 >> [v2:172.21.15.110:6832/36740,v1:172.21.15.110:6833/36740] conn(0x7f43a405a0b0 0x7f43a405c570 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f43b400bdd0 tx=0x7f43b4006e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-03-25T14:18:29.994 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:29.993+0000 7f43b17fa700 1 -- 172.21.15.110:0/1036982009 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (secure 0 0 0) 0x7f43bc0492e0 con 0x7f43c414ab30 2021-03-25T14:18:30.144 INFO:teuthology.orchestra.run.smithi110.stderr:2021-03-25T14:18:30.142+0000 7f43cb27e700 1 -- 172.21.15.110:0/1036982009 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 8} v 0) v1 -- 0x7f43c4159090 con 0x7f43c414ab30 2021-03-25T14:18:30.458 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2021-03-25T14:18:30.458 DEBUG:teuthology.task.console_log:Killing console logger for smithi110 2021-03-25T14:18:30.459 DEBUG:teuthology.task.console_log:Killing console logger for smithi174 2021-03-25T14:18:30.459 DEBUG:teuthology.exit:Finished running handlers